Cross-Sectional Stock Selection: Where Returns Come From and Why Models Fail

This post is also available in Chinese: View Chinese version

A cross-sectional model is not usually asked whether the market will rise tomorrow. Its job is to take the information available at a given point in time and rank a universe of stocks: which names look relatively attractive, and which look relatively weak?

That distinction matters. If the market falls, the top-ranked stocks may lose money too. The ranking can still be useful if they lose less than the stocks at the bottom. Conversely, a long-only portfolio can post a rising equity curve in a broad bull market even when its model has no genuine stock-selection skill.

A sensible evaluation therefore cannot begin and end with the backtest. First establish what the model predicts. Then ask why that relationship might exist and how it should be measured. Only after that should a drawdown be treated as evidence that the model has stopped working.

What a cross-sectional model actually predicts

Suppose the investable universe contains NN stocks on trading day tt. Given the features available at that time, xi,tx_{i,t}, the model assigns stock ii a score:

si,t=f(xi,t)s_{i,t}=f(x_{i,t})

The score may come from a simple rule, a linear model, a tree ensemble, or a neural network. In most stock-selection applications, its absolute value matters less than its position within that day's cross-section.

The model has ranking skill if high-scoring stocks consistently outperform low-scoring stocks over the relevant forward horizon. It answers "which stocks are likely to outperform?" rather than "will a given stock go up?"

This is the clearest difference between cross-sectional and time-series models. A time-series model commonly compares an asset with its own history. A cross-sectional model compares many assets at the same point in time. The two approaches can be combined, but they should not be judged by the same criteria.

Consider a day on which the top-ranked group subsequently loses 1% while the bottom-ranked group loses 3%. A market-neutral portfolio may make money from that spread; a long-only portfolio holding the top group still loses money. Model quality, portfolio construction, and realized profit and loss are related, but they are not the same thing.

Why relative rankings can persist

Market efficiency does not require every investor to interpret every piece of information instantly and in the same way. Cross-sectional signals often arise from differences in how information is processed, how risk is priced, and what investors are able to trade.

Prices do not absorb all information at once

Headline revenue and earnings may be reflected quickly after a company reports, while earnings quality, cash flow, business mix, management guidance, and supply-chain implications take longer to digest. Analysts must update their forecasts, institutions must complete their research and approval processes, and large positions cannot always be established in a single trade.

That process can leave temporary but repeatable differences across stocks. Companies receiving a sustained series of earnings upgrades may continue to drift upward. Companies whose operating quality is deteriorating may lag before the problem becomes a market-wide concern.

A model does not have to read every headline before everyone else. It can add value by applying the same framework across a large universe and identifying information that is already observable but not yet fully reflected in prices.

Investors make systematic mistakes

Investor errors are not entirely random. People underreact to gradual change, overreact to dramatic news, and anchor on prior prices and earnings expectations. Attention is concentrated in popular names, while companies with sparse coverage or difficult trading conditions are more easily neglected.

When those behaviors recur across many stocks, characteristics such as momentum, short-term reversal, valuation, earnings revisions, and quality can acquire predictive power. A useful model need not describe the psychology of every investor. It only needs to detect whether those behaviors produce a persistent difference between the future returns of high- and low-ranked stocks.

Some returns are compensation for risk

Not every cross-sectional return reflects mispricing. Cheap stocks may be cheap because they face falling earnings, financing stress, industry decline, or bankruptcy risk. Small caps may offer higher long-run returns while also exposing investors to poor liquidity and severe tail losses.

An opportunity that requires investors to tolerate years of underperformance, deep drawdowns, or concentrated losses during crises is difficult to arbitrage away. In that case, the model may be harvesting a risk premium rather than a free error in market prices.

Real-world constraints prevent complete arbitrage

Funds face benchmark and position limits. Short selling requires access to stock borrow. Large investors cannot move freely through illiquid stocks, and risk limits may force them to reduce positions at exactly the wrong time. Even when many investors recognize the same opportunity, they may lack the mandate, capacity, patience, or willingness to hold it.

This helps explain why well-known cross-sectional patterns do not necessarily disappear. The corresponding strategies may have limited capacity, painful drawdowns, or risks that only some investors are prepared to bear.

Weak signals add up in a portfolio

The future return of any single stock is extremely noisy. A model is unlikely to predict reliably whether one company will gain or lose 2% next week. It may still rank thousands of stocks across many dates slightly better than chance.

If that small advantage repeats across securities and through time, and the portfolio does not depend on a handful of names, diversification can turn it into a measurable return spread. The value of a cross-sectional model usually lies not in a few spectacular calls, but in many small edges that accumulate consistently.

Separate the model, portfolio, and implementation

An attractive equity curve is not enough. A complete evaluation must answer three distinct questions:

| Layer | Question | Typical evidence | | --- | --- | --- | | Model | Does the score rank relative winners and losers consistently? | Rank IC, portfolio sorts, signal decay | | Portfolio | Can the ranking support the intended investment strategy? | Excess return, risk exposures, drawdown, turnover | | Implementation | Does the edge survive actual trading? | Spread, impact, borrow, capacity, execution delay |

These layers often tell different stories. A model can retain ranking skill while its portfolio loses money because of sector concentration or trading costs. A profitable portfolio can owe its returns entirely to an unintended small-cap or high-beta exposure.

Define the research protocol first

Before evaluating results, fix the universe, forecast horizon, rebalance frequency, data-availability timestamps, execution assumptions, cost model, and benchmark. For every historical date, the researcher must know exactly what information would have been available at that time.

Fundamental data should enter the model when it was published, not at the end of the reporting period. Historical universes must include companies that later delisted. A signal calculated after the close cannot be assumed to trade at that same closing price.

Training, tuning, and final testing must also be separated through time. Walk-forward validation is a practical default: train only on past observations, save predictions for the next unseen period, advance the training window, and repeat. The final evaluation should use the out-of-sample scores that could actually have been produced at each historical date, not scores regenerated across the full history by a model trained today.

When labels span several future trading days, observations near the train-test boundary may share part of the same return window. Purging and an embargo are needed to keep those samples apart. Otherwise, an apparently strict time split can still leak future information.

Model layer: is the ranking real?

The standard starting point is the information coefficient (IC). On each date tt, calculate the cross-sectional correlation between model scores and subsequent returns:

ICt=corr(si,t,ri,t+h)IC_t=\operatorname{corr}(s_{i,t},r_{i,t+h})

Stock-selection research usually emphasizes Spearman rank correlation, or rank IC. It measures whether the ordering of scores agrees with the ordering of returns and is less sensitive to a few extreme outcomes than Pearson correlation.

IC should be computed across stocks separately on each date and then analyzed as a time series. Pooling every stock-date observation into one correlation mixes broad market moves with genuine cross-sectional skill.

The mean is only one part of the distribution. Is the median positive? What fraction of dates have positive IC? Is the result concentrated in a few years? Does it remain visible among large caps, small caps, and within individual industries? ICIR, the mean IC divided by its standard deviation, can summarize consistency. But overlapping labels introduce serial correlation, so mechanically multiplying by 252\sqrt{252} is not a valid annualization.

Portfolio sorts provide a more intuitive check. Divide the universe into quintiles or deciles by score each day and inspect the subsequent returns. A healthy signal tends to show a reasonably monotonic progression from the bottom group to the top, rather than one lucky result in the highest bucket.

It also matters which side creates the spread. If most of the result comes from persistent losses in the bottom group, the model may be better suited to risk screening or short-side selection. A long-only selector needs the top group itself to outperform an investable benchmark consistently.

Products that display only a short list of candidates should be assessed at the actual decision boundary. Are the results for the top 20, 30, and 50 reasonably smooth? Does the list turn over completely every day? Are one or two stocks responsible for most of the return? A model whose conclusion reverses after a small change in the cutoff is unlikely to be robust.

Horizon: how long does the edge last?

Every cross-sectional signal has a natural timescale. Rank IC and sorted-portfolio returns can be measured over the next 1, 5, 10, and 20 trading days to show when the signal begins to work, when it peaks, and how quickly it decays.

That decay curve should shape the trading strategy. A signal that exists only for a few minutes after release is of little use to a daily process. If most of the edge remains after a one-day delay, there is much more room for practical execution. Slow decay may also justify less frequent rebalancing, exchanging a small amount of forecast strength for materially lower costs.

Models that output expected returns or probabilities require calibration tests as well. Are high-confidence predictions actually more accurate? Among events assigned a probability of 60%, do roughly 60% occur? The ranking may remain correct while the model systematically overstates return magnitudes, making position sizes too aggressive.

A regime comparison: why the same model can look different across years

Consider a set of cross-sectional backtests using the same universe, features, and trading rules. The model struggles to produce sustained high returns in 2024, then performs much better in 2025 and 2026. The contrast illustrates an important point: performance depends both on predictive skill and on whether the market gives that skill enough time to translate into returns.

The US equity market did have clear leaders in 2024. Large technology and AI-related companies accounted for a substantial share of index gains early in the year. By midyear, changing inflation and rate-cut expectations prompted sharp rotations into small-cap and value stocks, while sector leadership shifted repeatedly. Year-end reviews showed broader participation than at the start of the year, though breadth remained below long-run norms. The problem was not an absence of winners; it was that leadership and the factors in favor changed more quickly. Reviews from Morningstar and Prime Buchholz describe this broadening from large growth companies into smaller, cheaper, and more varied parts of the market.

That environment creates two problems for cross-sectional models. First, a model based on medium-term momentum, earnings revisions, or fixed factor weights may identify the previous leaders just as the market rotates away from them. Second, rapid rotation destabilizes rankings and raises turnover, allowing trading costs to consume more of the paper spread. The model may still have some directional information, but its half-life is shorter and its returns are harder to realize consistently.

The market structure in 2025 and 2026 is more favorable to some models. AI capital spending, compute infrastructure, and large-cap technology earnings provide a more durable combination of narrative and fundamental evidence. Beneficiaries also extend beyond chipmakers and cloud platforms into data centers, power suppliers, and industrial companies. Analyses from BlackRock and Capital Group emphasize the effect of AI investment on corporate earnings, capital expenditure, and market leadership.

For a model combining price trends, earnings revisions, quality, and investor attention, persistent leadership allows highly ranked stocks to remain highly ranked for longer. Positions survive rebalancing more often, improving returns in the sorted portfolios, top-KK stability, and performance after costs. The model appears to perform better partly because the regime is better aligned with its design.

That does not imply that every cross-sectional model works in an AI-led bull market. Value, short-term reversal, and strictly industry-neutral models may behave very differently. If the 2025 and 2026 excess returns disappear after controlling for technology-sector, industry, and momentum exposures, the backtest may mostly reflect exposure to the AI trade rather than independent security-selection skill.

The useful question is not which year made more money, but why the results differ. Did annual rank IC change? Did signal decay slow? Did top-KK turnover fall? Did the model continue to rank stocks within industries? Did net returns remain above simple technology and momentum benchmarks? Only that decomposition can distinguish a friendlier regime from a genuine improvement in incremental predictive power.

Portfolio layer: stock selection or disguised exposure?

Once the ranking has passed model-level checks, scores can be converted into positions. The construction rules must match the intended use. A long-only selector should be compared with an investable benchmark. A market-neutral strategy needs separate analysis of the long and short books. An enhanced-index portfolio must control tracking error and industry deviations.

Annualized return, volatility, Sharpe ratio, and maximum drawdown are not enough. Report turnover, drawdown duration, tail losses, and return concentration as well. Gross and net results should always appear together.

Attribution is essential. Does the portfolio lean persistently toward small caps, illiquid stocks, high beta, or a few industries? After controlling for market, industry, size, value, momentum, and volatility exposures, is there still an economically meaningful alpha?

Neutralization is not automatically better. If a model is intentionally designed to harvest the value premium, removing all value exposure changes the research question. The goal is to separate risks taken deliberately from exposures introduced accidentally.

Implementation layer: can the backtest survive trading?

Predictive power is not the same as tradable return. A model with consistently positive rank IC may still be unusable if large daily changes in its ranking create intolerable turnover.

Trading costs should not be represented by one fixed number of basis points. Bid-ask spreads, volatility, order size relative to average daily volume, market impact, and borrow fees vary across stocks and through time. This matters especially for small caps: the price used by the backtest may have existed, but there may not have been enough liquidity to fill the strategy at the required size.

Capacity analysis should show how participation rates, impact costs, and net returns change as capital grows from a small allocation to a medium or large one. If the edge is concentrated in the hardest stocks to trade, its economic value will be far below the headline gross return.

Simple stress tests are often revealing. Delay execution by one period, raise cost assumptions, reduce available volume, and remove the handful of most profitable stocks. A strategy with a real implementation path should not depend on the most optimistic execution assumptions.

Statistical significance is not economic credibility

A cross-sectional data set may contain millions of rows, but stocks on the same date share common shocks, and adjacent predictions for the same stock are highly dependent. Millions of rows do not represent millions of independent observations.

Inference should therefore be based on the time series of cross-sectional results and account for autocorrelation, heteroskedasticity, and overlapping holding periods. A date-block bootstrap is generally more defensible than resampling individual rows. Confidence intervals are also more informative than a lone mean or p-value.

The number of research attempts matters too. After testing hundreds of features, windows, and parameter combinations, the best curve will contain selection bias by construction. Keeping a complete experiment record, preserving a genuinely untouched test period, and applying multiple-testing corrections or measures such as the Deflated Sharpe Ratio can reduce the chance of mistaking luck for discovery.

Finally, every complex model needs simple baselines. Does it consistently beat a single momentum, value, or quality factor? Does it beat a basic linear model? Is the incremental return large enough to justify higher turnover, greater data dependency, and additional maintenance? Complexity has no value when the answer is no.

How cross-sectional models fail

"Model failure" is often used as a catch-all for any disappointing result. In practice, failures tend to fall into four categories, and each calls for a different response.

A real relationship weakens

Market structure changes. Faster information dissemination, more capital using the same data, and changes in trading rules can compress an existing edge. A model that relies on an old market friction may gradually lose predictive power.

Crowding can also change the shape of returns. Performance may improve while capital first enters the trade. Once positioning becomes concentrated, deleveraging can cause stocks that normally appear diversified to fall together. The problem is no longer just a lower average return; exit capacity shrinks while tail risk rises sharply.

Some deterioration is regime-specific. Momentum is vulnerable to abrupt reversals. Value can lag for years during structural industry change. Short-term reversal repeatedly fights the tape in a strong trend. These effects may not be permanently broken, but regime risk can dominate their average edge for long periods.

Cross-sectional dispersion itself can also contract. During a systemic crisis, macro shocks overwhelm company differences, correlations rise, and liquidity becomes the dominant pricing variable. A model may continue to identify relative quality without realizing the spread over its intended holding period.

The historical edge was never real

Some models do not fail after deployment; their backtests were artifacts of the research process from the beginning.

Look-ahead bias is a common cause: using revised financial statements, assigning data to fiscal period-end rather than publication date, backtesting today's index constituents, dropping delisted stocks, or trading before information was fully available. Even standardizing features with full-sample statistics carries future distributional information into the past.

Overfitting is another source. The more features, labels, windows, and model classes a researcher tries, the greater the chance of finding an impressive result by accident. Warning signs include extreme parameter sensitivity, returns concentrated in a few years, performance at one exact holding period, and complex models that excel in-sample but become indistinguishable from noise out-of-sample.

Waiting for a better market regime will not fix these defects. The only remedy is to return to data timestamps, experiment records, and the out-of-sample process and establish whether the edge existed at all.

The forecast survives but the portfolio cannot monetize it

A model can continue to rank stocks correctly while the portfolio construction process consumes the advantage.

One explanation is hidden exposure. A portfolio that appears to select individual stocks may actually carry a persistent bet on an industry, small caps, high beta, or illiquidity. A style reversal can hurt the portfolio even while its within-industry ranking remains useful.

Another is rising transaction cost. The ranking still predicts returns, but turnover, spreads, impact, or borrow fees prevent those returns from being captured. The problem becomes more severe as the strategy grows.

Portfolio optimization can dilute the signal as well. Industry neutrality, risk budgets, single-name caps, and turnover constraints may all be reasonable in isolation. Combined, they can leave final holdings with little exposure to the original scores. Diagnosis must follow the full path from model score to target weight, execution, and final position rather than stopping at model output.

Target or calibration drift

A model trained to predict relative returns over the next 20 trading days may be used to trade the next day. A short-lived signal may be held for months to satisfy a turnover constraint. In both cases, the research target and the live decision have drifted apart.

Market changes can also alter the speed at which returns arrive. The ranking may remain directionally correct while the spread between high and low groups shrinks. Probabilities may preserve their ordering while becoming overconfident. The model has not lost all predictive power, but its former holding period and position-sizing rule are no longer appropriate.

Failure should therefore be separated into at least four cases: ranking failure, declining return magnitude, probability miscalibration, and a change in the risk profile. They require different interventions.

Distinguishing a normal drawdown from model failure

Every strategy or portfolio with risk exposure will experience drawdowns. Short-term losses do not prove that a model is broken, just as short-term profits do not prove that it works. A useful diagnosis starts with the easiest explanations to test.

First, inspect the data and production system. Did a vendor change a field? Are timestamps misaligned? Did missingness jump? Is the correct model version deployed? Were orders executed as expected? When performance collapses overnight, an engineering fault deserves investigation before assuming an economic relationship vanished overnight.

Second, return to model-level evidence. Has rolling rank IC declined? Has monotonicity across score buckets disappeared? Does the top-KK group still outperform? If the portfolio is losing while ranking metrics remain stable, the problem is more likely to lie in risk exposure or implementation.

Third, decompose portfolio returns. Are losses caused by market direction, industry deviations, style reversal, a short squeeze, or security selection? Is gross performance intact while costs consume net returns? How much of the original score is represented in actual holdings?

Fourth, examine the environment. Is the model experiencing an adverse regime already represented in its training history, or a new market structure that the sample never covered? The former may be a risk the model was always expected to bear. The latter is stronger evidence that its underlying relationship has changed.

| Observation | More likely explanation | | --- | --- | | IC and sorted-portfolio returns both decline persistently | Signal decay, structural change, or input drift | | IC is stable but portfolio returns deteriorate | Risk exposure, construction constraints, or trading costs | | The backtest is strong but live results fail immediately | Leakage, unrealistic fills, or research overfitting | | Gross return is stable while net return falls | Turnover, impact, borrow, or capacity | | The model works only in one industry or period | Hidden exposure or sample-selection bias | | The ranking remains useful but predicted magnitudes are too high | Calibration or position-sizing failure |

A convincing case of model failure usually requires several pieces of evidence at once: a persistent loss of out-of-sample ranking skill, no explanation from data faults, execution errors, or known regime risks, and a credible change in the economic mechanism supporting the model.

The decision rules should be written before deployment. Otherwise, researchers can relax standards after a drawdown or abandon a valid signal too quickly under short-term pressure.

Building models that remain robust over time

Robustness does not mean avoiding losses. It means avoiding dependence on one lucky sample, one source of risk, or an execution assumption that cannot survive contact with the market.

Start with a falsifiable economic rationale. Every core feature should have an explanation: what information or risk it represents, why the market would not remove it immediately, who stands on the other side of the trade, and what change would invalidate it. Variables included only because they correlated with returns in the past are the hardest to recognize when they stop working.

Research data must preserve point-in-time boundaries. Historical versions of financial statements, analyst-estimate snapshots, contemporaneous universes, delisting records, and corporate actions are part of the model itself, not minor data-cleaning details.

Complexity is not an achievement in its own right. Keep simple factors, linear models, and low-turnover baselines throughout the research process. A complex model is worth its maintenance burden only when it improves results consistently in strict out-of-sample tests and after realistic costs.

Cost and capacity should shape the model from the start rather than appear as footnotes after the backtest. Signal decay, rebalance frequency, and the tradable universe should jointly determine the label and the portfolio rules.

Production also requires explicit governance. Monitor data quality, feature distributions, score dispersion, rolling IC, risk exposures, turnover, and costs. Define in advance when to reduce exposure, suspend trading, and require revalidation. A candidate model should not replace the live model automatically simply because the incumbent has had a weak quarter.

Conclusion

The strength of a cross-sectional model is not foresight in the usual sense. It is disciplined comparison. Differences in information absorption, behavioral bias, risk bearing, and trading constraints create room for relative rankings, and a large number of weak judgments can add up to a statistically useful portfolio edge.

That edge is always conditional. It can decay as market structure changes, trades become crowded, or regimes shift. It may also have been an artifact of leakage or overfitting from the beginning. Even when predictive power survives, transaction costs, limited capacity, and portfolio constraints can erase its economic value.

A credible research conclusion therefore needs to say more than "the model works." It should identify where the evidence appears, how out-of-sample performance was produced, which risks generate the return, when the model is likely to struggle, and what evidence would trigger lower exposure, suspension, or a full revalidation.


Research disclaimer

This article discusses research methods and limitations for cross-sectional models. It is not a security recommendation, investment advice, or a promise of returns. Historical relationships, backtests, and model scores do not guarantee future performance. Real-world investing is also affected by data quality, liquidity, transaction costs, market impact, taxes, and individual risk tolerance.