Factor Investing: What Beating the Market Actually Looks Like

For most of the 20th century, investors explained stock returns using a single number: beta. A stock with a beta of 1.0 moved with the market. A stock with a beta of 1.5 moved more. The Capital Asset Pricing Model (CAPM) — developed by William Sharpe, John Lintner, and Jan Mossin in the 1960s — said beta was all that mattered. Higher risk (higher beta) should produce higher returns; everything else was random noise.

Then the data started showing otherwise. Small stocks consistently beat large stocks. Cheap stocks consistently beat expensive stocks. Stocks that had done well recently kept doing well. None of this made sense under CAPM. The academic response became known as factor investing — the idea that market returns aren't driven by beta alone, but by a set of identifiable, persistent risk factors that investors can systematically harvest for higher returns.

Here's a comprehensive guide to what those factors are, the evidence behind them, how to invest in them, and whether you should.

From CAPM to Fama-French: The Origin of Factor Investing

The CAPM was elegant. One equation: Expected Return = Risk-Free Rate + Beta × (Market Return - Risk-Free Rate). If you wanted more return, you bought more beta — you tilted toward high-beta stocks or used leverage. The problem was that the real world refused to cooperate.

The size effect: In 1981, Rolf Banz published research showing that small-cap stocks had significantly outperformed large-cap stocks over the long term, even after adjusting for beta. From 1926 through the early 1980s, the smallest decile of NYSE stocks outperformed the largest decile by roughly 4 to 5 percentage points per year. This couldn't be explained by CAPM. Banz's paper was one of the first cracks in the CAPM edifice.

The value effect: Even more striking was the performance of value stocks — stocks trading at low prices relative to their book value, earnings, or dividends. Graham and Dodd had been talking about value investing since the 1930s, but the academic formalization came in the late 1980s and early 1990s.

The Fama-French Three-Factor Model (1992): Eugene Fama and Kenneth French published their seminal paper "The Cross-Section of Expected Stock Returns" in 1992, introducing the three-factor model. It added two factors to CAPM:

1. SMB (Small Minus Big) — The size premium: the return of small-cap stocks minus the return of large-cap stocks.
2. HML (High Minus Low) — The value premium: the return of stocks with high book-to-market ratios (value stocks) minus the return of stocks with low book-to-market ratios (growth stocks).

The three-factor model explained roughly 90% to 95% of the variation in diversified portfolio returns — a dramatic improvement over CAPM, which explained about 70%. Fama and French didn't argue that small-cap and value stocks were free money; they argued that these stocks were riskier in specific, measurable ways. Small companies are more vulnerable to economic shocks. Value companies are often distressed, with uncertain futures. The premium you earn is compensation for bearing that risk.

The Five-Factor Model and the Momentum Anomaly

Fama-French Five-Factor Model (2015): Twenty-three years after the three-factor model, Fama and French added two more factors:

1. RMW (Robust Minus Weak) — The profitability premium: companies with high operating profitability outperform those with low operating profitability.
2. CMA (Conservative Minus Aggressive) — The investment premium: companies that invest conservatively (low asset growth) outperform those that invest aggressively (high asset growth).

The logic: highly profitable companies are rewarded by the market, and companies that invest heavily (building factories, acquiring competitors, expanding aggressively) tend to earn lower returns because those investments often produce disappointing results. The five-factor model improved explanatory power further, though the value factor (HML) became statistically redundant when profitability and investment were included — suggesting that much of the value premium could be explained by the fact that value companies tend to be less profitable and more aggressive investors.

Carhart's Momentum Factor (1997): Separately from Fama-French, Mark Carhart added momentum (WML — Winners Minus Losers): stocks that have performed well over the past 6 to 12 months tend to continue performing well over the next 3 to 12 months, and stocks that have performed poorly continue performing poorly. Momentum is the most well-documented factor in all of finance, present across asset classes, geographies, and time periods. Fama himself has called momentum "the premier anomaly." The challenge is that momentum requires high turnover (momentum signals decay quickly) and can suffer catastrophic crashes — momentum strategies lost 70% to 90% of their value in 1932 and 2009 as markets reversed violently.

The Factor Zoo: Understanding Each Major Factor

Decades of academic research have identified dozens of proposed factors, but a handful stand up to robust methodological scrutiny and survive out-of-sample testing. Here are the ones that matter:

Value (Low Price to Fundamentals)

What it is: Value stocks trade at low prices relative to fundamental measures — book value, earnings, cash flow, sales, or dividends. Common metrics include price-to-book (P/B), price-to-earnings (P/E), price-to-cash-flow (P/CF), and enterprise value-to-EBITDA.

Historical premium: From 1926 through 2024, the value premium (using Fama-French HML data) averaged roughly 4% to 5% annualized in the US, though with significant variation across decades. The premium was strongest in international markets, averaging 5% to 7% in developed ex-US markets and even higher in emerging markets.

Why it exists: The leading academic explanation is risk-based: value companies are distressed, more leveraged, less profitable, and more sensitive to economic downturns. The behavioral explanation is that investors systematically overpay for growth — they extrapolate recent growth rates far into the future and are consistently disappointed.

Recent history: Value underperformed dramatically from 2007 through 2020 — the longest and deepest drawdown for the factor in recorded history. US value stocks lost to growth stocks by roughly 5% per year over this period, driven by the extraordinary performance of mega-cap tech companies. This drawdown taught a painful lesson: factors can underperform for a very long time.

Size (Small-Cap Premium)

What it is: Smaller companies (measured by market capitalization) have historically outperformed larger companies. The size factor is typically measured by the return difference between the smallest and largest deciles or quintiles of stocks.

Historical premium: From 1926 through the early 1980s, the size premium was large and statistically significant — roughly 3% to 5% annualized. Since the early 1980s, the premium has largely disappeared in US markets, though it persists in international and emerging markets. Some researchers argue the size premium was never robust; others argue it was arbitraged away once it became widely known.

Why it might exist: Small companies are riskier — less diversified, less access to capital, more sensitive to economic conditions. The premium compensates for that risk. The behavioral explanation: small companies receive less analyst coverage and investor attention, creating mispricing opportunities.

Caveats: Many practitioner funds conflate the size factor with the value factor by buying small-cap value stocks. The academic evidence suggests that small-cap stocks without a value tilt produce negligible excess returns.

Momentum (Winners Keep Winning)

What it is: Stocks that have outperformed over the past 6 to 12 months tend to continue outperforming over the next 3 to 12 months. Cross-sectional momentum compares stocks to each other. Time-series (absolute) momentum compares an asset to its own past performance.

Historical premium: Momentum has been the strongest factor by a wide margin. From 1927 through 2024, US momentum strategies generated annualized premiums of 6% to 10%, depending on construction methodology. The premium exists in equities, bonds, currencies, and commodities, in every country and time period studied.

Why it exists: Momentum is almost certainly behavioral, not risk-based. Underreaction (investors are slow to incorporate new information) and overreaction (prices overshoot) combine with herding behavior and institutional constraints (fund managers buying winners at quarter-end to window-dress) to create persistent trends.

The catch: Momentum crashes. When markets reverse — think March 2009 or April 2020 — momentum strategies get crushed, sometimes losing 30% to 70% in a single month. Negative momentum (shorting losers) is especially dangerous during reversals because beaten-down stocks can double or triple in a matter of weeks.

Quality (Profitability and Safety)

What it is: Quality companies have high profitability, low leverage, stable earnings, and strong balance sheets. They're well-managed, earn high returns on equity, and generate consistent free cash flow.

Historical premium: Quality stocks have outperformed low-quality stocks by roughly 3% to 5% annualized over long periods. The premium is largest in down markets — high-quality stocks held up far better during the 2000-2002 bear market, the 2008 financial crisis, and the 2020 COVID crash.

The paradox: If quality companies are safer and more profitable, shouldn't they earn LOWER returns (investors accept lower returns for safety)? The theoretical justification is less settled than for value or size. The behavioral explanation: investors overpay for speculative growth while undervaluing boring but profitable compounders. The risk-based explanation is less convincing for quality than for other factors.

Low Volatility / Low Beta

What it is: Low-volatility or low-beta stocks have historically outperformed high-volatility stocks on a risk-adjusted basis — and remarkably, often on an absolute basis as well. This is the low-volatility anomaly, and it's one of the most embarrassing empirical facts for the CAPM, which predicts that higher risk must produce higher return.

Historical premium: Low-volatility stocks have matched or slightly exceeded the returns of high-volatility stocks with dramatically less risk. From 1968 through 2024, the lowest-volatility decile of US stocks had a Sharpe ratio roughly twice that of the highest-volatility decile.

Why it exists: Lottery preferences — investors irrationally prefer stocks with lottery-like payoffs (high volatility, positive skewness), bidding them up and depressing their expected returns. Leverage constraints — institutional investors who can't use leverage buy high-beta stocks to increase their market exposure, pushing up prices of risky stocks. Benchmark-relative investing — most professional investors are evaluated against a benchmark, so they avoid low-beta stocks that would cause them to deviate from the index.

Smart Beta ETFs: Factor Investing in Practice

Academic factor research becomes actionable through ETFs and mutual funds that systematically target specific factors. The industry calls these "smart beta" or "strategic beta" products. Here are representative examples:

Expense ratios for these products typically range from 0.05% (for simple, passive screens like VTV) to 0.35% (for more complex multifactor strategies). This is dramatically cheaper than active management, where fees of 1% to 2% consume most or all of any factor premium.

Implementation: Building a Factor-Tilted Portfolio

The decision is not binary — factor investing vs. market-cap indexing. Most factor investors use a core-satellite approach: a broad market-cap-weighted index fund as the core holding (50% to 80% of equity allocation) and factor funds as satellite positions (20% to 50%). This gives you exposure to factor premiums while limiting tracking error regret — the psychological pain of underperforming the market while your factor positions are in a drawdown.

Example portfolio — moderate factor tilt, $100,000 equity allocation:

• 60% Total US Stock Market (VTI, ITOT, or SCHB)
• 15% US Small-Cap Value (AVUV, VBR, or SLYV)
• 15% International Small-Cap Value (AVDV or FNDC)
• 10% Quality or Multifactor (QUAL or LRGF)

This portfolio tilts toward size, value, and quality. Its expected tracking error relative to the market is modest — perhaps 2% to 4% annually — but over 20+ years, it should outperform by 1% to 2% annually if the factor premiums persist. That small difference, compounded, is enormous: $100,000 invested for 30 years at 8% (factor-tilted) vs. 7% (market-only) becomes $1,006,000 vs. $761,000 — a difference of $245,000, or 32% more.

Implementation principles:

1. Use low-cost funds. Factor premiums are modest. Expense ratios of 0.50%+ will consume most of them.
2. Pick a methodology and stick with it. Switching between value, momentum, and quality funds based on recent performance is a recipe for buying high and selling low.
3. Rebalance annually. Factor exposures drift. A value fund that's performed well may no longer be particularly value-y; rebalancing maintains the tilt.
4. Consider tax location. Value and momentum funds generate more turnover and capital gains distributions than market-cap index funds. Hold them in tax-advantaged accounts when possible.

When Factor Investing Is NOT a Good Idea

Factor investing is not for everyone, and for many investors — perhaps most — it's an unnecessary complication.

If you check any of these boxes, stick with market-cap indexing:

• You check your portfolio more than quarterly. Factor strategies underperform for long stretches (value: 2007–2020; momentum: periodic crashes). If you'll panic and sell after 3 to 5 years of underperformance, you'll lock in the underperformance without ever capturing the premium. The premium requires behavioral discipline.

• You have less than $50,000 to invest. Factor tilting with small portfolios adds complexity without meaningful dollar impact. A 2% annual premium on $50,000 is $1,000 — arguably not worth the additional mental overhead and tracking error anxiety.

• You're within 10 years of retirement. Factors can underperform for a decade. If your retirement date is approaching and you'll need to start drawing from your portfolio, you may not have time to wait for factor premiums to materialize.

• You're not confident in your ability to stay the course. The biggest risk in factor investing is not the factors themselves — it's the investor who abandons the strategy after a period of underperformance, which is exactly when the factor premium is most likely to show up going forward.

• You don't understand what you're buying. If you can't explain why small-cap value stocks should outperform, you won't hold them through a 10-year drawdown. Conviction comes from understanding.

Multifactor vs. Single-Factor Funds

Single-factor funds (pure value, pure momentum, pure quality) offer clean, undiluted exposure. If you want the value premium, you buy a value fund. The problem is that single-factor funds can be volatile and require the investor to combine multiple funds to build a diversified factor portfolio.

Multifactor funds combine several factors into one product, screening for stocks that score well on multiple dimensions simultaneously (e.g., cheap AND profitable AND displaying positive momentum). The appeal is simplicity — one fund instead of three or four. The risk is lower factor intensity: by combining factors, you may water down each individual factor's contribution.

For most investors who want factor exposure, a single well-constructed multifactor fund (like LRGF, AVUS, or VFMF) plus a broad market-cap index fund is a reasonable approach.

Factor Crowding and the Replication Crisis

A recent strain of academic literature raises an uncomfortable question: have factor premiums shrunk or disappeared since they were discovered and widely adopted?

Factor crowding: As billions of dollars flow into factor strategies, the premium should theoretically shrink. If everyone knows small caps outperform, capital flows into small caps, pushing up prices, reducing future expected returns. This is the central tension in factor investing — the premium exists because of the anomaly; exploiting the anomaly may eliminate it.

The evidence: Some factors have clearly weakened. The size premium has been negligible in the US since the early 1980s. The value premium has been negative for most of the 2010s (though 2022 saw a dramatic resurgence, with value outperforming growth by over 20 percentage points). Momentum's premium has been more persistent, as has quality's. The cynical view: any factor premium survives only as long as it remains painful enough to harvest that most investors give up.

McLean and Pontiff (2016) found that factor returns decline by roughly 32% after academic publication, as arbitrageurs trade away the mispricing. But they don't disappear entirely — risk-based factors should endure because they compensate for genuine economic risks that investors will always demand a premium to bear.

Tax Considerations

Factor strategies — especially momentum and multifactor funds — generate higher turnover than market-cap-weighted index funds. Higher turnover means more realized capital gains, which means higher tax bills in taxable accounts.

• Value funds: Moderate turnover (20% to 40% annually), as stocks migrate in and out of the value universe. Tax-efficient value ETFs with low turnover (like VTV or SCHV) are more suitable for taxable accounts.
• Momentum funds: High turnover (100% to 300% annually), as the momentum signal requires frequent rebalancing. Momentum is a tax-inefficient strategy and should be held in tax-advantaged accounts.
• Quality and low-volatility funds: Low to moderate turnover (10% to 30%), relatively tax-efficient.

If you're implementing a factor-tilted portfolio, prioritize holding momentum, multifactor, and high-turnover strategies in IRAs and 401(k)s. Value and quality ETFs can work in taxable accounts if you select tax-efficient versions.

The Bottom Line

Factor investing offers a systematic, evidence-based approach to earning returns that exceed the market — but the gap between academic theory and investor experience is wide. Factors require patience measured in decades, not years. The value premium is real, but it disappeared for 13 years. Momentum is powerful, but it crashes violently. Small caps beat large caps for 60 years, then stopped beating them. The premium is the reward for tolerating the pain.

For most investors, the right decision is to own the total market at the lowest possible cost and accept market returns. That alone — consistently capturing the market return over a lifetime of saving and investing — puts you ahead of the vast majority of professional money managers. If you have the knowledge, the discipline, and the time horizon to tilt toward factors, keep it simple: a modest small-cap value tilt, a quality screen, and the patience to hold through whatever the next decade brings. The premium is there if you can earn it. Most people can't.