The Efficient Market Hypothesis

The Hundred-Dollar Bill on the Sidewalk

An economist and her graduate student are walking across campus when the student spots a hundred-dollar bill on the ground. The student bends down to pick it up. "Don't bother," says the economist. "If it were really there, someone would have picked it up already."

This is, by a wide margin, the most famous joke in economics. It's also, depending on whom you ask, either a devastating critique of economic orthodoxy or a surprisingly deep insight dressed up as a punchline. The joke works because it captures something genuinely weird about a certain kind of economic reasoning—reasoning that is simultaneously very clever and, when pushed to its logical extreme, obviously absurd.

The idea behind the joke has a name: the Efficient Market Hypothesis, or EMH. It is perhaps the most influential, most debated, and most misunderstood idea in all of finance. And like a lot of the most interesting ideas in mathematics, it sits in that uncomfortable zone where it's too true to dismiss and too false to accept.

The story of the EMH begins, as many stories in modern finance do, with a man named Eugene Fama. In 1970, Fama—then a young professor at the University of Chicago, the intellectual Vatican of free-market economics—published a paper called "Efficient Capital Markets: A Review of Theory and Empirical Evidence."1 The title sounds like something designed to cure insomnia, but the idea inside it was electric.

Here's what Fama said, stripped to its essence: the price of a stock already reflects all available information about that stock. Not most information. Not the important information. All of it. If a company is about to announce great earnings, the stock price has already gone up. If a CEO is secretly embezzling funds, the price has already gone down—maybe not because anyone knows about the embezzlement, but because enough smart people have noticed enough small signals that the aggregate effect is the same.

This sounds like magic, and in a sense it is. Not the magic of any individual genius, but the magic of millions of people—traders, analysts, algorithms, your uncle who reads the Wall Street Journal in the bathtub—all trying to make money, and in the process inadvertently creating a system that's smarter than any one of them.

Three Flavors of Efficiency

Fama, being a careful thinker, didn't just assert one blanket claim. He sliced the hypothesis into three increasingly bold versions, like a dare that keeps escalating.

Weak form efficiency says that stock prices already reflect all information contained in past prices. In other words, staring at price charts—what Wall Street calls "technical analysis"—is a waste of your time. That stock that's been going up for six straight days? The fact that it's been going up is already baked into today's price. The squiggly patterns that traders see in charts—head and shoulders, double bottoms, cup and handle formations (I am not making these names up)—are no more meaningful than the shapes you see in clouds.2

Semi-strong form efficiency goes further. It says prices reflect all publicly available information—not just past prices, but earnings reports, news articles, economic data, everything you could find on Bloomberg or Google or in the footnotes of an SEC filing. If this is true, then fundamental analysis—the practice of poring over balance sheets and income statements to find "undervalued" companies—is also a waste of time. By the time you've read the annual report, so have ten thousand other people, and the stock price has already adjusted.

Strong form efficiency is the full dare. It says prices reflect all information, including private insider information. If the CEO knows something nobody else does, the price already reflects it anyway—perhaps because the CEO's trading patterns, however subtle, have been detected by sharp-eyed observers. Almost nobody believes the strong form is literally true (we have insider trading laws for a reason), but it serves as a useful theoretical limit.

Now, here's the thing that makes mathematicians sit up. These aren't just qualitative claims—they have precise mathematical content. If the weak form is true, then price changes should be uncorrelated with past price changes. The technical term is that prices follow a random walk (or, more precisely, a martingale with drift).3 Tomorrow's price change is as unpredictable as a coin flip, regardless of what happened yesterday.

The Scoreboard

So is the EMH true? Let's check the evidence, starting with the case for.

Every year, S&P Global publishes something called the SPIVA Scorecard—a brutal reckoning that compares the performance of actively managed mutual funds against their benchmark indices.4 The results are, if you're a fund manager, deeply uncomfortable. Over a 15-year period, roughly 90% of actively managed U.S. stock funds underperform the S&P 500 index. Let that sink in. Nine out of ten professional investors—people who went to Wharton, who have Bloomberg terminals and research teams and expense accounts—would have been better off buying an index fund and going to the beach.

And it's not like the other 10% are obviously skilled. If you have enough monkeys throwing darts at a stock page, some of them will hit the bullseye. The question isn't whether anyone beats the market. Of course someone does—that's just probability. The question is whether they beat it by more than you'd expect from chance alone.

The great Warren Buffett himself has made this argument. In 2007, Buffett bet $1 million that a simple S&P 500 index fund would outperform a hand-picked collection of hedge funds over ten years. He won convincingly.5 The hedge funds, after their hefty fees, returned about 36% over the decade. The index fund returned 125%.

Try It Yourself

Don't take my word for it. Here's a simulated stock market. You get 20 rounds of trading. Buy and sell as you see fit, using whatever strategy your gut tells you is clever. At the end, we'll compare your returns to what you'd have earned by simply buying and holding.

How did you do? If you're like most people, you probably underperformed the simple strategy of buying on day one and holding until the end. Don't feel bad—this isn't because you're bad at trading. It's because the price movements are essentially random, and every time you trade, you're betting that you can predict the unpredictable. Even without transaction costs, trying to time a random walk is a losing proposition on average.

The Exceptions That Prove the Rule (Or Do They?)

The case against perfect efficiency is also substantial, and a lot more fun to talk about.

Start with Warren Buffett. Buffett's track record at Berkshire Hathaway is staggering: roughly 20% annualized returns over more than fifty years. The probability of achieving this by luck alone is astronomically small—somewhere in the neighborhood of one in several billion.6 Buffett himself addressed this in a famous 1984 speech called "The Superinvestors of Graham-and-Doddsville," where he pointed out that the most successful investors tend to cluster around a specific intellectual tradition (value investing), which is exactly what you'd expect if skill, not luck, were the explanation.

Then there are the anomalies—patterns in stock returns that shouldn't exist if markets were truly efficient. The momentum effect: stocks that have gone up recently tend to keep going up for a while. The value premium: cheap stocks (low price-to-earnings ratios) tend to outperform expensive ones over time. The small-cap effect: small companies tend to earn higher returns than big ones. Each of these has been documented in dozens of academic papers across multiple countries and time periods.

And then there's 2008. If markets are so efficient, how did they price mortgage-backed CDOs—collateralized debt obligations stuffed with subprime loans—as though they were nearly risk-free? The entire global financial system nearly collapsed because "the market" had convinced itself that you could take a pile of terrible loans, slice them into tranches, and somehow transmute junk into gold. The alchemists of the Middle Ages had nothing on Lehman Brothers.

The Beautiful Paradox

In 1980, two economists named Sanford Grossman and Joseph Stiglitz published a short, elegant paper with a devastating argument.7 Their logic went like this:

Suppose markets are perfectly efficient—prices always reflect all available information. If that's the case, then there's no point in doing any research. You can't gain an edge by analyzing companies, because everything you might discover is already reflected in the price. So you might as well save yourself the trouble and just buy an index fund.

But here's the catch: if nobody does research, then who is putting the information into prices? Prices can't reflect information that nobody has bothered to gather. If all the analysts go home, the information pipeline shuts down, prices drift away from true values, and suddenly the market isn't efficient anymore.

So we have a paradox: perfectly efficient markets are logically impossible, because efficiency depends on the very activity that efficiency would render pointless. The market is like a city that's clean because someone is always picking up litter. If you concluded that the city was so clean that there was no litter to pick up, and therefore fired all the cleaners, the city would get dirty very quickly.

Grossman and Stiglitz's resolution is beautiful. Markets must be efficient enough that the expected profit from gathering information approximately equals the cost of gathering it. If the market gets too inefficient (too much metaphorical litter), more analysts pile in, exploiting the opportunities and pushing prices back toward efficiency. If the market gets too efficient (too clean), analysts leave because there's no money in it, and the market slowly becomes less efficient again.

It's an equilibrium—not of efficiency, but of almost-efficiency. The hundred-dollar bill isn't glued to the ground. It appears occasionally, someone grabs it, and for most of the time the sidewalk is bare. The economist in the joke is almost right. The bill is almost never there. Almost.

The Lucky Monkey Problem

Here's an interactive to drive the point home. We're going to simulate 1,000 fund managers, each making random stock picks—pure dart-throwing monkeys in business suits. Some of them will beat the market, some by a lot. The question is: how many winners would you expect from pure chance?

Notice anything? Even when every single manager is picking stocks at random, some of them end up with spectacular records. Over five years, you'll typically see a handful who beat the market by five or more percentage points per year. Put those names on the cover of Forbes. Over 10 or 15 years, the lucky few thin out—but they don't disappear entirely. And that's the insidious thing about luck: it looks exactly like skill, especially in small samples.

The Joint Hypothesis Trap

There's one more wrinkle, and it's a doozy. Suppose you think you've found evidence that the market is inefficient—say, value stocks outperform growth stocks by 3% per year. Is the market wrong? Or is it simply the case that value stocks are riskier in some way that your model doesn't capture, and the extra return is fair compensation for that risk?

This is called the joint hypothesis problem, and it makes testing the EMH maddeningly difficult. Any test of market efficiency is simultaneously a test of your model of what prices should be. If the test fails, you don't know which part failed—the market or your model.

You can never test market efficiency in isolation. It always comes bundled with a theory of risk and return, and you can't unwrap the package.

It's as if you were trying to test whether a scale is accurate, but the only way to check is by weighing objects whose true weight you don't know. If the scale reads 7 pounds for something you expected to weigh 5, is the scale broken, or were you wrong about the object?

Fama himself has been admirably honest about this. He's argued that the value premium and momentum effect might be genuine anomalies, or they might be risk premia that existing models fail to capture. The EMH, in some deep sense, might not even be testable.8 Which raises a philosophical question that would warm the heart of Karl Popper: if a theory can't be falsified, is it even a scientific theory?

The Mathematician's Answer

So where does all this leave us? Is the EMH true or not?

The honest answer—the mathematician's answer—is that this is the wrong question. The EMH is not a binary proposition to be proved or disproved. It's a spectrum, and the interesting question is where on that spectrum real markets actually sit.

Here's what we can say with reasonable confidence: markets are efficient enough that the vast majority of people, the vast majority of the time, cannot beat them after accounting for costs. The SPIVA data makes this painfully clear. If you're an ordinary investor, the EMH is true for you—not because the market is literally omniscient, but because whatever inefficiencies exist are too small, too fleeting, and too expensive to exploit.

But markets are not perfectly efficient. The Grossman-Stiglitz paradox tells us they can't be. Anomalies exist—momentum, value, occasional spectacular mispricings like the housing bubble. Some investors, through genuine skill or structural advantages, can earn excess returns. They're just much rarer than the financial industry would like you to believe, and much harder to identify in advance.

The old joke, it turns out, needs a revision. The economist and the student are walking along. The student spots a hundred-dollar bill. The economist says, "If it were real, someone would have picked it up." The student picks it up. But the next ninety-nine things that look like hundred-dollar bills turn out to be leaves, mirages, and clever marketing from hedge funds charging 2-and-20.

The mathematical moral: the world is full of situations where something is approximately true—true enough to be extremely useful, but not true enough to be taken literally. The EMH is one of the most important approximate truths in all of economics. It will not make you rich. But understanding it—really understanding both what it claims and where it fails—might just keep you from going broke.

Which, when it comes to money, is the smarter bet.