Optimism Bias

I'm pretty fascinated by this chart from the McKinsey Quarterly, which is a great demonstration of the optimism bias. The chart captures the earnings estimates of equity analysts for S&P 500 companies. The downward slope of these yellow lines is what happens when our hopeful projections meet dismal reality:


Needless to say, these estimates come from highly paid professionals, with access to vast amounts of data. (They're also making projections about the relatively near future.) Unfortunately, all that data is no match for a deep-seated bias, which leads us to accentuate the positive and downplay the prospect of potential losses. (This helps explain why earnings projections are even less accurate during economic downturns.) Interestingly, the only segment of the population that isn't vulnerable to the optimism bias are people with major depressive disorder. Maybe Wall Street should think about hiring them.

More like this

This chart shows what the stock market had been doing since the summer of 2007, when the effects of the economic crisis were openly recognized by the Administration.  You can see that that various interventions have resulted in brief improvements, but nothing sustained.  The overall trend clearly…
There was always an assumption that the Affordable Care Act would need time to find its sea legs. That’s why it included measures to shield insurers from the potential profit losses that inherently come with offering millions more people better health coverage at more reasonable prices. Insurers…
First of all, thank you to everyone who took the time to write and comment on my recent article on depression. I really appreciated all the insightful emails and I'm trying to respond to every one. In the meantime, I wanted to address some important criticisms of the analytic-rumination hypothesis…
...shitty. I don't see how the economy will substantively improve without getting rid of the zombie banks--those banks that are insolvent, that have more debts than assets. Since they are unable to make loans, they're essentially non-functioning banks. The federal government for the first time…

Are there any studies out there comparing stock picking strategies of the chronically depressed?


this has nothing to do with optimism. Equity analysts are just cheerleaders for the companies they cover, so that their banks can get investment banking business. If the analysts started becoming pessimists, the banks would get no deals.

It's regression to the mean, right?

S&P 500 companies are those which have performed well in the past... companies that are pretty successful. The problem is, we fail to regress our projections.

My guess, if you looked at analyst expectations for poor stocks, you'd see the opposite - you'd see rising expectations over time. People would have initially failed to regress past performance as they project it into the future.

All the data points look like sperm--does that mean anything?!

By DeborahInLA (not verified) on 17 Apr 2010 #permalink

Optimism bias could be easily eliminated by discounting optimist forecasts by, say, 5%/year.
The problem is that even after such discounting forecasts are still not accurate at all (either too optimistic or too pessimistic).

Optimism is a form of the hope that allows you to get out of bed in the morning and face again the real prospect of failure. A bias formed for an unbiased purpose.

This is an important graph. (1) Demonstration of optimism bias in human nature; (2) demonstration of the uselessness of financial forecast (even in catastrophic years, the predictions were standard); (3) demonstrates the power of a good chart to finally drive home an idea supported by tons of data. I wish that there were more details on the years that were different from the average (words with arrows for instance).

Actually, there's a fairly rich literary history of the "adventures" of the majorly depressed on Wall Street... Bartleby the Scrivener anyone? (http://en.wikipedia.org/wiki/Bartleby,_the_Scrivener) Maybe Melville wasn't quite the introspective neuroscientist Proust was, but his take on the perversion of human nature in the emerging industrial/financial environment is worth analyzing as much as this fascinating graph.

Interesting, but not the full picture though. These analysts are not investing, merely selling their research (so called sell-side). I think when it comes to actual investing (buy side), loss aversion trumps the optimism bias, on average. What do you think?

I'm puzzled by the claim that this chart confirms an innate bias toward optimism. That claim seems predicated on the idea that analysts consistently overestimate a company's earnings, but that's not what I see in the chart. In some years I see the downward trend on which that claim seems to rest, but in some years I see the reverse (analysts underestimating eventual earnings), and in some years I see substantively little difference between analysts' initial expectations and the earnings eventually reported. It looks like there are probably more years with downward trends than there are flatlines or upward trends, but some of the downward trends are a matter of a few cents per share or less. More important, if the downward trends are to be explained by an innate bias, then why isn't there a downward trend every single year?

By Jay Ulfelder (not verified) on 19 Apr 2010 #permalink


I think you're reading the graph the wrong way. Still, your way seems to make the case for the optimism bias: 18 out of 24 years (75%), analysts have started by overestimating the EPS, then adjusting downwards as reality set in. The years where they didn't were exceptional in growth and proved to be irrational and lead to a major economic crisis. It was too good to be true - even for optimists.

I think the stronger evidence for the optimism bias lies on the vertical axis: at a given date, the predictions for the longer time frame are consistently higher than for the short run. To this rule, I see only one exception across all the graph: the 1999 prediction for 2002. This is what optimism is about: it will be better in the future.