Skip to main content

Survivorship Bias

Focusing on successes while ignoring failures

Attention

What is it?

Survivorship bias is the logical error of concentrating on successful outcomes that passed a selection process while overlooking failures that are less visible. The classic example comes from World War II: engineers wanted to armor the parts of returning aircraft that showed the most bullet holes, until statistician Abraham Wald pointed out that the holes showed where planes could be hit and still return—the missing planes were hit elsewhere. This bias pervades business advice, where we study successful companies without equal attention to failed ones that did the same things. "Follow your passion" is survivorship-biased advice: we hear from passionate people who succeeded, not the equally passionate who failed. Music, art, startups—every field has visible successes that mask an invisible graveyard of failures. The bias leads to overestimating the probability of success and misattributing causes. A strategy that works for one visible success might have failed for thousands of invisible cases. Correcting survivorship bias requires actively seeking out failure cases, understanding selection mechanisms, calculating base rates of success, and asking "what would I expect to see if success were purely random?" to distinguish skill from luck.

Example

Studying only successful entrepreneurs without considering the many who failed. Following advice from visible millionaires, not invisible bankrupts. Copying strategies of surviving companies.

References

Brown, S. J., Goetzmann, W., Ibbotson, R. G., & Ross, S. A. (1992). Survivorship Bias in Performance Studies. The Review of Financial Studies, 5(4), 553-580.

Elton, E. J., Gruber, M. J., & Blake, C. R. (1996). Survivorship Bias and Mutual Fund Performance. The Review of Financial Studies, 9(4), 1097-1120.

How to Prevent It

Question

What about those who tried and failed?

Question

Am I seeing a complete picture or just the winners?

Question

How many people started with similar advantages and failed?

Question

Is this success due to skill or just survivorship?

Question

What selection effects might be hiding failures?

Technique

Research failure cases, not just success stories.

Technique

Calculate success rates from the full population.

Technique

Seek out "graveyards" of failed attempts in any domain.

Technique

Study post-mortems and failure analyses in your field.

Technique

Ask survivors what factors eliminated their competitors.