Skip to main content

Survivorship Bias

Focusing on successes while ignoring failures

Attention

What is it?

Survivorship bias is the logical error of concentrating on successful outcomes that passed a selection process while overlooking failures that are less visible. The classic example comes from World War II: according to the usual account, engineers wanted to armor the parts of returning aircraft that showed the most bullet holes, until statistician Abraham Wald pointed out that the holes showed where planes could be hit and still return; the missing planes had been hit elsewhere. This bias runs through business advice, where we study successful companies without equal attention to failed ones that did the same things. "Follow your passion" is survivorship-biased advice: we hear from passionate people who succeeded, not the equally passionate who failed. In music, art, startups and many other fields, visible successes mask a much larger, invisible set of failures. The bias leads to overestimating the probability of success and misattributing its causes. A strategy that worked for one visible success may have failed in many cases we never hear about. Correcting survivorship bias requires actively seeking out failure cases, understanding selection mechanisms, calculating base rates of success, and asking "what would I expect to see if success were purely random?" to distinguish skill from luck.

Example

Studying only successful entrepreneurs without considering the many who failed. Following advice from visible millionaires, not invisible bankrupts. Copying strategies of surviving companies.

References

Brown, S. J., Goetzmann, W., Ibbotson, R. G., & Ross, S. A. (1992). Survivorship Bias in Performance Studies. The Review of Financial Studies, 5(4), 553-580.

Elton, E. J., Gruber, M. J., & Blake, C. R. (1996). Survivorship Bias and Mutual Fund Performance. The Review of Financial Studies, 9(4), 1097-1120.

How to Prevent It

Doxa uses AI and can make mistakes. How it's built

Question

What about those who tried and failed?

Question

Am I seeing a complete picture or just the winners?

Question

How many people started with similar advantages and failed?

Question

Is this success due to skill or just survivorship?

Question

What selection effects might be hiding failures?

Technique

Research failure cases, not just success stories.

Technique

Calculate success rates from the full population.

Technique

For any success story, name at least one person or firm that did the same thing and failed.

Technique

Study post-mortems and failure analyses in your field.

Technique

Ask survivors what factors eliminated their competitors.