Skip to main content

Outcome Bias

Judging decisions by their results, not their quality

Judgment

What is it?

Outcome bias is the tendency to evaluate the quality of a decision based on its outcome rather than on the information available and reasoning applied at the time the decision was made. A good decision can have a bad outcome due to unforeseeable events, and a bad decision can succeed through luck. Yet we consistently judge decision-makers by results. This creates several problems: it punishes thoughtful risk-taking when luck doesn't cooperate, it rewards reckless decisions that happen to succeed, and it prevents learning the right lessons from experience. In medicine, a surgeon who makes the correct choice given available information but loses a patient may be judged more harshly than one who made a questionable call but got lucky. In investing, fund managers are rated by returns without accounting for the risks taken to achieve them. Outcome bias is closely related to hindsight bias—once we know the outcome, it colors our judgment of the decision process. Combating outcome bias requires separating decision quality from outcome quality, evaluating decisions based on process and reasoning at the time, creating "decision journals" that document thinking before outcomes are known, and accepting that in uncertain environments, good decisions will sometimes fail.

Example

Praising a risky investment that happened to pay off. Firing a manager whose good decision had a bad outcome due to luck. Celebrating a reckless gamble that succeeded.

References

Baron, J., & Hershey, J. C. (1988). Outcome Bias in Decision Evaluation. Journal of Personality and Social Psychology, 54(4), 569-579.

Gino, F., Moore, D. A., & Bazerman, M. H. (2009). No Harm, No Foul: The Outcome Bias in Ethical Judgments. Harvard Business School Working Paper, No. 08-080.

How to Prevent It

Question

Was the decision sound given the information at the time?

Question

Did luck play a role in this outcome?

Question

Would the same process lead to different results if repeated?

Question

Am I judging the quality of the decision or just the result?

Question

What was the expected value of this decision at the time?

Technique

Evaluate decisions based on the process used.

Technique

Document your reasoning before outcomes are known.

Technique

Create decision quality metrics separate from outcome metrics.

Technique

Review decisions in cohorts to see process quality over time.

Technique

Celebrate good processes even when outcomes are unlucky.