Confirmation Bias Challenge
Challenge favored assumptions with dissent, diverse data, and self-questioning.
- Difficulty
- Moderate
- Time to result
- ~weeks to results
- Steps
- 5
- Confidence
- 99%
The Confirmation Bias Challenge creates deliberate resistance against the brain's tendency to notice, interpret, and remember evidence that supports an existing belief. The decision-maker begins by naming the preferred assumption, then actively seeks trusted people whose perspectives and analytical tendencies differ. Rather than collecting supportive stories, the group compares quantitative evidence and information from multiple sources, including material that weakens the favored case. The decision-maker then asks directly whether contradictory information is being overlooked or reinterpreted unfairly. If the original position can account for the opposing data, it becomes stronger; if it cannot, the position changes. The framework makes dissent and disconfirmation routine inputs to judgment, reducing the chance that confidence, authority, or selective research will disguise a weak business decision.
Origin
Extracted from The Jasmine Star Show, where Jasmine Star explained how she consults two trusted people likely to disagree with her and submits to their advice when her case cannot overcome their data.
Core principles
- 01The brain naturally favors evidence that supports existing beliefs.
- 02Trusted dissent improves the quality of important decisions.
- 03Data from multiple sources is stronger than convenient anecdotes.
- 04A favored idea should survive deliberate attempts to challenge it.
- 05Changing your mind can be an act of strength.
How to run it
- 1
Name the Favored Assumption
Write down the belief or conclusion you currently want to be true. Make its supporting assumptions explicit before collecting more information.
Pro tip Phrase it as a testable claim rather than a broad opinion.
Watch out An unstated preference can silently shape every later interpretation.
- 2
Recruit Deliberate Dissent
Consult trusted people who are likely to see the situation differently. Ask them to challenge the assumptions and present the strongest contrary case.
Pro tip Choose dissenters for judgment and evidence quality, not for reflexive opposition.
Watch out Do not punish or marginalize people for providing the disagreement you requested.
- 3
Prioritize Diverse Data
Compare numbers and evidence from different sources instead of relying on personal experience or memorable anecdotes. Examine indications that contradict the preferred answer.
Pro tip Record the source and limitations of each meaningful data point.
Watch out More data is not automatically better if every source reflects the same underlying sample.
- 4
Question Your Interpretation
Ask whether you are only noticing information that confirms your belief or explaining away contradictory evidence. Reinterpret the full evidence set as though someone else proposed the idea.
Pro tip Write the conditions under which you would change your mind before making the final decision.
Watch out Do not set impossible standards for contrary evidence while accepting weak support for your own view.
- 5
Update the Decision
Retain the preferred position only if it adequately survives the opposing evidence. Otherwise revise it or submit to the stronger judgment and data.
Pro tip Document what changed your conclusion to reinforce evidence-led decision habits.
Watch out Seeking disagreement is performative if the decision can never actually change.
In the wild
A software founder believes a higher price will attract more serious customers. Before changing it, she asks two skeptical advisers to build the opposing case and reviews conversion interviews, churn data, competitor pricing, and willingness-to-pay results. The evidence shows strong price sensitivity in the target segment, so she tests a smaller increase instead.
→ The company avoids imposing a preferred premium strategy that the market evidence does not support.
Common mistakes
Choosing Friendly Dissenters
People who habitually validate the leader's position will not create a meaningful challenge, even when formally asked to disagree.
Using Anecdotes as Market Evidence
A vivid customer story or personal experience can illustrate a possibility but cannot establish the broader pattern by itself.
Moving the Goalposts
Continually raising the standard for contrary evidence protects the preferred belief instead of testing it.
Is it for you?
Best for
It is best for pricing, product, hiring, investment, and strategy decisions where leaders already have a favored answer.
Not ideal for
It is not ideal when an immediate operational decision must be made before meaningful opposing evidence can be gathered.
From the transcript
“First, seek opposing views like actively, intentionally seek out feedback and perspectives that challenge your assumptions.”
“If I cannot convince people who see differently and present data, then I have to submit to their wisdom and advice.”
“Ask yourself, am I only looking at information that confirms my beliefs?”
From the episode
The 4 Things My Brain Did to Keep Me Stuck - and How I Overcame Them