Concept · part of How people actually believe things
Imagine five colleagues each tell you the new policy starts Monday. Five confirmations feels like plenty. But all five heard it from the same person, who was wrong. You reasoned sensibly at every step and ended up sure of something false.
Cailin O’Connor and James Owen Weatherall, in The Misinformation Age, show the same thing with formal models of whole communities. Give every member flawless reasoning, with no gullibility and no carelessness, and the group can still settle on a false belief. The failure lives in the shape of the network and the way evidence moves through it: who hears from whom, whose word counts for more, and the pull of agreeing with peers. The Zollman effect is one version, where a tightly connected group locks onto an early lead too fast.
The book leans on this result to rule out a tempting diagnosis: that false beliefs spread because people are careless or stupid. If flawless reasoners can go wrong together, telling individuals to think harder will not fix it. What needs attention is which claims get passed along, and by what criteria. The same models show how two communities can drift apart with nobody behaving irrationally.
Read the full argument
- Chapter 5b: Selection As The Other Engine, section “The strongest objection: people are not that gullible”
- Chapter 9: The Integration Problem, section “Why “just connect them” doesn’t work”
How it connects
- See also: Conformity, Credibility weighting, Epistemic vigilance (mental immune systems), Polarization via distrust, The Zollman effect
- Evidence: Not Born Yesterday, The Misinformation Age
- Supported by: Not Born Yesterday
- Where the book discusses it: Chapter 5b: Selection As The Other Engine, Chapter 7: Emotional Memetics As The Floor
← Conformity · How people actually believe things (7 of 7)
Explore all the ideas · Read the book in order · Open the interactive map