Concept · part of How people actually believe things

Imagine five colleagues each tell you the new policy starts Monday. Five confirmations feels like plenty. But all five heard it from the same person, who was wrong. You reasoned sensibly at every step and ended up sure of something false.

Cailin O’Connor and James Owen Weatherall, in The Misinformation Age, show the same thing with formal models of whole communities. Give every member flawless reasoning, with no gullibility and no carelessness, and the group can still settle on a false belief. The failure lives in the shape of the network and the way evidence moves through it: who hears from whom, whose word counts for more, and the pull of agreeing with peers. The Zollman effect is one version, where a tightly connected group locks onto an early lead too fast.

The book leans on this result to rule out a tempting diagnosis: that false beliefs spread because people are careless or stupid. If flawless reasoners can go wrong together, telling individuals to think harder will not fix it. What needs attention is which claims get passed along, and by what criteria. The same models show how two communities can drift apart with nobody behaving irrationally.

Read the full argument

How it connects


← Conformity · How people actually believe things (7 of 7)

Explore all the ideas · Read the book in order · Open the interactive map