Theme 9 of 13 · 7 ideas

The strongest objection to the book’s alarm, taken seriously. People have real defenses against bad information. This theme is about what those defenses protect, what they leave open, and how sensible individual habits can still produce a group that is confidently wrong.

The same ground, told as a story: Chapter 7: Emotional Memetics As The Floor, Chapter 5b: Selection As The Other Engine.

The ideas

Each one is a short page. Walk them in this order, or start with whichever catches your eye.

  1. Epistemic vigilance (mental immune systems): People come equipped with mental defenses that check whether a claim is plausible and whether its source can be trusted.
  2. Open vigilance (Mercier’s paired construct): People are both open to useful information and wary of unreliable sources, and their mistakes lean toward doubting too much.
  3. Reflective vs. intuitive belief (Sperber’s split): Some beliefs steer what you actually do, while others you only say or share and never act on.
  4. Justification market (behavior→belief arrow): People often decide what to do first and then go looking for beliefs that make the decision feel right.
  5. Credibility weighting: Nobody can check everything personally, so we all judge claims partly by how much we trust whoever is telling us.
  6. Conformity: People often take up a belief because the people around them hold it, whatever the evidence says.
  7. False consensus among rational agents: A group of people who each reason carefully and honestly can still end up agreeing on something false, because of how evidence reaches them.

← What the filter rewards · All themes · Groups, splits and scale →