Theme 4 of 13 · 17 ideas

A biased picture misleads whoever reads it. A picture that gets acted on does something stronger: forests are replanted to match the table, prices move to match the formula, people change to match the category. This is where framework bias stops being a quirk of thought and becomes a force in the world, and it ends with what to do about it.

The same ground, told as a story: Thinking Inside Frameworks, Chapter 8b: Intersubjective Truth.

The ideas

Each one is a short page. Walk them in this order, or start with whichever catches your eye.

  1. The map is not the territory: A model or a summary is a simplified picture of something, and trouble starts when people forget what the picture left out.
  2. Legibility: To manage something large, you first simplify it into what can be written down, and whatever cannot be written down stops counting.
  3. Scientific forestry and the Normalbaum (example): German foresters replanted their woods to match a table of timber yields, and after one good harvest the simplified forests began to fail.
  4. Classification torque: When official categories do not fit the people sorted into them, the categories hold and the people are the ones who bend.
  5. Apartheid race classification (example): South Africa’s government sorted every person into a legal race category that decided where they could live and work, even splitting families.
  6. The DSM and RDoC (example): Psychiatry’s manual defines illnesses by agreed lists of symptoms, and in 2013 a US research institute said its studies would move away from them.
  7. Framework feedback (mechanism): When people act on a framework’s picture of the world, the world changes, sometimes to match the picture and sometimes to break it.
  8. Goodhart’s law: Once people are rewarded for hitting a number, they find ways to hit it that no longer deliver what the number was meant to track.
  9. AI benchmarks as milestones (example): AI researchers compete on a small set of shared tests, and higher scores on them get read as progress toward general AI.
  10. Performativity: A model that enough people use to make decisions can stop merely describing the world and start pushing the world toward itself.
  11. Black-Scholes and the option market (example): A formula for pricing options fit the market badly at first, then traders adopted it and prices moved to match, until the 1987 crash.
  12. The Gaussian copula and 2008 (example): Investment banks shared one formula for agreeing on values and booking profits, so its blind spot about a housing-wide downturn became everyone’s blind spot.
  13. Looping effects: People who are put in a category react to being put there, and their reaction changes what the category contains.
  14. Conway’s law: The things an organization builds end up shaped like the organization’s own internal lines of communication.
  15. Path dependence and lock-in: An early choice, even an arbitrary one, can become nearly impossible to change once everyone has built their habits around it.
  16. QWERTY and the disputed lock-in story (example): The standard keyboard layout is the best-known example of an early choice that stuck, though whether a better layout really lost is disputed.
  17. Framework rotation: The way to see how one way of looking is bending your view is to look a second way and compare.

← Thinking inside frameworks · All themes · The finite reader →