Concept · part of Thinking inside frameworks
Show a child three dogs and she can spot a fourth. To do that she had to assume something the three dogs did not strictly prove: that fur, four legs and a bark matter, and that the color of the carpet they stood on does not. Learning from examples is impossible without assumptions of that kind.
Machine-learning researchers call these assumptions inductive bias. Every learning system has them. An image model assumes that nearby pixels belong together. A language model reasons over whatever units its text was chopped into, which is why irregular chunking makes arithmetic harder for it, much as Roman numerals did for people (notation-as-tool-of-thought).
This is the one field that treats a framework’s bias as unavoidable and chooses it on purpose, the attitude the book recommends everywhere else. It is also the field that has shown most clearly how fast unexamined frameworks take over. A model’s answers can swing wildly with the formatting of the question (prompt-format-sensitivity), and a few test suites steer what the whole field builds (ai-benchmarks). In the book’s account of AI these are dials the model’s builder controls (one owner, every dial).
Read the full argument
- Thinking Inside Frameworks, section “The clearest case is a machine”
How it connects
- See also: AI benchmarks as milestones, Corpus capture, LLM as collapsed selection-design moment, Notation as a tool of thought, Prompt formatting and the 76-point swing
- Evidence: Frameworks That Shape the Thoughts Built Inside Them
- Where the book discusses it: Chapter 11: AI as a New Kind of Node, Thinking Inside Frameworks
← Law of the instrument · Thinking inside frameworks (20 of 21) · Prompt formatting and the 76-point swing →
Explore all the ideas · Read the book in order · Open the interactive map