The No Free Lunch Theorem
No shortcut works everywhere for free.
There is no method, model, or rule that beats every other on every problem. Any approach that does better on one kind of task pays for it by doing worse on another — so "best for which problem?" is the only sensible question.
Everybody wants the one best tool — the best diet, the best study method, the best investing rule, the best algorithm. It feels like it must exist; you just haven’t found it yet. The No Free Lunch theorem is the surprising, slightly annoying news that it doesn’t. Averaged over every possible problem, every method ties. The clever ones and the lazy ones come out exactly even.
That’s not a counsel of despair — it’s a redirection. If no method is best everywhere, then all the performance lives in the match between a method and the particular problem in front of you. “What’s the best rule?” is the wrong question. “Best for which problem?” is the right one. This short course builds that intuition from zero — no proofs, no heavy maths — and hands you a lens you’ll reuse for the rest of your life.
In this topic
- 1 Why This Course Exists A two-minute orientation to the No Free Lunch theorem — why the search for a single best method is doomed, what "averaged over all problems" means, and how the rest of the course is laid out. 5 min
- 2 No Shortcut That Works Everywhere The No Free Lunch claim in plain words, where the phrase comes from, and the key terms — method, problem, average — you need before we prove anything. Assumes zero background. 11 min
- 3 Why It's True (You Can Count It) A hand-countable toy example plus an interactive board that show two search strategies genuinely tie once you average over every problem — and the balancing act that forces the tie. 14 min
- 4 It Does NOT Mean All Methods Are Equal The crucial misreading. Real problems aren't drawn evenly from all possible problems — they have structure. Matching a method's built-in assumptions to that structure is the whole game. 13 min
- 5 The Many Faces of 'It Depends' The same idea in diets, investing, management, and study — 'it depends' has a theorem behind it. How No Free Lunch connects to circle of competence and the latticework of models. 13 min
- 6 The Lunch You CAN Get No Free Lunch forbids only the FREE lunch. Exploiting known structure and priors is legitimate and powerful. The two failure modes — nihilism and the universal hammer — and how to hold the model correctly. 12 min
- 7 Final Exam: The No Free Lunch Theorem A graded, one-way final exam on the No Free Lunch theorem — the claim, why the tie is forced, why methods still differ on real problems, its many faces, and the paid lunch. Pass mark 70%. 20 min
Mark course as finished
Done with every lesson? Lock it in — your progress is saved on this device.