Exercises

One file per exercise. Every exercise that touches nanorag/ must ship with a measurement and an interval — a point estimate is not a result.

Stuck on one? Each exercise has a long-running clinic thread in Q&A — ask there rather than opening a new thread, so the answers accumulate where the next person will look for them.

	Exercise		Clinic
🟢	EX-01	Attribute ten failures	ask
🟡	EX-02	Find the N where the ceiling stops moving	ask
🔴	EX-03	Break the funnel on purpose	ask
🟡	EX-04	Manufacture an eval set for a new domain	ask
🔴	EX-05	Make starvation reproduce	ask
🟡	EX-06	Null questions for a real corpus	ask
🟡	EX-07	Chunking bake-off on your own corpus	ask
🔴	EX-08	Implement a new chunking strategy	ask
🔴	EX-09	Survive an encoder upgrade	ask
🔴	EX-10	Prove permission isolation	ask
🟢	EX-11	BM25 by hand	ask
🟡	EX-12	The analyzer audit	ask
🔴	EX-13	Route α by query class	ask
🔴	EX-14	Beat the reranker	ask
⚫	EX-15	Make the dense leg earn its keep	ask
🟡	EX-16	Price your own k	ask
🔴	EX-17	Measure position sensitivity for real	ask
⚫	EX-18	Solve abstention	ask
🟡	EX-19	Calibrate a judge against humans	ask
🔴	EX-20	Build a third bias probe	ask
🟡	EX-21	Cost model for a real client shape	ask
⚫	EX-22	Fix evidence retention	ask

Difficulty: 🟢 first exercise · 🟡 needs a measurement · 🔴 a cohort project · ⚫ open research

How to submit

1. Post it in Show and Tell titled [solution · EX-NN] ..., with your numbers, your interval, and what you tried that did not work.
2. Reviewers reply with a measurement, not an opinion.
3. If it changes code, open a PR that links the thread.