Experiment — ⟨EN: short name⟩
Project ⟨Pnn⟩ · notebook entry ⟨NNN⟩ · ⟨date⟩
A lightweight companion to
notebook.mdfor a single sweep. Use this when an experiment is one variable and one afternoon; use the full notebook when it carries a hypothesis.
Question
⟨One sentence. What am I trying to find out?⟩
Independent variable
| Variable | |
| Values | |
| Verified to vary? | ⟨how you confirmed the sweep actually changes the thing you think it changes⟩ |
Held fixed
⟨Everything else. Being explicit here is what makes it a controlled experiment.⟩
Prediction
⟨Written before running. Specific enough to be wrong.⟩
| Value | Predicted outcome |
|---|---|
Shape I expect: ⟨linear / concave / a knee at X / no effect⟩
What would surprise me: ⟨...⟩
Setup
hardware :
software :
data :
seed :
trials :
command :
Measurement resolution: ⟨the smallest effect this experiment can distinguish from noise. If you are measuring a rate p, you need ~100/p trials for a 10% relative standard error.⟩
Results
| Value | Metric 1 | Metric 2 | p50 | p95 | p99 | n |
|---|---|---|---|---|---|---|
Verdict
| Prediction | confirmed / falsified / inconclusive |
| Gap | ⟨quantified⟩ |
| Shape | ⟨as predicted, or not⟩ |
Why
⟨The mechanism. If the prediction was wrong, what specifically was wrong in my model? Name a decision or a quantity, not a category.⟩
Secondary metric that explains it
⟨Which additional measurement closes the argument? If there isn't one, that is a finding: you are measuring the outcome but not the mechanism.⟩
What this changes
⟨A decision in the project, or a prediction for a later one. If nothing changes, say so — an experiment that changes nothing was worth running only if it ruled something out, and you should name what.⟩
Raw data
file :
commit :