Open Bench · Unit 7 of 8
Proving it worksHow do you actually know a medicine helped?
Students take apart two real published trials, one that worked and one that did not, and learn the single most transferable skill in the course: telling evidence from a story.
Length
60 minutes
Tracks
Explorer (Grades 6–8) · Builder (Grades 9–12)
Cost
Free, permanently
Licence
CC BY 4.0
Objectives
By the end of the hour, a student can do each of these without being prompted.
- 01
Explain why a control group is necessary, using an example where its absence misled people.
- 02
Define randomization and blinding and say what each one protects against.
- 03
Read a real trial's primary endpoint and judge whether the abstract describes it fairly.
- 04
Write a short, fair critique of a published study.
Run of show
The hour, minute by minute.
Timings are a plan, not a rule. The segment most worth protecting when you run late is noted in the teacher notes below.
- 10 min
The treatment that always works
Describe an impressive-sounding uncontrolled result. Ask what else could explain it. Students will generate the concept of a control group themselves within five minutes.
- 10 min
Randomize and blind
Two ideas, two examples of what goes wrong without them. Keep statistics entirely out of this segment.
- 20 min
Take apart a real trial
Work through the peanut prevention trial as a class. Find the primary endpoint, the comparison, and the actual numbers. Check the abstract against what the results section says.
- 15 min
The one that did not work
Now the trial where the skin intervention failed. Ask why a negative result is published at all, and what would have happened to the field if it had not been.
- 5 min
Your checklist
Students write their own five-question checklist for judging any future study. They will use it in the capstone.
The activity
The critique
- 1
Choose any trial from the Reading Room.
- 2
Write down its primary endpoint in your own words before reading the conclusion.
- 3
Find the actual numbers behind that endpoint in the results.
- 4
Judge whether the abstract's summary is fair to those numbers.
- 5
Write 300 words: what it showed, what it did not show, and what you would do next.
What you hand in
A 300-word critique. The best ones are published in our journal, and several are typically better than what gets written about these trials in the press.
Tools, all free
Our citation-checked paper list. Units 7 and 8 run entirely off it.
Free. Abstracts for everything, full text for a great deal.
Explorer track swap
Explorers run a live classroom experiment first, testing something harmless with a control group of their classmates, then apply the same logic to the published trial.
The misconception to expect
“If people got better after taking it, it worked.”
People also get better after taking nothing. Most conditions fluctuate, and most people seek treatment when they feel worst, so improvement is the expected result either way. Only the comparison tells you anything.
Teaching it
Notes from the room.
How you know it landed
A student has it when they read an impressive health claim in the wild and their first question is what it was compared against.
- 01
The negative trial is the more important half of this lesson. Protect its fifteen minutes even if the first half runs long.
- 02
Expect a student to bring up a supplement or remedy their family uses. Apply the checklist to it respectfully and let the checklist do the talking.
Reading for this unit
The papers behind the hour.
Optional for Explorers, expected for Builders. Full notes on each one are in the reading room.
- R-01
Follow-up to Adolescence after Early Peanut Introduction for Allergy Prevention
NEJM Evidence · 2024 · Free full text
Children who ate peanut from infancy to age five were followed to age twelve. At 144 months, peanut allergy was present in 4.4 percent of the early-eating group and 15.4 percent of the avoidance group. Protection held even though many children went years without eating peanut.
- R-02
Early food intervention and skin emollients to prevent food allergy in young children (PreventADALL)
The Lancet · 2022
A four-arm trial in Norway and Sweden tested introducing peanut, milk, wheat and egg from three months of age, applying skin emollients from two weeks, both, or neither. Early food introduction reduced food allergy at three years. The emollient arm did not.
- R-05
Efficacy and safety of oral immunotherapy in children aged 1–3 years with peanut allergy (IMPACT)
The Lancet · 2022 · Free full text
Peanut oral immunotherapy in toddlers was tested for desensitization at 134 weeks and, critically, for remission after a further 26 weeks off treatment. Separating those two endpoints is the point of the trial.
- R-08
Therapeutic responses to Roseomonas mucosa in atopic dermatitis may involve lipid-mediated TNF-related epithelial repair
Science Translational Medicine · 2020 · Free full text
Topically applying a harmless skin bacterium to fifteen children with eczema was associated with reduced severity, better barrier function, less Staphylococcus aureus, and lower steroid use. Improvement persisted up to eight months after treatment stopped.