- Study method affects the strength of epidemiological evidence.
- Bias is a systematic error that can distort results.
- Confounding occurs when another factor partly explains the pattern.
- Evaluation needs a judgement, not just a description.
Year 12 Biology
Module 8 · IQ3
⏱ ~45 min
Practice bank · 3 Short Answer
Lesson 13 of 21
Data analysis focus
Evaluating Epidemiological Study Methods
A study's conclusion is only as strong as its method. Learn how design, sampling, bias, confounding and follow-up affect what epidemiological evidence can prove.
Today's hook: Two studies report the same disease pattern, but one is a small survey and the other follows thousands of people over ten years. Should you trust them equally?
0/5TASKS
Warm up first
Three quick questions from earlier lessons. Pulling old material back to mind before you learn something new makes the new material stick better, so this is not busywork.
Worksheets
Practise this lesson
Four printable worksheets that build from the foundations up to exam-style questions, start at whatever level suits you.
Lesson map
Method -> evidence -> judgement
Use a study checklist to decide whether a conclusion is well supported.
- 1Identify the design.Different study designs answer different questions.
- 2Test the method.Look for sample size, control groups, bias and confounding.
- 3Judge the claim.State what the method supports and what it cannot prove.
Know what matters
- Cohort, case-control, cross-sectional and RCT designs have different strengths.
- Blinding, controls and follow-up can improve study quality.
- Statistical significance is not the same as practical importance.
- Absolute risk reduction, relative risk reduction and NNT.
- Systematic reviews and replication.
- Survival curves and endpoint selection.
0
Predict first: what weakens the claim?
connectA survey finds people who eat breakfast report lower heart disease rates. Which issue most directly limits a causal claim?
1
Key vocabulary, translated
vocabMethodhow the study was designed and conducted
Biassystematic error that pushes results away from truth
Confounderthird factor that can partly explain a pattern
Control groupcomparison group without the tested intervention or exposure
Sample sizenumber of people or records included
True or false: a large sample automatically removes all bias.
2
What each design is good for
applyCohort
Follows people over time. Strong for showing exposure before disease.
Case-control
Starts with people who have or do not have the disease. Useful for rare diseases.
RCT
Randomly allocates a treatment or prevention strategy. Strong for testing interventions.
Cross-sectional studies take a snapshot at one time. They are useful for prevalence, but weaker for proving which factor came first.
Build an evaluation+7 XP
Put the study-evaluation steps in order.
- Identify one limitation such as bias, confounding or short follow-up.
- Name the study design.
- Judge whether the conclusion is strong, limited or not supported.
- State one strength of the method.
3
From data to a fair claim
explainA strong answer separates what the study found from what the study proves. "Associated with lower risk" is safer than "causes lower risk" unless the method controls competing explanations.
HSC exam move
For "evaluate the method", write: design, strength, limitation, judgement. Use exact evidence from the stimulus when it is provided.
4
Choose your route
differentiateUse the frame to evaluate one study method.
Compare a cohort study and an RCT for testing a prevention strategy.
A headline reports a large relative risk reduction. Explain one extra number you would request before judging importance.
5
Exit check
retrieveMemorise
Bias, confounder, control group, cohort, case-control, RCT.
Understand
Methods determine how strongly a study supports its conclusion.
Apply
Evaluate a method by naming strengths and limitations.
Avoid
Do not call a weak association proof of causation.
01
Multiple Choice
+5 XP
A fresh set drawn from this lesson's question bank, feedback shown immediately. +5 XP per correct · +25 XP all correct
Pick your answer, then rate your confidence, that tells the system what to drill next.
02
Short Answer, 15 marks
+5 XP
ApplyBand 4(4 marks) 1. A cohort study finds that an exposure is associated with disease. Use the evaluation frame: name the design, one strength, one limitation and a justified conclusion.
AnalyseBand 4–5(5 marks) 2. Compare a cohort study and an RCT for testing a prevention strategy. Include one strength and one limitation of each.
EvaluateBand 5–6(6 marks) 3. A headline claims a prevention program “cuts risk by 40%”. Explain one extra number you would request, then evaluate why a headline alone is not enough evidence for a health decision.
Show all answers
Multiple choice
MC answers and full explanations are shown inline as you complete each question. Use the retry button to attempt a fresh set from the lesson bank.
Short Answer Model Answers
SA1 (4 marks): ARR = 20% − 11% = 9 percentage points (0.09) [1]. NNT = 1 ÷ 0.09 ≈ 11, for every 11 patients treated, one extra recurrence is prevented [1]. Verification: RRR = 9% ÷ 20% = 45%, confirming the headline is the relative risk reduction [1]. Why it misleads: the 45% is relative to the 20% baseline; a patient may interpret "slashes risk by 45%" as their personal risk falling 45 percentage points (to near zero), whereas it actually falls from 20% to 11%, a 9 percentage point absolute reduction. The benefit is real but far smaller than the headline implies [1].
SA2 (5 marks): What the data shows: at 3 years, 60% of targeted-therapy patients were alive vs 35% on chemotherapy, a 25 percentage point absolute difference, statistically significant (p < 0.001) and clinically meaningful, roughly doubling 3-year survival [1]. What it does NOT show: (1) survival beyond 3 years (curves may converge later); (2) toxicity/quality-of-life profile; (3) whether results generalise, targeted therapies usually benefit only patients with specific tumour mutations, so a mutation-selected trial population may not represent all lung cancer patients [2]. Additional information needed: mutation profiling, longer-term (5–10 yr) survival data, toxicity comparison, cost-effectiveness, and head-to-head data in mutation-positive vs mutation-negative groups [1]. Conclusion: replacing chemotherapy for ALL patients is premature, the data justifies prioritising the therapy for mutation-positive patients but not universal adoption [1].
SA3 (6 marks): Strengths of individual RCTs: randomisation distributes known and unknown confounders equally; double-blinding reduces performance and detection bias; a well-powered RCT with a pre-specified outcome is the strongest single study for establishing efficacy and causation [1.5]. Limitations: (1) chance, even a good RCT carries ~5% false-positive risk; (2) publication bias overstates efficacy if negative trials go unpublished; (3) narrow eligibility limits generalisability; (4) small trials may produce significant subgroup results by chance [2]. Role of systematic review/replication: pooling independent RCTs increases power and averages out chance; pre-specified inclusion minimises selection bias; publication bias can be assessed; consistency across trials (a Bradford Hill criterion) increases confidence [1.5]. When a single RCT may justify action: severe, life-threatening disease with no existing treatment, a large, well-powered, double-blind trial with a very large effect and clear mechanism. When to wait: minor condition, existing effective alternatives, modest effect, funding-bias concerns, or quality issues. Conclusion: the claim is overstated as a universal rule, single RCTs can change practice in specific high-stakes contexts but generally require replication and systematic review [1].
Check what actually stuck
Take the full module quiz
quiz
A full module quiz covering every lesson in this module, not just this one. Set aside a decent block of time and treat it like a real assessment.
Start the module quiz →Blast the Correct Answer
blaster
Defend your ship by identifying study designs, strengths, limitations and fair conclusions. Scores count toward the Asteroid Blaster leaderboard.
☄️ Play Asteroid Blaster →Race Through Study Evaluation!
Answer questions on cohort, case-control and randomised studies, then evaluate bias and confounding. Pool: lessons 1–13.
How did your thinking change?
Return to the breakfast survey from Think First. It reported an association between eating breakfast and lower heart-disease rates, but breakfast habits may also be linked with exercise, income and healthcare access.
Evaluate the method using the four-part frame from this lesson: name the likely design, state one strength, identify one limitation or confounder, and finish with a justified conclusion that does not overclaim causation.