Biology • Year 12 • Module 8 • Lesson 13
Analysing Epidemiological Data — Pattern Recognition and Risk Factor Quantification
Apply risk measure calculations to real trial data, read and interpret a Kaplan-Meier survival graph, evaluate a study's limitations, and critique a misleading media claim.
1. Calculate and interpret risk measures — Heart Protection Study (2002)
The Heart Protection Study (HPS), published in The Lancet in 2002, recruited 20,536 patients with existing cardiovascular disease and randomly assigned them to simvastatin 40 mg/day or placebo over a mean follow-up of 5 years. The primary outcome was a major vascular event (heart attack, stroke, or revascularisation). The table below shows selected results. 8 marks
| Group | Patients | Major vascular event | Event rate (%) |
|---|---|---|---|
| Simvastatin | 10,269 | 2,033 | 19.8% |
| Placebo | 10,267 | 2,585 | 25.2% |
Source: Heart Protection Study Collaborative Group (2002). MRC/BHF Heart Protection Study. The Lancet, 360(9326), 7–22.
1.1 Calculate the relative risk (RR) of a major vascular event in the simvastatin group compared to placebo. Show your working. 2 marks
1.2 Calculate the absolute risk reduction (ARR) and number needed to treat (NNT) over 5 years. Interpret the NNT in plain language. 3 marks
1.3 A journalist reports: "Statins slash heart attack risk by 24%." Calculate the relative risk reduction (RRR) and explain why the journalist's figure is not wrong but could mislead a low-risk patient. 3 marks
2. Interpret a Kaplan-Meier survival curve — melanoma immunotherapy trial
The figure below is based on the pattern of results from the CheckMate 067 trial comparing nivolumab plus ipilimumab (combination immunotherapy) versus ipilimumab alone (chemotherapy-era standard) in advanced melanoma. Values are stylised for worksheet use. 7 marks
Figure 2. Overall survival in advanced melanoma. Stylised from Larkin et al. (2019). CheckMate 067. New England Journal of Medicine, 381(16), 1535–1546. Tick marks indicate censored patients.
2.1 Read the graph: at 24 months, estimate the overall survival proportion for each group, and calculate the absolute difference in survival between groups at that time point. 2 marks
2.2 The curves diverge from approximately month 6 and continue to separate through month 60. Explain what this divergence pattern suggests about how combination immunotherapy works over time compared to ipilimumab alone. 2 marks
2.3 What does the small vertical tick mark at approximately month 17 on the combination immunotherapy line represent? What does the presence of multiple tick marks tell you about the study? 2 marks
2.4 State one conclusion that IS supported by this graph and one conclusion that is NOT supported. 1 mark
3. Evaluate a study — APBR pain relief trial
Read the study description below and answer all sub-questions. 8 marks
Study description. A 10-week single-blind RCT examined the effect of a new non-steroidal anti-inflammatory drug (NSAID) on knee osteoarthritis pain in 90 participants recruited from a single Sydney rheumatology clinic. 45 received the new NSAID; 45 received an existing standard-of-care NSAID. Clinicians knew which treatment each patient received. The primary outcome was self-reported pain reduction on the WOMAC scale at 10 weeks. Results: 58% of new NSAID patients reported ≥30% pain reduction vs 40% of standard NSAID patients (p = 0.048). Patients with severe kidney impairment, aged over 75, or on anticoagulants were excluded. The company that makes the new NSAID funded the trial.
3.1 Calculate the ARR and NNT for this trial. 2 marks
3.2 Identify and explain two specific methodological limitations that reduce confidence in this trial's conclusions. 4 marks
3.3 p = 0.048 is statistically significant. Identify one reason why a clinician should not immediately switch all patients to the new NSAID based on this evidence alone. 2 marks
4. Predict and justify — changing the study design
Researchers plan to conduct a follow-up trial of the same NSAID from Q3 above, but make three design changes: (1) increase sample size to 1,200 participants across 8 Australian hospitals; (2) make it double-blind; (3) extend follow-up to 24 months. 5 marks
4.1 Predict how each of the three design changes would affect the reliability and generalisability of the results, and why. You must address all three changes. 3 marks
4.2 Even with all three improvements, identify one limitation that cannot be removed by these design changes. Justify your answer. 2 marks
Q1.1 — Relative risk (Heart Protection Study)
RR = risk in simvastatin group ÷ risk in placebo group = 19.8% ÷ 25.2% = 0.786 ≈ 0.79 [1 mark for correct calculation]. This means the simvastatin group had approximately 79% of the risk of the placebo group — about 21% lower relative risk [1 mark for correct interpretation].
Q1.2 — ARR, NNT and interpretation
ARR = 25.2% − 19.8% = 5.4 percentage points (0.054) [1 mark]. NNT = 1 ÷ 0.054 ≈ 19 [1 mark]. Plain language: approximately 19 high-risk patients with existing cardiovascular disease must take simvastatin for 5 years to prevent one additional major vascular event (heart attack, stroke, or revascularisation) compared to placebo. For a high-risk group, NNT = 19 is considered clinically meaningful [1 mark for interpretation].
Q1.3 — RRR and the misleading headline
RRR = ARR ÷ risk in control = 5.4% ÷ 25.2% ≈ 21.4% ≈ 21% [Note: the trial's reported headline figure of ~24% reflects a more refined statistical model; accept 21–24%]. [1 mark for correct method]. Why it could mislead a low-risk patient: the 24% (or ~21%) RRR is accurate but is calculated relative to the HPS patients' baseline event rate of 25.2%, which is very high (existing CVD). If the same drug is given to a low-risk person with an event rate of only ~5% over 5 years, a 21% RRR would translate to an ARR of only ~1% and an NNT of ~100 — far less impressive in absolute terms. A low-risk patient hearing "24% risk reduction" may overestimate their personal benefit [2 marks for complete explanation].
Q2.1 — 24-month survival values
At 24 months: combination immunotherapy ≈ 0.70 (70%); ipilimumab monotherapy ≈ 0.47 (47%) [1 mark for reading both values, ±0.05 acceptable]. Absolute difference = 70% − 47% = approximately 23 percentage points — roughly 23% more patients in the combination group were alive at 24 months [1 mark].
Q2.2 — Diverging curves interpretation
The curves diverge from ~month 6 and continue to separate through 60 months, meaning the survival advantage of combination immunotherapy grows over time rather than diminishing [1 mark]. This is consistent with the mechanism of immunotherapy: nivolumab and ipilimumab block immune checkpoints (PD-1 and CTLA-4), releasing the patient's own T-cells to attack melanoma cells and establish immunological memory. This durable immune response provides continuing benefit over time, producing a progressively wider gap compared to ipilimumab alone, which has a more limited and shorter-lived immune activation [1 mark].
Q2.3 — Censoring tick marks
The vertical tick mark represents a censored patient — a participant who left the study before experiencing the primary outcome (death), either because the study ended, they were lost to follow-up, or they withdrew [1 mark]. Multiple censoring marks indicate that not all participants reached the end of follow-up — a common feature of clinical trials. This is important because survival estimates become less reliable later in follow-up when fewer participants remain "at risk", so caution is needed when interpreting the far-right portion of the curve [1 mark].
Q2.4 — Supported and unsupported conclusions
Supported: At 60 months, a higher proportion of patients who received combination immunotherapy remained alive compared to those who received ipilimumab alone (approximately 52% vs 24%). Not supported: That combination immunotherapy cures advanced melanoma — 48% of combination patients also died within 60 months, and we do not know what happens beyond 60 months. [½ mark each — 1 mark total].
Q3.1 — ARR and NNT for NSAID trial
ARR = 58% − 40% = 18 percentage points (0.18) [1 mark]. NNT = 1 ÷ 0.18 ≈ 5.6, so approximately 6 patients [1 mark]. For every 6 patients treated with the new NSAID instead of standard NSAID, one additional patient achieves ≥30% pain reduction at 10 weeks.
Q3.2 — Methodological limitations (2 marks each)
Limitation 1 — Single-blind design (2 marks): Clinicians who know which patients received the new NSAID may unconsciously rate or document those patients more favourably, or encourage them to report greater improvement during assessments (assessment bias). For a subjective outcome like self-reported pain on the WOMAC scale, assessor knowledge of treatment allocation substantially undermines confidence in the result. Double-blinding (where both patients and all assessors are unaware of allocation) would be required to rule this out [2 marks for identifying the limitation AND explaining how it affects the conclusion].
Limitation 2 — Industry funding / single site / small sample (any one fully explained): (a) Industry funding: the manufacturer of the new NSAID funded the trial, which creates a conflict of interest — industry-funded trials are statistically more likely to report favourable results than independently funded trials, possibly through selective outcome reporting or endpoint choice. This does not invalidate the result but reduces confidence without independent replication [2 marks]. OR (b) Small sample from one clinic: 90 participants from a single Sydney rheumatology clinic is a small, geographically narrow sample. Patients at this clinic may differ systematically in age, comorbidities, or prior treatment history from the broader Australian osteoarthritis population, limiting generalisability [2 marks]. OR (c) Short follow-up: 10 weeks may not be sufficient to capture clinically relevant outcomes for a chronic condition like osteoarthritis — late-onset adverse effects, the sustainability of pain relief, and disease modification over time are all unmeasurable from this trial [2 marks].
Q3.3 — Why not immediately switch all patients
p = 0.048 is barely above the conventional 0.05 threshold — with a small sample (90 patients), there is a higher probability this represents a chance finding or is sensitive to minor analytical choices [1 mark]. Additionally, the trial excluded patients over 75, with severe kidney impairment, or on anticoagulants — precisely the patients most likely to need osteoarthritis pain relief in real practice. The drug's safety and efficacy in these excluded populations is completely unknown, meaning the result cannot be generalised to a large proportion of the real clinical population [1 mark].
Q4.1 — Impact of three design changes
(1) Larger sample (1,200) across 8 hospitals: Increases statistical power to detect a real but modest effect (reduces false-negative risk), and improves generalisability — multiple sites with different patient demographics and clinical practices provide a more representative sample of the broader Australian osteoarthritis population [1 mark]. (2) Double-blinding: Eliminates assessment bias by ensuring clinicians cannot unconsciously influence how they assess or record outcomes based on knowing treatment allocation. For a subjective outcome like pain, this is essential for a reliable result [1 mark]. (3) 24-month follow-up: Captures sustained efficacy (whether pain relief persists), allows detection of late-onset adverse effects, and is more clinically relevant for a chronic condition like osteoarthritis, where long-term management is the goal [1 mark].
Q4.2 — Limitation that cannot be removed
The industry funding conflict of interest cannot be removed by these design changes — the manufacturer still has a financial interest in a positive result [1 mark]. Even a perfectly designed trial can be selectively reported (outcome-switching, publication of only the favourable findings, suppression of adverse event data). The only resolution is independent replication by researchers with no financial ties to the manufacturer, and ideally inclusion in an independent systematic review [1 mark for explaining how this persists despite design improvements].