250 likes | 271 Views
Learn when and how to conduct systematic reviews and meta-analyses, their importance, challenges, and practical guidance for conducting comprehensive research projects. Understand the process, quality assessment, and reporting standards.
E N D
Systematic reviews and meta-analyses: when and how to do them Andrew Smith Royal Lancaster Infirmary 18 May 2015
Cochrane’s challenge ‘It is surely a great criticism of our profession that we have not organised a critical summary, by specialty or subspecialty, adapted periodically, of all relevant randomised controlled trials’
Systematic review ‘A review in which evidence on a topic has been systematically identified, appraised and summarised according to predetermined criteria’
Systematic review Decide scope and purpose (PICO) Exhaustive search for material Inclusion on pre-defined criteria Quality assessment of relevant studies Data extraction Synthesis and integration Interpretation
Primary and secondary research • Reviews are retrospective, observational studies and are subject to both systematic and random error • Bias can be reduced by applying the same principles in reviews as primary studies
Primary Recruitment Selection Allocation Detection Attrition Reporting Secondary Selection Publication Language Inclusion Appraisal Interpretation Bias
Heterogeneity Heterogeneity: variability in estimates of treatment effects between studies in a meta-analysis Significant heterogeneity suggest that trials are not estimating a single common effect – possibly due to differences in patients, setting, intervention and outcomes Can be clinical, methodological or statistical Can be explored by subgroup and sensitivity analyses Meta-regression can also be applied
Common ‘faults’ Too little thought Too many outcomes Too many subgroups ‘Lumping’ vs. ‘splitting’ Scoring risk of bias Not doing anything with quality assessment
Challenges in systematic reviews The RCT itself Anaesthesia/critical care Changing methodology New review types: DTA, non-randomised, prognostic, network meta-analysis False certainty
Challenges in systematic reviews The RCT itself Anaesthesia/critical care Changing methodology New review types: DTA, non-randomised, prognostic, network meta-analysis False certainty Uncertainty: inconclusive conclusions
The limits to knowledge certain doubtful unknown
When When you’re thinking about a research project When you need practical guidance When you really can’t do any primary research!
How Think first – write a protocol! Use PICO to specify the question Register the review Use ‘risk of bias’ tool for quality Get as many comments as possible Be explicit about process and judgements Be realistic about what can be achieved Use PRISMA tool for reporting