Article Text

Download PDFPDF
Should this systematic review and meta-analysis change my practice? Part 2: exploring the role of the comparator, diversity, risk of bias and confidence
  1. Mervyn J Travers1,2,
  2. Myles Calder Murphy1,3,
  3. James Robert Debenham1,
  4. Paola Chivers4,
  5. Max K Bulsara4,
  6. Matthew K Bagg5,6,
  7. Thorvaldur Skulli Palsson7,
  8. William Gibson1
  1. 1 School of Physiotherapy, University of Notre Dame Australia, Fremantle, Western Australia, Australia
  2. 2 School of Physiotherapy and Exercise Science, Curtin University, Perth, Western Australia, Australia
  3. 3 Sports Science Sports Medicine Department, Western Australian Cricket Association, Perth, Western Australia, Australia
  4. 4 Institute for Health Research, University of Notre Dame Australia, Fremantle, Western Australia, Australia
  5. 5 Pain Research, Education and Management Program, Neuroscience Research Australia (NeuRA), Sydney, New South Wales, Australia
  6. 6 UNSW Prince of Wales Clinical School, Randwick, New South Wales, Australia
  7. 7 Laboratory for Musculoskeletal Pain and Motor Control, Center for Sensory-Motor Interaction (SMI), Department of Health Science and Technology, Aalborg University, Aalborg, Denmark
  1. Correspondence to Dr Mervyn J Travers, School of Physiotherapy, University of Notre Dame Australia, Fremantle, WA 6160, Australia; mervyn.travers{at}nd.edu.au

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Introduction

Systematic review and meta-analyses (SRMA) represent the highest quality of evidence of the effects of interventions and have the capacity to usefully inform clinical decisions, reduce research waste and direct policy making.1–4 Interventional SRMA often amalgamate the results of multiple randomised controlled trials (RCTs) to determine the magnitude of the estimate of the effect for a chosen intervention and to examine variation among study outcomes (heterogeneity).5 As such they represent the highest level of evidence to inform clinicians on the usefulness of a given treatment. Of course, the robustness of SRMA findings is dependent on the quality of the trials that have been pooled. The aim of this two-part Educational Editorial Series is to outline a process of scrutiny and analysis for SRMA to facilitate answering the important question ‘Should this SRMA change my practice?’. An understanding of key features of SRMA which have been outlined in related BJSM Educational Editorials is needed by clinicians in order to make this decision.2 6–10 Here, we present a worked example for clinicians illustrating some important considerations when reading an interventional SRMA. Specifically, we highlight the need to consider the pooling of comparators, clinical diversity, comparisons to active control, risk of bias and confidence in the results when interpreting interventional SRMA findings.

The example SRMA

The example SRMA investigated the efficacy of platelet-rich plasma (PRP) injections for tendinopathy.11 Based on data extracted from 16 RCTs (see online supplementary file 1 for a list of references), the authors reported a moderate treatment effect in favour of PRP with a standard mean difference (SMD) of 0.47 (95% CI 0.22 to 0.72, p<0.001). Part 1 of this Educational Editorial series demonstrated issues of methodological reporting, transparency and reproducibility which undermined the trustworthiness of this result and we presented a revised estimate of treatment effect of …

View Full Text

Footnotes

  • Contributors All authors contributed to the inception of the research idea. MJT, MCM and MKB performed the independent data extraction. WG provided oversight to the data extraction and associated disputes. MJT, WG and MCM performed the statistical analysis with oversight from PC and MB. All authors contributed to drafting/review of manuscript. MKB = Matthew K Bagg; MB = Max K Bulsara

  • Competing interests None declared.

  • Patient consent for publication Not required.

  • Provenance and peer review Not commissioned; externally peer reviewed.

Linked Articles