Article Text

Download PDFPDF

A comparison of two primary care trials on tennis elbow: issues of external validity
  1. N Smidt1,2,
  2. M Lewis1,
  3. E M Hay1,
  4. D A W M Van der Windt2,
  5. L M Bouter2,
  6. P Croft1
  1. 1Primary Care Science Research Centre, Keele University, Keele, Staffordshire, UK
  2. 2Institute for Research in Extramural Medicine, VU University Medical Centre, Amsterdam, Netherlands
  1. Correspondence to:
    Dr Nynke Smidt
    Institute for Research in Extramural Medicine, VU University Medical Centre, Van der Boechorststraat 7, 1081 BT Amsterdam, Netherlands; n.smidtvumc.nl

Abstract

Objective: To assess clinical heterogeneity across two studies with respect to study population, interventions, and outcome measures, and to evaluate the influence of these sources of heterogeneity on the results of the studies.

Methods: The individual patient data were used from two randomised controlled trials investigating the effectiveness of conservative treatments in patients with tennis elbow in primary care. Patients were allocated at random to treatment with steroid injection, wait and see policy, non-steroidal anti-inflammatory drugs, placebo tablets, or physiotherapy. Outcome measures included severity of the main complaint, inconvenience of the elbow complaints, pain during the day, elbow disability, pain-free grip strength, and global improvement. All outcomes were assessed at 1, 6, and 12 months after randomisation.

Results: The two study populations were similar with respect to age, sex, comorbid neck/shoulder complaints, and baseline scores for the severity of pain. However, significant differences were observed for employment status, duration of elbow complaints, dominant side affected, previous history of elbow complaints, and use of analgesics. Local injections differed between the two studies with respect to volume, number, and steroid preparation. However, after 1, 6, and 12 months, the treatment effects of steroid injections were very similar between the study populations.

Conclusions: Despite large differences in study population at baseline, the responses to steroid injections were remarkably similar. Also the responses to other conservative interventions and the placebo treatment were very consistent, suggesting a uniform course of a tennis elbow and a lack of influence of clinical heterogeneity.

  • NSAID, non-steroidal anti-inflammatory drug
  • RCT, randomised controlled trial
  • tennis elbow
  • randomised controlled trial
  • physiotherapy

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Lateral epicondylalgia (tennis elbow) is a common musculoskeletal problem. The incidence is estimated to be 4–7 per 1000 patients per year in general practice,1 and between 1% and 3% per year in the adult general population.2–5 Recently, Assendelft et al summarised the available evidence on the effectiveness of various treatment options for lateral epicondylalgia.6 They concluded that topical non-steroidal anti-inflammatory drugs (topical NSAIDs) are effective for short term pain relief, and that oral NSAIDs are likely to be beneficial. Limited evidence was found for the short term effectiveness of steroid injections compared with placebo, local anaesthetic, elbow strapping, or physiotherapy. Although the randomised controlled trial (RCT) is the gold standard for evaluating the effectiveness of interventions, it is always open to question whether the results can be generalised to other populations.

We compared two large pragmatic randomised controlled trials in primary care investigating conservative treatments for lateral epicondylalgia that were remarkably similar in their outcome measures, interventions, and study populations.7,8 To investigate the generalisability of the results of these RCTs concerning the effectiveness of conservative treatments for lateral epicondylalgia,7,8 we determined the clinical heterogeneity across the two studies for study population, interventions, and outcome measures, and evaluated the influence of these sources of heterogeneity on the results of the studies.

METHODS

One RCT was carried out by Hay et al and compared the effectiveness of local injection of 20 mg methylprednisolone plus lignocaine (lidocaine), naproxen 500 mg twice daily for two weeks, and placebo tablets in 164 patients with a new episode of lateral epicondylalgia in North Staffordshire and South Cheshire, United Kingdom.7

The second RCT was carried out in Amsterdam and its vicinity in the Netherlands by Smidt et al.8 In this study, 185 patients with a new episode of lateral epicondylalgia were allocated either to a local injection of 10 mg triamcinolone acetonide and lignocaine, physiotherapy, or a wait and see policy of ergonomic advice and pain medication.8

Study population

In both studies, consecutive patients who consulted their general practitioner (GP) for elbow pain were eligible for participation. The following inclusion criteria were applied in both studies: clinical diagnosis of lateral epicondylalgia; age between 18 and 70 years; and ability to fill in questionnaires and give informed consent.

Exclusion criteria in both studies included the following: contraindications to the treatments evaluated; previous surgery of the elbow; congenital or acquired deformities of the elbow; presence of signs and symptoms suggesting some other cause of lateral elbow pain (for example, cervical radiculopathy); and systemic musculoskeletal or neurological disorders. However, Hay et al7 excluded patients who had consulted their GP for their elbow pain during the preceding 12 months, whereas Smidt et al8 excluded patients who had been treated with physiotherapy or injection in the previous six months, patients with bilateral elbow complaints, and those with symptoms of less than six weeks’ duration.

In both studies, patient characteristics and potential prognostic factors were recorded by a research nurse at the initial visit before randomisation. Demographic and clinical characteristics included age, sex, employment status, duration of the elbow complaints, presence of neck or shoulder pain, previous elbow complaints, and use of analgesics. The patients were also asked what they thought was the cause of their elbow complaint.

Outcome measures

Both studies assessed the following:

  • the severity of the main complaint;

  • inconvenience of the elbow complaints;

  • pain during the day;

  • elbow disability;

  • pain-free grip strength at baseline and during follow up at 1, 6, and 12 months.

For three of these outcome measures, minor differences were found between the scales used in the two studies: severity of the main complaint, inconvenience of the elbow complaints, and pain during the day. Hay et al7 used a 10 point Likert scale whereas Smidt et al8 used an 11 point Likert scale. Also, different versions of the Pain-free Function Questionnaire9 were used to assess elbow disability: Hay et al7 used the eight item tool with binary response options whereas Smidt et al8 used the 10 item tool including five point Likert options. To standardise scores across the two studies, all outcome measurements were transformed to 0 to 100 scales, where 100 indicates maximum severity.

The two studies used different instruments for the measurement of grip strength (hand held dynamometer by Hay et al7; Jamar hand dynamometer by Smidt et al8), and so for comparison purposes, the ratio of grip strength in the involved to the uninvolved arm was calculated and multiplied by 100 (a higher score indicates better grip strength).

General improvement was measured in both studies directly after the intervention period. However, Hay et al7 used a five point Likert scale (complete recovered, improved, no change, worse, much worse), whereas Smidt et al8 used a six point Likert scale (completely recovered, much improved, improved, no change, worse, much worse). For the computation of success rates, patients who rated themselves “completely recovered”, “much improved”, or “improved” were counted as successes.

Treatments

In the study of Hay et al, 53 patients were treated with a steroid injection, 53 received naproxen, and 58 received placebo tablets.7 In the study of Smidt et al, 64 patients were allocated to physiotherapy treatment, 62 received a steroid injection, and 59 were treated according to a wait and see policy.8

Statistical analysis

The data analysis was based on the individual patient data from both RCTs and was carried out using SPSS.10 Descriptive statistics were used to analyse differences in patient characteristics and outcome measures between the two study populations, and describe the course of symptoms. The Student t test was used for ordinal and continuous outcomes and the χ2 test for dichotomous outcomes.

To compare treatment effects between the two trials, the following interventions were included: injection versus NSAID or placebo (NSAID and placebo had similar effect)7; and injection versus wait and see policy.8 For this analysis, the physiotherapy group was excluded, as it was only a treatment option in one of the trials. The main outcome measures in the two studies were “pain during the day” and global assessment of change (“improvement” versus “no improvement”) at a six week follow up.

Multiple regression (linear regression for pain during the day, and logistic regression for global assessment of change), including the treatment × study interaction was used to test the differences in treatment outcome across study populations. If the interaction was not statistically significant, suggesting that the treatment effect was consistent across the two study populations, the interaction term was dropped and differences in treatment outcome were studied in the combined dataset.

In addition, in order to estimate and compare the overall effectiveness of the interventions during the one year follow up, the area under the curve (AUC) for “pain during the day” was calculated.

RESULTS

Study population

In all, 182 patients had consulted the participating general practices (n = 23) in the UK and 164 (90.1%) had finally been enrolled in the trial. Reasons for exclusion were: no informed consent (n = 12), exclusion criteria (n = 5), and inclusion criteria (n = 1). In the study of Smidt et al, 185 (71.4%) of 259 patients consulting participating GPs (n = 85) in the Netherlands were finally included in the trial. Reasons for exclusion were: no informed consent (n = 17), exclusion criteria (n = 52), and inclusion criteria (n = 5).

Table 1 shows the demographic and clinical characteristics and measurements for the two studies at baseline. The study populations were similar with respect to age, sex, and comorbid neck and shoulder complaints. Mean age of the patients in both studies was 48 years and almost 50% of the study population were female.

Table 1

 Patient characteristics at baseline*

However, significant differences were observed for employment status, duration of elbow complaints, proportion of patients with the dominant side affected, previous history of elbow complaints, and use of analgesics. Also, the patients’ attributed causes of their elbow complaints were less often identified in the study by Hay et al.7

With respect to sociodemographic and clinical characteristics, the mean severity of pain at baseline was similar in the two study populations, but self reported disability was greater among participants in the study by Hay et al.7 By contrast, severity of the main complaint, severity of the inconvenience of elbow complaints, and the pain-free grip strength were significantly worse in the study by Smidt et al.8 There was little change in these baseline measures after controlling for differences in sociodemographic and clinical characteristics (table 1).

Figure 1 presents the course of “severity of pain during the day” for each intervention, except the physiotherapy treatment. After 12 months of follow up, a decrease in pain during the day was found for almost all patients (89%), regardless of their treatment. The course of patients who received a corticosteroid injection (n = 115) was remarkably similar in the two studies. After one month a large decrease in pain was found for patients treated with a corticosteroid injection. Many of these patients reported relapses or recurrences after six and 12 months of follow up. The course of pain during the day in patients who received NSAIDs, placebo tablets, and a wait and see policy was also quite similar (fig 1).

Figure 1

 The severity of pain during the day at baseline and during follow up at 1, 6, and 12 months after randomisation for each intervention separately.

Overall at six weeks, there was improvement in 106 (65%) of 164 patients in the UK and 158 (85%) of 185 patients in the Netherlands. Also, for the pooled database, there was an improvement in 110 (96%) of 115 patients given an injection and 101 (59%) of 170 patients not given an injection. Regression analysis using the pooled databases indicated no significant interaction effect between treatment and study for both outcome measures (pain during the day and global assessment of change) (p>0.05). A greater proportion of the Dutch study population than of the UK population showed improvement by six weeks (adjusted odds ratio (OR) (95% confidence interval (CI)) = 2.8 (1.4 to 5.4)), and less self reported pain (adjusted mean difference for pain during the day  = 7.3 (1.6 to 13.0)).

The area under the curve (AUC) for the injection group (n = 115) and no injection group (without physiotherapy) showed no significant differences between the studies, although the AUCs were lower (more pain relief) in Smidt’s than in Hay’s study (mean difference in AUC (95% CI) for the injection group = 101 (−284 to 487); mean difference in AUC for the no-injection group = 115 (−188 to 419)].

DISCUSSION

The comparison of baseline patient characteristics between two randomised controlled trials recruiting patients with lateral epicondylalgia from primary care in different countries suggests that there are clinical differences between the study populations. However, the influence of the clinical heterogeneity between the studies on the effectiveness of conservative treatments for lateral epicondylalgia seems to be low, as the effectiveness of steroid injections and treatment with NSAID, placebo tablets, or a wait and see policy were similar in the two trials. There was a remarkable similarity between the course of pain in patients who received an injection in both studies. We do not know the reason for the high rate of relapses or recurrences in patients who received a steroid injection. For example, could it be that a steroid injection is actually harmful in the long term in patients with a non-inflammatory condition such as lateral epicondylalgia? Alternatively, do patients overtax their elbow too quickly after the initial dramatic reduction in pain following an injection?

The differences between the two studies in the duration of the elbow complaints and previous episodes of elbow complaints could be directly explained by disparities in the defined selection criteria of the two studies. Smidt et al8 excluded recent onset episodes (less than six weeks) and this was reflected in the longer average duration of elbow complaints in their study. In contrast, Hay et al7 excluded patients who had episodes of elbow complaints in the previous year, resulting in a lower prevalence of past elbow complaints in their study population.

Furthermore, outcome measures used in both studies used different scales, which might explain the large differences in grip strength and elbow disability at baseline. The severity of pain during the day was the only outcome measure at baseline, which was comparable between the studies. To facilitate the interpretation and comparison of the results of various studies on lateral epicondylalgia, additional research is needed to standardise outcome measures. The incorporation of a standard set of outcome measures in all future RCTs on epicondylalgia would greatly enhance comparability of RCTs.

It is encouraging that recruiting patients from different countries and health care systems did not affect the important findings from these trials. Local corticosteroid injection was effective in the short term for treating lateral epicondylalgia but, crucially, does not improve long term outcome. The treatment effects in these two heterogeneous populations were similar for all interventions examined. These findings show that these trials have robust external validity and suggest that their results are generalisable to other primary care populations of patients with lateral epicondylalgia.7,8

Acknowledgments

The study of Hay et al was funded by the Arthritis Research Campaign and the study of Smidt et al by the Netherlands Organisation for Scientific Research (NWO) and the Fund for Investigative Medicine of the Health Insurance Council. The collaboration project was funded by The Netherlands Organisation for Scientific Research (NWO) and the North Staffordshire Primary Care Research Consortium.

REFERENCES

Footnotes

  • Published Online First 30 March 2005