Objectives To develop a core outcome set for lateral elbow tendinopathy (COS-LET) and to provide guidance for outcome evaluation in future studies.
Methods We implemented a multi-stage mixed-methods design combining two systematic reviews, domain mapping of outcome measurement instruments to the core domains of tendinopathy, psychometric analysis of instruments, two patient focus groups and a Delphi study incorporating two surveys and an international consensus meeting. Following the OMERACT guidelines, we used a 70% threshold for consensus.
Results 38 clinicians/researchers and 9 patients participated. 60 instruments were assessed for inclusion. The only instrument that was recommended for the COS-LET was Patient Rated Tennis Elbow Evaluation (PRTEE) for the disability domain. Interim recommendations were made to use: the PRTEE function subscale for the function domain; PRTEE pain subscale items 1, 4 and 5 for the pain over a specified time domain; pain-free grip strength for the physical function capacity domain; a Numerical Rating Scale measuring pain on gripping for the pain on activity/loading domain; and time off work for the participation in life activities domain. No recommendations could be made for the quality-of-life, patient rating of condition and psychological factors domains.
Conclusions The COS-LET comprises the PRTEE for the disability domain. Interim-use recommendations included PRTEE subscales, time off work, pain-free grip strength and a Numerical Rating Scale measuring pain on gripping. Further work is required to validate these interim measures and develop suitable measures to capture the other domains.
Data availability statement
All data relevant to the study are included in the article or uploaded as supplementary information. Not applicable.
This is an open access article distributed in accordance with the Creative Commons Attribution 4.0 Unported (CC BY 4.0) license, which permits others to copy, redistribute, remix, transform and build upon this work for any purpose, provided the original work is properly cited, a link to the licence is given, and indication of whether changes were made. See: https://creativecommons.org/licenses/by/4.0/.
Statistics from Altmetric.com
If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.
Background and objectives
Pain arising from the tendons on the lateral side of the elbow is common in adults, particularly in middle age.1 Historically, it has been known by various names such as lateral epicondylitis or tennis elbow, but the current accepted description is lateral elbow tendinopathy (LET).2 It is acknowledged that there is substantial heterogeneity of outcome measure instrument use in elbow research and specifically for LET.3 With no clear consensus on which instruments most accurately represent a patient’s LET-related health status, comparison of effectiveness research and evidence synthesis/meta-analysis has been hampered.
In 2019, an international group of experts in the field of tendinopathy (International Scientific Tendinopathy Symposium Consensus (ICON) Group), comprising researchers, healthcare professionals and patients, published a consensus document defining the nine health-related core domains of tendinopathy. That group recommended researchers and clinicians measure outcomes for specific regional tendinopathies against these domains.4
The aim of this project was to develop a core outcome set (COS) for LET that maps to the nine domains. A COS is a minimal set of outcome measures to be used in future research and clinical practice involving people with LET. It enables meta-analysis of findings from different studies using a consistent set of measures. To be included in a COS, measures need to be both practical to perform (based on cost, patient burden and availability) and of high quality (valid, responsive, reliable, interpretable and of acceptable burden for patients and investigators).5 The result will be a minimum set of outcome measurement instruments to be used in future LET research that allows direct comparison between different studies across the nine domains.
This COS relates to all adults diagnosed with LET and applies to interventional research (including surgical and non-surgical) and longitudinal assessment. The COS will only apply to the English language.
We designed the project following the COSMIN–COMET guideline.6 We developed a COS that was based on a consensus of perspectives gained from healthcare professionals with expertise in LET and patients with the condition. This involved a multi-stage stepwise process, which started with identifying the instruments used in studies of LET by updating a previous systematic evaluation of patient-rated outcomes for LET.7 These instruments were then mapped by the steering committee to the nine core tendinopathy domains.4 The mapped outcome measurement instruments were then subjected to the OMERACT truth (part a) and feasibility filters8 by participants in the first round of a Delphi survey. We (MB and JPE) then systematically evaluated the psychometric properties of the included instruments—applying the OMERACT truth (part b) and discrimination filters,8 using the EMPRO tool.9 This information then formed the basis of the second Delphi survey, which was conducted to make recommendations for a COS-LET. Focus groups were conducted with patients to review findings after Delphi survey 2. The results of the surveys and focus groups were then reviewed and discussed by participants at an international consensus online meeting (Delphi stage 3), before voting to determine the final COS-LET. The study was led by an international eight-person steering committee with expertise in LET—comprising a mix of junior and senior researchers and clinicians from surgical and physiotherapy backgrounds.
Protocol/ registry entry
We registered the project with the Core Outcome Measures in Effectiveness Trials Initiative (http://www.comet-initiative.org/Studies/Details/1497) and published the protocol in an open access journal. (https://trialsjournal.biomedcentral.com/articles/10.1186/s13063-021-05291-9). This report follows the COS Standards for Reporting checklist.10
The Delphi study population comprised of experienced clinicians and researchers nominated by the steering committee, identified by their reputation as elbow clinical specialists or prior publications related to LET. Additionally, a search of the Expertscape11 and SCOPUS12 databases by author and filtered by the terms ‘tennis elbow’ and ‘trial’ identified a list of other researchers to approach. Representation from a range of nationalities, with a spread of ethnicity and sex was ensured.
Patient representatives were invited by the clinicians on the steering committee.
In order to comprehensively evaluate all outcome measurement instruments used in research of LET, we systematically reviewed the literature. To do this, we updated the 2019, Evans et al,7 systematic review of English language instruments used in surgical and non-surgical trials for LET (census date: 1 May 2017). The search results were screened initially by title and abstract by two reviewers (MB and JPE) independently of each other using the online Rayyan tool13—any disagreements were discussed and reconciled. We included all study designs except research protocols, case studies and small case series of less than five patients. One hundred and ninety nine full texts from the original search and 93 from the updated searches (to February 2020) were screened down to 256 papers for data extraction—providing a comprehensive list of instruments used in LET research (figure 1). Extracted data included all outcome instruments used, number of patients included in the study and full details of any novel instruments.
Consensus process and outcome scoring
The retrieved instruments were then submitted to a stepwise consensus process that mapped them to the core tendinopathy domains. The mapped instruments where then used to construct the first survey. The instruments agreed to in that survey were then evaluated for their psychometrics—the results of which were included in a second survey. Results of the surveys were discussed in two patient focus groups. Finally, a consensus meeting reviewed and discussed findings before voting on the final COS-LET.
Instruments mapped to domains: the steering committee members mapped each instrument to the nine core tendinopathy domains4: patient rating of condition; participation in life activities (day to day, work and sport); pain on activity/loading; function; psychological factors; physical function capacity; disability; quality of life; and pain over a specified time. Each instrument was mapped by two steering committee members independently, then compared and reconciled if needed—using the instrument’s published development study or manual.
Survey 1: each instrument and its reference document, including original development study and/or manual, were presented per mapped domain to participants in the first online survey using Qualtrics (Provo, Utah, USA). Participants were asked to respond yes/no/unsure whether each instrument was a truthful measure of the domain (valid), feasible to use clinically and whether it should be included in the COS-LET.
Outcomes were scored using the OMERACT traffic light system,8 whereby responses achieving <30% agreement were rated red and excluded; those achieving ≥70% were rated green and included; and those achieving 30%–69% were rated amber, inconclusive but not excluded.
Psychometric evaluation of instruments: following exclusion of instruments (<30% agreement in survey 1) and inclusion of any new instruments proposed by respondents, the OMERACT truth (part b) and discrimination filters were applied by two members of the steering committee (MB and JPE). This involved an update of Evans et al’s7 systematic review to identify instrument development or validation studies (figure 2). These members used the EMPRO tool, separately to each other, to assess the psychometric properties (construct validity, reliability, repeatability, responsiveness and interpretability) of each instrument, then meeting to discuss points of contention.9 These were resolved without the need of a third assessor. The steering committee then voted anonymously, using the OMERACT traffic light system, on whether each instrument should be considered ‘Good to go’, ‘A concern/more work needed’ or ‘Stop, do not continue’.8 This voting stage was included to ratify the psychometric evaluation process and was guided by an EMPRO score threshold of 40% for inclusion.
Survey 2: during the second Delphi survey, participants were presented with the findings of Delphi survey 1 (online supplemental file 1), showing the traffic light rating of each instrument within their associated matched domain, and subsequent outcome of the truth (part b) and discrimination filters (online supplemental file 2). Participants were asked to rate instruments that achieved a nominal EMPRO score of ≥40% for inclusion in the final COS-LET (yes/no/unsure). Those instruments that were no or unsure for the final COS-LET, had no psychometric data or had an EMPRO score of <40% were rated for interim use (yes/no). The responses were analysed and those instruments achieving <30% of votes were excluded.
Patient focus groups: results of the Delphi stages, inclusive of survey 2, were then discussed at an online patient focus group for UK patients and another for Australian patients. Patients were asked to provide their insights/perspectives on the decisions to date and to ratify any instruments voted ≥70%.
Final consensus meeting: participants attended an online consensus meeting to discuss the findings of the Delphi process to date (including patient focus group outcomes) and to vote on outcome measures in the COS-LET and for interim use. A report of the results of previous surveys and patient focus groups (online supplemental file 3) was provided to the participants 2 weeks prior.
For each domain, instruments voted for by ≥70% of participants in both surveys and at the meeting were included in the COS-LET. For domains where no instruments were agreed, interim suggestions were proposed based on a green light from Delphi survey 1 (≥70%), and amber light from Delphi survey 2 (30%–69%) and ≥70% agreement from the consensus meeting vote.
We commenced this study in January 2020, with regular steering committee working meetings to plan and design data collection. Data collection was completed at the consensus meeting on 5 May 2021.
The only deviation from the published protocol was that patient focus groups were conducted, rather than one-to-one interviews. This decision was taken to allow for patient interaction and group discussion, the impact of which on our findings is likely low to negligible.
We invited 58 healthcare professionals of which 40 agreed to participate, 7 did not agree (retired (2) and no reason given (5)) and 11 did not respond (maternity leave out of office message (1) and unknown reason (10)). Thirty eight engaged with the process and 2 withdrew. Thirty six (90%) of the clinicians/researchers who agreed to participate fully completed both surveys (table 1), 2 (5%) completed one survey and 31 (84%) of those completing surveys attended the online meeting. The clinician/researcher cohort consisted mainly of physiotherapists or orthopaedic surgeons, located in Europe or Australia, and had research higher degree training.
Nine patients from the UK and Australia participated in the study—7 completed the first survey and 5 participated in the focus groups.
Sixty unique instruments were identified from the first systematic review and included in survey 1 (table 2). From survey 1, three measures: pain on gripping, Patient Rated Tennis Elbow Evaluation (PRTEE)14–16 and Quick Disability of Arm, Shoulder and Hand Questionnaire (DASH),17 were the only ones reaching ≥70% for both the patient and the clinician/researcher groups. The Patient Specific Function Scale18 (function domain) and Tennis Elbow Functional Scale19 (both pain domains) were voted to be in the COS-LET by patients who commented favourably on the scores’ item level face validity—however, the lack of robust psychometric evaluation in LET populations precluded their inclusion following clinician/researcher evaluation (table 2). Twenty four instruments were excluded after this survey as they received <30% of votes for inclusion in the COS-LET by both patients and clinicians/researchers. Participants proposed an additional seven instruments (table 2).
Core outcome set
A search for studies of the measures with ≥30% responses from survey 1 revealed that only 8/21 (38%) instruments had been evaluated for their psychometric properties in specific LET populations. These measures were submitted to analysis with the EMPRO tool—scoring between 25% and 73% (table 3). The additional instruments proposed by responders in survey 1 had no psychometric data for the LET population and were not considered further in the development of the COS-LET. Seven instruments had an EMPRO score of ≥40 and received ≥70% of votes in survey 1 from either patients or clinicians/researchers—they were: DASH,17 20–22 Quick DASH,17 23 24 Oxford Elbow Score,25 26 PRTEE,14–16 Tennis Elbow Functional Scale,19 as well as grip strength.27–29 These were then independently assessed by the steering committee using the OMERACT truth (part b) and discrimination filters (results given in online supplemental file 2), which along with results from survey 1, were available to inform clinician’s/researcher’s decisions in survey 2. The results of survey 2 are presented in table 3—only the PRTEE met the threshold for inclusion in the COS-LET for the disability domain, which was ratified at the consensus meeting.
Where there was no measure in a domain that met the criteria for the COS-LET, we considered measures that reached ≥70% hurdle in survey 1—aiming to recommend one per domain to be used in the interim and as a direction for future research (table 3, Part B).
Of the measures that had psychometric data—that is, Tennis Elbow Functional Scale, maximum grip strength, pain-free grip strength and the PRTEE pain and function subscales—only the latter was voted as an interim measure in survey 2 (table 3). The patients (focus groups) agreed that items/subscales of the PRTEE (for pain on loading/activity, function and pain over specified time domains) and pain-free grip strength (for physical function capacity domain) were relevant to their condition. The consensus meeting decided that relevant subscale items from the PRTEE would be recommended as interim measures for function and pain over specified time domains. Pain-free grip strength was selected over maximum grip strength as it was thought to be more clinically and patient relevant. The meeting decided that pain on gripping, which had support in survey 1 but with no psychometric data, would be the preferred measure for pain on loading/activity domain, instead of the relevant subscale items from the PRTEE (table 3).
Of the other measures that did not have psychometric data (see table 3), only time off work was voted as an interim measure in survey 2—it was ratified at the consensus meeting.
Notably, after the consensus meeting, there were three domains for which no interim measures were agreed. These were: quality of life, participant overall rating of condition and psychological.
This is the first attempt to determine the minimum COS-LET. We reached agreement for an outcome measure for one of the nine tendinopathy domains—PRTEE for disability. Although the PRTEE has been found to be psychometrically robust, we note that the total EMPRO score was lower than other measures considered for inclusion. As previously identified, as the PRTEE was developed without patient involvement, its EMPRO score is, therefore, reduced as a consequence.7 However, the expert and patient groups within this COS development were concordant in their agreement that the PRTEE preferentially aligned with the disability domain. It was not possible to include measures in a COS-LET for the remaining domains, because there was either no instrument or a lack of instrument validation. In the interim, we decided on measures to recommend for validation studies and use in trials of LET.
The PRTEE function subscale was selected as an interim measure for the function domain, but concerns were raised that it mainly queries basic tasks and not higher-level tasks required in sports. This requires further investigation, along with the psychometric properties of the subscale. Patient responses from survey 1 favoured the Patient Specific Functional Scale for the function domain, but this was not supported by clinicians/researchers. This scale can be tailored to athletic/high-level tasks so may be an area for future investigation.
The pain over a specified time domain had no suitable instruments following survey 2. We resolved at the consensus meeting to recommend three questions from the PRTEE (pain at rest, least and worst over the last week) in the interim. The PRTEE had already been accepted for the COS-LET, thereby minimising patient burden—a key priority identified in the patient focus groups; however, the psychometric properties of these PRTEE items require further assessment.
Pain-free grip strength was recommended as an interim measure for physical function capacity domain, but it was not included in the final COS-LET due to limited validation in LET populations. With clear stakeholder approval, further validation work should be prioritised.
Measuring the pain on activity/loading domain was the source of a lengthy discussion, because the two options with sufficient psychometric evidence failed to reach consensus. Discussion then moved to rating pain on gripping as an interim measure. Gripping was raised as a common pain provoking activity in the patient focus groups. It had been voted in survey 1 to be in the COS-LET by patients and clinicians/researchers, but due to a lack of research it was not voted in survey 2. In the meeting, concerns were raised about standardising the gripping task—as this would be difficult across sexes and different work/sport contexts. We resolved to recommend using a Numerical Rating Scale to record pain during gripping in the interim and to prioritise its validation.
Time off work was recommended as an interim measure of the participation domain, but there were concerns regarding the definition of work and whether this was applicable to patients who were retired, unemployed, students or full-time parents/carers. Due to the value of using time off work as part of health economic evaluation, however, it was agreed that it should still be used in the interim. It was recommended that future research should consider how this measure may be individualised to a patient’s context.
No recommendations could be made for the domains of quality of life, patient rating of condition and psychology, primarily because there were no measures that had been validated for use in LET. For quality of life, the EQ5D narrowly missed interim selection and provoked mixed feelings from the patient focus groups. It was considered useful from a health economics perspective, for the calculation of quality adjusted life years.30 31 Of the three instruments considered for the patient rating of condition domain, the Global Rating of Change (GROC) was preferred by the patient focus groups and is also regarded as an appropriate anchor for responsiveness analysis of other outcome measures.32 33 The Single Assessment Numerical Evaluation34 was proposed as an alternative option with the advantage that it can be used pretreatment and posttreatment, rather than relying on symptom recall, like the GROC. For the psychology domain, patients indicated the Tampa Scale of Kinesiophobia35 was more representative of their condition than anxiety and depression scales. Future studies should investigate the psychometric properties of these instruments for the LET population.
Strengths and Limitations
A strength of this study is that we included experts in LET (ie, patients and clinicians/researchers) from across the globe and followed a robust methodology that was published in advance.
There are several limitations that need to be considered in implementing the findings of this study. First, the COS-LET was developed on the basis of previously agreed on core domains for tendinopathy and are dependent on that work—any changes to those core domains will require revision of the COS-LET. Second, we were unable to recommend outcome measures for all of the core domains of tendinopathy—in which case we made interim recommendations. These interim recommendations should not be misconstrued as being part of the COS-LET, because they were made on the basis of opinions of participants without appropriate instrument validation. Third, we restricted the study to English outcome measures—using the COS-LET in non-English language situations requires validation. Fourth, we did not include a patient in our steering committee.
Areas for future research
Future research is required to establish valid and feasible measures across all health-related tendinopathy domains in patients who have LET. We have identified some targets herein: PRTEE subscales/items, pain on gripping, GROC, EQ5D and Tampa Scale of Kinesiophobia.
The PRTEE should be used in all future studies related to LET—especially for the disability domain. Time off work, pain-free grip strength and a Numerical Rating Scale measuring pain on gripping should also be used until future studies recommend alternative, more robust, measures of participation in life activities, physical function capacity and pain on activity/loading. A COS-LET Tool, containing these recommended measures, has been composed (see online supplemental file 4). Further work is required to (a) validate the interim measures for use in research involving persons with LET and (b) develop/validate suitable measures of the patient rating of condition, quality of life and psychological factors domains.
What is already known?
Core outcome sets (COSs) are recommended for research and clinical practice to facilitate comparison and meta-analysis of results.
COSs for tendinopathies should map to the established list of nine core health-related domains.
Lateral elbow tendinopathy (LET) is a common clinical problem that has received considerable research attention.
There is no agreed COS-LET—limiting meta-analysis.
What are the findings?
The COS-LET consists of the Patient Rated Tennis Elbow Evaluation—it should be used to capture the disability domain in clinical settings and in all research of this condition.
The Patient Rated Tennis Elbow Evaluation and its subscales offer insights into the domains of pain and function in addition to disability.
When measuring participation, physical function capacity and pain on loading, we recommend as interim measures, respectively, time off work, pain-free grip strength and a numerical rating scale for pain on gripping.
Further work is required to validate many of the measures used in clinical practice.
How might it impact on clinical practice in the future?
Systematic use of the COS-LET will allow for meta-analysis of research studies and comparison of results between different clinical practices during service evaluation.
Meta-analysis and network meta-analysis across multiple research trials that apply the COS-LET will increase understanding of treatment effectiveness for people with LET.
Data availability statement
All data relevant to the study are included in the article or uploaded as supplementary information. Not applicable.
Patient consent for publication
This study involves human participants and was approved by the University of Queensland's research ethics committee (reference number: 2020001340). Participants gave informed consent to participate in the study before taking part.
The steering committee would like to acknowledge the contributions of the core outcome set for lateral elbow tendinopathy participant group, who donated their time voluntarily. Without them, this project would not have been possible.
This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.
MB and JPE are joint first authors.
Twitter @MarcusBatemanPT, @jon_evans_uk, @vianavuvan, @Valjones2305val, @myelbowdoc, @leannebisset, @Bill_Vicenzino
Collaborators COS-LET consensus group: Isabel Andia (BioCruces Health Research Institute, Spain), Paolo Arrigoni (Università degli Studi di Milano, Italy), Canan Aydin (Metin Sabanci Baltalimani Bone Diseases Training and Research Hospital, Turkey), Paul Barratt (Salford Royal Foundation Trust, UK), Ram Chidambaram (MGM Healthcare, India), Joshua Cleland (School of Medicine, Tufts University, Medford, Massachusetts, USA), Brooke Coombes (Griffith University, Australia), Uri Farkash (Assuta Ashdod University Hospital, Israel), Taco Gosens (Elisabeth Tweesteden Hospital, the Netherlands), Luke Heales (Central Queensland University, Australia), Martin Kroslak (University of New South Wales, Australia), Chris Littlewood (Manchester Metropolitan University, UK), Joy MacDermid (University of Western Ontario, Canada), George Murrell (University of New South Wales, Australia), Morten Olaussen (University of Oslo, Oslo, Norway), John Orchard (University of Sydney, Australia), Tuomo Pienimaki (Oulu Regional Institute of Occupational Health, Finland), Amar Rangan (James Cook University Hospital, UK), Eirik Solheim (University of Bergen, Norway), Dimitrios Stasinopoulos (University of West Attica, Greece), Jill Thomas (Wrightington, Wigan and Leigh NHS Foundation Trust, UK), Timothy Tyler (Lenox Hill Hospital, New York City, New York, USA), Danielle Van Der Windt (Keele University, UK), Roger Van Riet (Monica Hospital Antwerp, Belgium), Allan Wang (St John of God Subiaco Hospital, Australia), Esther Waugh (University of Toronto, Canada), Jennifer Moriatis Wolf (University of Chicago, Chicago, Illinois, USA), Tony Wright (Curtin University, Australia), Eva Zeisig (Umeå University, Sweden), Ming Hao Zheng (University of Western Australia, Australia), CH (patient representative, UK), Priyesh Mistry (patient representative, UK), RN (patient representative, UK), Ruth Newsome (patient representative, UK), MW (patient representative, UK), Mark Ford (patient representative, Australia), Karen Jackson (patient representative, Australia), Phuong Le (patient representative, Australia) and Joo Yeun Song (patient representative, Australia).
Contributors MB and JPE share joint first authorship and were responsible for study concept, design and the writing of this manuscript. BV was responsible for study concept, design, oversight and the writing of this manuscript. AW, JP, VJ, VV and LMB were responsible for study concept, design and the editing of this manuscript. All authors contributed to the conduct of the study and have approved the final version of the manuscript. MB is guarantor.
Funding This work is not funded and relies on the individuals involved donating their time. Open access publication fees were funded by the University Hospitals of Derby and Burton NHS Foundation Trust Charity.
Competing interests MB and JPE contributed equally and share first authorship. MB, JPE, AW, JP, VJ, VV, LMB and BV declare that they have no competing interests. The core outcome set for lateral elbow tendinopathy (COS-LET) consensus group has no competing interests except for Joy MacDermid, who is the author of the Patient Rated Tennis Elbow Evaluation (PRTEE). Her responses were removed from survey and consensus voting related to the use of the PRTEE in the COS-LET.
Provenance and peer review Not commissioned; externally peer reviewed.
Supplemental material This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.