Development and validation of a new method for the registration of overuse injuries in sports injury epidemiology: the Oslo Sports Trauma Research Centre (OSTRC) Overuse Injury Questionnaire
- Correspondence to Benjamin Clarsen, Oslo Sports Trauma Research Center, Norwegian School of Sport Sciences, PO Box 4014 Ullevål Stadion, Oslo 0806, Norway;
- Received 28 June 2012
- Accepted 3 September 2012
- Published Online First 4 October 2012
Background Current methods for injury registration in sports injury epidemiology studies may substantially underestimate the true burden of overuse injuries due to a reliance on time-loss injury definitions.
Objective To develop and validate a new method for the registration of overuse injuries in sports.
Methods A new method, including a new overuse injury questionnaire, was developed and validated in a 13-week prospective study of injuries among 313 athletes from five different sports, cross-country skiing, floorball, handball, road cycling and volleyball. All athletes completed a questionnaire by email each week to register problems in the knee, lower back and shoulder. Standard injury registration methods were also used to record all time-loss injuries that occurred during the study period.
Results The new method recorded 419 overuse problems in the knee, lower back and shoulder during the 3-month-study period. Of these, 142 were classified as substantial overuse problems, defined as those leading to moderate or severe reductions in sports performance or participation, or time loss. Each week, an average of 39% of athletes reported having overuse problems and 13% reported having substantial problems. In contrast, standard methods of injury registration registered only 40 overuse injuries located in the same anatomical areas, the majority of which were of minimal or mild severity.
Conclusion Standard injury surveillance methods only capture a small percentage of the overuse problems affecting the athletes, largely because few problems led to time loss from training or competition. The new method captured a more complete and nuanced picture of the burden of overuse injuries in this cohort.
Overuse injuries, defined as those without a specific, identifiable event responsible for their occurrence, may be a substantial problem in many sports. They are thought to be the predominant injury type in sports that involve long, monotonous training sessions, for example, cycling, swimming and long-distance running,1–4 as well as in technical sports that involve the repetition of similar movement patterns such as throwing and jumping.5–7 They may also be common in team sports such as football, handball and volleyball, particularly at an elite level and among young athletes when the total load on the athlete from training and competition increases rapidly.8–10 However, when compared to acute, traumatic injuries such as anterior cruciate ligament ruptures and lateral ankle-ligament sprains, overuse injuries have received very little attention in the sports injury prevention literature.11 Valid and reliable data on their magnitude and severity are scarce in almost all sports, and there are very few studies specifically aiming to prevent overuse injuries in sport.12
One possible explanation for the lack of knowledge on overuse injuries is that their typical presentation and characteristics make them difficult to record in epidemiological studies, when currently accepted methods of injury registration are used.13 Symptoms such as pain or functional limitation most often appear gradually and may be transient in nature, and therefore it is likely that athletes will continue to train and compete despite the presence of overuse conditions, at least in the early phase. In the face of a worsening problem, athletes may try to adapt their training, for example, by refraining from the most aggravating activities or choosing an alternative form of exercise, and at some stage it is also likely that medical treatment will be sought for the injury. It is typically only after these attempts at injury management have failed that athletes will cease participation in training and competition. Furthermore, athletes may choose to defer time loss if possible, for example, by postponing rest or treatment until off-season periods which are not always covered in injury surveillance studies. Thus, it is likely that few overuse injuries lead to time loss from sport. In fact, cross-sectional surveys of athletes from a variety of different sports suggest that it is very common for athletes to continue to train and compete despite the presence of pain and reduced function from overuse injury.1 ,8 ,13–15
A vast majority of recently published injury surveillance, risk factor and prevention studies employ registration methods that are based on a consensus statement for the study of injuries in football, published in 2006 and later adapted for other sports.16–19 Under these methods, injuries are registered prospectively by researchers or team medical personnel over the course of a study, using one of several possible injury definitions; all physical complaints regardless of their consequences (any physical complaint definition), injuries leading to the athlete seeking attention from a qualified medical practitioner (medical attention definition), or injuries leading to the athlete being unable to fully participate in normal training and competition (time-loss definition). Of these injury definitions, it would seem that the first two would be most appropriate for recording overuse conditions, as a ‘time-loss’ definition would only capture the very worst problems, or the so-called tip of the iceberg. However, apart from special cases such as during short-duration tournaments,3 20–23 the ‘any physical complaint’ and ‘medical attention’ definitions are rarely used in injury studies.13 Furthermore, irrespective of the injury definition chosen, time loss remains a fundamental component of ‘standard’ registration methods as it forms the basis for the measurement of injury severity.
We have recently made recommendations for new methodology for measuring the occurrence and severity of overuse injuries in sport.13 We suggested that a questionnaire on overuse injuries should be administered to the entire cohort at regular occasions throughout the course of a study. The major benefits with this design would be that the degree of overuse symptoms could be determined for each athlete and monitored over time, and that injury severity measures could be based on changes in an athlete's function or sports performance limitation, rather than on the duration of time loss.
The primary objectives of this study were to develop such a method and to examine the extent to which it may provide greater information on overuse injuries in comparison to standard methods of injury registration. The first step in this process was to develop a new questionnaire suitable to measure the consequences of overuse injuries in sport. The questionnaire was then administered to a group of junior and senior elite Norwegian athletes from a variety of team and individual sports each week for a period of 3 months. During this time, injury registration was also conducted using standard methods as per current recommendations.16 ,17 ,19
Development of an overuse injury questionnaire
Question generation and reduction
A new overuse injury questionnaire was developed during a series of group meetings at our institution, attended by sports physiotherapists, medical practitioners, sports injury epidemiologists, athletes and experts in questionnaire design. The intention was to create a questionnaire that could be applied to any overuse injury problem in any area of the body; however, for the purposes of this study, we chose to focus on three common areas of overuse injury among athletes, the knee, lower back and shoulder.
During the initial meetings, a draft list of questions was prepared that included items on injury symptoms, the consequences of overuse injuries on sports participation and performance, and the degree to which injury affected physical functions such as jumping, lifting and throwing.
Interviews were then conducted with athletes and team clinicians from a variety of sports to determine what they considered to be important consequences of overuse injuries, and to provide feedback on the appropriateness and understandability of the draft questions. There was general agreement that pain, limited participation in training and competition, and reduced sporting performance were all important consequences of overuse injury, with several athletes indicating that, of these, limited sports participation was the most important injury consequence. However, several instances arose where athletes felt that the area-specific questions on physical function were irrelevant. For example, cross-country skiers felt that questions relating to jumping and throwing ability were not good measures of injury consequences for their sport.
We therefore chose to eliminate all questions that were area-specific and related to particular functional activities, and to concentrate on recording pain levels and the consequences of injury on sports participation and sporting performance. After a second round of athlete interviews, four questions were agreed upon that serve as the basis for the assessment of any anatomical area. Figure 1 shows these questions applied to the knee. In studies with multiple anatomical area of interest, the 4 questions are repeated for each area, such that a study of two areas would consist of 8 questions and a study of three areas would consist of 12 questions. In formulating these questions, we chose to use the term ‘problem’ rather than ‘injury’, because we felt that there was a much greater variation in athletes’ interpretation of the term ‘injury.’ Before each anatomical area, the term problem was defined, for example ‘pain, aching, stiffness, looseness or other complaints in one or both of your shoulders’ and ‘pain, aching, stiffness or other problems in your lower back’. We also decided not to ask athletes to attempt to differentiate between acute and overuse problems themselves, as some overuse injuries can have a rapid onset of symptoms and be experienced by an athlete as an acute injury.13 Instead, we used the questionnaire to gather information on all types of problems and then manually separated acute injury problems from overuse injuries in the dataset post hoc based on an interview by a sports physiotherapist.
The responses to each of the four questions shown above are allocated a numerical value from 0 to 25, and these are summed in order to calculate a severity score from 0 to 100 for each overuse problem. The response values were allocated such that 0 represents no problems and 25 represents the maximum level for each question. The values for intermediate responses were chosen in order to maintain as even a distribution from 0 to 25 as possible while still using whole numbers. Therefore, questions 1 and 4 are scored 0-8-17-25, and questions 2 and 3 are scored 0-6-13-19-25. The severity score can be used as an objective measure of the consequences of an overuse problem, and can also be plotted for each athlete and used to monitor the progress of overuse problems during the course of a study (see example of typical data in figure 2).
Analysis of psychometric properties of the questionnaire
A total of 1074 complete questionnaire responses from elite Norwegian athletes were analysed using SPSS statistics software (SPSS V.18, IBM Corporation, New York, USA) to determine the internal consistency of the questionnaire (Cronbach's α). A factor analysis was also performed using a principle component analysis extraction method. The component matrix was assessed in order to determine whether it would be necessary to weight the questions’ contribution to the injury severity score. If the factor loading of each question varied by less than 10%, this was taken as a sign that weighting the responses would be of little value.24
Determination of the face validity of the new method
In order to establish the face validity of the new method's ability to identify and measure overuse problems at the knee, lower back and shoulder, it was applied in a 3-month study of 313 elite Norwegian junior and senior athletes from a variety of sports, including cross-country skiing, floorball, handball, road cycling and volleyball (table 1). During this period, the new questionnaire was administered to all subjects on a weekly basis. At the same time, a parallel registration of time-loss injuries was also conducted using standard methods of injury registration.
We approached team coaches and asked whether they were interested in participation in the study, and if they expressed interest, all athletes in the team were provided with information about the study and asked to consent to participation. The study was approved by the Norwegian Data Inspectorate and reviewed by the South-Eastern Norway Regional Committee for Research Ethics.
Injury registration: new method
Each athlete was asked to provide their email address when giving their written consent to participation in the study. Online survey software (Questback V. 9692, Questback AS, Oslo, Norway) was then used to send the overuse problem questionnaire to that address every week for 13 weeks. If no response had been received from an athlete after 3 days, they were automatically sent a reminder email, and if an athlete failed to respond for three consecutive weeks, they were contacted by telephone to encourage them to continue to participate in the project.
The questionnaire included the abovementioned four questions on the consequences of overuse problems at the knee, the lower back and the shoulder. These questions were preceded by a short introduction explaining that all questions should be completed, regardless of whether or not the athlete had experienced any problems in that area, and giving examples of the most common overuse symptoms for each area. The survey software prevented questionnaire submission if all items were not fully completed. The complete questionnaire is available as an online supplementary appendix in the online version of this article.
Injury registration: standard method
In the handball, floorball and volleyball teams, time-loss injuries were registered during scheduled training sessions by the team coach or physiotherapist, according to the methods described in the consensus statement for injury surveillance methods in football.16 However, as road cyclists and cross-country skiers typically train individually rather than as a team, this was not possible in these groups. We therefore employed methods similar to those described by Nilstad et al,25 whereby an extra question was added into their weekly questionnaires that asked whether they had had any form of physical complaint that prevented them from being fully able to train or compete in their sport. Any athletes that answered ‘yes’ to this question were contacted by a researcher on the telephone, and injuries that satisfied a time-loss injury definition were registered using standard methods. The extra question was added to the end of the questionnaire, after the specific questions on knee, lower back and shoulder problems had been answered. It was stated clearly that they should report any problem, regardless of whether or not they had already reported the same one in the previous questions.
At the conclusion of the study, all athletes were interviewed by a sports physiotherapist to confirm that all injury information we had received via both registration methods was correct. All injuries that were associated with a specific, identifiable event were classified as acute injuries. If an acute injury had been sustained in the knee, shoulder or lower back, data corresponding to these injuries that were obtained through the overuse injury questionnaires were separated in the database.
Each week the prevalence of overuse problems was calculated for each anatomical area by dividing the number of athletes that reported any type of problem in that area by the number of questionnaire respondents. A similar calculation was made for the number of athletes who reported problems leading to moderate or severe reductions in training volume, or moderate or severe reductions in sports performance or complete inability to participate in sport (ie, athletes who selected option 3, 4 or 5 in either Question 2 or Question 3). This is referred to as the prevalence of substantial overuse problems. The average severity score for each anatomical area was also calculated weekly by averaging the score of all athletes that reported a problem. At the conclusion of the study, the weekly average of these measures were calculated for each anatomical area: the average weekly prevalence of all problems, the average weekly prevalence of substantial problems, the average severity score and the average number of weeks that each problem was reported. A 95% confidence interval was calculated for each of these measures.
Modelling the effects of different sampling frequencies and removing the first questionnaire
In order to assess the effects of sampling less frequently, the abovementioned outcome measures were recalculated using only information from every second questionnaire and every fourth questionnaire. Outcome measures were also recalculated after removing the first questionnaire, and a related-samples Wilcoxon paired rank test was used to analyse differences between the first and second weeks in the prevalence of problems reported in each anatomical area in the five different sports.
Weekly injury reports were completed by coaches of the handball, floorball and volleyball teams for every week of the project, and in the individual sports, all injuries reported at the end of the questionnaire were successfully registered by telephone interview. Using these methods, a total of 103 time-loss injuries, 42 acute and 61 overuse injuries, were recorded among 82 athletes during the course of the study (table 2). Of the 61 overuse injuries, 40 were located in the knee, lower back or shoulder; 18 were new injuries and 22 were recurrent injuries. These 40 injuries were distributed among 33 athletes, equating to 11% of the cohort. Most knee, lower back and shoulder injuries were of minimal severity (48%); 15% were mild, 25% moderate and 13% severe.
The average weekly response rate to the overuse injury questionnaire was 93%, with 81% of athletes responding to all 13 questionnaires administered during the course of the study. A total of 419 overuse conditions were identified, affecting 236 athletes (75% of the cohort). Fifty-two per cent of all athletes registered conditions located at the knee, 43% at the shoulder and 40% at the lower back. Forty-four per cent of all problems were present at the beginning of the study. Of all overuse conditions, 17% only involved minor pain and did not have any consequences on sporting participation or performance, whereas 34% were classified as substantial problems. Thirty-six percent of the cohort experienced a substantial problem at some stage during the course of the study. The average weekly prevalence of all problems and substantial problems, the average weekly severity score and the average duration of problems is shown in table 3. Figure 3 shows the number of cases recorded by the two different methods. Figure 4 illustrates data reported by the 10 athletes with the highest cumulative severity scores over the 3-month period. Of the 23 overuse conditions reported by these athletes, 7 were also recorded with the standard method.
Effects of different sampling frequencies on outcome measures
Sampling less frequently led to fewer cases being identified; however, the average prevalence and average severity measures were not affected (table 4). The greatest prevalence of overuse problems in all anatomical areas was reported in the first questionnaire (p<0.01), and reanalysis of the dataset after removing the first questionnaire led to a 14% reduction in the number of problems being identified without affecting the average prevalence or average severity score.
Psychometric questionnaire properties
The questionnaire had high internal consistency, with a Chronbach's α of 0.91. This was not improved any further by removing items (table 5). The factor weighting ranged from 0.86 to 0.91 for the four questions, suggesting that there is a little reason to weight items in the calculation of the severity score.
The ability to validly and reliably record overuse conditions presents a particular problem in sports injury epidemiology, largely due to the fact that athletes often continue to train and compete despite the existence of overuse problems. This study clearly highlights the inadequacy of currently accepted injury registration methods to record the true magnitude of overuse problems, given that the new method identified more than 10 times as many cases than the standard method and demonstrated that 75%, rather than 11%, of athletes were affected during the 3-month study period. However, objective comparison of the two methods is difficult as we are proposing a completely different paradigm for the recording and reporting of overuse problems. An appraisal of the potential benefits and limitations of the new method must therefore be largely qualitative in nature.
The first factor that prevents direct comparison of the results of each method is that we have not only compared two different ways of collecting injury data but also two different injury definitions. The standard method used a time-loss definition, only recording injuries that lead to a cessation of training or competition for at least 1 day, whereas the new method recorded all physical complaints even if the only symptom was mild pain. A far greater number of problems would therefore be expected to have been captured using the all physical complaints definition, regardless of the registration methods used. Although it would have been possible to have used a similar definition for the standard method, we chose to use a time-loss definition because it is currently the most commonly used definition in the recent sports epidemiology literature.13 Broader definitions, such as all physical complaints or medical attention, may be seldom used because they greatly increase the burden on injury recorders and because there are concerns over their reliability of the information they collect. For example, the number of injuries recorded will vary depending on the extent of contact between injury recorders and athletes, and different injury recorders are likely to have differing interpretations of what constitutes a recordable event.26 In contrast, the new method may be less susceptible to these sources of bias as data are reported directly by athletes rather than third-party injury recorders. While the information collected remains subjective, it reflects the consequences of overuse problems that are relevant for each athlete and this is unlikely to vary systematically between different cohorts. The ability to compare broad-definition injury data between studies is therefore greatly enhanced using the new method.
A second factor that prevents direct comparison of the two methods is that each one expresses the rate and severity of injuries in different ways. Traditionally, injury rates are expressed as an incidence, most often as the number of new injuries per 1000 h of sports participation.27 However, incidence fails to account for injuries that are present at the start of a study, and this may preclude the registration of a large proportion of overuse problems. For example, in the present study, 44% of cases identified using the new method would have been excluded from incidence calculations for this reason. We therefore chose to express the rate of overuse problems as an average prevalence with a 95% CI. This effectively reflects the proportion of athletes that could be expected to be affected by overuse problems at any given point during the study. The average prevalence of substantial problems was also reported, as this measure filters out the most minor problems and thereby provides important information on the true burden of overuse injury among a group of athletes.
Injury severity is also expressed in different ways by the two methods. Traditionally, it is expressed as the number of days taken from the time of injury until the athlete resumes full training and competition, and if the injury does not lead to time loss, it is recorded as being of ‘0 days’ severity. In the current study, this situation applied to a majority of overuse problems, despite the fact that many of these so-called ‘slight’ problems led to reduced performance, pain and modified participation that lasted for many weeks. Clearly, basing severity on time loss alone underestimates the true impact of overuse problems. Furthermore, even when an overuse problem does cause time loss, it is often interspersed between repeated attempts to return to training and competition.13 Although suggestions have been made on how to deal with such problems,28 most studies using standard methods adopt return-to-play criteria for defining injury resolution, meaning that fluctuating problems are treated as separate events, each time the athlete returns to full training and competition. This is obviously an invalid representation of the true nature of such injuries.
The new method therefore measures the severity of overuse problems using the severity score, which reflects the athlete's self-assessment of their pain and the impact that the problem has had on their participation, training volume and sports performance. Due to the subjectivity of this method, the validity of directly comparing individual athlete's questionnaire responses is questionable; however, the severity score is useful in monitoring the progression of overuse problems over time, such as in the examples displayed in figures 2 and 3. This approach may be of particular benefit if the new method is used as a practical injury surveillance tool. Furthermore, as there is little reason to suspect a systematic bias in severity scores between different groups of athletes, the average severity score can be used as the basis for comparison between groups. Future studies may also calculate the area under each athlete's injury curve such as those shown in figures 2 and 4, and use that number as a reflection of the total burden of each overuse problem. In this way, a long duration problem of mild or moderate severity may be scored higher than a more severe one that is only of a brief duration. This technique may be particularly relevant when applying the new method in risk factor and prevention studies; however, missing data will be a complicating factor when making these calculations.
A final advantage of the new method is that it is likely to be a cheaper alternative than traditional methods of data collection as once the survey software has been set up, all questionnaires and reminders are automatically delivered each week for the duration of the study. This is likely to be far less costly than paying research staff to manually record injuries.
The new method does, however, have several limitations. First, as information is based on athlete self-reports and the definition of a recordable problem is very broad, it is possible that some of the cases recorded may in fact be ‘normal’ pain related to athletic participation rather than an overuse injury, for example, delayed-onset muscle soreness. This may be particularly relevant for the 17% of cases that only involved minor pain and had no consequences on sports performance or participation. Ideally, the solution to this problem is that each problem reported by an athlete is quickly followed up with a confirmatory medical examination; however, this obviously increases the logistical difficulty and cost of conducting a study.
A second limitation of the method is that the validity of the recorded information is dependent on a high response rate throughout the course of the study. As the burden of injury registration is placed upon athletes, much attention and effort needs to be paid to motivating them to respond to each questionnaire. In the current study, the average response rate of 93% was very high; however, it is unknown whether such a good rate could have been maintained over a longer period of time. Future studies that involve a longer duration of data collection may need to be performed with less frequent questionnaire administration, for example, every second week or every month. This may also be the case for studies of recreational or non-elite athletes who may be less motivated to report injury data so frequently. In order to assess the effect of this, we performed data simulations with information from every second and every fourth questionnaire. The results indicate that when sampling less frequently, the average prevalence and severity score measures remain unchanged, while the number of problems identified is reduced. Based on these findings, sampling less frequently may be acceptable; however, if this is done, it is important to recognise that some shorter duration problems will be missed. We recommend that regardless of the sampling frequency, the retrospective period of registration of problems should not extend beyond 7 days, in order to minimise the risk of recall bias.
In our data simulation, we also analysed the effect of removing the results of the first questionnaire from the dataset. This led to a slight reduction in the number of reported cases, but did not affect the average prevalence measures or the severity score. We performed this analysis because the first questionnaire identified the highest prevalence of overuse problems in every anatomical area in every group of athletes, and this could not be explained by seasonal variation as the data were not collected at exactly the same time, and each group of athletes were in different periods of their season during the collection period. We therefore suspect that the first questionnaire returns an artificially high rate of overuse problems, and suggest that with future use of the new method these data should be excluded from the final dataset.
The new method is also dependent on the athletes providing honest information, which may be a concern if they feel that reporting an overuse problem may have adverse effects for them, such as on their chances of team selection. In order to minimise this risk, we were careful to explicitly guarantee confidentiality in the information letter prior to the study and in the introduction to the questionnaire they received each week. However, as with all forms of injury surveillance, it is hard to verify the extent to which athletes report the truth and this remains a threat to the validity of the data.
Another limitation to the new method is that the amount of details that can be collected directly from athletes is limited. The questionnaire only collects information on the anatomical location of each problem, rather than the injury type or specific diagnosis. This is because we do not expect that athletes will be able to reliably report this information, which should ideally be based on a clinical examination. Similarly, in the current study, we used telephone interviews to differentiate between acute and overuse injuries because we were concerned that so-called sudden-onset overuse injuries may have been misclassified if athletes had been asked to differentiate between the two types themselves. However, this approach is not without problems as it limits the potential sample size of a study and retrospective telephone interviews are subject to interviewer and recall bias. Alternative means of differentiating between acute injuries and overuse problems may be necessary in future studies.
A final limitation of the new method is that in its current form it only collects data on predefined injury areas. The method therefore needs to be modified in order to be used in studies where the research objective is a general registration of all types of overuse problems. However, when the objective is to study specific overuse problems, the current approach may be preferable as previous studies have shown that general questioning on overuse injuries leads to fewer problems being identified than when specific questions on predefined areas are used.1
What are the new findings?
Standard methods of injury registration using a time-loss injury definition may be insufficient for the study of overuse injuries.
When studying overuse injuries, all physical complaints need to be recorded and severity measures need to be based on pain and the consequences of injury on athletes’ participation and sporting performance.
The rate of overuse problems should be expressed using prevalence and severity measures, rather than incidence.
How might it impact on clinical practice in the near future?
This paper may lead to a change in the methods that are used to register the magnitude and severity of overuse problems in epidemiological studies of sports injuries.
We have developed a new method for the registration of overuse problems in sports injury epidemiology. As demonstrated by this study, the new approach offers several advantages over standard methods, particularly as it allows for the use of a broad injury definition and a means of quantifying injury severity that is not dependent on time loss. The new method may therefore be a better alternative for the specific study of overuse problems in sport.
Correction notice This article has been corrected since it was published Online First. The section ‘: the Oslo Sports Trauma Research Centre (OSTRC) Overuse Injury Questionnaire’ has been added to the title. The text reference to figure 1 has also been corrected.
Acknowledgements The authors acknowledge M Engedal, G Midtsundstad, L Rosenlund and G Thorsen for their contribution in developing the new method and collecting data. We also thank MA Risberg, EM Roos and I Holme for their assistance in the development of the questionnaire. The Oslo Sports Trauma Research Center has been established at the Norwegian School of Sport Sciences through generous grants from the Royal Norwegian Ministry of Culture, the South-Eastern Norway Regional Health Authority, the International Olympic Committee, the Norwegian Olympic Committee & Confederation of Sport, and Norsk Tipping AS.
Contributors All authors were involved in planning the project, the development of the questionnaire and in writing the manuscript. BC was also responsible for coordination of the data collection and for data analysis. BC is responsible for the overall content as guarantor.
Competing interests None.
Ethics approval South-Eastern Norway Regional Committee for Research Ethics.
Provenance and peer review Not commissioned; externally peer reviewed.
Data sharing statement All unpublished data are available upon request. However, we are planning a second article based on the same data set describing the prevalence and severity of overuse injuries in each of the five sports. This paper will shed additional light on the validity of the new method.