Assessing agreement between measurements recorded on a ratio scale in sports medicine and sports science.

A M Nevill and G Atkinson

School of Human Sciences, Liverpool John Moores University, United Kingdom.

OBJECTIVE: The consensus of opinion suggests that when assessing measurement agreement, the most appropriate statistic to report is the "95% limits of agreement". The precise form that this interval takes depends on whether a positive relation exists between the differences in measurement methods (errors) and the size of the measurements--that is, heteroscedastic errors. If a positive and significant relation exists, the recommended procedure is to report "the ratio limits of agreement" using log transformed measurements. This study assessed the prevalence of heteroscedastic errors when investigating measurement agreement of variables recorded on a ratio scale in sports medicine and sports science. METHODS: Measurement agreement (or repeatability) was assessed in 13 studies (providing 23 examples) conducted in the Centre for Sport and Exercise Sciences at Liverpool John Moores University over the past five years. RESULTS: The correlation between the absolute differences and the mean was positive in all 23 examples (median r = 0.37), eight being significant (P < 0.05). In 21 of 23 examples analysed, the correlation was greater than the equivalent correlation using log transformed measurements (median r = 0.01). Based on a simple meta-analysis, the assumption that no relation exists between the measurement differences and the size of measurement must be rejected (P < 0.001). CONCLUSIONS: When assessing measurement agreement of variables recorded on a ratio scale in sports medicine and sports science, this study (23 examples) provides strong evidence that heteroscedastic errors are the norm. If the correlation between the absolute measurement differences and the means is positive (but not necessarily significant) and greater than the equivalent correlation using log transformed measurements, the authors recommend reporting the "ratio limits of agreement".

CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    What's this?

This article has been cited by other articles:

• Goosey-Tolfrey, V., Swainson, M., Boyd, C., Atkinson, G., Tolfrey, K. (2008). The effectiveness of hand cooling at reducing exercise-induced hyperthermia and improving distance-race performance in wheelchair and able-bodied athletes. J. Appl. Physiol. 105: 37-43 [Abstract] [Full Text]  
• Cooper, S-M, Baker, J S, Tong, R J, Roberts, E, Hanford, M (2005). The repeatability and criterion related validity of the 20 m multistage fitness test as a predictor of maximal oxygen uptake in active young men. Br. J. Sports. Med. 39: e19-e19 [Abstract] [Full Text]  
• Flouris, A D, Metsios, G S, Koutedakis, Y (2005). Enhancing the efficacy of the 20 m multistage shuttle run test. Br. J. Sports. Med. 39: 166-170 [Abstract] [Full Text]  
• Symons, T. B., Vandervoort, A. A., Rice, C. L., Overend, T. J., Marsh, G. D. (2005). Reliability of a Single-Session Isokinetic and Isometric Strength Measurement Protocol in Older Men. Journals of Gerontology Series A: Biological Sciences and Medical Sciences 60: 114-119 [Abstract] [Full Text]  
• Cooper, S-M, Baker, J S, Eaton, Z E, Matthews, N (2004). A simple multistage field test for the prediction of anaerobic capacity in female games players. Br. J. Sports. Med. 38: 784-789 [Abstract] [Full Text]  
• Buckley, J P, Sim, J, Eston, R G, Hession, R, Fox, R (2004). Reliability and validity of measures taken during the Chester step test to predict aerobic power and to prescribe aerobic exercise. Br. J. Sports. Med. 38: 197-205 [Abstract] [Full Text]  
• Williams, A G, van den Oord, M, Sharma, A, Jones, D A (2001). Is glucose/amino acid supplementation after exercise an aid to strength training?. Br. J. Sports. Med. 35: 109-113 [Abstract] [Full Text]  
• Buckley, J. P, Eston, R. G, Sim, J. (2000). Ratings of perceived exertion in braille: validity and reliability in production mode. Br. J. Sports. Med. 34: 297-302 [Abstract] [Full Text]  
• Lamb, K. (1998). Test-Retest Reliability in Quantitative Physical Education Research: A Commentary. European Physical Education Review 4: 145-152 [Abstract]