Article Text

Download PDFPDF

The repeatability and criterion related validity of the 20 m multistage fitness test as a predictor of maximal oxygen uptake in active young men
Free
  1. S-M Cooper1,
  2. J S Baker2,
  3. R J Tong1,
  4. E Roberts1,
  5. M Hanford1
  1. 1University of Wales Institute Cardiff, Cardiff, UK
  2. 2University of Glamorgan, Pontypridd, UK
  1. Correspondence to:
 S-M Cooper
 University of Wales Institute Cardiff, School of Sport, PE and Recreation, Cyncoed Campus, Cyncoed Road, Cyncoed, Cardiff CF 23 6XD, UK; smcooperuwic.ac.uk

Abstract

Objective: To investigate the repeatability and criterion related validity of the 20 m multistage fitness test (MFT) for predicting maximal oxygen uptake (Vo2max) in active young men.

Methods: Data were gathered from two phases using 30 subjects (x̄±s; age = 21.8±3.6 years, mass = 76.9±10.7 kg, stature = 1.76±0.05 m). MFT repeatability was investigated in phase 1 where 21 subjects performed the test twice. The MFT criterion validity to predict Vo2max was investigated in phase 2 where 30 subjects performed a continuous incremental laboratory test to volitional exhaustion to determine Vo2max and the MFT.

Results: Phase 1 showed non-significant bias between the two applications of the MFT (x̄diff±sdiff = −0.4±1.4 ml kg−1 min−1; t = −1.37, p = 0.190) with 95% limits of agreement (LoA) ±2.7 ml kg−1 min−1 and heteroscedasticity 0.223 (p = 0.330). Log transformation of these data reduced heteroscedasticity to 0.056 (p = 0.808) with bias −0.007±0.025 (t = −1.35, p = 0.190) and LoA±0.049. Antilogs gave a mean bias on the ratio scale of 0.993 and random error (ratio limits) ×/÷1.050. Phase 2 showed that the MFT significantly underpredicted Vo2max (x̄diff±sdiff = 1.8±3.2 ml kg−1 min−1; t = 3.10, p = 0.004). LoA were ±6.3 ml kg−1 min−1 and heteroscedasticity 0.084 (p = 0.658). Log transformation reduced heteroscedasticity to −0.045 (p = 0.814) with LoA±0.110. The significant systematic bias was not eliminated (x̄diff±sdiff = 0.033±0.056; t = 3.20, p = 0.003). Antilogs gave a mean bias of 1.034 with random error×/÷1.116.

Conclusions: These findings lend support to previous investigations of the MFT by identifying that in the population assessed it provides results that are repeatable but it routinely underestimates Vo2max when compared to laboratory determinations. Unlike previous findings, however, these results show that when applying an arguably more appropriate analysis method, the MFT does not provide valid predictions of Vo2max.

  • LoA, limits of agreement
  • MFT, 20 m multistage fitness test
  • criterion related validity
  • field test
  • limits of agreement
  • maximal oxygen uptake
  • repeatability

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

It is widely recognised that the most valid physiological indicator of a subject’s cardiovascular function is a laboratory determination of maximal oxygen uptake (Vo2max).1 Such determinations require the use of sophisticated technical equipment and are expensive in terms of the financial cost of this equipment, the training of assessors, the time that it takes to make each estimate of Vo2max, and the accurate analyses of expired gases. As a consequence, exercise scientists have continued to pursue the idea of estimating Vo2max from maximal or sub-maximal tests conducted in non-laboratory environments, via walking protocols2–4, cycling protocols5,6, and running protocols.7–9

The most common field test for the prediction of Vo2max is the 20 m multistage fitness test (MFT). Originally developed for adults by Léger and Lambert8 and modified later for children, by reducing the stages from 2 min to 1 min, by Léger et al10, it aims to simulate a continuous incremental exercise test to volitional exhaustion. The MFT was included in the Eurofit provisional handbook11, and after subsequent developmental work by Ramsbottom et al,9 it has been marketed commercially in the form of an audiocassette tape, or CD diskette, and accompanying instruction booklet that includes a table for the conversion of MFT performances into predicted Vo2max.12 The test is widely used by sports scientists, teachers, coaches, and fitness advisors because it requires limited equipment, is relatively easy to administer, and is suitable for the assessment of large numbers of subjects.

As is the case with all tests and measurements used to assess the components of physical fitness, critical questions must be asked concerning the repeatability and validity of the MFT. A number of studies have been conducted, each of which purport to have investigated the repeatability and/or validity of the MFT when used with children or adolescents10,13–17 and with adults.8,9,18,19 In the case of each of these previously published investigations, the authors have used analytical methods such as Pearson’s inter-class correlation coefficient and hypothesis tests such as the dependent (paired) t test or repeated measures ANOVA as indices of the MFT’s repeatability and/or validity. Bland and Altman,20 and more recently Nevill and Atkinson,21 have criticised the reliance upon these methods, in particular the correlation coefficients, as being primarily indicants of relationship rather than of agreement. In the estimation of both test repeatability and test validity, the preferred analysis of choice should be the 95% limits of agreement (LoA) method introduced by Bland and Altman in 1986.22

The aim of the present study was therefore twofold: (i) to examine the repeatability of the MFT, as described by Brewer et al,12 by applying 95% LoA to predicted Vo2max gathered from repeat applications of the test, and (ii) to consider the criterion related validity of the MFT by calculating the 95% LoA between predicted Vo2max and Vo2max measured directly in a laboratory, in a group of active young men.

METHODS

Subjects

Measurements were made on 30 male undergraduates (x̄±s; age = 21.8±3.6 years, body mass = 76.9±10.7 kg, and stature = 1.76±0.05 m) who were all pursuing sports studies degrees at a British university. Before data collection began the relevant University Research Ethics Sub-Committee approved both phases of the proposed study, and all participants gave written informed consent and volunteered to act as subjects. Each was also screened to verify that he was a non-smoker and was not suffering from an injury. None had any history of cardiovascular disease or other health risks, and none were taking medication known to influence oxygen uptake.

Data collection procedures

The first phase of the study aimed to establish the repeatability of the MFT in a group of 21 subjects drawn randomly from the 30 volunteers. Each subject performed the MFT twice, with a minimum of 7 days and a maximum of 14 days elapsing between the test and the retest. In phase 2, the 30 subjects performed both the MFT and a laboratory assessment to determine Vo2max. Each assessment was performed randomly on separate days with a minimum of 7 days and a maximum of 14 days elapsing between assessments. All subjects were fully familiarised with both measurement protocols before data collection. In order to avoid the affects of diurnal variations, data were collected from the subjects in both phases of the study at approximately the same time of day. Because of the difficulties involved in ensuring compliance, no attempt was made to control the diet of the subjects (this included their consumption of alcohol) nor was an attempt made to control the pre-testing exercise condition of the subjects.

Laboratory determined Vo2max

Maximal oxygen uptake was defined as the maximum rate at which a subject could take up and utilise oxygen while breathing air at sea level (Bird and Davidson23, page 64) and was determined during a continuous incremental exercise test to volitional exhaustion while running on a motorised treadmill (Ergo ELG2, Woodway, Weil am Rhein, Germany). Each assessment was preceded by a standardised 5 min warm up on the treadmill where subjects ran at a speed of 2.22 m s−1 and zero (0%) gradient. Subjects began the test by running at a speed of 3.06 m s−1 and 0% gradient, after which the inclination of the treadmill was increased by 2.5° every 3 min. This increase in treadmill inclination continued until the subject indicated that he could run no further. During the last minute of each 3 min exercise period, expired air was channelled into pre-emptied 150 l Douglas bags via a two way low resistance respiratory valve (Hydraulic Transmission Services, Salford, UK) with 80 ml dead space and a short length of 32 mm bore respiratory tubing. Towards the end of the Vo2max assessment, a sample of expired air was collected when the subject indicated that he could continue for only one more minute. All subjects were verbally encouraged to perform maximally throughout the assessment. After being assessed, all subjects participated in a 5 min cool down that included prescribed jogging and stretching.

Subsequently, each Douglas bag was analysed for volume, using a dry gas meter (Harvard Apparatus, Edenbridge Kent, UK), oxygen consumption, and carbon dioxide production in order to determine oxygen uptake. Oxygen and carbon dioxide concentrations were obtained from a Servomex 1440C dual gas analyser (Servomex International, Crowborough, UK) that was calibrated before each assessment using gases of known concentration. In deciding whether individual subjects had achieved Vo2max, three of the criteria provided by the British Association of Sport and Exercise Sciences were used: (i) subjective fatigue and volitional exhaustion, (ii) a plateau in the oxygen uptake/exercise intensity relationship, and (iii) a final respiratory exchange ratio of 1.15 or above (Bird and Davidson,23 page 64).

Maximal oxygen uptake was expressed relative to body mass for each subject. Relative performance was derived using the ratio standard where Vo2max (ml min−1) was divided by body mass (ml kg−1 min−1). It is fully acknowledged that this method of scaling these data might be considered inappropriate, and further that allometric modelling of these data might be more appropriate in partitioning out differences in body size.24 In order for the requisite comparisons with data gathered from performance on the MFT to be made, however, it was considered that this was the necessary approach to take.

Multistage fitness test (MFT)

The protocol for the MFT was identical to that described by Brewer et al.12 Briefly, this consisted of shuttle running between two parallel lines set 20 m apart, running speed cues being indicated by signals emitted from a commercially available pre-recorded audiocassette tape. The audiocassette tape dictated that subjects started running at an initial speed of 2.36 m s−1 and that running speed increased by 0.14 m s−1 each minute. This increase in running speed is described as a change in test level.9 The speed of the cassette player was checked for accuracy in accordance with the manufacturer’s instructions before each application. All subjects performed a 10 min warm up that included prescribed jogging and stretching. The MFT was conducted in a gymnasium with sprung wooden flooring where subjects ran in groups of five in order to add an element of competition and to aid maximal effort. All were verbally encouraged to perform maximally during each assessment. After finishing the MFT, all subjects participated in a 5 min cool down that also included prescribed jogging and stretching. MFT results for each subject were expressed as a predicted Vo2max (ml kg−1 min−1) obtained by cross-referencing the final level and shuttle number (completed) at which the subject volitionally exhausted with that of the Vo2max table provided in the instruction booklet accompanying the MFT. Only fully completed 20 m shuttle runs were considered.

Statistical analyses

The normality of appropriate data sets (that is, residual errors) was confirmed via the Anderson-Darling normality test.25 It was considered appropriate therefore to test stated hypotheses using parametric statistical techniques. A maximum a priori α level of 0.05 was applied throughout.

In phase 1 of the study the agreement between repeat performances on the MFT (test-retest) was quantified using the 95% LoA method originally described by Bland and Altman.20 This included plotting a graph (Bland-Altman plot) of the mean for subjects’ test and retest results [(test+retest)/2] on the x axis corresponding to the difference between each subject’s test and retest results (test−retest) on the y axis. To investigate systematic bias, a dependent t test was conducted to test the hypothesis of no difference between the sample mean score for the test versus the sample mean score for the retest. Provided the differences between subjects’ test and retest scores (residual errors) were normally distributed, the 95% LoA (indicative of random error) were expressed as ±1.96 multiplied by the standard deviation of the residual errors (that is, ±1.96×sdiff). When the systematic bias is not statistically significant, there is a rationale for expressing the 95% LoA as ± the value of this bias, thus, x̄diff±(1.96×sdiff). In which case the results could therefore be described in the actual units of measurement.26

Heteroscedasticity occurs in test data when the amount of random error increases as the measured values increase.26 Heteroscedasticity was investigated in the present study by calculating the zero order correlation coefficient (heteroscedasticity coefficient) between the means of subjects’ test and retest scores (indicative of the size of measured values) and the absolute differences between subjects’ test and retest scores (indicative of random error). Bland and Altman20 originally proposed that the solution to establishing a positive, statistically significant heteroscedasticity coefficient (p<0.05) was to transform the original test data into natural logarithms and then to repeat the limits of agreement methods described above with these log transformed data. Subsequently, Nevill and Atkinson21 have suggested that if the correlation between absolute residual errors and individual means is positive, but not necessarily statistically significant, there is some benefit in reducing heteroscedasticity by transforming test data into natural logarithms and recalculating the limits of agreement. This suggestion was followed in the present study so that when antilogs of these results were taken, the outcomes could be expressed as the mean bias ×/÷ by the 95% agreement component (random error) on the ratio scale.

In phase 2, the criterion related validity of the MFT was investigated by quantifying the agreement between subjects’ laboratory determined Vo2max and their predicted Vo2max from performing the MFT. Both laboratory determined Vo2max and MFT predicted Vo2max data were exposed to exactly the same diagnostic statistical tests as those described for calculating the 95% LoA for the data collected in phase 1 of the study.

RESULTS

Phase 1 test-retest repeatability of MFT scores (table 1 and fig 1)

Table 1

 Performance characteristics and analysis summary from phase 1: repeatability of MFT scores (n = 21)

Figure 1

 Bland-Altman plot summarising the results from phase 1.

Two administrations (test-retest) of the MFT were performed by a group of 21 subjects (x̄±s; age = 22.1±3.9 years, body mass = 77.1±8.4 kg, stature = 1.78±0.05 m). The mean MFT performance for the test was 52.9±8.8 ml kg−1 min−1, and for the retest it was 53.3±8.9 ml kg−1 min−1. The dependent t test conducted to test the hypothesis of equality of means showed no significant bias. The residual errors between the test and the retest were normally distributed and the bias ± the 95% LoA was −0.4±2.7 ml kg−1 min−1.

Figure 1 shows that there is some evidence of heteroscedasticity present in these data. While the computed heteroscedasticity coefficient was not statistically significant, however, it was positive (r = 0.223, p = 0.330). Transformation of the test and retest data into natural logarithms reduced the heteroscedasticity to r = 0.056 (p = 0.808). The dependent t test performed between the log transformed mean score for the test (3.95±0.19) and the log transformed mean score for the retest (3.96±0.19) showed no significant bias. Residual errors between test and retest log transformed data were normally distributed. The mean difference ± the 95% LoA was −0.007±0.049. Taking antilogs of these values gave a mean bias of 0.993 with a random error component of ×/÷1.050.

Phase 2 criterion related validity of the MFT (table 2 and fig 2)

Table 2

 Performance characteristics and analysis summary from phase 2: criterion related validity of the MFT (n = 30)

Figure 2

 Bland-Altman plot summarising the results from phase 2.

A total of 30 subjects (age = 21.8±3.6 years, body mass = 76.9±10.7 kg, stature = 1.76±0.05 m) performed a laboratory test to determine Vo2max and the MFT from which Vo2max was predicted. Table 2 shows that the mean laboratory determined Vo2max was 57.5±4.5 ml kg−1 min−1 and the mean predicted Vo2max from performing the MFT was 55.7±5.0 ml kg−1 min−1. Residual errors were normally distributed and the mean bias (1.8 ml kg−1 min−1) was statistically significant (t29 = 3.10, p = 0.004). The 95% LoA were ±6.3 ml kg−1 min−1.

Figure 2 shows that there was very little evidence of heteroscedasticity present in these data. However, the computed coefficient was positive (r = 0.084, p = 0.658). Data were therefore transformed into natural logarithms and the 95% LoA method repeated. This reduced heteroscedasticity to r = −0.045 (p = 0.814). The dependent t test performed between the mean log transformed score for laboratory determined Vo2max (4.05±0.08) and the mean log transformed score for the MFT predicted Vo2max (4.02±0.09) continued to show a significant systematic bias (x̄diff = 0.033; t29 = 3.20, p = 0.003). Residual errors were normally distributed and the 95% ratio limits of agreement were ±0.110. Taking antilogs of these values gave a mean bias of 1.034 with a random error component of ×/÷1.116.

DISCUSSION

It was not possible to compare the results of the present MFT repeatability 95% LoA directly, as none were available in the current literature. In terms of the statistics that could be compared however, we computed, post hoc, the zero order correlation between the test and the retest results from phase 1 and found there to be a high and statistically significant linear relationship (r = 0.988, p = 0.0005). In addition, there was no significant difference between the mean scores for the test and the retest (x̄diff = −0.4 ml kg−1 min−1; t20 = −1.37, p = 0.190). These results are similar to those reported by Léger et al10 in their original study, where subjects also ran to volitional exhaustion during a 20 m multistage shuttle run test (r = 0.95, p<0.01 and unspecified t, p>0.05).

The test sample used by Léger et al10 consisted of 81 men and women whose ages ranged from 20 to 45 years, and who were in varying states of physical condition. In contrast, the sample used in phase 1 were active male undergraduate students, all of a similar age, physical condition, and training status. The strength of the test-retest correlation in the present data is surprising therefore as normally the calculation of the numerical value of the coefficient is highly influenced by the range of the characteristic being analysed, that is data heterogeneity.27–29 Indeed, this observation is often cited as one of the major weaknesses of the correlation coefficient as a measure of repeatability.20,22 The strong test-retest correlation in the present data might have been due to the fact that all of the subjects who participated in the study were sports studies students, all of whom were used to performing the MFT as part of their programmes of study and were therefore also better able to gauge the intensity of their performances.

In considering the approach to the design of phase 1, it was intended to identify the stability reliability30 of the MFT. Regardless of the source of the error, however, there are two components of variability associated with the assessment of measurement error—systematic bias and random error—that need to be considered in detail.26 Inspection of the Bland-Altman plot presented as fig 1 provides a visual indication of both systematic bias and random error in the raw data. It can be seen from both the direction and the size of the raw data scatter around the zero line (y axis) that there is evidence of a slight tendency towards a negative bias as well as random variation in these data. From fig 1 there is also visual evidence to suggest that these raw data show some evidence of heteroscedasticity. Natural log transformation of the test and retest raw data reduced the heteroscedasticity coefficient and gave a mean bias±the 95% LoA of −0.007±0.049. Taking antilogs resulted in a mean bias on the ratio scale of 0.993 and an agreement (random error) component of ×/÷1.050. That is, 95% of the ratios for the sample (log transformed test score divided by log transformed retest score) should be contained between the values 0.946 (0.993÷1.050) and 1.043 (0.993×1.050). In fact, in the present data, 100% of the ratios for the 21 subjects assessed were contained between these two values. For any new individual from the studied population therefore, assuming the bias present (0.007%) to be negligible, any two tests would differ due to measurement error by no more than 5% in a positive or negative direction.21 It is interesting to note that this latter result is very similar to the 95% coefficient of variation of 5.2% calculated for the original (non-transformed) data in the arguably simpler manner [100×((1.96×sdiff)/grand x̄)] identified by Bland.31

These ratio limits of agreement are not common indices in the sport and exercise sciences. To put them into some practical context therefore, if a new subject from the studied population presented with an estimated MFT performance of 30 ml kg−1 min−1 on the first application of the test, the worse case scenario (a 95% probability) is that this subject on the second occasion could score an estimated score as low as 30×0.946 = 28.4 ml kg−1 min−1, or as high as 30×1.043 = 31.3 ml kg−1 min−1. Most sports scientists would probably consider these limits of agreement to be acceptable. However, for a subject with a higher estimated performance on the test of, for instance, 70 ml kg−1 min−1, there is a 95% probability that their retest performance might be as low as 70×0.946 = 66.2 ml kg−1 min−1 or as high as 70×1.043 = 73.0 ml kg−1 min−1. These ratio limits of agreement might vary in absolute terms, but they remain a constant ratio in performance from the test to the retest. While these scores are probably acceptable for the repeatability of a field test of one of the physiological aspects of physical fitness, they are also more realistic in the manner in which they are allowed to vary depending upon the standards of performance of the subjects.21

The term calibration refers to the development of a model that facilitates the prediction of measured criterion values from related predictor values (Atkinson and Nevill,32 page 812). In the development of useful calibration models the regression equation developed on one sample of the chosen population should be cross-validated against results provided by another equivalent sample. Without cross-validation to test the accuracy of the prediction, results will always be suspect.22,26,33 Indeed, Atkinson and Nevill26 believe that many of the most commonly used field tests of physiological fitness that provide tables for the prediction of the directly measured physiological parameter from indirect measures lack this key element of validity. The MFT is a prime example of such a test, and the design of phase 2, and the manner in which the resultant data were analysed using the 95% LoA method, was an attempt to address this issue directly.

In order to develop the Vo2max table found in the booklet that accompanies the MFT, Brewer et al12 used linear regression methods on the data of Ramsbottom et al9 to produce a calibration model that predicted Vo2max from MFT performances expressed as maximum level and shuttle number achieved. Regrettably the authors’ of those studies available in the literature that have investigated the validity of this calibration model have reported their results in terms of correlation coefficients and/or hypothesis tests rather than applying limits of agreement to measured and predicted data gathered from equivalent samples. Consequently, it was not possible to compare the 95% LoA results from phase 2 directly, as none were currently available in the literature.

Out of interest therefore, we computed, post hoc, the magnitude of the zero order correlation between the predicted Vo2max from the MFT and the laboratory determined Vo2max. Although this correlation was statistically significant (r = 0.785, p = 0.0005) it was disappointingly low when compared to others available in the literature. For example, McNaughton et al19 have reported that for 32 male undergraduates, the correlation coefficient between MFT predicted Vo2max and a laboratory determined Vo2max was far stronger than that forthcoming from the present data (r = 0.82, p<0.05). Indeed, in the original validation study of the MFT9 from which Brewer et al12 subsequently developed the version of the MFT used in our study, the correlation between the shuttle run test and laboratory determined Vo2max for 36 males was also r = 0.82 (p<0.01).

The Bland-Altman plot presented as fig 2 provides a visual indication of both the systematic bias and the random error between MFT predicted Vo2max and laboratory determined Vo2max in the raw data drawn from the present sample. From both the direction and the size of the scatter of these data around the zero line (y axis) there is evidence of a substantial positive systematic bias. Additionally, there seems to be limited random variation in these data. Atkinson and Nevill26 have shown that a significant difference between means is more likely when there is limited random variation amongst the raw scores, and vice versa.

The statistical analyses conducted on these data as part of the limits of agreement method confirmed the situations relating to both systematic bias and random error. The mean of the residual errors between laboratory determined Vo2max and MFT predicted Vo2max was statistically significant (x̄diff±sdiff = 1.8±3.2 ml kg−1 min−1; t29 = 3.10, p = 0.004). This resulted from the mean MFT predicted Vo2max being 3.1% below that for laboratory determined Vo2max. This result is similar to that reported by McNaughton et al19 where the mean (±s) Vo2max predicted from the MFT (58.1±4.9 ml kg−1 min−1) was 3% lower than that for a laboratory determination (59.7±5.9 ml kg−1 min−1). This difference was not reported as being statistically significant (p>0.05). It is also interesting to report the similarity between the present results and those reported originally by Ramsbottom et al9 with respect to such differences. It is unfortunate that Ramsbottom et al9 did not report the results of a hypothesis test of equality of means that would have quantified the systematic bias between measured and predicted values, but the mean (n = 36, males) MFT predicted Vo2max (55.4 ml kg−1 min−1) was 5.2% lower than that recorded for the laboratory determination (58.5 ml kg−1 min−1).

Even though it showed statistical significance, most exercise physiologists would probably consider that a mean difference between measured and predicted Vo2max in the order of 1.8 ml kg−1 min−1 would not be significant from a practical perspective. Considering the criticisms levelled at hypothesis tests when used as the sole method in the assessment of test validity in the literature,26 we decided to interrogate our data further (post hoc) in an attempt to identify the practical significance of this bias. Cohen34 considers the effect size to be a reasonable index of the meaningfulness of a statistical outcome. In the present study the effect size index (d) for the t test for means was computed: d = [|x̄1−x2|sP], where: x̄1 is the sample mean for the laboratory measured Vo2max, x̄2 is the sample mean for the MFT predicted Vo2max, and sp is the pooled standard deviation = √[((s12(n1−1))+(s22(n2−1)))/(n1+n2−2)]. Here s12 and n1 are, respectively, the sample variance and the sample number for the laboratory measured Vo2max, and s22 and n2 are the sample variance and the sample number for the MFT predicted Vo2max. In the present data d = 0.4 which is described by Cohen34 (page 40) as only a small to medium sized difference. Indeed, the statistical power of this analysis in rejection of the null hypothesis of equality of means in the population from which this sample of subjects was drawn was only 33%.

When measurements are made in the sport and exercise sciences there are often multiple sources of error. While we attempted to account for many sources of error in our research design, we can speculate that a mean underprediction in Vo2max by the MFT when compared to a laboratory determination of the magnitude 1.8 ml kg−1 min−1 might well have been due to the error inherent in a different gas analysis system being used in the present study to that used by Ramsbottom et al9 in their study. Unfortunately, Ramsbottom et al9 do not identify the gas analysis system that they used. Consequently, we could not perform a study to compare the Servomex analysis system that was used in the present research with that used by Ramsbottom et al.9

It is clear from the Bland-Altman plot (fig 2) generated from the phase 2 data that there is no substantial increase in variability in these scores as the size of the measured values increases. The statistical examination of heteroscedasticity resulted in a coefficient of r = 0.084 (p = 0.658). If confirmation of the presence of heteroscedasticity in these data was based solely on the size of the coefficient therefore, it can be concluded that the assumption that the limits of agreement remain constant throughout the range of measurements can be accepted.20 Even though the heteroscedasticity coefficient was close to zero, it was still positive. Consequently the raw data were transformed into natural logarithms and the limits of agreement method was applied to these transformed scores.

Log transformation reduced heteroscedasticity to r = −0.045 (p = 0.814) but it did not improve the normality of the distribution of residual errors between laboratory determined Vo2max and MFT predicted Vo2max (p = 0.057). Once again, the mean difference between these two data sets was found to be statistically significant (x̄diff±sdiff = 0.033±0.056; t29 = 3.20, p = 0.003) and the 95% LoA were ±0.110. Taking antilogs of these values gave a mean bias on the ratio scale of 1.034 and a random error component of ×/÷1.116.

In terms of the ratio limits of agreement the 3.3% bias present (the 0.2% difference between this logarithmic value and that calculated from the raw data (3.1%) is probably due to rounding errors) cannot be considered to be negligible. The two methods of determining Vo2max differ due to measurement error by a substantial 11.6% in a positive or negative direction. Interestingly, when Bland’s31 calculation was applied to the original data before log transformation, it gave a 95% coefficient of variation of 11.1%. Indeed, 95% of the ratios for the sample (log transformed laboratory determined Vo2max divided by log transformed MFT prediction of Vo2max) should be contained between the limits 0.927 (1.034÷1.116) and 1.154 (1.034×1.116). In the present data, 100% of the ratios for the 30 subjects assessed were actually contained between these two values.

To help interpret these ratio limits of agreement: if a new subject from the studied population presented with a laboratory determined Vo2max of 30 ml kg−1 min−1, there is a 95% probability that their predicted performance from the MFT calibration model could be as low as 30×0.927 = 27.8 ml kg−1 min−1 or as high as 30×1.154 = 34.6 ml kg−1 min−1. For a subject with a higher laboratory determined performance of 70 ml kg−1 min−1 the prediction from the MFT calibration model could result (a 95% probability) in a score as low as 70×0.927 = 64.9 ml kg−1 min−1 or as high as 70×1.154 = 80.8 ml kg−1 min−1. We consider these ratio limits of agreement to be more realistic in the way that they are allowed to vary depending upon the levels of subjects’ performances. Considering that the MFT is a field test, the ratio limits for the lower performing subject are probably just on the border of acceptability, while the ratio limits for the higher performer are too wide to be acceptable for most sports scientists. As has previously been stated, however, the fact that a significant systematic bias was identified in these data indicates that the MFT cannot be considered as a valid predictor of laboratory determined Vo2max in male undergraduates, regardless of the calculated limits of agreement.

CONCLUSIONS

From these results it was possible to conclude that the calculated bias and 95% LoA are narrow enough for the MFT to be considered repeatable when used with active male undergraduates. However, while the MFT might prove useful in predicting the more substantial effect that might accompany aerobic training conducted by a less well trained subject, there is some doubt as to whether the test is sensitive enough to monitor the small changes in performance that might accompany the improved training status of a subject who already has a highly developed aerobic fitness.

These findings also lend support to previous validations of the MFT by identifying that it routinely underestimates Vo2max when compared to laboratory determinations. Unlike previous findings, however, these results also show that when applying an arguably more appropriate analysis method (95% LoA), the MFT does not provide valid predictions of Vo2max. The results of the cross-validation of the calibration model developed by Brewer et al12 which provided the Vo2max table that accompanies the commercially available MFT, showed a significant systematic bias in underestimating Vo2max when compared to a laboratory determined assessment. While the MFT is a well established and ubiquitous field test of cardiovascular function, these results show that it is not a valid test for the accurate prediction of Vo2max in active male undergraduates at least. Additionally, and arguably more importantly, these findings highlight the need for sport and exercise scientists to appraise the repeatability and validity of frequently used measurement protocols by applying more appropriate statistical methods.

What is already known on this topic

The most common field test for the prediction of Vo2max is the 20 m multistage fitness test (MFT). However, critical questions must be asked concerning the repeatability and validity of the MFT.

What this study adds

While the MFT is a well established and ubiquitous field test of cardiovascular function, the results of this study show that it is not a valid test for the accurate prediction of Vo2max in active young men.

REFERENCES

View Abstract

Footnotes

  • Competing interests: none declared

Linked Articles

  • Miscellanea
    BMJ Publishing Group Ltd and British Association of Sport and Exercise Medicine