Article Text
Abstract
Objective: To investigate sex differences in baseline neuropsychological function and concussion symptoms between male and female collegiate athletes.
Methods: A post-test only design was used to examine baseline neuropsychological test scores and concussion symptoms. A total of 1209 NCAA Division I collegiate athletes from five northeastern universities in the USA completed a baseline ImPACT test. ImPACT, a computerised neuropsychological test battery, was administered during an athlete’s pre-season.
Results: Female athletes performed significantly better than male athletes on baseline verbal memory scores (p = 0.001), while male athletes performed significantly better than female athletes on baseline visual memory scores (p = 0.001). Female athletes endorsed a significant number of mild baseline symptoms as compared to male athletes.
Conclusions: Male and female athletes exhibit differences on baseline neuropsychological test performance and concussion symptoms.
- concussion symptoms
- ImPACT
- neuropsychological functioning
- sex differences
Statistics from Altmetric.com
Sex differences in cognitive performance have been reported for verbal memory,1–4 perceptual motor speed2 and visuospatial tasks.2,4 Moreover, researchers have shown that brain function differs between the sexes.1–4 Weiss et al2 found that females perform better on verbal memory and perceptual motor speed compared to males. Conversely, males perform better on visuospatial tests than females. Therefore, it is important to determine if collegiate male and female athletes exhibit differences in baseline neuropsychological function and symptoms. If female and male athletes’ neurocognitive abilities vary on baseline test scores, then it is possible that the athletes may also perform differently on post-concussion testing.
Approximately 300 000 sport-related concussions are reported each year.5 Over the past two decades, sports medicine professionals have stressed the importance of baseline neuropsychological testing of athletes for comparison after concussion.6,7,8,9,10,11 However, very few researchers have explored sex differences in baseline neuropsychological function and concussion symptoms among collegiate athletes.2,12 Baseline neuropsychological testing is useful for evaluating concussion. First, post-concussion decreases in performance from baseline testing may provide a more subtle evaluation13 of neuropsychological impairment. Second, individual performance may vary on tests of attention and concentration, memory, information processing and reaction time. If it is not known how an individual athlete performed before sustaining a concussion, it is difficult to ascertain whether their post-concussion level of test performance is due to the effects of the concussion or to individual variability. As a result, comparisons between the concussed athlete and a normative group are difficult. Finally, baseline neuropsychological tests may be used as a tool for determining concussion resolution together with clinical evaluation for readiness to return to play.11 Athletes should not return to participation until their neuropsychological test scores are equal to or better than the baseline test scores and they do not display any signs and symptoms of concussion.14 For these reasons, baseline neuropsychological test scores should provide for more sensitive and accurate concussion evaluation and detection and may reduce the risks of cumulative neurocognitive dysfunction.15 Therefore, the purpose of this study was to determine if sex differences exist in baseline neuropsychological function and concussion symptoms.
METHODS
Study design
A post-test only design was used to compare neuropsychological test scores and concussion symptoms. The independent variable was sex. The dependent variables were verbal and visual memory, reaction time and processing speed composite scores, as well as total symptom scores.
Subjects
The subjects were American collegiate athletes participating in baseball, basketball, cheerleading, fencing, figure skating, football, gymnastics, lacrosse, soccer, softball, volleyball and wrestling (see table 1). The athletes were from five northeastern universities representing the states of Delaware, New Jersey, and Pennsylvania and were practicing and competing in the 2002–2003 and 2003–2004 academic seasons. A total of 1209 athletes volunteered to participate in the study with a mean of 1.24 years of collegiate experience. Sex distribution was reasonably consistent with the athletic population from each institution, with 651 males (height 184±45.17 cm, weight 70.85±7.00 lbs) and 558 females (height 136.2±27.05 cm, weight 65.4±6.53 lbs) participating in the study.
Outcome measures
ImPACT version 2.0 was used for the study.16 The ImPACT instrument is a computer-based program used to assess neurocognitive function and concussion symptoms. It consists of six neurocognitive tests that evaluate attention processes, verbal recognition memory, visual working memory, visual processing speed, reaction time, numerical sequencing ability and learning.17 Test-retest reliability for ImPACT was assessed over 8 days across four administrations, yielding correlation coefficients ranging from 0.66 to 0.85 for the verbal memory index, 0.75 to 0.88 for the processing speed, and 0.62 to 0.66 for the reaction time.18 Using reliable change indices, repeated administrations over a 2 week period revealed no practice effects.19 Correlations between the ImPACT visual and verbal memory composites with the Brief Visual Spatial Memory Test-Revised total score (r = 0.50) and the delayed recall score (r = 0.85) have been established20; the processing speed composite was shown to correlate with Trailmaking Tests A (r = −0.49) and B (r = −0.60), and the Symbol-Digit Modalities test (r = 0.68). Schatz and colleagues21 documented a combined sensitivity of 81.9% for ImPACT indices and total symptom score, and a specificity of 89.4%; positive likelihood ratio was approximately 8:1 and negative likelihood ration was 2:1. Validity studies did not examine sex differences, nor was ImPACT developed to minimise sex differences.
Protocol
Institutional Review Board approval for the research study was granted from each participating university, and written informed consent was obtained from all team physicians, athletic directors, athletes and certified athletic trainers. Athletes reported to their own institution’s athletic training room and then were taken to the computer laboratory by the researchers and explained the test procedures. Athletes completed the ImPACT neuropsychological test battery on a computer, which required approximately 30 min.
Data analysis
The ImPACT yields individual scores as well as composite scores for verbal memory, visual memory, motor processing speed and reaction time. Higher scores on verbal and visual memory and motor processing speed indicate a better performance. Verbal and visual memory scores are presented as a percentage of 100 and motor processing speed as a number composite score. The number composite score for motor processing speed is comprised of the average of the following test scores: (i) X’s and O’s–total correct (interference)/4; and (ii) three-letters-average counted correctly multiplied by 3. A lower score on reaction time indicates a better performance. All reaction time scores are presented in seconds. The ImPACT also yields individual scores for concussion symptoms. Athletes are asked to indicate if they are currently experiencing any of 22 concussion symptoms. The concussion symptoms are rated on a 7-point Likert scale, with 0 indicating not experiencing and 6 indicating severe.
A one-way multiple analysis of variance (MANOVA) was performed on verbal and visual memory, reaction time, and motor processing speed with sex as the between factor. The level of significance was set at p = 0.05. Another one-way MANOVA was performed on all the concussion symptoms with sex as the between factor. A minimum effect size of η2 = 0.25 between subjects and a probability level of 0.05 would require 25 subjects in each group for a statistical power of p = 0.80.22 All analyses were conducted using the Statistical Package for the Social Sciences version 11.1 (SPSS Inc, Chicago, USA).
RESULTS
Baseline neuropsychological test scores
MANOVA (Hotelling’s trace) revealed a significant multivariate effect of sex on cognitive performance (F4,1204 = 19.08, p = 0.001; h2 = 0.06). Subsequent univariate ANOVAs revealed that female athletes (n = 558) performed significantly better than male athletes on baseline verbal memory test scores (F1,1207 = 35.6, p = 0.001; d = 0.40). Male athletes (n = 613) performed significantly better than female athletes on baseline visual memory test scores (F1,1207 = 10.5, p = 0.001; d = 0.23). There were no significant differences on baseline motor processing speed and reaction time test scores (see table 2).
Baseline concussion symptoms
MANOVA (Wilks’ lambda) revealed a significant multivariate effect of sex on symptoms endorsed (F22,1186 = 4.63, p = 0.001; h2 = 0.08). Subsequent univariate ANOVAs (df = 1, 1207) revealed that symptoms endorsed by female athletes resulted in significantly higher mean symptom scores for the following symptoms, as compared to male athletes: headache (F = 20.4, p = 0.001; d = 0.25), nausea (F = 7.9, p = 0.005; d = 0.16), fatigue (F = 7.3, p = 0.007; d = 0.16), sleeping more than usual (F = 6.2, p = 0.01; d = 0.14), drowsiness (F = 6.2, p = 0.01; d = 0.14), sensitivity to light (F = 8.9, p = 0.003; d = 0.17), sensitivity to noise (F = 6.6, p = 0.01; d = 0.15), sadness (F = 14.9, p = 0.001; d = 0.22), nervousness (F1,1207 = 11.7, p = 0.001; d = 0.21), feeling more emotional (F = 51.3, p = 0.001; d = 0.40), difficulty concentrating (F = 10.4, p = 0.002; d = 0.18), visual problems (F = 4.9, p = 0.03; d = 0.13), and total symptom scores (F = 17.4, p = 0.001; d = 0.24). Refer to table 3 for means, standard deviations, ANOVA results and effect sizes.
As mean symptom scores did not reflect sex differences in symptom severity or likelihood of endorsing symptoms, Likert-scale symptom scores were recoded into a nominal/ordinal variable: none (scores of 0), mild (scores of 1, 2), moderate (scores of 3, 4) and severe (scores of 5, 6). χ2 analyses (df = 3; see table 4) revealed a significantly higher likelihood of symptom endorsement by female athletes for the following symptoms: headache (χ2 = 21.8, p = 0.001; V = 0.13), nausea (χ2 = 8.2, p = 0.04; V = 0.08), fatigue (χ2 = 10.6, p = 0.014; V = 0.09), trouble falling asleep (χ2 = 9.5, p = 0.024; V = 0.09), sleeping more than usual (χ2 = 8.3, p = 0.03; V = 0.09), sleeping less than usual (χ2 = 8.2, p = 0.04; V = 0.08), drowsiness (χ2 = 5.5, p = 0.05; V = 0.08), sensitive to light (χ2 = 10.9, p = 0.012; V = 0.10), sensitive to noise (χ2 = 10.7, p = 0.013; V = 0.09), irritability (χ2 = 12.2, p = 0.007; V = 0.10), sadness (χ2 = 16.5, p = 0.001; V = 0.12), nervousness (χ2 = 12.7, p = 0.005; V = 0.10), feeling more emotional (χ2 = 51.1, p = 0.001; V = 0.21), difficulty concentrating (χ2 = 9.4, p = 0.025; V = 0.09), and total symptom scores (χ2 = 12.3, p = 0.006; V = 0.10).
DISCUSSION
The overall results of this study revealed sex differences in baseline neuropsychological function and concussion symptoms. According to our findings, female athletes performed significantly better on baseline verbal memory compared to male athletes, while male athletes performed significantly better on baseline visual memory compared to female athletes. These results are consistent with Weiss et al2 who suggest that females perform better on verbal memory compared to males, while males respond to visual information better than females. Similarly, Barr12 reported that female athletes performed better on verbal initiation compared to male athletes.
Females may perform better on baseline verbal memory scores due to increased levels of oestrogen compared to males. Maki et al22 reported that females who received hormone replacement therapy exhibited better verbal memory test scores than those who did not. Both male and female athletes endorsed a wide range of mild symptoms at baseline, with 68% of male athletes and 76% of female athletes endorsing at least one symptom. Our findings revealed sex differences in baseline concussion symptoms. Small (effect size) but significant differences were seen in endorsement of mild degrees (for example, 1–2 on a 0–6 scale) of headache, fatigue, sleep difficulty, irritability, sadness, nervousness, feeling more emotional, feeling slowed down and difficulty concentrating. Further, at baseline, approximately 30–50% of the participants endorsed mild degrees of fatigue, sleep difficulty, drowsiness and difficulty concentrating. It is important to note that nearly all symptoms endorsed were mild in nature, with only 2–3% of participants endorsing any severe symptom (for example, 5–6 on a 0–6 scale). Baseline differences in symptom endorsement may be accounted for by numerous factors. For example, fatigue, drowsiness, and sleeping more than usual may be attributed to over training, time of season or lack of rest. Headache, nausea, sadness, and feeling more emotional may be attributed to female athletes’ menstrual cycle. However, these variables were not addressed in this study and warrant further investigation. Thus, sex differences in baseline symptom endorsing illustrate the importance of individual baseline evaluation which may help clinicians determine if an athlete is symptomatic as a result of the concussion or individual sex variability.
The present study shows that male and female athletes differ on baseline test measures. Normative data for ImPACT have been gender-corrected,23 so these results, in part, serve as a replication and external validation of the test developer’s norms. However, it is recommended that baseline testing continues, to allow athletes to serve as their own controls when comparing baseline and post-concussion data. The current study demonstrates that athletes’ performance does vary on the basis of gender on tests of visual and verbal memory, with significant between-groups differences and small-to-medium effect sizes, respectively. Furthermore, the athletes, as a group, displayed considerable variation in their performance on baseline test measures. Therefore, if an individual player’s performance before sustaining a concussion is not known, it is difficult to ascertain whether his/her level of performance is due to the effects of the concussion or to secondary effects.
In conclusion, significant sex differences were found in baseline neuropsychological function and concussion symptoms, with small-to-medium effect sizes. As male and female athletes exhibit sex differences at baseline, they may also demonstrate sex differences on post-concussion test scores, and clinicians need to be aware of these differences, especially when evaluating post-concussion data in the absence of a baseline assessment.
What is already known on this topic
-
Sex differences in cognitive performance have been reported for verbal memory, perceptual motor speed and visuospatial tasks.
-
Normative data for ImPACT, a computerised neuropsychological test battery, have been gender-corrected.
What this study adds
-
The present study shows that male and female athletes differ on baseline tests of visual and verbal memory.
-
It is recommended that baseline testing continues to allow athletes to serve as their own controls when comparing baseline and post-concussion data.
REFERENCES
Commentary
Without question, there are small but meaningful differences between men and women on variables that are relevant to outcome from concussion in sports. For example, women and men differ on some neurocognitive abilities and they differ in the way they experience and report subjective symptoms. More research is needed on the effects of a number of demographic and clinical variables, such as sex, ethnicity, learning disabilities, ADHD, and substance use on outcome measures used in sport concussion research.
Commentary
This study is clearly presented, and important. The authors address a topic that is timely and relevant in sports medicine. In a large sample of 1209 collegiate male and female athletes’ baseline neuropsychological function and concussion symptoms, the present study illustrates that male and female athletes differ on baseline neuropsychological test measures. Variability, particularly on verbal and visual memory scores between genders indicates a need to compare an athlete with his/her own baseline and not a normative group when making field decisions regarding post-concussion status and return to participation. Secondly, female athletes reported 13 out of 22 baseline concussion symptoms higher compared to male athletes. However, the small difference in concussion symptom scores may indicate that the significance found may be due to the very large sample size and may not be clinically relevant. Also, symptoms were self-reported by each athlete. Therefore, significant gender differences may be due, in part, to an athlete’s willingness to report symptoms. Further study is needed to determine if male and female athletes exhibit differences on post-concussion symptoms and neuropsychological function.
Footnotes
-
Published Online First 21 September 2006
-
We would like to thank the National Athletic Trainers’ Association Research and Education Foundation for financial support of this study (302DGP002).
-
Competing interests: None declared.