Research article
Physical Activity Assessment: Validation of a Clinical Assessment Tool

https://doi.org/10.1016/j.amepre.2006.08.021Get rights and content

Background

Physicians report that they fail to counsel patients about physical activity due to a lack of practical tools, time, reimbursement, knowledge, and confidence. This paper reports concurrent and criterion validation of the Physical Activity Assessment Tool (PAAT), designed to rapidly assess patient physical activity in clinical settings and reduce time for assessment, and thus to facilitate counseling.

Methods

Adult volunteers (n=68) completed the PAAT and International Physical Activity Questionnaire-Long Form (IPAQ-Long) twice and wore a Manufacturing Technology, Inc. (MTI) accelerometer for 14 days in 2003. Continuous and categorical measures of physical activity by PAAT were compared to MTI accelerometer and IPAQ-Long in analyses conducted in 2003 to 2006. Consistent with national recommendations, participants were classified as active if they accumulated more than 150 minutes per week of moderate to vigorous physical activity (MVPA) or more than 60 minutes per week of vigorous physical activity.

Results

The PAAT was significantly correlated with the IPAQ (r=0.562, p<0.001) and MTI (r=0.392, p=0.015) for MVPA. Seven-day test–retest reliability was comparable for PAAT (r=0.618, p<0.001) and MTI (r=0.527, p<0.001). PAAT classified participants as “active” or “under-active” concordantly with MTI for 69.8% of participants and with IPAQ for 66.7%; strength of agreement was fair (κ=0.338 and 0.212, respectively). The PAAT classified fewer participants as active than either the MTI (p=0.169) or IPAQ (p<0.001), and measured physical activity more like the direct objective measure (MTI) than did IPAQ.

Conclusions

The concurrent and criterion validity of the PAAT are comparable to self-report instruments used in epidemiologic research.

Introduction

Because of the salutary health effects of physical activity,1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11 the U.S. Surgeon General, Centers for Disease Control and Prevention, and American College of Sports Medicine recommend that American adults should get at least 30 minutes of moderate-intensity physical activity (MPA) in bouts of 10 or more minutes on most days of the week or 20 minutes of vigorous physical activity (VPA) on 3 or more days each week.1, 2 Although physician counseling appears to be modestly effective for short-term increases in patient physical activity, it remains uncertain how counseling should be done to elicit more durable changes in physical activity.12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28 Nonetheless, Healthy People 201029 recommended physician counseling for physical activity, and because 82% of people see a physician every year, the potential public health impact of physician counseling could be significant even if it is only modestly effective. Yet 52% to 78% of patients report that they have not been counseled about physical activity by their physicians.30, 31, 32, 33, 34, 35 Physicians report that they do not counsel patients because of a lack of practical tools, time, reimbursement, knowledge, and confidence that counseling will trigger behavior change.1, 2, 32, 36

The self-administered Physical Activity Assessment Tool (PAAT) (Figure 1) was developed to rapidly assess patient physical activity in primary care settings, reduce physician time for assessment, facilitate counseling, and address physician knowledge and confidence deficits. The PAAT defines moderate and vigorous physical activity, and incorporates questions used in International Physical Activity Questionnaire (IPAQ) Short form37 with lists of common types of physical activity that are stratified by intensity according to the updated Compendium of physical activity.38 The PAAT measures type, frequency, and duration of moderate and vigorous physical activity from all four domains of physical activity—leisure, occupational, household, and transportation—in the last 7 days, and asks if this is “more, less, or about the same as usual” activity. The PAAT can be completed in 5 to 7 minutes while patients wait to see a physician. It includes questions about possible contraindications to physical activity, stage of change, patient-oriented benefits, and psychosocial facilitators of physical activity. This paper describes validation of self-reported physical activity by PAAT against a direct, objective measure of physical activity—the Manufacturing Technology, Inc. (MTI, formerly Computer Science and Applications, Inc. [CSA]) accelerometer39, 40, 41, 42, 43, 44, 45, 46—and a previously validated, self-report instrument—the IPAQ-Long Form, Self Administered.37

Section snippets

Subjects

After human subjects approval, 69 adult volunteers from a university community in New Orleans were recruited in 2003 using flyers, word-of-mouth referrals, and one university-wide e-mail. Volunteers were screened for eligibility by phone and scheduled for enrollment and baseline data collection at one of two on-campus sites. Volunteers were eligible if they were aged 18 to 64 years, not pregnant, had a body mass index (BMI) <40, and no contraindications to moderate physical activity based on

Results

Sixty-nine individuals were enrolled, and 34 (49.3%) reported that they were active at screening. One participant withdrew during the first week of the study; 68 participants completed two data-collection visits. Because of missing data, MTI data were available for analysis for only 63 participants. Participants and enrollment and retention are described in Table 1 and Figure 2. More than half of participants were classified as active by each of the three measures. The PAAT classified fewer

Discussion

The PAAT meets criteria for concurrent and criterion validity described by Sallis and Saelens,52 and incorporates a wide range of types of physical activity thought to be acceptable to and understood by culturally diverse patients.53, 54 The PAAT assesses physical activity frequency, intensity, type, and time; elicits recall for moderate and vigorous physical activity from all four domains of physical activity—leisure, occupational, household chores, and transportation52, 55; is able to measure

Conclusion

The PAAT demonstrates concurrent and criterion validity comparable to other physical activity self-report instruments, and agreement with the criterion measure MTI is fair. Test–retest reliability was similar to that of our criterion measure, MTI accelerometers. In this study, the PAAT slightly under-estimated the number of active participants compared with the criterion measure MTI, but performed more like the criterion measure than did the IPAQ. The PAAT warrants further evaluation.

References (91)

  • R.A. Washburn et al.

    The Physical Activity Scale for the Elderly (PASE): development and evaluation

    J Clin Epidemiol

    (1993)
  • R.A. Washburn et al.

    Reliability and physiologic correlates of the Harvard Alumni activity survey in a general population

    J Clin Epidemiol

    (1991)
  • B.E. Ainsworth et al.

    Accuracy of the College Alumnus Physical Activity questionnaire

    J Clin Epidemiol

    (1993)
  • R.B. Warnecke et al.

    Improving question wording in surveys of culturally diverse populations

    Ann Epidemiol

    (1997)
  • Physical activity and health: report of the Surgeon General

    (1996)
  • R.R. Pate et al.

    Physical activity and public healthA recommendation from the Centers for Disease Control and Prevention and the American College of Sports Medicine

    JAMA

    (1995)
  • R.S. Paffenbarger et al.

    Physical activity, all-cause mortality, and longevity of college alumni

    N Engl J Med

    (1986)
  • R.S. Paffenbarger et al.

    The association of changes in physical-activity level and other lifestyle characteristics with mortality among men

    N Engl J Med

    (1993)
  • S.N. Blair et al.

    Physical fitness and all-cause mortalityA prospective study of healthy men and women

    JAMA

    (1989)
  • S.N. Blair et al.

    Changes in physical fitness and all-cause mortalityA prospective study of healthy and unhealthy men

    JAMA

    (1995)
  • I.M. Lee et al.

    Exercise intensity and longevity in menThe Harvard Alumni Health Study

    JAMA

    (1995)
  • M. Wei et al.

    Relationship between low cardiorespiratory fitness and mortality in normal-weight, overweight, and obese men

    JAMA

    (1999)
  • B. Rockhill et al.

    A prospective study of recreational physical activity and breast cancer risk

    Arch Intern Med

    (1999)
  • A.S. Leon et al.

    Leisure-time physical activity levels and risk of coronary heart disease and death

    JAMA

    (1987)
  • M.L. Slattery et al.

    Leisure time physical activity and coronary heart disease death

    Circulation

    (1989)
  • R.J. Petrella et al.

    Does counseling help patients get active?Systematic review of the literature

    Can Fam Physician

    (2002)
  • R.J. Petrella et al.

    An office-based instrument for exercise counseling and prescription in primary careThe Step Test Exercise Prescription (STEP)

    Arch Fam Med

    (2000)
  • M.W. Kreuter et al.

    How does physician advice influence patient behavior?Evidence for a priming effect

    Arch Fam Med

    (2000)
  • E.G. Eakin et al.

    Review of primary care-based physical activity intervention studies: effectiveness and implications for practice and future research

    J Fam Pract

    (2000)
  • Effects of physical activity counseling in primary careThe Activity Counseling Trial: a randomized controlled trial

    JAMA

    (2001)
  • C.R. Elley et al.

    Effectiveness of counselling patients on physical activity in general practice: cluster randomised controlled trial

    BMJ

    (2003)
  • K.B. Eden et al.

    Does counseling by clinicians improve physical activity? A summary of the evidence for the U.SPreventive Services Task Force

    Ann Intern Med

    (2002)
  • A. Steptoe et al.

    The impact of behavioral counseling on stage of change in fat intake, physical activity, and cigarette smoking in adults at increased risk of coronary heart disease

    Am J Public Health

    (2001)
  • B.J. Smith et al.

    Promoting physical activity in general practice: a controlled trial of written advice and information materials

    Br J Sports Med

    (2000)
  • N.M. Kerse et al.

    Improving the health behaviours of elderly people: randomised controlled trial of a general practice education programme

    BMJ

    (1999)
  • P.J. O’Connor et al.

    Professional advice and readiness to change behavioral risk factors among members of a managed care organization

    Am J Manag Care

    (2001)
  • Healthy people 2010

    (1999)
  • M.L. Granner et al.

    Health care provider counseling for physical activity among black and white South Carolinians

    J S C Med Assoc

    (2001)
  • C.C. Wee et al.

    Physician counseling about exercise

    JAMA

    (1999)
  • Physician advice and individual behaviors about cardiovascular disease risk reduction—seven states and Puerto Rico, 1997

    MMWR Morb Mortal Wkly Rep

    (1999)
  • T.M. Damush et al.

    Prevalence and correlates of physician recommendations to exercise among older adults

    J Gerontol A Biol Sci Med Sci

    (1999)
  • C.L. Craig et al.

    International physical activity questionnaire:12-country reliability and validity

    Med Sci Sports Exerc

    (2003)
  • B.E. Ainsworth et al.

    Compendium of physical activities: an update of activity codes and MET intensities

    Med Sci Sports Exerc

    (2000)
  • P.S. Freedson et al.

    Calibration of the Computer Science and Applications, Inc. accelerometer

    Med Sci Sports Exerc

    (1998)
  • S.G. Trost et al.

    Validity of the computer science and applications (CSA) activity monitor in children

    Med Sci Sports Exerc

    (1998)
  • Cited by (57)

    • Objective assessment of physical activity patterns based on accelerometer and GPS data in adults

      2021, Travel Behaviour and Society
      Citation Excerpt :

      In this study, we analysed only walking activity. The triaxial accelerometer records body movements and it is used to measure PA (Meriwether et al., 2006; Puyau et al., 2002; Reddy et al., 2010). The triaxial accelerometer sensor records the data of PA every 10 s (10 Hz measurement frequency).

    • Validity of the Exercise Vital Sign Tool to Assess Physical Activity

      2021, American Journal of Preventive Medicine
      Citation Excerpt :

      When examining the performance of the EVS in identifying inactive participants compared with accelerometry, sensitivity was 67% (95% CI=61%, 73%), specificity was 68% (95% CI=62%, 73%), positive predictive value was 61% (95% CI=55%, 67%), and negative predictive value was 73% (95% CI=68%, 78%) (Table 3). When examining the criterion validity of the EVS against 7-day accelerometry in a large cohort of adults, a low-to-fair correlation for weekly MVPA was found, which is consistent with comparisons of previous studies of the EVS and other self-report instruments with accelerometry.15,16,26–28 The EVS correctly classified 68% and 67% of adults who did and did not meet PA guidelines, respectively.

    • A Community Health Orientation for Wellness Technology Design &amp; Delivery

      2018, Designing Healthcare That Works: A Sociotechnical Approach
    • Health Care Systems and National Policy. Role of Leadership in the Obesity Crisis.

      2016, Primary Care - Clinics in Office Practice
      Citation Excerpt :

      These specific behaviors are amenable to brief clinic-based counseling for prevention and treatment of obesity.82 Two valid and reliable questionnaires exist to assess physical activity in adults: the Rapid Assessment of Physical Activity83 and the Physical Activity Assessment Tool 3.84 Physical Activity Vital Sign (PAVS) uses 2 questions to assess moderate to vigorous physical activity levels: (1) How many days during the past week have you performed physical activity where your heart beats faster and your breathing is harder than normal for 30 minutes or more? (

    View all citing articles on Scopus
    View full text