Statistics from Altmetric.com
P values have been the subject of debate for decades. Many researchers tend to think—or at least describe—their study outcomes to be either true or false based solely on p values.1 While a recent British Journal of Sports Medicine editorial provided a primer for sports medicine researchers to correctly understand p values,2 we aim to extend this discussion by reminding researchers to adopt a thoughtful approach to the entire statistical analysis process, using the relevant tools to build their case.
The goal of the sports medicine researcher—a building analogy
Scientific reasoning can be viewed as building a case for the existence (or non-existence) of phenomena. For sports medicine researchers, their specific goals may include the case for or against a treatment’s effectiveness, the risk of injury associated with certain risk factors, or the ability to predict a certain outcome given a set of criteria.
As with any building process, a number of steps are required. In this analogy, the process should include the following: designing the blueprint (preregistering studies where possible and outlining planned analyses), laying a foundation of sound data collection (appropriate sampling strategy, blinding where possible, ensuring measurement validity/reliability), understanding the flooring and roofing of study power (effect size, sample size and others), and painting the internal/external validity of the study. The entire process takes …
If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.