Volume 7 Supplement 1

8th International Conference on Conservative Management of Spinal Deformities and SOSORT 2011 Annual Meeting

Open Access

Determining clinical significance independently from statistical significance? Implications for practice

  • S Schreiber1,
  • EC Parent2 and
  • DM Hedden2
Scoliosis20127(Suppl 1):O34

DOI: 10.1186/1748-7161-7-S1-O34

Published: 27 January 2012

Objective

To present two proposed methods for determining clinically significant effects and describe each by using the same example from the scoliosis literature where statistical significance was not obtained.

Background

In science, statistics are universally used for making an inference about a population from sample data. The purpose of statistical inference is to determine if a proposed null hypothesis can be rejected, by comparing the probability of an observation to occur under the null hypothesis (p-value) to a chosen alpha level of confidence. The null hypothesis is rejected if the p-value is smaller than alpha. The current focus on null hypothesis statistical significance testing in published work perpetuates confusion between statistical significance and clinical importance. Clinically, there are shortfalls to relying only on statistical inference.

Materials and methods

A review of the Pubmed literature revealed several methods for assessing the significance of a clinical effect [1][2]. Two methods will be presented because they are easy to calculate and all variables needed for calculation were available from the scoliosis literature: Half standard deviation rule of thumb and a method combining cut-off points and reliable change index (RCI). Both methods are presented using an example from the scoliosis literature on the effect of exercises where statistical significance was not obtained.

Results

The proposed methods, although mathematically different, are more similar than different in terms of the conclusions they produce.

Conclusions

A combination of statistical and clinical significance determination methods to drawn statistically and clinically relevant inferences should be used when reporting clinical study results.

Authors’ Affiliations

(1)
University of Alberta, Faculty of Rehabilitation Medicine
(2)
University of Alberta/Alberta Health Services

References

  1. Wise EA: Statistical significance testing and clinical effectiveness studies. Psychotherapy (chic). 2011, 48 (3): 225-8.View ArticleGoogle Scholar
  2. Chapman JR, Norvell DC, Hermsmeyer JT, Bransford RJ, Devine J, McGirt MJ, Lee MJ: Evaluating common outcomes for measuring treatment succes for chronic low back pain. Spine. 2011, 36 (21): S54-68.View ArticlePubMedGoogle Scholar

Copyright

© Schreiber et al; licensee BioMed Central Ltd. 2012

This article is published under license to BioMed Central Ltd. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Advertisement