Clinical significance vs statistical significance. How to interpret the confidence interval at 95 %
PDF (Spanish)
PubMed

Supplementary Files

XML (Spanish)

Keywords

P-value
Confidence interval 95 %
Clinical decision

Abstract

The validity of a study depends on its proper planning, execution and analysis. If these are sufficiently correct, the decision to apply the recommendations issued depends on the expected clinical effect. This effect may have random variations, hence the need to use statistical inference. For years the p-value has been used to determine this statistical significance and the confidence intervals to measure the magnitude of the effect. In this review we present a proposal of how to interpret the 95 % confidence intervals (CI 95 %) as estimators of the expected effect variability based on considering the threshold or value of clinical significance and the null value of the difference or rejection of statistical significance. Thus, an association or effect where the CI 95 % includes the null value (no effect or difference) is interpreted as inconclusive; one between the null value and the clinical threshold (without including them) as possibly inconsequential; one that does not include the null value but the clinical threshold as yet not conclusive and one beyond the clinical threshold as conclusive.
PDF (Spanish)
PubMed

References

Argimon JM. El intervalo de confianza: algo más que un valor de significación estadística. Med Clin. 2002;118(10):382-384. DOI: http://dx.doi.org/10.1016/S0025-7753(02)72393-2

van-Rijn MHC, Bech-A, Bouyer J, van-Den-Brand JAJG. Statistical significance versus clinical relevance. Nephrol Dial Transplant. 2017;32 Suppl 2:ii6-ii12. DOI: http://dx.doi.org/10.1016/S0025-7753(02)72393-2

Greenland S, Senn SJ, Rothman KJ, Carlin JB, Poole C, Goodman SN, et al. Statistical tests, P values, confidence intervals, and power: A guide to misinterpretations. Eur J Epidemiol. 2016;31(4):337-50. DOI: http://dx.doi.org/10.1007/s10654-016-0149-3

Fisher RA. Statistical methods for research workers. Escocia: Genesis Publishing; 1925.

Goodman S. A dirty dozen: Twelve p-value misconceptions. Semin Hematol. 2008;45(3):135-140. DOI: http://dx.doi.org/10.1053/j.seminhematol.2008.04.003

Feinstein AR. P-values and confidence intervals: two sides of the same unsatisfactory coin. J Clin Epidemiol. 1998;51(4):355-360. DOI: http://dx.doi.org/10.1016/S0895-4356(97)00295-3

Gardner MJ, Altman DG. Confidence intervals rather than P values: Estimation rather than hypothesis testing. Br Med J (Clin Res Ed). 1986;292(6522):746-750. DOI: http://dx.doi.org/10.1136/bmj.292.6522.746

Head ML, Holman L, Lanfear R, Kahn AT, Jennions MD. The extent and consequences of p-hacking in science. PLoS Biol. 2015;13(3):e1002106. DOI: http://dx.doi.org/10.1371/journal.pbio.1002106

Frick RW. The appropriate use of null hypothesis testing. Psychol Methods. 1996;1(4):379-390. Disponible en: http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.468.6113&rep=rep1&type=pdf

Rothman J. A show of confidence. N Engl J Med. 1978;299(24):1362-1363. DOI: http://dx.doi.org/10.1056/NEJM197812142992410

Du-Prel JB, Hommel G, Röhrig B, Blettner M. Confidence interval or p-value?: part 4 of a series on evaluation of scientific publications. Dtsch Arztebl Int. 2009;106(19):335-339. DOI: http://dx.doi.org/10.3238/arztebl.2009.0335

Morey RD, Hoekstra R, Rouder JN, Lee MD, Wagenmakers EJ. The fallacy of placing confidence in confidence intervals. Psychon Bull Rev. 2016;23(1):103-123. DOI: http://dx.doi.org/10.3758/s13423-015-0947-8

Page P. Beyond statistical significance: clinical interpretation of rehabilitation research literature. Int J Sports Phys Ther. 2014;9(5):726-736.

Savitz DA, Tolo KA, Poole C. Statistical significance testing in the American Journal of Epidemiology, 1970-1990. Am J Epidemiol. 1994;139(10):1047-1052. DOI: http://dx.doi.org/10.1093/oxfordjournals.aje.a116944

Manterola C, Pineda V, Grupo MINCIR. El valor de “p” y la “significación estadística”. Aspectos generales y su valor en la práctica clínica. Rev Chil Cir. 2008;60(1):86-89. DOI: http://dx.doi.org/10.4067/S0718-40262008000100018

Clark ML. Los valores p y los intervalos de confianza: ¿en qué confiar? Rev Panam Salud Publica. 2004;15(5):293-296. Disponible en: https://scielosp.org/pdf/rpsp/v15n5/21999.pdf

Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

Copyright (c) 2017 Revista Alergia México

Downloads

Download data is not yet available.