Bonferroni correction
From Wikipedia, the free encyclopedia
In statistics, the Bonferroni correction states that if an experimenter is testing n dependent or independent hypotheses on a set of data, then one way of maintaining the familywise error rate is to test each individual hypothesis at a statistical significance level of 1/n times what it would be if only one hypothesis were tested (α/n). Statistically significant simply means that a given result is unlikely to have occurred by chance assuming your hypothesis is correct. Another correction that is often used is
- 1 − (1 − α)1/n (corrected for n comparisons)
For example, to test two independent hypotheses on the same data at 0.05 significance level, instead of using a p value threshold of 0.05, one would use a stricter threshold equal to the square root of 0.05. Notably one can derive valid confidence intervals matching the test decision using the Bonferroni correction by using 100(1 − α1/n)% confidence intervals.
The Bonferroni correction is a safeguard against multiple tests of statistical significance on the same data falsely giving the appearance of significance, as 1 out of every 20 hypothesis-tests is expected to be significant at the α = 0.05 level purely due to chance. Furthermore, the probability of getting a significant result with n tests at this level of significance is 1 − 0.95n (1 − probability of not getting a significant result with n tests).
It was developed by Italian mathematician Carlo Emilio Bonferroni.
A uniformly more powerful test procedure (i.e. more powerful regardless of the values of the unobservable parameters) is the Holm-Bonferroni method; however, current methods for obtaining confidence intervals for the Holm-Bonferroni method do not guarantee confidence intervals that are contained within those obtained using the Bonferroni correction. A less restrictive criterion that does not control the familywise error rate is the rough false discovery rate giving (3/4)0.05 = 0.0375 for n = 2 and (21/40)0.05 = 0.02625 for n = 20.
[edit] See also
[edit] References
- Abdi, H (2007). "Bonferroni and Sidak corrections for multiple comparisons". in N.J. Salkind (ed.). Encyclopedia of Measurement and Statistics. Thousand Oaks, CA: Sage. http://www.utdallas.edu/~herve/Abdi-Bonferroni2007-pretty.pdf.
- Manitoba Centre for Health Policy (MCHP) 2008, Concept: Multiple Comparisons, http://mchp-appserv.cpe.umanitoba.ca/viewConcept.php?conceptID=1049
- Perneger, Thomas V, What's wrong with Bonferroni adjustments, BMJ 1998;316:1236-1238 ( 18 April ) http://www.bmj.com/cgi/content/full/316/7139/1236
- School of Psychology, University of New England, New South Wales, Australia, 2000, http://www.une.edu.au/WebStat/unit_materials/c5_inferential_statistics/bonferroni.html
- Weisstein, Eric W. "Bonferroni Correction." From MathWorld–A Wolfram Web Resource http://mathworld.wolfram.com/BonferroniCorrection.html
- Shaffer, J. P. "Multiple Hypothesis Testing." Ann. Rev. Psych. 46, 561–584, 1995.
- Strassburger, K, Bretz, Frank. "Compatible simultaneous lower confidence bounds for the Holm procedure and other Bonferroni-based closed tests". Stat Med, 2008.
This article is in need of attention from an expert on the subject. WikiProject Statistics or the Statistics Portal may be able to help recruit one. (November 2008) |