Behavioral Ecology Vol. 14 No. 3: 438-445
© 2003 International Society for Behavioral Ecology
A survey of the statistical power of research in behavioral ecology and animal behavior
a School of Botany and Zoology, Australian National University, Canberra, A.C.T. 0200, Australia, Smithsonian Tropical Research Institute, Apartado 2072, Balboa, Republic of Panama b Laboratoire d'Ecologie Evolutive Parasitaire, CNRS FRE 2365, Université Pierre et Marie Curie, Bât. A, 7ème étage, 7 quai St. Bernard, Case 237, F-75252 Paris Cedex 5, France
Address correspondence to M.D. Jennions at the School of Botany and Zoology, Australian National University, Canberra, A.C.T. 0200, Australia. E-mail: michael.jennions{at}anu.edu.au.
We estimated the statistical power of the first and last statistical test presented in 697 papers from 10 behavioral journals. First tests had significantly greater statistical power and reported more significant results (smaller p values) than did last tests. This trend was consistent across journals, taxa, and the type of statistical test used. On average, statistical power was 13–16% to detect a small effect and 40–47% to detect a medium effect. This is far lower than the general recommendation of a power of 80%. By this criterion, only 2–3%, 13–21%, and 37–50% of the tests examined had the requisite power to detect a small, medium, or large effect, respectively. Neither p values nor statistical power varied significantly across the 10 journals or 11 taxa. However, mean p values of first and last tests were significantly correlated across journals (
), with a similar trend for mean power (
). There is therefore some evidence that power and p values are repeatable among journals. Mean p values or power of first and last tests were, however, uncorrelated across taxa. Finally, there was a significant correlation between power and reported p value for both first (
) and last tests (
). If true effect sizes are unrelated to study sample sizes, the average true effect size must be nonzero for this pattern to emerge. This suggests that failure to observe significant relationships is partly owing to small sample sizes, as power increases with sample size. Key words: effect size, meta-analysis, publication bias, sample sizes, statistical power. [Behav Ecol 14:438–445 (2003)]
CiteULike 
Connotea 
Del.icio.us What's this?
This article has been cited by other articles:
|
|
 |
|
  G. Stewart Meta-analysis in applied ecology Biol Lett, September 23, 2009; (2009) rsbl.2009.0546v1. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 B. Ask, E. H. van der Waaij, and S. C. Bishop Modeling Variability in Immunocompetence and Immunoresponsiveness Poult. Sci., September 1, 2008; 87(9): 1748 - 1759. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 O. Rios-Cardenas and M. S. Webster Paternity and paternal effort in the pumpkinseed sunfish Behav. Ecol., September 1, 2005; 16(5): 914 - 921. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
S. Nakagawa A farewell to Bonferroni: the problems of low statistical power and publication bias Behav. Ecol., November 1, 2004; 15(6): 1044 - 1045. [Full Text] [PDF]
|
|