Skip to main content

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

  • News Feature
  • Published:

Scientific method: Statistical errors

P values, the 'gold standard' of statistical validity, are not as reliable as many scientists assume.

This is a preview of subscription content, access via your institution

Access options

Buy this article

Prices may be subject to local taxes which are calculated during checkout

References

  1. Nosek, B. A., Spies, J. R. & Motyl, M. Perspect. Psychol. Sci. 7, 615–631 (2012).

    Article  Google Scholar 

  2. Ioannidis, J. P. A. PLoS Med. 2, e124 (2005).

    Article  Google Scholar 

  3. Lambdin, C. Theory Psychol. 22, 67–90 (2012).

    Article  Google Scholar 

  4. Goodman, S. N. Ann. Internal Med. 130, 995–1004 (1999).

    Article  CAS  Google Scholar 

  5. Goodman, S. N. Epidemiology 12, 295–297 (2001).

    Article  CAS  Google Scholar 

  6. Goodman, S. N. Stat. Med. 11, 875–879 (1992).

    Article  CAS  Google Scholar 

  7. Gorroochurn, P., Hodge, S. E., Heiman, G. A., Durner, M. & Greenberg, D. A. Genet. Med. 9, 325–321 (2007).

    Article  Google Scholar 

  8. Cacioppo, J. T., Cacioppo, S., Gonzagab, G. C., Ogburn, E. L. & VanderWeele, T. J. Proc. Natl Acad. Sci. USA 110, 10135–10140 (2013).

    Article  ADS  CAS  Google Scholar 

  9. Simmons, J. P., Nelson, L. D. & Simonsohn, U. Psychol. Sci. 22, 1359–1366 (2011).

    Article  Google Scholar 

  10. Simonsohn, U., Nelson, L. D. & Simmons, J. P. J. Exp. Psychol. http://dx.doi.org/10.1037/a0033242 (2013).

  11. Campbell, J. P. J. Appl. Psych. 67, 691–700 (1982).

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Additional information

See Editorial page 131

Tweet Facebook LinkedIn Weibo

Related links

Related links

Related links in Nature Research

Number crunch 2014-Feb-12

Policy: NIH plans to enhance reproducibility 2014-Jan-27

Weak statistical standards implicated in scientific irreproducibility 2013-Nov-11

Uncertainty on trial 2013-Oct-02

Matters of significance 2013-Aug-29

Announcement: Reducing our irreproducibility 2013-Apr-24

Replication studies: Bad copy 2012-May-16

Blog post: Let's give statistics the attention it deserves in biological research

Blog post: Statistics is the sexy in science

Nature special: Challenges in irreproducible research

Related external links

Psychological Science tutorial on alternatives to the P value

The BUGS (Bayesian inference Using Gibbs Sampling) Project

Bayesian Cognitive Modelling: A Practical Course

Rights and permissions

Reprints and permissions

About this article

Cite this article

Nuzzo, R. Scientific method: Statistical errors. Nature 506, 150–152 (2014). https://doi.org/10.1038/506150a

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1038/506150a

Search

Quick links

Nature Briefing AI and Robotics

Sign up for the Nature Briefing: AI and Robotics newsletter — what matters in AI and robotics research, free to your inbox weekly.

Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing: AI and Robotics