45

Scheel, A. M., Schijen, M., & Lakens, D. (2020). An excess of positive results: Comparing the

standard Psychology literature with Registered Reports.

https://doi.org/10.31234/osf.io/p6e9c

Schimmack, U. (2012). The ironic effect of significant results on the credibility of multiple-study

articles. Psychological Methods, 17(4), 551–566. https://doi.org/10.1037/a0029487

Schmidt, S. (2009). Shall we Really do it Again? The Powerful Concept of Replication is

Neglected in the Social Sciences. Review of General Psychology, 13(2), 90–100.

https://doi.org/10.1037/a0015108

Schnall, S. (2014). Clean data: Statistical artifacts wash out replication efforts.

Schwarz, N., & Strack, F. (2014). Does merely going through the same moves make for a

“direct” replication? Concepts, contexts, and operationalizations. Social Psychology,

45(4), 305–306.

Schweinsberg, M., Madan, N., Vianello, M., Sommer, S. A., Jordan, J., Tierney, W., Awtrey, E.,

Zhu, L. L., Diermeier, D., Heinze, J. E., Srinivasan, M., Tannenbaum, D., Bivolaru, E.,

Dana, J., Davis-Stober, C. P., du Plessis, C., Gronau, Q. F., Hafenbrack, A. C., Liao, E.

Y., … Uhlmann, E. L. (2016). The pipeline project: Pre-publication independent

replications of a single laboratory’s research pipeline. Journal of Experimental Social

Psychology, 66, 55–67. https://doi.org/10.1016/j.jesp.2015.10.001

Sedlmeier, P., & Gigerenzer, G. (1992). Do studies of statistical power have an effect on the

power of studies?

Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi-experimental

designs for generalized causal inference/William R. Shedish, Thomas D. Cook, Donald

T. Campbell. Boston: Houghton Mifflin,.

Shiffrin, R. M., Börner, K., & Stigler, S. M. (2018). Scientific progress despite irreproducibility: A

seeming paradox. Proceedings of the National Academy of Sciences, 115(11), 2632–

2639. https://doi.org/10.1073/pnas.1711786114
 46

Shih, M., & Pittinsky, T. L. (2014). Reflections on positive stereotypes research and on

replications.

Silberzahn, R., Uhlmann, E. L., Martin, D. P., Anselmi, P., Aust, F., Awtrey, E., Bahník, Š., Bai,

F., Bannard, C., Bonnier, E., Carlsson, R., Cheung, F., Christensen, G., Clay, R., Craig,

M. A., Dalla Rosa, A., Dam, L., Evans, M. H., Flores Cervantes, I., … Nosek, B. A.

(2018). Many Analysts, One Data Set: Making Transparent How Variations in Analytic

Choices Affect Results. Advances in Methods and Practices in Psychological Science,

1(3), 337–356. https://doi.org/10.1177/2515245917747646

Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011). False-Positive Psychology: Undisclosed

Flexibility in Data Collection and Analysis Allows Presenting Anything as Significant.

Psychological Science, 22(11), 1359–1366. https://doi.org/10.1177/0956797611417632

Simons, D. J. (2014). The Value of Direct Replication. Perspectives on Psychological Science,

9(1), 76–80. https://doi.org/10.1177/1745691613514755

Simons, D. J., Shoda, Y., & Lindsay, D. S. (2017). Constraints on Generality (COG): A

Proposed Addition to All Empirical Papers. Perspectives on Psychological Science,

12(6), 1123–1128. https://doi.org/10.1177/1745691617708630

Simonsohn, U. (2015). Small Telescopes: Detectability and the Evaluation of Replication

Results. Psychological Science, 26(5), 559–569.

https://doi.org/10.1177/0956797614567341

Simonsohn, U., Simmons, J. P., & Nelson, L. D. (2020). Specification curve analysis. Nature

Human Behaviour, 1–7. https://doi.org/10.1038/s41562-020-0912-z

Smaldino, P. E., & McElreath, R. (2016). The natural selection of bad science. Royal Society

Open Science, 3(9), 160384. https://doi.org/10.1098/rsos.160384

Smith, P. L., & Little, D. R. (2018). Small is beautiful: In defense of the small-N design.

Psychonomic Bulletin & Review, 25(6), 2083–2101. https://doi.org/10/gc7qn4

Soderberg, C. K. (2018). Using OSF to share data: A step-by-step guide. Advances in Methods
 47

and Practices in Psychological Science, 1(1), 115–120.

Soderberg, C. K., Errington, T., Schiavone, S. R., Bottesini, J. G., Thorn, F. S., Vazire, S.,

Esterling, K. M., & Nosek, B. A. (2020). Research Quality of Registered Reports

Compared to the Traditional Publishing Model. MetaArXiv.

https://doi.org/10.31222/osf.io/7x9vy

Soto, C. J. (2019). How replicable are links between personality traits and consequential life

outcomes? The life outcomes of personality replication project. Psychological Science,

30(5), 711–727. https://doi.org/10/gfx5h3

Spellman, B. A. (2015). A Short (Personal) Future History of Revolution 2.0. Perspectives on

Psychological Science, 10(6), 886–899. https://doi.org/10.1177/1745691615609918

Steegen, S., Tuerlinckx, F., Gelman, A., & Vanpaemel, W. (2016). Increasing Transparency

Through a Multiverse Analysis. Perspectives on Psychological Science, 11(5), 702–712.

https://doi.org/10.1177/1745691616658637

Sterling, T. D., Rosenbaum, W. L., & Weinkam, J. J. (2012). Publication Decisions Revisited:

The Effect of the Outcome of Statistical Tests on the Decision to Publish and Vice Versa.

The American Statistician.

http://www.tandfonline.com/doi/abs/10.1080/00031305.1995.10476125

Sterling, Theodore D. (1959). Publication Decisions and their Possible Effects on Inferences

Drawn from Tests of Significance—Or Vice Versa. Journal of the American Statistical

Association, 54(285), 30–34. https://doi.org/10/gckf9z

Stroebe, W., & Strack, F. (2014). The Alleged Crisis and the Illusion of Exact Replication.

Perspectives on Psychological Science, 9(1), 59–71.

https://doi.org/10.1177/1745691613514450

Szucs, D., & Ioannidis, J. P. A. (2017). Empirical assessment of published effect sizes and

power in the recent cognitive neuroscience and psychology literature. PLOS Biology,

15(3), e2000797. https://doi.org/10/b4r4

 48

Tiokhin, L., & Derex, M. (2019). Competition for novelty reduces information sampling in a

research game-a registered report. Royal Society Open Science, 6(5), 180934.

https://doi.org/10/gf9h3t

TOP Resources—Evidence and Practices. (2016). https://doi.org/None

Van Bavel, J. J., Mende-Siedlecki, P., Brady, W. J., & Reinero, D. A. (2016). Contextual

sensitivity in scientific reproducibility. Proceedings of the National Academy of Sciences,

113(23), 6454–6459. https://doi.org/10.1073/pnas.1521897113

Vazire, S. (2018). Implications of the Credibility Revolution for Productivity, Creativity, and

Progress. Perspectives on Psychological Science, 13(4), 411–417.

https://doi.org/10.1177/1745691617751884

Vazire, S., Schiavone, S. R., & Bottesini, J. G. (2020). Credibility Beyond Replicability:

Improving the Four Validities in Psychological Science. PsyArXiv.

https://doi.org/10.31234/osf.io/bu4d3

Verhagen, J., & Wagenmakers, E.-J. (2014). Bayesian tests to quantify the result of a replication

attempt. Journal of Experimental Psychology: General, 143(4), 1457–1475.

https://doi.org/10.1037/a0036731

Verschuere, B., Meijer, E. H., Jim, A., Hoogesteyn, K., Orthey, R., McCarthy, R. J., Skowronski,

J. J., Acar, O. A., Aczel, B., & Bakos, B. E. (2018). Registered replication report on

Mazar, Amir, and Ariely (2008). Advances in Methods and Practices in Psychological

Science, 1(3), 299–317.

Vosgerau, J., Simonsohn, U., Nelson, L. D., & Simmons, J. P. (2019). 99% impossible: A valid,

or falsifiable, internal meta-analysis. Journal of Experimental Psychology: General,

148(9), 1628–1639. https://doi.org/10.1037/xge0000663

Wagenmakers, E.-J., Beek, T., Dijkhoff, L., Gronau, Q. F., Acosta, A., Adams, R. B., Albohn, D.

N., Allard, E. S., Benning, S. D., Blouin-Hudon, E.-M., Bulnes, L. C., Caldwell, T. L.,

Calin-Jageman, R. J., Capaldi, C. A., Carfagno, N. S., Chasten, K. T., Cleeremans, A.,
 49

Connell, L., DeCicco, J. M., … Zwaan, R. A. (2016). Registered Replication Report:

Strack, Martin, & Stepper (1988). Perspectives on Psychological Science, 11(6), 917–

928. https://doi.org/10.1177/1745691616674458

Wagenmakers, Eric-Jan, Wetzels, R., Borsboom, D., & Van Der Maas, H. L. (2011). Why

psychologists must change the way they analyze their data: The case of psi: comment

on Bem (2011).

Wagenmakers, Eric-Jan, Wetzels, R., Borsboom, D., van der Maas, H. L., & Kievit, R. A. (2012).

An agenda for purely confirmatory research. Perspectives on Psychological Science,

7(6), 632–638.

Wagge, J., Baciu, C., Banas, K., Nadler, J. T., Schwarz, S., Weisberg, Y., IJzerman, H., Legate,

N., & Grahe, J. (2018). A Demonstration of the Collaborative Replication and Education

Project: Replication Attempts of the Red-Romance Effect. PsyArXiv.

https://doi.org/10.31234/osf.io/chax8

Whitcomb, D., Battaly, H., Baehr, J., & Howard-Snyder, D. (2017). Intellectual humility: Owning

our limitations. https://doi.org/10/ghwq2x

Wicherts, J. M., Bakker, M., & Molenaar, D. (2011). Willingness to Share Research Data Is

Related to the Strength of the Evidence and the Quality of Reporting of Statistical

Results. PLoS ONE, 6(11), e26828. https://doi.org/10/g29

Wilkinson, M. D., Dumontier, M., Aalbersberg, Ij. J., Appleton, G., Axton, M., Baak, A.,

Blomberg, N., Boiten, J.-W., da Silva Santos, L. B., Bourne, P. E., Bouwman, J.,

Brookes, A. J., Clark, T., Crosas, M., Dillo, I., Dumon, O., Edmunds, S., Evelo, C. T.,

Finkers, R., … Mons, B. (2016). The FAIR Guiding Principles for scientific data

management and stewardship. Scientific Data, 3(1), 160018. https://doi.org/10/bdd4

Wilson, B. M., Harris, C. R., & Wixted, J. T. (2020). Science is not a signal detection problem.

Proceedings of the National Academy of Sciences, 117(11), 5559–5567.

https://doi.org/10.1073/pnas.1914237117
 50

Wilson, B. M., & Wixted, J. T. (2018). The Prior Odds of Testing a True Effect in Cognitive and

Social Psychology. Advances in Methods and Practices in Psychological Science, 1(2),

186–197. https://doi.org/10.1177/2515245918767122

Yang, Y., Youyou, W., & Uzzi, B. (2020). Estimating the deep replicability of scientific findings

using human and artificial intelligence. Proceedings of the National Academy of

Sciences, 117(20), 10762–10768. https://doi.org/10.1073/pnas.1909046117

Yarkoni, T. (2019). The Generalizability Crisis [Preprint]. PsyArXiv.

https://doi.org/10.31234/osf.io/jqw35

Yong, E. (2012). A failed replication draws a scathing personal attack from a psychology

professor. https://www.nationalgeographic.com/science/phenomena/2012/03/10/failed-

replication-bargh-psychology-study-doyen/

Zwaan, R. A., Etz, A., Lucas, R. E., & Donnellan, M. B. (2018a). Improving social and behavioral

science by making replication mainstream: A response to commentaries. Behavioral and

Brain Sciences, 41. https://doi.org/10/gjghg5

Zwaan, R. A., Etz, A., Lucas, R. E., & Donnellan, M. B. (2018b). Making replication mainstream.

Behavioral and Brain Sciences, 41. https://doi.org/10.1017/S0140525X17001972