Advancing the Cognitive Science of Religion through Replication and Open Science
Issue: (0) ADVANCE ACCESS TO FORTHCOMING ARTICLES
Journal: Journal for the Cognitive Science of Religion
Subject Areas: Religious Studies Cognitive Studies Linguistics
DOI: 10.1558/jcsr.39039
Abstract:
The Cognitive Science of Religion (CSR) is a relatively young but prolific field that has offered compelling insights into religious minds and practices. However, many empirical findings within this field are still preliminary and their reliability remains to be determined. In this paper, we first argue that it is crucial to critically evaluate the CSR literature and adopt open science practices and replication research in particular to move the field forward. Second, we highlight the outcomes of previous replications and make suggestions for future replication studies in the CSR, with a particular focus on neuroscience, developmental psychology, and qualitative research. Finally, we provide a "replication script" with advice on how to select, conduct, and organize replication research. Our approach is illustrated with a "glimpse behind the scenes" of the recently launched Cross-Cultural Religious Replication Project, in the hope of inspiring scholars of religion to embrace open science and replication in their own research.
Author: Suzanne Hoogeveen, Michiel van Elk
References :
Anczyk, A., H. Grzymala-Moszczyńska, A. Krzysztof-Swiderska and J. Prusak. 2019. "The Replication Crisis and Qualitative Research in the Psychology of Religion." The International Journal for the Psychology of Religion 29: 278-291. https://doi.org/10. 1080/10508619.2019.1687197
Anderson, M. S., B. C. Martinson and R. De Vries. 2007. "Normative Dissonance in Science: Results from a National Survey of U.S. Scientists." Journal of Empirical Research on Human Research Ethics 2: 3-14. https://doi.org/10.1525/jer.2007.2.4.3
Baker, M. 2016. "Is There a Reproducibility Crisis?" Nature 533: 452-454.
Bakker, M., C. H. J. Hartgerink, J. M. Wicherts and H. L. J. van der Maas. 2016. "Researchers' Intuitions about Power in Psychological Research." Psychological Science 27: 1069-1077. https://doi.org/10.1177/0956797616647519
Banerjee, K. and P. Bloom. 2013. "Would Tarzan Believe in God? Conditions for the Emergence of Religious Belief." Trends in Cognitive Sciences 17: 7-8. https://doi.org/10. 1016/j.tics.2012.11.005
Barch, D. M. and T. Yarkoni. 2013. "Introduction to the Special Issue on Reliability and Replication in Cognitive and Affective Neuroscience Research." Cognitive, Affective, and Behavioral Neuroscience 13: 687-689. https://doi.org/10.3758/s13415-013-0201-7
Barrett, J. L. 1998. "Cognitive Constraints on Hindu Concepts of the Divine." Journal for the Scientific Study of Religion 37(4): 608-619. https://doi.org/10.2307/1388144
----. 2000. "Exploring the Natural Foundations of Religion." Trends in Cognitive Sciences 4: 29-34. https://doi.org/10.1016/S1364-6613(99)01419-9
----. 2018. "Some Common Misunderstandings about Cognitive Approaches to the Study of Religion: A Reply to Sterelny." Religion, Brain & Behavior 8: 425-428. https: //doi.org/10.1080/2153599X.2017.1323787
Barrett, J. L., R. M. Newman and R. Richert. 2003. "When Seeing Is Not Believing: Children's Understanding of Humans' and Non-Humans' Use of Background Knowledge in Interpreting Visual Displays." Journal of Cognition and Culture 3: 91-108. https: //doi.org/10.1163/156853703321598590
Barrett, J. L., R. A. Richert and A. Driesenga. 2001. "God's Beliefs Versus Mother's: The Development of Nonhuman Agent Concepts." Child Development 72: 50-65. https: //doi.org/10.1111/1467-8624.00265
Bem, D. J. 2011. "Feeling the Future: Experimental Evidence for Anomalous Retroactive Influences on Cognition and Affect." Journal of Personality and Social Psychology 100: 407-425. https://doi.org/10.1037/a0021524
Bering, J. M. 2006. "The Folk Psychology of Souls." Behavioral and Brain Sciences 29: 453- 462. https://doi.org/10.1017/S0140525X06009101
Bishop, L. 2009. "Ethical Sharing and Reuse of Qualitative Data." Australian Journal of Social Issues 44: 255-272. https://doi.org/10.1002/j.1839-4655.2009.tb00145.xeprint:https://onlinelibrary.wiley.com/doi/pdf/10.1002/j.1839-4655.2009.tb00145.x
Bloom, P. 2005. Descartes' Baby: How the Science of Child Development Explains What Makes Us Human. New York: Random House.
----. 2007. "Religion Is Natural." Developmental Science 10: 147-151. https://doi.org/ 10.1111/j.1467-7687.2007.00577.x
Boekel, W., E. Wagenmakers, L. Belay, A. J. Verhagen, S. D. Brown and B. Forstmann. 2015. "A Purely Confirmatory Replication Study of Structural Brain-Behavior Correlations." Cortex 66: 115-133. https://doi.org/10.1016/j.cortex.2014.11.019
Bonett, D. G. 2012. "Replication-Extension Studies." Current Directions in Psychological Science 21: 409-412. https://doi.org/10.1177/0963721412459512
Botvinik-Nezer, R., F. Holzmeister, C. F. Camerer, A. Dreber, J. Huber, M. Johannesson, M. Kirchler, R. Iwanir, J. A. Mumford, R. A. Adcock, P. Avesani, B. M. Baczkowski, A. Bajracharya, L. Bakst, S. Ball, M. Barilari, N. Bault, D. Beaton, J. Beitner ... T. Schonberg. 2020. "Variability in the Analysis of a Single Neuroimaging Dataset by Many Teams." Nature 582: 84-88. https://doi.org/10.1038/s41586-0202314-9
Botvinik-Nezer, R., R. Iwanir, F. Holzmeister, J. Huber, M. Johannesson, M. Kirchler, A. Dreber, C. F. Camerer, R. A. Poldrack and T. Schonberg. 2019. "fMRI Data of Mixed Gambles from the Neuroimaging Analysis Replication and Prediction Study." Scientific Data 6: 106. https://doi.org/10.1038/s41597-019-0113-7
Bulbulia, J. 2013. "The Arts Transform the Cognitive Science of Religion." Journal for the Cognitive Science of Religion 1(2): 141-160. https://doi.org/10.1558/jcsr.v1i2.141
Bulbulia, J. and E. Slingerland. 2012. "Religious Studies as a Life Science." Numen. International Review for the History of Religions 59: 564-613. https://doi.org/10. 1163/15685276-12341240
Button, K. S., J. P. A. Ioannidis, C. Mokrysz, B. A. Nosek, J. Flint, E. S. J. Robinson and M. R. Munafò. 2013. "Power Failure: Why Small Sample Size Undermines the Reliability of Neuroscience." Nature Reviews Neuroscience 14: 365-376. https://doi. org/10.1038/nrn3475
Camerer, C. F., A. Dreber, F. Holzmeister, T. Ho, J. Huber, M. Johannesson, M. Kirchler, G. Nave, B. Nosek, T. Pfeiffer, A. Altmejd, N. Buttrick, T. Chan, Y. Chen, E. Forsell, E. Heikensten, L. Hummer, T. Imai, S. Isaksson ... H. Wu. 2018. "Evaluating Replicability of Social Science Experiments in Nature and Science." Nature Human Behaviour 2: 637-644.
Camerer, C. F., A. Dreber, T.-H. Ho, J. Huber, M. Johannesson, M. Kirchler, J. Almenberg, A. Altmejd, T. Chan, E. Heikensten, F. Holzmeister, T. Imai, S. Isaksson, G. Nave, T. Pfeiffer and M. Razen. 2016. "Evaluating Replicability of Laboratory Experiments in Economics." Science 351: 1433-1436. https://doi.org/10.1126/science.aaf0918
Cesario, J. 2014. "Priming, Replication, and the Hardest Science." Perspectives on Psychological Science 9: 40-48. https://doi.org/10.1177/1745691613513470
Chambers, C. D. 2013. "Registered Reports: A New Publishing Initiative at Cortex." Cortex 49: 609-610. https://doi.org/10.1016/j.cortex.2012.12.016
Charles, S. J., J. E. Bartlett, K. J. Messick, T. J. Coleman III and A. Uzdavines. 2019. "Researcher Degrees of Freedom in the Psychology of Religion." The International Journal for the Psychology of Religion 29: 230-245. https://doi.org/10.1080/10508619.2019.1660573
Chartier, C., M. Kline, R. McCarthy, M. Nuijten, D. J. Dunleavy and A. Ledgerwood. 2018. "The Cooperative Revolution Is Making Psychological Science Better." APS Observer (30 November).
Chatard, A., G. Hirschberger and T. Pyszczynski. 2020. "A Word of Caution about Many Labs 4: If You Fail to Follow Your Preregistered Plan, You May Fail to Find a Real Effect." (Preprint). PsyArXiv. https://doi.org/10.31234/osf.io/ejubn
Claesen, A., S. L. B. T. Gomes, F. Tuerlinckx and W. Vanpaemel. 2019. "Preregistration: Comparing Dream to Reality." PsyArXiv. https://doi.org/10.31234/osf.io/d8wex
Consortium, T. M. 2020. "Quantifying Sources of Variability in Infancy Research Using the Infant-Directed-Speech Preference." Advances in Methods and Practices in Psychological Science 3(1): 24-52. https://doi.org/10.1177/2515245919900809
Corriveau, K. H., E. E. Chen and P. L. Harris. 2015. "Judgments about Fact and Fiction by Children from Religious and Nonreligious Backgrounds." Cognitive Science 39: 353-382. https://doi.org/10.1111/cogs.12138
Cova, F., B. Strickland, A. Abatista, A. Allard, J. Andow, M. Attie, J. Beebe, R. Berniūnas, J. Boudesseul, M. Colombo, F. Cushman, R. Diaz, N'D. N. van Dongen, V. Dranseika, B. D. Earp, A. G. Torres, I. Hannikainen, J. V. HernándezConde, W. Hu ... X. Zhou. 2018. "Estimating the Reproducibility of Experimental Philosophy." Review of Philosophy and Psychology (14 June): 1-36. https://doi.org/10. 1007/s13164-018-0400-9
Cristia, A., A. Seidl, L. Singh and D. Houston. 2016. "Test-Retest Reliability in Infant Speech Perception Tasks." Infancy 21: 648-667. https://doi.org/10.1111/infa.12127
Crüwell, S., J. van Doorn, A. Etz, M. C. Makel, H. Moshontz, J. C. Niebaum, A. Orben, S. Parsons and M. Schulte-Mecklenbeck. 2019. "Seven Easy Steps to Open Science." Zeitschrift für Psychologie 227: 237-248. https://doi.org/10.1027/2151-2604/ a000387
de Rijcke, S. and B. Penders. 2018. "Resist Calls for Replicability in the Humanities." Nature 560: 29. https://doi.org/10.1038/d41586-018-05845-z
DeHaven, A. C. 2017. Preregistration: A Plan, Not a Prison. (23 May). Center for Open Science. https://www.cos.io/blog/preregistration-plan-not-prison
Dienes, Z. 2014. "Using Bayes to Get the Most Out of Non-Significant Results." Frontiers in Psychology 5: 781 (1-17). https://doi.org/10.3389/fpsyg.2014.00781
Doyen, S., O. Klein, C. L. Pichon and A. Cleeremans. 2012. "Behavioral Priming: It's All in the Mind, but Whose Mind?" PLoS ONE 7(1): 1-7. e29081. https://doi.org/10.1371/journal. pone.0029081
Dreber, A., T. Pfeiffer, J. Almenberg, S. Isaksson, B. Wilson, Y. Chen, B. A. Nosek and M. Johannesson. 2015. "Using Prediction Markets to Estimate the Reproducibility of Scientific Research." Proceedings of the National Academy of Sciences of the United States of America 112: 15343-15347. https://doi.org/10.1073/pnas.1516179112
Dubois, J. and R. Adolphs. 2016. "Building a Science of Individual Differences from fMRI." Trends in Cognitive Sciences 20: 425-443. https://doi.org/10.1016/j.tics.2016.03. 014
Dutilh, G., A. Sarafoglou and E.-J. Wagenmakers. 2019. "Flexible Yet Fair: Blinding Analyses in Experimental Psychology." Synthese (19 November): 1-28. https://doi.org/10.1007/s11229-01902456-7
Ebersole, C., O. Atherton, A. Belanger, H. Skulborstad, J. Allen, J. Banks, E. Baranski, M. Bernstein, D. Bonfiglio, L. Boucher, E. Brown, N. Budiman, A. Cairo, C. Capaldi, C. Chartier, J. Chung, D. Cicero, J. Coleman, J. Conway ... B. Nosek. 2016. "Many Labs 3: Evaluating Participant Pool Quality across the Academic Semester via Replication." Journal of Experimental Social Psychology 67: 68-82.
Etz, A., Q. F. Gronau, F. Dablander, P. A. Edelsbrunner and B. Baribault. 2018. "How to Become a Bayesian in Eight Easy Steps: An Annotated Reading List." Psychonomic Bulletin & Review 25: 219-234.
Evans, E. M. 2001. "Cognitive and Contextual Factors in the Emergence of Diverse Belief Systems: Creation versus Evolution." Cognitive Psychology 42(3): 217-266. https://doi.org/ 10.1006/cogp.2001.0749
Forsell, E., D. Viganola, T. Pfeiffer, J. Almenberg, B. Wilson, Y. Chen, B. A. Nosek, M. Johannesson and A. Dreber. 2018. "Predicting Replication Outcomes in the Many Labs 2 Study." Journal of Economic Psychology 75 (25 October): 1-16. https://doi.org/10.1016/j.joep.2018.10.009
Francis, G. 2013. "Replication, Statistical Consistency, and Publication Bias." Journal of Mathematical Psychology 57: 153-169. https://doi.org/10.1016/j.jmp.2013.02.003
Frank, M. C., E. Bergelson, C. Bergmann, A. Cristia, C. Floccia, J. Gervain, J. K. Hamlin, E. E. Hannon, M. Kline, C. Levelt, C. Lew-Williams, T. Nazzi, R. Panneton, H. Rabagliati, M. Soderstrom, J. Sullivan, S. Waxman and D. Yurovsky. 2017. "A Collaborative Approach to Infant Research: Promoting Reproducibility, Best Practices, and Theory-Building." Infancy 22: 421-435. https://doi.org/10. 1111/infa.12182
Gervais, W. M., S. E. McKee and S. Malik. 2020. "Do Religious Primes Increase Risk Taking? Evidence against 'Anticipating Divine Protection' in Two Preregistered Direct Replications of Kupor, Laurin, and Levav (2015)." Psychological Science 31: 858-864. https://doi.org/10.1177/0956797620922477
Gervais, W. M. and A. Norenzayan. 2012. "Analytic Thinking Promotes Religious Disbelief." Science 336: 493-496. https://doi.org/10.1126/science.1215647
Gervais, W. M., A. K. Willard, A. Norenzayan and J. Henrich. 2011. "The Cultural Transmission of Faith: Why Innate Intuitions Are Necessary, but Insufficient, to Explain Religious Belief." Religion 41: 389-410. https://doi.org/10.1080/0048721X.2011.604510
Gervais, W. M., D. Xygalatas, R. T. McKay, M. van Elk, E. E. Buchtel, M. Aveyard, S. R. Schiavone, I. Dar-Nimrod, A. M. Svedholm-Häkkinen, T. Riekki, E. Kundtova Klocová, J. E. Ramsay and J. Bulbulia. 2017. "Global Evidence of Extreme Intuitive Moral Prejudice against Atheists." Nature Human Behaviour 1: 0151 (1-6). https://doi.org/10.1038/s41562-017-0151
Gewin, V. 2016. "Data Sharing: An Open Mind on Open Data." Nature 529: 117-119. https://doi.org/10.1038/nj7584-117a
Gilder, T. S. E. and E. A. Heerey. 2018. "The Role of Experimenter Belief in Social Priming." Psychological Science 29: 403-417. https://doi.org/10.1177/0956797617737128
Gilmore, R. O., J. L. Kennedy and K. E. Adolph. 2018. "Practical Solutions for Sharing Data and Materials from Psychological Research." Advances in Methods and Practices in Psychological Science 1: 121-130. https://doi.org/10.1177/2515245917746500
Gomes, C. M. and M. E. McCullough. 2015. "The Effects of Implicit Religious Primes on Dictator Game Allocations: A Preregistered Replication Experiment." Journal of Experimental Psychology: General 144: e94-e104. https://doi.org/10.1037/xge0000027
Haaf, J. M., S. Hoogeveen, S. Berkhout, Q. F. Gronau and E.-J. Wagenmakers. 2020. "A Bayesian Multiverse Analysis of Many Labs 4: Quantifying the Evidence against Mortality Salience." (Preprint). PsyArXiv. https://doi.org/10.31234/osf.io/cb9er
Haith, M. M. 1998. "Who Put the Cog in Infant Cognition? Is Rich Interpretation Too Costly?" Infant Behavior and Development 21: 167-179. https://doi.org/10.1016/s01636383(98)90001-7
Hardwicke, T. E., M. B. Mathur, K. MacDonald, G. Nilsonne, G. C. Banks, M. C. Kidwell, A. Hofelich Mohr, E. Clayton, E. J. Yoon, M. Henry Tessler ... M. C. Frank. 2018. "Data Availability, Reusability, and Analytic Reproducibility: Evaluating the Impact of a Mandatory Open Data Policy at the journal Cognition." Royal Society Open Science 5: 180448 (1-18). https://doi.org/10.31222/osf.io/39cfb
Hardwicke, T. E., M. H. Tessler, B. Peloquin and M. C. Frank. 2018. "A Bayesian Decision-Making Framework for Replication." Behavioral and Brain Sciences 41: e132. https: //doi.org/10.1017/S0140525X18000675
Hardy, A. 1981. The Spiritual Nature of Man: A Study of Contemporary Religious Experience. Oxford: Oxford University Press.
Harris, P. and M. Giménez. 2005. "Children's Acceptance of Conflicting Testimony: The Case of Death." Journal of Cognition and Culture 5: 143-164. https://doi.org/10. 1163/1568537054068606
Harris, S., J. T. Kaplan, A. Curiel, S. Y. Bookheimer, M. Iacoboni and M. S. Cohen. 2009. "The Neural Correlates of Religious and Nonreligious Belief." PLoS ONE 4(10): e7272 (1-9). https://doi.org/10.1371/journal.pone.0007272
Hone, L. S. E. and M. E. McCullough. 2015. "Does Religious Cognition Really Down-Regulate Hand Grip Endurance in Men? A Failure to Replicate." Evolution and Human Behavior 36: 81-85. https://doi.org/10.1016/j.evolhumbehav.2014.08.007
Hoogeveen, S., A. Sarafoglou and E.-J. Wagenmakers. 2020. "Laypeople Can Predict Which Social-Science Studies Will Be Replicated Successfully." Advances in Methods and Practices in Psychological Science, 1-19. https://doi.org/10.1177/2515245920919667
Hoogeveen, S., L. Snoek and M. van Elk. 2020. "Religious Belief and Cognitive Conflict Sensitivity: A Preregistered fMRI Study." Cortex 129: 247-265. https://doi.org/10. 1016/j.cortex.2020.04.011
Hoogeveen, S., E.-J. Wagenmakers, A. C. Kay and M. van Elk. 2018. "Compensatory Control and Religious Beliefs: A Registered Replication Report across Two Countries." Comprehensive Results in Social Psychology 3: 240-265. https://doi.org/10.1080/ 23743603.2019.1684821
Huber, D. E., K. W. Potter and L. D. Huszar. 2019. "Less 'Story' and More 'Reliability' in Cognitive Neuroscience." Cortex 113: 347. https://doi.org/10.1016/j.cortex.2018.10.030
Inzlicht, M., I. McGregor, J. B. Hirsh and K. Nash. 2009. "Neural Markers of Religious Conviction." Psychological Science 20: 385-392. https://doi.org/10.1111/j.14679280.2009.02305.x
Inzlicht, M., A. M. Tullett and M. Good. 2011. "The Need to Believe: A Neuroscience Account of Religion as a Motivated Process." Religion, Brain & Behavior 1: 192-212. https: //doi.org/10.1080/2153599x.2011.647849
Ioannidis, J. P. A. 2005. "Why Most Published Research Findings Are False." PLoS Medicine 2: 696-701. https://doi.org/10.1080/09332480.2005.10722754
JASP Team. 2019. JASP (version 0.11.1) [Computer software].
John, L. K., G. Loewenstein and D. Prelec. 2012. "Measuring the Prevalence of Questionable Research Practices with Incentives for Truth-Telling." Psychological Science 23: 524-532. https://doi.org/10.1037/e632032012-001
Jong, J., J. Halberstadt, M. Bluemke, C. Kavanagh and C. Jackson. 2019. "Death Anxiety, Exposure to Death, Mortuary Preferences, and Religiosity in Five Countries." Scientific Data 6: 154 (1-5). https://doi.org/10.1038/s41597-019-0163-x
Kavanagh, C. M., J. Jong, R. McKay and H. Whitehouse. 2018. "Positive Experiences of High Arousal Martial Arts Rituals Are Linked to Identity Fusion and Costly Pro-Group Actions." European Journal of Social Psychology 49(3): 461-481. https://doi.org/10.1002/ejsp. 2514
Kavanagh, C. M. and R. Kapitany. 2017/2019. "Promoting the Benefits and Clarifying Misconceptions about Preregistration, Preprints, and Open Science for Cognitive Science of Religion." Journal for the Cognitive Science of Religion 5(2).
Kay, A. C., D. Gaucher, J. L. Napier, M. J. Callan and K. Laurin. 2008. "God and the Government: Testing a Compensatory Control Mechanism for the Support of External Systems." Journal of Personality and Social Psychology 95: 18-35. https://doi.org/10.1037/0022-3514.95.1.18
Kelemen, D. 2004. "Are Children 'Intuitive Theists'? Reasoning about Purpose and Design in Nature." Psychological Science 15: 295-301. https://doi.org/10.1111/j.09567976.2004.00672.x
Kidwell, M. C., L. B. Lazarević, E. Baranski, T. E. Hardwicke, S. Piechowski, L. Falkenberg, C. Kennett, A. Slowik, C. Sonnleitner, C. Hess-Holden, T. M. Errington, S. Fiedler and B. A. Nosek. 2016. "Badges to Acknowledge Open Practices: A Simple, Low Cost, Effective Method for Increasing Transparency." PLoS Biology 14: e1002456 (1-15). https://doi.org/10.1371/journal.pbio.1002456
Klein, O., T. E. Hardwicke, F. Aust, J. Breuer, H. Danielsson, A. Hofelich Mohr, H. IJzerman, G. Nilsonne, W. Vanpaemel and M. C. Frank. 2018. "A Practical Guide for Transparency in Psychological Science." Collabra: Psychology 4: 1-15. https:// doi.org/10.1525/collabra.158
Klein, R., C. L. Cook, C. R. Ebersole, C. A. Vitiello, B. A. Nosek, C. R. Chartier, C. D. Christopherson, S. Clay, B. Collisson, J. Crawford, R. Cromar, D. Vidamuerte, G. Gardiner, C. Gosnell, J. E. Grahe, C. Hall, J. A. Joy-Gaba, A. M. Legg, C. Levitan ... K. A. Ratliff. 2019. "Many Labs 4: Failure to Replicate Mortality Salience Effect with and without Original Author Involvement." (Preprint). PsyArXiv. https://doi.org/10.31234/osf.io/vef2c
Klein, R., K. Ratliff, M. Vianello, R. B. Adams, Jr., S. Bahńik, M. Bernstein, K. Bocian, M. Brandt, B. Brooks, C. Brumbaugh, Z. Cemalcilar, J. Chandler, W. Cheong, W. Davis, T. Devos, M. Eisner, N. Frankowska, D. Furrow, E. M. Galliani ... B. Nosek. 2014. "Investigating Variation in Replicability: A 'Many Labs' Replication Project." Social Psychology 45: 142-152. https://doi.org/10.1027/1864-9335/ a000178
Klein, R., M. Vianello, F. Hasselman, B. Adams, R. Adams, S. Alper, M. Aveyard, J. Axt, S. Bahník, R. Batra, M. Berkics, M. Bernstein, D. Berry, O. Bialobrzeska, E. Binan, K. Bocian, M. Brandt, R. Busching, A. Redei ... B. Nosek. 2018. "Many Labs 2: Investigating Variation in Replicability across Sample and Setting." Advances in Methods and Practices in Psychological Science 1: 443-490.
Konvalinka, I., D. Xygalatas, J. Bulbulia, U. Schjødt, E.-M. Jegindø, S. Wallot, G. Van Orden and A. Roepstorff. 2011. "Synchronized Arousal between Performers and Related Spectators in a Fire-Walking Ritual." Proceedings of the National Academy of Sciences 108: 8514-8519. https://doi.org/10.1073/pnas.1016955108
Kupor, D. M., K. Laurin and J. Levav. 2015. "Anticipating Divine Protection? Reminders of God Can Increase Nonmoral Risk Taking." Psychological Science 26: 374-384. https://doi.org/10.1177/0956797614563108
Leshinskaya, A., J. M. Contreras, A. Caramazza and J. P. Mitchell. 2017. "Neural Representations of Belief Concepts: A Representational Similarity Approach to Social Semantics." Cerebral Cortex 27(1): 344-357. https://doi.org/10.1093/cercor/bhw401
Luhrmann, T. M. 2005. "The Art of Hearing God: Absorption, Dissociation, and Contemporary American Spirituality." Spiritus: A Journal of Christian Spirituality 5: 133-157. https://doi.org/10.1353/scs.2006.0014
----. 2012. When God Talks Back: Understanding the American Evangelical Relationship with God. New York, Vintage Books.
Luhrmann, T. M., R. Padmavati, H. Tharoor and A. Osei. 2015. "Hearing Voices in Different Cultures: A Social Kindling Hypothesis." Topics in Cognitive Science 7: 646-663. https://doi.org/10.1111/tops.12158
MacCoun, R. and S. Perlmutter. 2015. "Hide Results to Seek the Truth." Nature 526: 187- 189.
Makel, M. C., J. A. Plucker and B. Hegarty. 2012. "Replications in Psychology Research: How Often Do They Really Occur?" Perspectives on Psychological Science 7: 537- 542. https://doi.org/10.1177/1745691612460688
Makris, N. and D. Pnevmatikos. 2007. "Children's Understanding of Human and Supernatural Mind." Cognitive Development 22: 365-375. https://doi.org/10.1016/j. cogdev.2006.12.003
McCullough, M. E., E. C. Carter, C. N. DeWall and C. M. Corrales. 2012. "Religious Cognition Down-Regulates Sexually Selected, Characteristically Male Behaviors in Men, but Not in Women." Evolution and Human Behavior 33: 562-568. https://doi.org/ 10.1016/j.evolhumbehav.2012.02.004
McPhetres, J. 2018. "Religiosity and Confirmation Bias or: How I Learned to Stop Worrying and Love Preregistered Direct Replications." OSF Preprints. https://doi.org/10.31219/