Community Replications



My Open Data
For each of my projects, I include an open practices statement in the Method section that outlines where my materials and data can be found. I host pre-registrations, experiment materials, data, and analysis code on the Open Science Framework (OSF). I also post preprints on the PsyArXiv server.

When conducting statistical analyses, I use free and open-source R software, and list package versions to ensure that my analyses are reproducible far into the future.

In one such example, I conducted a meta-analysis encompassing 50+ years of research (published in Psychological Bulletin), all the while ensuring that my analysis decisions were meticulously documented with citations and rationale, and I even posted the entire data set online so that others can conduct their own investigations.

Each of my published articles can be found (for free) on this website, along with links to the official versions and related OSF pages. See my Publications page for more details.

Think/No-Think Registered Replication Report
As part of a multi-site registered replication of the “Think/No-Think” paradigm, I contributed 120 participants alongside my colleagues at the University of Waterloo. This replication study has been accepted in-principle for publication at Nature Human Behaviour. For more details, you can view the project’s OSF page here and the Stage 1 protocol here.

Replication Games at Northwestern University
At the Replication Games at Northwestern University hosted by the Institute for Replication, my team and I successfully replicated the analyses of Fath & Proudfoot (2024). Their study, published in Psychological Science, explored how omission from demographic options lists can lead to increased anger and stronger identification amongst the left-out minority groups. Our replication confirmed their findings, and our discussion paper will be included in a broader, invited meta-paper that the Institute for Replication will submit to Psychological Science.

Peer Review Replications
Whenever I serve as a peer reviewer, I make it a priority to replicate analyses and encourage authors to make their data available if it is not already posted. I also replicate power analyses to ensure the robustness of the research. I have applied these practices while reviewing for the following journals:

Psychological Bulletin, Attention, Perception, & Psychophysics, Quarterly Journal of Experimental Psychology, Memory, Journal of Cognitive Psychology, Cortex, Journal of Applied Research in Memory and Cognition, Journal of Experimental Psychology: Learning, Memory, and Cognition, Canadian Journal of Experimental Psychology, Memory & Cognition, Psychological Research, and Mind Pad.

Official records for 8 of these peer reviews are available on my Web of Science profile.

Brady R.T. Roberts
Brady R.T. Roberts
NSERC Postdoctoral Scholar

Postdoctoral scholar exploring how visual design influences what we remember.