The Systematizing Confidence in Open Research and Evidence (SCORE) program was a large-scale, multi-method initiative funded by DARPA that involved 865 researchers to assess the credibility of findings in the social and behavioral sciences. By sampling 3,900 papers published between 2009 and 2018, the project evaluated research across three distinct dimensions: reproducibility (same data/analysis), robustness (same data/different analysis), and replicability (new data/same analysis).
The results, published three papers in Nature and six preprints, revealed that while human experts are reasonably accurate at forecasting replication success, only about half of attempted studies successfully replicated, and many lacked the transparency needed for basic reproduction. Ultimately, the program highlights that research credibility is multidimensional and complex, providing a massive open-access database to help innovate future methods for verifying scientific discoveries.
Nature collection: https://www.nature.com/immersive/d42859-026-00015-y/index.html;
All papers, preprints, and data openly accessible: https://cos.io/score/.
#announcements#book-announcement