Is most published science WRONG? – the replication crisis

It seems we have a problem. John Ioannidis said: “There is increasing concern that in modern research, false findings may be the majority or even the vast majority of published research claims.”

Over 70% of researchers have tried and failed to reproduce another scientist’s experiments. 52% agreed that there is a replication crisis.

We live in a world right now where a lot of people say our public policy should “follow the science” in some very important areas – with big consequences. So it does matter that the science should be robust. How big is the problem? What causes it? And how can it be – and indeed is it being – addressed?

Support this channel! https://patreon.com/mallenbaker

The Mallen Baker Show is aimed at all people who see themselves as change makers, with commentary on issues and change movements with a particular focus on climate change and environment, social issues, free speech and corporate social responsibility.

References

Why Most Published Research Findings Are False, Ioannidis 2005 https://journals.plos.org/plosmedicine/article?id=10.1371/journal.pmed.0020124

Karl Popper (1959). The logic of scientific discovery. New York, NY: Basic Books.

1,500 scientists lift the lid on reproducibility https://www.nature.com/news/1-500-scientists-lift-the-lid-on-reproducibility-1.19970

Estimating the Reproducibility of Psychological Science https://www.researchgate.net/publication/281286234_Estimating_the_Reproducibility_of_Psychological_Science

What Meta-Analyses Reveal about the Replicability of Psychological Research, Stanley et al 2017 https://www.deakin.edu.au/__data/assets/pdf_file/0007/1198456/WhatMeta-AnalysesReveal_WP.pdf

What is social priming? https://www.discovermagazine.com/the-sciences/what-is-social-priming

Reconstruction of a Train Wreck: How Priming Research Went off the Rails https://replicationindex.com/2017/02/02/reconstruction-of-a-train-wreck-how-priming-research-went-of-the-rails/

Behavioral Priming: It's All in the Mind, but Whose Mind? Doyen et al, 2012 https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0029081

Contradicted and Initially Stronger Effects in Highly Cited Clinical Research https://jamanetwork.com/journals/jama/fullarticle/201218

Scientific Audit – A key management tool (10-20% of R&D funds spent on questionable studies) https://www.tandfonline.com/doi/abs/10.1080/08989629208573811

Rein in the four horsemen of irreproducibility https://www.nature.com/articles/d41586-019-01307-2

The association between early career informal mentorship in academic collaborations and junior author performance https://www.nature.com/articles/s41467-020-19723-8

Perspectives on Data Reproducibility and Replicability in Paleoclimate and Climate Science https://hdsr.m ... https://www.youtube.com/watch?v=W0aBN1jmVPs