Most papers fail to report many aspects of the experiment and analysis that we may not with advantage omit - things that are crucial to understanding the result and its limitations and to repeating the work. Instead of arguing about whether results hold up, we should strive to provide enough information for others to repeat the experiments.
Reproducibility failures occur even in fields such as mathematics or computer science that do not have statistical problems or issues with experimental design. Suggested policy changes ignore a core feature of the process of scientific inquiry that occurs after reproducibility failures: the integration of conflicting observations and ideas into a coherent theory.
A Remedy for Broken Science, or an Attempt to Undercut It?
Reproducibility issues pose serious challenges for scientific communities. But what happens when those issues get picked up by political activists? A report from the National Association of Scholars takes on the reproducibility crisis in science. Not everyone views the group’s motives as pure.
The Irreproducibility Crisis of Modern Science: Causes, Consequences, and the Road to Reform
This study by the National Association of Scholars examines the different aspects of the reproducibility crisis of modern science. The report also includes a series of policy recommendations, scientific and political, for alleviating the reproducibility crisis.
Scientific research can be a cutthroat business, with undue pressure to publish quickly, first, and frequently. PLOS Biology is now formalizing a policy whereby manuscripts that confirm or extend a recently published study are eligible for consideration.