Dubious studies on the danger of hurricane names may be laughable. But bad science can cause bad policy.
Academic publishing was rocked by the news on July 8 that a company called Sage Publications is retracting 60 papers from its Journal of Vibration and Control, about the science of acoustics. The company said a researcher in Taiwan and others had exploited peer review so that certain papers were sure to get a positive review for placement in the journal. In one case, a paper’s author gave glowing reviews to his own work using phony names.
Acoustics is an important field. But in biomedicine faulty research and a dubious peer-review process can have life-or-death consequences. In June, Dr. Francis Collins, director of the National Institutes of Health and responsible for $30 billion in annual government-funded research, held a meeting to discuss ways to ensure that more published scientific studies and results are accurate. According to a 2011 report in the monthly journal Nature Reviews Drug Discovery, the results of two-thirds of 67 key studies analyzed by Bayer researchers from 2008-2010 couldn’t be reproduced.
That finding was a bombshell. Replication is a fundamental tenet of science, and the hallmark of peer review is that other researchers can look at data and methodology and determine the work’s validity. Dr. Collins and co-author Dr. Lawrence Tabak highlighted the problem in a January 2014 article in Nature. “What hope is there that other scientists will be able to build on such work to further biomedical progress,” if no one can check and replicate the research, they wrote.