Investigators present studies on rare disease research that achieved negative or irreproducible results and highlight the importance and value of these data in this special issue of the <em>Journal of Neuromuscular Diseases</em> on "The Null Hypothesis"
“Negative results are just as useful as positive ones,” explained Guest Editors Virginia Arechavala-Gomeza, PhD, Neuromuscular Disorders, Biocruces Bizkaia Health Research Institute, Barakaldo; and Ikerbasque, Basque Foundation for Science, Bilbao, Spain; and Annemieke Aartsma-Rus, PhD, Department of Human Genetics, Leiden University Medical Center, Leiden, the Netherlands. “Research results that prove an original hypothesis to be incorrect advance knowledge as much as those that confirm it. If the experiments are done and analyzed correctly, negative results let us advance in our research and sharing this information avoids duplication of work. A publication bias towards therapeutic approaches that appear to have beneficial effects and a lack of published studies where therapies are either not useful or toxic, or where published results are not reproducible, not only impedes science and therapy development, but also leads to unnecessary duplication of effort and a waste of resources.”
“The need to share negative information is gaining backers, but in a rare disease field such as neuromuscular disorder research, not having all the information is a tragedy,” added Dr. Arechavala-Gomeza.
This special issue marks the inauguration of a new section of the Journal of Neuromuscular Diseases dedicated to negative results that nevertheless provide valuable contributions to the scientific record. It presents eight articles on a variety of subjects, from animal models to biomarkers and clinical trials.
One contribution re-examines the effect of simvastatin in Duchenne muscular dystrophy (DMD). A study in 2015, led by Nick Whitehead, PhD, University of Washington, Seattle, Washington, USA, provided evidence that simvastatin, a widely used cholesterol lowering drug, had potential to be a novel treatment for DMD. Two independent labs led by Prof. Dr. Aartsma-Rus in the Netherlands and Dominic J. Wells, VetMB, PhD, Department of Comparative Biomedical Sciences, Neuromuscular Diseases Group, Royal Veterinary College, London, UK, were unable to replicate the results in DMD model mice (mdx mice) although the treatment protocol was similar. They concluded that simvastatin did not improve DMD pathology, suggesting this could either be due to the ineffectiveness of simvastatin itself or low simvastatin plasma levels following oral administration in the mice’s chow.
In a rebuttal published in this issue, Dr. Whitehead noted that his lab and many others have conducted many studies, some unpublished, using several batches of simvastatin in chow, on at least three colonies of mdx mice. All of these showed an improvement in mdx skeletal and cardiac muscle health and function. He pointed out that his lab achieved much higher drug exposure. “Replication of results by an independent lab is the foundation of scientific inquiry,” he stated. “We welcome a careful effort to replicate our results. Unfortunately, they failed to meet the most critical aspect of animal drug studies – levels of drug exposure in the therapeutic range.”
In their response, Prof. Dr. Aartsma-Rus and colleagues explained that the batch of chow they fed to the mdx mice contained the same dose of simvastatin and was prepared in an identical manner as the original study and queried the results of similar studies that either did not mention the dose or used a higher dose. “While these studies confirm the therapeutic effect of simvastatin treatment in mdx mice, they do not confirm that this can be achieved at doses that are in the range of what humans use.”
Commenting on this productive exchange among researchers, the Guest Editors added, “Failure to replicate the finding does not mean that simvastatin does not work; it means that in different lab settings the same dose of simvastatin in chow resulted in different plasma levels. This is something that needs to be studied further and for now clinical trials should be held off. These kinds of studies are often not ‘sexy’ enough for regular funders. The Duchenne UK patient association funded the replication studies because they felt it important to only plan clinical trials if a robust treatment effect could be replicated.”
The issue also highlights reporting on a clinical trial on edasalonexent, a randomized, double-blind, placebo-controlled, global phase 3 study in pediatric patients 4–8 years old with DMD, the results of the PolarisDMD trial, by Richard S. Finkel, MD, St. Jude Children’s Research Hospital, Memphis, TN, and Nemours Children’s Hospital, Orlando, FL, USA, and colleagues. While edasalonexent was generally well tolerated with a manageable safety profile at the dose of 100 mg/kg/day, it did not achieve statistically significant improvement of DMD in the study population. Results did suggest edasalonexent may slow disease progression in patients under 6.
“We of course regret that this did not work out,” noted the Guest Editors. “However, we really appreciate that the clinical experts involved and the industry sponsor pushed for timely publication so the field can benefit from these results.” Studies such as this are important to publish, especially when the results fail to confirm the preliminary favorable findings in the Phase 2 study. They provide an opportunity to explore the reasons for a failure to replicate the earlier findings.
“While most researchers consider it important to share negative results many themselves do not actually do this. This mindset needs to change,” commented Prof. Dr. Aartsma-Rus. ”In a field such as neuromuscular disorders, which are rare diseases, not having all the information is a big problem. If a potential therapeutic approach is not effective in cells, mice, or patients, the field needs to know this as soon as possible to avoid unnecessary duplication of work.”
“Sharing results of a research question that turned out to be incorrect gives less ‘credit’ than sharing results of a research question that was correct,” added Dr. Arechavala-Gomeza. “We need to adopt a new mindset in which sharing well conducted research is valued regardless of whether the research question was correct or not.”
“The only really ‘negative’ results are those that end up in a drawer and are never shared!” concluded the Guest Editors.
###
NOTES FOR EDITORS
Special Issue: The Null Hypothesis Stands
Guest Editors: Virginia Arechavala-Gomeza, PhD, and Annemieke Aartsma-Rus, PhD
Journal of Neuromuscular Diseases, Volume 8, Issue 5
Online at: content.iospress.com/journals/journal-of-neuromuscular-diseases/8/5
This special issue includes eight peer-reviewed research articles, plus two letters and the editorial, which is openly available: “Sharing ‘Negative’ Results in Neuromuscular Research: A Positive Experience.”
Featured Articles
- “A Randomized, Double-Blind, Placebo-Controlled, Global Phase 3 Study of Edasalonexent in Pediatric Patients with Duchenne Muscular Dystrophy: Results of the PolarisDMD Trial” by Richard S. Finkel, Craig M. McDonald, H. Lee Sweeney, Erika Finanger, Erin Neil Knierbein, Kathryn R. Wagner, Katherine D. Mathews, Warren Marks, Jeffrey Statland, Jessica Nance, Hugh J. McMillan, Gary McCullagh, Cuixia Tian, Monique M. Ryan, Declan O’Rourke, Wolfgang Müller-Felber, Mar Tulinius, W. Bryan Burnette , Cam-Tu Nguyen, Kayal Vijayakumar, Jessika Johannsen, Han C. Phan, Michelle Eagle, James MacDougall, Maria Mancini, and Joanne M. Donovan (for the PolarisDMD Study Group); research article, open access at: content.iospress.com/articles/journal-of-neuromuscular-diseases/jnd210689
- “Simvastatin Treatment Does Not Ameliorate Muscle Pathophysiology in a Mouse Model for Duchenne Muscular Dystrophy” by Ingrid E.C. Verhaart, Ornella Cappellari, Christa L. Tanganyika-de Winter, Jaap J. Plomp, Sofia Nnorom, Kim E. Wells, John C.W. Hildyard, David Bull, Annemieke Aartsma-Rus, and Dominic J. Wells; research article, open access at: content.iospress.com/articles/journal-of-neuromuscular-diseases/jnd200524
- “Rebuttal to: Simvastatin Treatment Does Not Ameliorate Muscle Pathophysiology in a Mouse Model for Duchenne Muscular Dystrophy, Verhaart et al. 2020” by N.P Whitehead, M.J Kim, K.L Bible, M.E. Adams, and S.C. Froehner; letter to the editor, openly available at: content.iospress.com/articles/journal-of-neuromuscular-diseases/jnd219005
- “Author’s Response to: Rebuttal to: Simvastatin Treatment Does Not Ameliorate Muscle Pathophysiology in a Mouse Model for Duchenne Muscular Dystrophy, Verhaart et al. 2020” by Annemieke Aartsma-Rus, Ingrid Verhaart, and Dominic Wells; letter to the editor, openly available at: content.iospress.com/articles/journal-of-neuromuscular-diseases/jnd219004
Contact
For additional information contact Diana Murray, IOS Press (+1 718-640-5678 or d.murray@iospress.com). Journalists who wish to interview the Guest Editors or authors should contact: Virginia Arechavala-Gomeza (+34 946007967, virginia.arechavalagomeza@osakidetza.eus); Annemieke Aartsma-Rus via the Communications Department, Leiden University Medical Center (pers@lumc.nl); or Richard Finkel (richard.finkel@stjude.org).
About the Journal of Neuromuscular Diseases
The Journal of Neuromuscular Diseases (JND) facilitates progress in understanding the molecular genetics/correlates, pathogenesis, pharmacology, diagnosis, and treatment of acquired and genetic neuromuscular diseases (including muscular dystrophy, myasthenia gravis, spinal muscular atrophy, neuropathies, myopathies, myotonias, and myositis). The journal publishes research reports, reviews, and short communications. Guided by Editors-in-Chief Carsten G. Bönnemann (National Institute of Neurological Disorders and Stroke, NIH) and Hanns Lochmüller (Children’s Hospital of Eastern Ontario Research Institute, Ottawa, Canada), JND is dedicated to providing an open forum for original research in basic science, translational, and clinical research that will improve our fundamental understanding and lead to effective treatments of neuromuscular diseases. iospress.com/journal-of-neuromuscular-diseases
About IOS Press
IOS Press is an independent international scientific, technical, medical (STM) publishing house established in 1987 in Amsterdam. We produce around 90 journals and 70 books annually in a broad range of subject categories, primarily specializing in biomedical and life sciences (including neurosciences, medical informatics, cancer research, rehabilitation) and physical sciences (including computer sciences, artificial intelligence, engineering). In addition, we offer specialized services that support scientific advancement. iospress.com
