We are pleased to share results from a pilot with 13 journals testing the Materials Design Analysis Reporting (MDAR) checklist, minimum standards reporting checklist for life sciences.  The checklist is designed to help adoption of the MDAR framework, minimum standards reporting framework for life sciences that covers four areas materials, design, analysis, and reporting, with two levels of reporting stringency, a minimum recommendation, and a best practice recommendation; a statement of task can be found here.

We are very grateful to the 13 participating journals and platforms - BMC Microbiology, Ecology & Evolution, eLIFE, EMBO journals, Epigenetics, F1000R, Molecular Cancer Therapeutics, Microbiology Open, PeerJ, PLOS Biology,  PNAS, Science, Scientific Reports  - for testing the MDAR checklist.

The pilot had two main goals: first, to understand whether the checklist was accessible and useful for authors and editors to help comply with journal policy a policy framework and second, to understand whether the elements within the checklist are clearly conveyed so as to help fulfill policy expectations.  In total, 211 authors across participating journals tested the checklist and provided their feedback.  Participating journal teams screened 289 manuscripts using the checklist and 89 of these manuscripts were subject to a dual-assessment by independent reviewers which allowed us to determine inter-assessor agreement, and thus clarity of specific items on the checklist.

We are encouraged to find that about 80% of authors and editors found the checklist useful to different degrees and that the majority of participating editors reported only a small increase in manuscript processing time as a result of using the checklist.  While participating authors and editors did not identify major gaps in the requirements covered in the checklist, the feedback from authors and editors has given us a better understanding of areas in the checklist and elaboration document where the language is unclear and needs to be improved. 

We are making the draft MDAR Framework, MDAR Checklist and MDAR Elaboration document and the pilot datasets available here.  This work was also recently presented at the NASEM workshop on Enhancing Scientific Reproducibility through Transparent Reporting; slides are available here.

We are currently gathering feedback on the MDAR framework, checklist and elaboration document from a broad group of about 40-50 experts on transparency and reproducibility.  Based on the feedback from the pilot and the expert input, we anticipate revising all three MDAR outputs by end-2019.

We are sharing this update on the work of the Minimum Standards Working Group through coordinated posts on member platforms.  If you would like more information about our work and progress, please contact Veronique Kiermer and Sowmya Swaminathan, who lead this collaborative initiative. If you’re a Wiley colleague or partner, then please get in touch with Karen Chambers or Chris Graf.

On behalf of the “minimal standards” working group:

Karen Chambers (Wiley; kchamber@wiley.com)
Andy Collings (eLife)
Chris Graf (Wiley; cgraf@wiley.com)
Veronique Kiermer (Public Library of Science; vkiermer@plos.org)
David Mellor (Center for Open Science)
Malcolm Macleod (University of Edinburgh)
Sowmya Swaminathan (Nature Research/Springer Nature; s.swaminathan@us.nature.com)
Deborah Sweet (Cell Press/Elsevier)
Valda Vinson (Science/AAAS)