Stagge, J. H., Rosenberg, D. E., Abdallah, A. M., Akbar, H., Attallah, N. A., & James, R. (2019). Assessing data availability and research reproducibility in hydrology and water resources. Scientific Data, 6(1), 190030.
Added by: Christoph Külls (2021-03-14 19:41:33) Last edited by: Christoph Külls (2021-03-14 19:42:08)
|Resource type: Journal Article
ID no. (ISBN etc.): 2052-4463
BibTeX citation key: Stagge2019
View all bibliographic details
Creators: Abdallah, Akbar, Attallah, James, Rosenberg, Stagge
Collection: Scientific Data
Views index: 54%
Downloads index: 19%
Popularity index: 27.75%
|Attachments sdata201930.pdf [0/109]||URLs https://doi.org/10.1038/sdata.2019.30|
There is broad interest to improve the reproducibility of published research. We developed a survey tool to assess the availability of digital research artifacts published alongside peer-reviewed journal articles (e.g. data, models, code, directions for use) and reproducibility of article results. We used the tool to assess 360 of the 1,989 articles published by six hydrology and water resources journals in 2017. Like studies from other fields, we reproduced results for only a small fraction of articles (1.6% of tested articles) using their available artifacts. We estimated, with 95% confidence, that results might be reproduced for only 0.6% to 6.8% of all 1,989 articles. Unlike prior studies, the survey tool identified key bottlenecks to making work more reproducible. Bottlenecks include: only some digital artifacts available (44% of articles), no directions (89%), or all artifacts available but results not reproducible (5%). The tool (or extensions) can help authors, journals, funders, and institutions to self-assess manuscripts, provide feedback to improve reproducibility, and recognize and reward reproducible articles as examples for others.