Paper RA+AS+BI-WeA1
Responding to New and Old Challenges to Data, Analysis and Scientific Study Reproducibility

Wednesday, October 23, 2019, 2:20 pm, Room A124-125

An increasing number of studies, surveys and editorials highlight experimental and computational reproducibility and replication issues that frequently appear in most areas of modern science. In a 2018 AVS conducted survey, 66% of those responding identified reproducibility as a significant issue. There are multiple and complex causes of what some have called a “reproducibility crisis,” which can impact materials, interface/(bio)interphase, vacuum and others sciences of importance to AVS members. Reproducibility challenges are not new, but now appear in both old and new forms requiring innovative solutions. Drivers influencing reproducibility problems include the increasingly multi-discipline, multi-method nature of much advanced science, increased complexity of the problems and systems being addressed, and the large amounts and multiple types of experimental and computational data being collected and analyzed in many studies. Such issues challenge experimental teams and the review process. Systematic and sustained efforts are needed to address the causes of reproducibility problems that can hinder the rate of scientific progress and lower public and political regard for science. The Focus topic New Challenges to Reproducible Data and Analysis aims to raise awareness of the challenges, examine the causes, impacts of reproducibility problems and explore approaches that can help address both the newer and older generation of reproducibility challenges. Some problems and solutions are easy to identify, even if not readily implemented. Other drivers and causes are less obvious and therefore harder to address. This talk will introduce the focus topic sessions, review key literature on the topic of reproducibility and summarize how the presentations fit together as a way to address reproducibility challenges.