An increasing number of studies, surveys, and editorials highlight experimental and computational reproducibility and replication issues that appear to pervade most areas of modern science. This perspective examines some of the multiple and complex causes of what has been called a “reproducibility crisis,” which can impact materials, interface/(bio)interphase, and vacuum sciences. Reproducibility issues are not new to science, but they are now appearing in new forms requiring innovative solutions. Drivers include the increasingly multidiscipline, multimethod nature of much advanced science, increased complexity of the problems and systems being addressed, and the large amounts and multiple types of experimental and computational data being collected and analyzed in many studies. Sustained efforts are needed to address the causes of reproducibility problems that can hinder the rate of scientific progress and lower public and political regard for science. The initial efforts of the American Vacuum Society to raise awareness of a new generation of reproducibility challenges and provide tools to help address them serve as examples of mitigating actions that can be undertaken.

2.
R.
Harris
,
Chem. Eng. News
95
,
2
(
2017
), see https://cen.acs.org/articles/95/i47/Reproducibility-issues.html (accessed 4 October 2018).
3.
The Concordat to Support Research Integrity (2012), see https://www.universitiesuk.ac.uk/policy-and-analysis/reports/Documents/2012/the-concordat-to-support-research-integrity.pdf (accessed 3 September 2018).
4.
Federal Research Misconduct Policy|ORI - The Office of Research Integrity (2018), see https://ori.hhs.gov/federal-research-misconduct-policy (accessed 3 September 2018).
5.
6.
Replicability Research Group Tel Aviv University, Replicability vs Reproducibility - Replicability Research Group (2018), see http://www.replicability.tau.ac.il/index.php/replicability-in-science/replicability-vs-reproducibility.html (accessed 3 September 2018).
7.
H. V.
Fineberg
, Reproducibility_and_Replicability_in_Science (2018), see http://sites.nationalacademies.org/dbasse/bbcss/reproducibility_and_replicability_in_science/index.htm (accessed 3 September 2018).
8.
9.
J.
Park
,
J. D.
Howe
, and
D. S.
Sholl
,
Chem. Mater.
29
,
10487
(
2017
).
10.
A. L.
Plant
,
L. E.
Locascio
,
W. E.
May
, and
P. D.
Gallagher
,
Nat. Methods
11
,
895
(
2014
).
11.
M.
Sené
,
I.
Gilmore
, and
J.-T.
Janssen
,
Nature
547
,
397
(
2017
).
12.
A.
Belu
,
K.
Maniura
, and
S.
McArthur
,
Biointerphases
11
,
040201
(
2016
).
13.
RDAlliance, Improving Reproducibility in Research: The Role of Measurement Science (2018), see https://www.rd-alliance.org/improving-reproducibility-research-role-measurement-science (accessed 3 September 2018).
14.
Technical Working Area 2 Surface Chemical Analysis (2018), see http://www.vamas.org/twa2/index.html (accessed 3 September 2018).
15.
M. D.
Wilkinson
et al,
Sci. Data
3
,
160018
(
2016
).
17.
J. M.
Buriak
,
C. W.
Jones
,
P. V.
Kamat
,
K. S.
Schanze
,
G. C.
Schatz
,
G. D.
Scholes
, and
P. S.
Weiss
,
Chem. Mater.
28
,
3525
(
2016
).
20.
D. R.
Baer
et al,
Surf. Interface Anal.
40
,
529
(
2008
).
21.
D. R.
Baer
et al,
J. Vac. Sci. Technol. A
31
,
050820
(
2013
).
22.
D. R.
Baer
,
P.
Munusamy
, and
B. D.
Thrall
,
Biointerphases
11
,
04B401
(
2016
).
24.
C. G.
Begley
and
J. P. A.
Ioannidis
,
Circ. Res.
116
,
116
(
2015
).
25.
B.
Belluz
,
B.
Plumer
, and
B.
Resnick
, The 7 Biggest Problems Facing Science, According to 270 Scientists (2016), see https://www.vox.com/2016/7/14/12016710/science-challeges-research-funding-peer-review-process (accessed 3 September 2018).
26.
D.
Durbin
and
N.
Car
, Research Data Provenance IG (2018), see https://rd-alliance.org/groups/research-data-provenance.html (accessed 3 September 2018).
27.
S.
Wild
, “Irreproducible astronomy,” Phys. Today (2018, April), see https://physicstoday.scitation.org/do/10.1063/PT.6.1.20180404a/full/ (accessed 3 September 2018).
28.
Checklists work to improve science
,
Nature
556
,
273
(
2018
).
30.
M.
Bionaz
,
J. Nutr. Food Sci.
3
,
1000e1120
(
2013
).
31.
R.
Harris
, Scientists Aim to Pull Peer Review Out of the 17th Century (2018), see https://www.npr.org/sections/health-shots/2018/02/24/586184355/scientists-aim-to-pull-peer-review-out-of-the-17th-century
32.
J.
Somers
, The Scientific Paper is Obsolete (2018, April), see https://www.theatlantic.com/science/archive/2018/04/the-scientific-paper-is-obsolete/556676/ (accessed 3 September 2018).
33.
R.
Kiley
, Wellcome Open Research (2018), see https://wellcomeopenresearch.org/ (accessed 3 September 2018).
34.
G. B.
de al Fuente
, What is Open Science? Introduction (2018), Foster Facilitate Open Science Training for European Research, see https://www.fosteropenscience.eu/content/what-open-science-introduction (accessed 3 September 2018).
35.
R. M.
Crist
,
J. H.
Grossman
,
A. K.
Patri
,
S. T.
Stern
,
M. A.
Dobrovolskaia
,
P. P.
Adiseshaiah
,
J. D.
Clogston
, and
S. E.
McNeil
,
Integr. Biol.
5
,
66
(
2013
).
36.
San Francisco Declaration on Research Assessment (DORA) (2018), see https://sfdora.org/ (accessed 3 September 2018).
37.
John W. Gardner Quotes (2018), see https://www.brainyquote.com/quotes/john_w_gardner_134413 (accessed 3 September 2018).
You do not currently have access to this content.