Here we propose the reweighted autoencoded variational Bayes for enhanced sampling (RAVE) method, a new iterative scheme that uses the deep learning framework of variational autoencoders to enhance sampling in molecular simulations. RAVE involves iterations between molecular simulations and deep learning in order to produce an increasingly accurate probability distribution along a low-dimensional latent space that captures the key features of the molecular simulation trajectory. Using the Kullback-Leibler divergence between this latent space distribution and the distribution of various trial reaction coordinates sampled from the molecular simulation, RAVE determines an optimum, yet nonetheless physically interpretable, reaction coordinate and optimum probability distribution. Both then directly serve as the biasing protocol for a new biased simulation, which is once again fed into the deep learning module with appropriate weights accounting for the bias, the procedure continuing until estimates of desirable thermodynamic observables are converged. Unlike recent methods using deep learning for enhanced sampling purposes, RAVE stands out in that (a) it naturally produces a physically interpretable reaction coordinate, (b) is independent of existing enhanced sampling protocols to enhance the fluctuations along the latent space identified via deep learning, and (c) it provides the ability to easily filter out spurious solutions learned by the deep learning procedure. The usefulness and reliability of RAVE is demonstrated by applying it to model potentials of increasing complexity, including computation of the binding free energy profile for a hydrophobic ligand–substrate system in explicit water with dissociation time of more than 3 min, in computer time at least twenty times less than that needed for umbrella sampling or metadynamics.

1.
O.
Valsson
,
P.
Tiwary
, and
M.
Parrinello
,
Annu. Rev. Phys. Chem.
67
,
159
(
2016
).
2.
P.
Tiwary
and
A.
van de Walle
,
Multiscale Materials Modeling for Nanomechanics
(
Springer
,
2016
), pp.
195
221
.
3.
P.
Tiwary
and
B. J.
Berne
,
Proc. Natl. Acad. Sci. U. S. A.
113
,
2839
(
2016
).
4.
J.
McCarty
and
M.
Parrinello
,
J. Chem. Phys.
147
,
204109
(
2017
).
5.
M. M.
Sultan
and
V. S.
Pande
,
J. Chem. Theory Comput.
13
,
2440
(
2017
).
6.
G.
Gobbo
,
M. A.
Bellucci
,
G. A.
Tribello
,
G.
Ciccotti
, and
B. L.
Trout
,
J. Chem. Theory Comput.
14
,
959
(
2018
).
7.
I.
Gimondi
and
M.
Salvalaglio
,
Mol. Syst. Des. Eng.
3
,
243
(
2018
).
8.
A.
Chaimovich
and
M. S.
Shell
,
J. Chem. Phys.
134
,
094112
(
2011
).
9.
P.
Shaffer
,
O.
Valsson
, and
M.
Parrinello
,
Proc. Natl. Acad. Sci. U. S. A.
113
,
1150
(
2016
).
10.
A.
Ma
and
A. R.
Dinner
,
J. Phys. Chem. B
109
,
6769
(
2005
).
11.
R.
Galvelis
and
Y.
Sugita
,
J. Chem. Theory Comput.
13
,
2489
(
2017
).
12.
A.
Mardt
,
L.
Pasquali
,
H.
Wu
, and
F.
Noé
,
Nat. Commun.
9
,
5
(
2018
).
13.
C.
Wehmeyer
and
F.
Noé
,
J. Chem. Phys.
148
,
241703
(
2018
).
14.
W.
Chen
and
A. L.
Ferguson
, preprint arXiv:1801.00203 (
2017
).
15.
C. X.
Hernández
,
H. K.
Wayment-Steele
,
M. M.
Sultan
,
B. E.
Husic
, and
V. S.
Pande
, preprint arXiv:1711.08576 (
2017
).
16.
M. M.
Sultan
,
H. K.
Wayment-Steele
, and
V. S.
Pande
,
J. Chem. Theory Comput.
14
,
1887
(
2018
).
17.
D. P.
Kingma
and
M.
Welling
, preprint arXiv:1312.6114 (
2013
).
18.
C.
Doersch
, preprint arXiv:1606.05908 (
2016
).
19.
I.
Goodfellow
,
Y.
Bengio
,
A.
Courville
, and
Y.
Bengio
,
Deep Learning
(
MIT Press
,
Cambridge
,
2016
), Vol. 1.
20.
21.
D.-A.
Clevert
,
T.
Unterthiner
, and
S.
Hochreiter
, preprint arXiv:1511.07289 (
2015
).
22.
F.
Chollet
 et al., “Keras,” https://github.com/keras-team/keras (
2015
).
23.
H.
Grubmüller
,
Phys. Rev. E
52
,
2893
(
1995
).
24.
J.
McCarty
,
O.
Valsson
,
P.
Tiwary
, and
M.
Parrinello
,
Phys. Rev. Lett.
115
,
070601
(
2015
).
25.
A.
Laio
and
M.
Parrinello
,
Proc. Natl. Acad. Sci. U. S. A.
99
,
12562
(
2002
).
26.
A.
Berezhkovskii
and
A.
Szabo
,
J. Chem. Phys.
122
,
014503
(
2005
).
27.
G.
Bussi
and
M.
Parrinello
,
Phys. Rev. E
75
,
056707
(
2007
).
28.
P.
Tiwary
and
B. J.
Berne
,
J. Chem. Phys.
147
,
152701
(
2017
).
29.
P.
Tiwary
and
B. J.
Berne
,
J. Chem. Phys.
145
,
054113
(
2016
).
30.
J.
Mondal
,
J. A.
Morrone
, and
B. J.
Berne
,
Proc. Natl. Acad. Sci. U. S. A.
110
,
13277
(
2013
).
31.
P.
Tiwary
,
J.
Mondal
,
J. A.
Morrone
, and
B. J.
Berne
,
Proc. Natl. Acad. Sci. U. S. A.
112
,
12015
(
2015
).
32.
Y.
Bengio
,
International Conference on Speech Processing
(
Springer
,
2013
), pp.
1
37
.
33.
P.
Tiwary
,
J. Phys. Chem. B
121
,
10841
(
2017
).
34.
S.
Pressé
,
K.
Ghosh
,
J.
Lee
, and
K. A.
Dill
,
Rev. Mod. Phys.
85
,
1115
(
2013
).
35.
P. D.
Dixit
,
A.
Jain
,
G.
Stock
, and
K. A.
Dill
,
J. Chem. Theory Comput.
11
,
5464
(
2015
).
You do not currently have access to this content.