The determination of kinetics of high-dimensional dynamical systems, such as macromolecules, polymers, or spin systems, is a difficult and generally unsolved problem — both in simulation, where the optimal reaction coordinate(s) are generally unknown and are difficult to compute, and in experimental measurements, where only specific coordinates are observable. Markov models, or Markov state models, are widely used but suffer from the fact that the dynamics on a coarsely discretized state spaced are no longer Markovian, even if the dynamics in the full phase space are. The recently proposed projected Markov models (PMMs) are a formulation that provides a description of the kinetics on a low-dimensional projection without making the Markovianity assumption. However, as yet no general way of estimating PMMs from data has been available. Here, we show that the observed dynamics of a PMM can be exactly described by an observable operator model (OOM) and derive a PMM estimator based on the OOM learning.

1.
H.
Mori
,
Prog. Theor. Chem. Phys.
33
,
423
(
1965
).
2.
R.
Zwanzig
,
J. Stat. Phys.
9
,
215
(
1973
).
3.
O. F.
Lange
and
H.
Grubmüller
,
J. Chem. Phys.
124
,
214903
(
2006
).
4.
R.
Hegger
and
G.
Stock
,
J. Chem. Phys.
130
,
034106
(
2009
).
5.
C.
Schütte
,
A.
Fischer
,
W.
Huisinga
, and
P.
Deuflhard
,
J. Comput. Phys.
151
,
146
(
1999
).
6.
W. C.
Swope
,
J. W.
Pitera
, and
F.
Suits
,
J. Phys. Chem. B
108
,
6571
(
2004
).
7.
N.
Singhal
and
V. S.
Pande
,
J. Chem. Phys.
123
,
204909
(
2005
).
8.
J. D.
Chodera
,
K. A.
Dill
,
N.
Singhal
,
V. S.
Pande
,
W. C.
Swope
, and
J. W.
Pitera
,
J. Chem. Phys.
126
,
155101
(
2007
).
9.
F.
Noé
,
I.
Horenko
,
C.
Schütte
, and
J. C.
Smith
,
J. Chem. Phys.
126
,
155102
(
2007
).
10.
N. V.
Buchete
and
G.
Hummer
,
J. Phys. Chem. B
112
,
6057
(
2008
).
11.
A. C.
Pan
and
B.
Roux
,
J. Chem. Phys.
129
,
064107
(
2008
).
12.
F.
Noé
,
C.
Schütte
,
E.
Vanden-Eijnden
,
L.
Reich
, and
T. R.
Weikl
,
Proc. Natl. Acad. Sci. U. S. A.
106
,
19011
(
2009
).
13.
M.
Sarich
,
F.
Noé
, and
C.
Schütte
,
SIAM Multiscale Model. Simul.
8
,
1154
(
2010
).
14.
J.-H.
Prinz
,
H.
Wu
,
M.
Sarich
,
B.
Keller
,
M.
Senne
,
M.
Held
,
J. D.
Chodera
,
C.
Schütte
, and
F.
Noé
,
J. Chem. Phys.
134
,
174105
(
2011
).
15.
C.
Schütte
,
F.
Noé
,
J.
Lu
,
M.
Sarich
, and
E.
Vanden-Eijnden
,
J. Chem. Phys.
134
,
204105
(
2011
).
16.
F.
Noé
,
H.
Wu
,
J.-H.
Prinz
, and
N.
Plattner
,
J. Chem. Phys.
139
,
184114
(
2013
).
17.
J.-H.
Prinz
,
J. D.
Chodera
, and
F.
Noé
,
Phys. Rev. X
4
,
011020
(
2014
).
18.
H.
Jaeger
, “
Discrete-time, discrete-valued observable operator models: A tutorial
,”
Technical Report GMD-42
, German National Research Center for Information Technology (GMD), 1998.
19.
An Introduction to Markov State Models and Their Application to Long Timescale Molecular Simulation
,
Advances in Experimental Medicine andBiology
, edited by
G. R.
Bowman
,
V. S.
Pande
, and
F.
Noé
(
Springer
,
Heidelberg
,
2014
), Vol.
797
.
20.
C.
Schütte
and
W.
Huisinga
,
Handbook of Numerical Analysis
(
Elsevier
,
2003
), pp.
699
744
.
21.
A.
Bovier
,
V.
Gayrard
, and
M.
Klein
,
J. Eur. Math. Soc.
7
,
69
(
2005
).
22.
G.
Perez-Hernandez
,
F.
Paul
,
T.
Giorgino
,
G.
de Fabritiis
, and
F.
Noé
,
J. Chem. Phys.
139
,
015102
(
2013
).
23.
C. R.
Schwantes
and
V. S.
Pande
,
J. Chem. Theory Comput.
9
,
2000
(
2013
).
24.
F.
Noé
and
F.
Nüske
,
SIAM Multiscale Model. Simul.
11
,
635
(
2013
).
25.
F.
Nüske
,
B.
Keller
,
G.
Pérez-Hernández
,
A. S. J. S.
Mey
, and
F.
Noé
,
J. Chem. Theory Comput.
10
,
1739
(
2014
).
26.
R. T.
McGibbon
,
B.
Ramsundar
,
M. M.
Sultan
,
G.
Kiss
, and
V. S.
Pande
,
Proc. Int. Conf. Mach. Learn.
31
,
1197
1205
(
2014
).
27.
M.
Weber
, “
Meshless methods in conformation dynamics
,” Ph.D. thesis,
Verlag
,
2006
.
28.
F.
Noé
,
H.
Wu
,
J.-H.
Prinz
, and
N.
Plattner
,
J. Chem. Phys.
139
,
184114
(
2013
).
29.
M.
Thon
and
H.
Jaeger
,
J. Mach. Learn. Res.
16
,
103
(
2015
).
31.
D. E.
Shaw
,
P.
Maragakis
,
K.
Lindorff-Larsen
,
S.
Piana
,
R.
Dror
,
M.
Eastwood
,
J.
Bank
,
J.
Jumper
,
J.
Salmon
,
Y.
Shan
, and
W.
Wriggers
,
Science
330
,
341
(
2010
).
32.
A. J.
Laub
,
Matrix Analysis for Scientists and Engineers
(
SIAM
,
2005
).
33.
J. C.
Latorre
,
P.
Metzner
,
C.
Hartmann
, and
C.
Schütte
,
Commun. Math. Sci.
9
,
1051
(
2011
).
You do not currently have access to this content.