We introduce a new mathematical framework for the qualitative analysis of dynamical stability, designed particularly for finite-time processes subject to slow-timescale external influences. In particular, our approach is to treat finite-time dynamical systems in terms of a slow–fast formalism in which the slow time only exists in a bounded interval, and consider stability in the singular limit. Applying this to one-dimensional phase dynamics, we provide stability definitions somewhat analogous to the classical infinite-time definitions associated with Aleksandr Lyapunov. With this, we mathematically formalize and generalize a phase-stabilization phenomenon previously described in the physics literature for which the classical stability definitions are inapplicable and instead our new framework is required.
An important phenomenon in nonlinear science is the stabilization of processes by external forces. This phenomenon can manifest as the mutual synchronization of an array of processes evolving under the same law but starting at different initial states, where the synchronization is due to the processes being subject to a common external forcing. Such stabilization is traditionally analyzed in terms of Lyapunov exponents and other related long-time-asymptotic conceptions of dynamical stability; these can be applied to both deterministic and stochastic dynamical systems that are well-defined over infinite time. References 1 and 2 present a stabilization phenomenon in which the kind of external forcing considered is a slow-timescale process; our present paper concerns mathematically rigorous formulation, proof, and generalization of this stabilization phenomenon. We will see that the traditional approaches to theoretical stability analysis such as Lyapunov exponents and other infinite-time approaches cannot generally be applied to describe the stabilization phenomenon of Refs. 1 and 2. In fact, the critical forcing strength required to induce stability is generally dependent on the time-interval over which the system is being considered. This means that the phenomenon should be understood in terms of finite-time stability, in contrast to other stabilization phenomena such as the well-known case of stabilization by stationary noise. Our work represents a significant contribution to the important and growing field of finite-time dynamical systems (FTDSs) and finite-time stability, whose necessity in the study of various nonlinear systems, such as climate and biological systems, is increasingly being recognized.
I. INTRODUCTION
For either an autonomous dynamical system
with a time-independent vector field , or a nonautonomous3–5 dynamical system
with a time-dependent vector field , dynamics is traditionally analyzed in terms of behavior as . For example, attractors, repellers, asymptotic stability, and Lyapunov exponents are typically defined in terms of such long-time-asymptotic behavior. From a practical perspective, this approach is based on the assumption that one is interested in the system’s behavior after a sufficiently long time that “transients have decayed.”
However, in more recent decades, the study of “finite-time dynamical systems” (FTDSs) has grown in popularity;6–14 these are dynamical systems in which time is constrained to a compact interval, i.e.,
for some time-dependent vector field . As described in Secs. 1.1 and 6 of Ref. 11, situations where the FTDS framework is appropriate include
when one is interested in behavior on a shorter timescale than that required for a given model’s long-time-asymptotic dynamical picture to emerge, or
when the temporal variations of the external forcing over finite timescales of interest are “unextendible,” meaning that they do not (or are not know to) follow any particular indefinite-time deterministic or stochastic model, and so there is no such thing as “long-time-asymptotic” behavior.
Now sometimes, the temporal variations of the external forcing may be relatively slow, and this slowness may play an important role in shaping the consequent dynamical behavior.15 In this paper:
We will introduce (immediately below, and further in Sec. III) a framework for investigating the role of slow variation of external forcing on the consequent dynamical behavior, specifically designed to be applicable to “unextendible” temporal variations defined over compact time-intervals. (The need for such a framework will be further illustrated in Sec. II B.)
We will apply this framework to provide a rigorous mathematical description of a certain one-dimensional phase-stabilization phenomenon described in the physics literature, in Refs. 1 and 2.
The framework we introduce is a slow–fast setup in which the slow time is constrained to a compact interval (without loss of generality, the unit interval). That is, we consider systems of the form
for some -parameterized vector field,
While traditional mathematical definitions of stability and Lyapunov exponents are formulated in terms of the behavior, we will formulate analogous definitions in terms of the behavior of (2). While a classical limit represents “non-transient dynamical phenomena,” the limit represents “non-rate-induced16 dynamical phenomena.” Here, represents the “timescale separation” between the slower timescale of the external forcing and the faster timescale of the internal dynamics; this setup can equivalently take the form
Now, in investigating the stability properties of (2) and (3), this paper focuses on the natural “starting case” to consider, namely, dynamics on a one-dimensional phase space (specifically, the circle ). This already provides significant non-trivialities to deal with (see Sec. II C), especially the canard phenomenon17 of multiple-timescale dynamics where solutions spend a long time traveling along an unstable portion of the slow manifold. Our results in this paper will both formalize and considerably generalize the core findings of Refs. 1 and 2 regarding stabilization of the one-dimensional Adler equation by slow-timescale additive forcing. The two main steps that will be involved are
showing that “generic” time-dependent vector fields admit an adiabatically traceable moving sink analogous to the moving sink of the slowly varying Adler equation (Theorem 14); and
making mathematically rigorous the heuristic stability arguments used in Refs. 1 and 2 for the Adler equation (Theorem 24), which we mainly achieve by adapting methods that were used in Ref. 17 for investigating periodic orbits of an Adler equation subject to low-frequency sinusoidal forcing.
We will also analyze the generic behavior of the transition to stability from neutral stability induced by slow-timescale forcing, and its contrast to analogous classical saddle-node bifurcations (see Secs. III G, IV D, and IV E 3). Let us also mention that fast-timescale forcing of the Adler equation as a FTDS has been considered in Theorem 6.3 of Ref. 18, as part of a study of phase-synchronization transitions.
From a physical perspective, dynamical systems on can be used to describe the phase of a cyclic process via phase reduction, which has been established for systems subject to slow-timescale forcing in Refs. 19–21. The study of one-dimensional phase dynamics has particular relevance for various biological oscillatory processes or coupled pairs of oscillatory processes;1,2,18,21–23 and indeed, in such contexts, it is especially important that temporal variations in external forcing are “unextendible” in the sense described above, otherwise, the organism cannot properly interact with the outside world and will quickly die.
However, we repeat that the rationale behind this paper is not simply to obtain results about one-dimensional phase dynamics. We hope through our treatment of the one-dimensional case of (2) to help lay the foundations for the development of more general methodology for treating FTDSs involving multiple timescales. The need for theory of higher-dimensional dynamics within the framework of Eqs. (2) and (3) is already evidenced in Sec. III of Ref. 2, where numerics indicate that the phenomenon of stabilization of solutions by slowly varying forcing can also occur in higher-dimensional systems, including chaotic systems. Additionally, Ref. 24 shows that the same mechanism of stabilization described in Refs. 1 and 2 for one-dimensional dynamics can also induce local stability of synchronous solutions in a driven Kuramoto network of arbitrary size.
So, we anticipate that the line of inquiry initiated by this paper may find utility in the investigation of various complex systems such as biological oscillator networks (where our earlier comment about the necessity of “unextendible” temporal variations still applies) and climate systems subject to natural or anthropogenic forcing. Furthermore, we believe that mathematical theory of multiple-timescale FTDSs can provide deeper insight into the nature and application of time-series analysis tools designed for studying time-localized dynamics, such as those described in Refs. 5, 25, and 26.
The paper is organized as follows.
In Sec. II, we describe the stabilization of the Adler equation presented in Refs. 1 and 2, its physical motivations, and its contrast to the traditional cases of stabilization by constant forcing and by noise. We illustrate how the stability and neutral stability observed in Refs. 1 and 2 cannot generally be formulated in terms of the traditional definitions and quantification of stability due to Aleksandr Lyapunov, such as asymptotic stability and asymptotic Lyapunov exponents. We then outline the primary mathematical non-trivialities for our main task of providing a mathematically rigorous formulation and proof of the stabilization phenomenon.
In Sec. III, we first introduce our concepts of stability for systems of the form (2) defined on the circle . Then, we present other definitions necessary for the formulation of our main results (such as curves of the stable and unstable slow manifolds and tracking of such curves) and present our main results that mathematically formalize and generalize the basic argument of Refs. 1 and 2. We also outline our main methods of proof and their relation to the methods in Ref. 17. Finally, we give a result regarding the generic scenario of a transition between stability and neutral stability within our framework, highlighting, in particular, its signature characteristic of approximately linear growth of the stability exponent on the stable side of the transition (in contrast to the square-root growth in classical saddle-node bifurcations).
In Sec. IV, we carry out a comparison of our new framework of stability analysis with the classical long-time-asymptotic framework, particularly through the example of low-frequency-periodically forced Adler equations.
In Sec. VI, we summarize and conclude.
In Appendix A, for the sake of completeness, we obtain a much more refined version of one of the results (Corollary 45) needed within the proof of Theorem 24(C).
In Appendix B, we state the numerical procedures used for all the numerics in this paper.
I. Note
II. STABILIZATION OF ADLER EQUATIONS BY SLOW-TIMESCALE FORCING
In Sec. II A, we first give preliminaries regarding the general concept of stabilization by external forcing and two basic mechanisms of stabilization of the Adler equation; then, we describe the stabilization by slow-timescale forcing studied in Refs. 1 and 2. In Sec. II B, we will demonstrate an example of this latter mechanism of stabilization, where we use a slow-timescale forcing that is “unextendible” in the sense described in Sec. I. In Sec. II C, we will outline the main non-trivialities in obtaining a mathematically rigorous formulation and proof of this stabilization phenomenon.
A. Stabilization by external forcing
It is well-known that trajectories of an autonomous dynamical system (1) can often be “stabilized” by the introduction of external forcing, e.g., an additive forcing giving rise to a nonautonomous dynamical system of the form
This “stabilization” can be defined in terms of synchronization between solutions starting at different initial conditions:29 namely, it refers to the scenario that for an array of distinct initial conditions , the solutions of (1) starting at these initial conditions remain clearly distinct at all times but the solutions of (4) starting at these same initial conditions become synchronized with each other. Note that this synchronization is not induced by any “direct” coupling between the solutions but rather by the “indirect coupling” of being simultaneously subject to the same external driving . A natural question then is what kinds of forcing function will give rise to such synchronization.
As a prototype: on the circle , all solutions of the autonomous Adler equation
with constant parameters , move strictly periodically round the circle with common period ; and so, in particular, the solutions of any two distinct initial conditions do not synchronize with each other. We now consider what types of external forcing can cause the solutions of different initial conditions to become synchronized with each other.
1. Stabilization by constant forcing
One crude way to stabilize system (5) is to apply a perpetually constant external forcing such that the “effective new -value” lies in . In this case, all solutions now converge to the point apart from one single exceptional solution that remains fixed at the point ; and thus, the phase differences between these solutions trivially tend to as . This mutual synchronization of solutions takes place at an exponential rate with exponent , called the Lyapunov exponent associated with the fixed point . [This exponent is obtained as the derivative of at .]
Note that if one were instead to take the constant sufficiently close to zero, then the Adler equation would not be stabilized: solutions would move strictly periodically round the circle with common period . The bifurcation that takes place as crosses the critical threshold is a saddle-node bifurcation, namely, the creation of a stable and an unstable equilibrium point.
Now, from a practical point of view, this crude approach to the removal of asynchrony among solutions through simply forcing them perpetually to remain at a fixed point may (depending on context) be problematic due to the inability of solutions to move freely throughout the phase space. It may also (again depending on context) be rather energy-inefficient to keep this forcing perpetually maintained.
2. Stabilization by noise
One kind of forcing that is often known to induce stability in dynamical systems is noise.29–31 Noise-induced stability is very common in general but is especially typical for one-dimensional phase-oscillator dynamics, where, for example, memoryless stationary noise is guaranteed to lead to mutual synchronization of solutions under weak conditions.32,33
As an example, the addition of stationary Gaussian white noise of intensity to the Adler equation (5) will stabilize the Adler equation, regardless of how small is.29,34 To be more precise: if we fix the values of , and , almost every realization of a Wiener process has the property that all solutions of the corresponding nonautonomous dynamical system
synchronize with each other in the limit as (i.e., their phase differences tend to ), apart from one solution starting at a single exceptional initial condition. Moreover, this synchronization of solutions comes with a well-defined Lyapunov exponent (i.e., long-time-asymptotic exponential rate of decay of phase differences), which is exactly the same value across almost all realizations of the Wiener process.
The mechanism behind this exponential synchronization of solutions is that the infinite time-horizon allows for statistical large-number laws to come into play, whereby random events in the noise which bring the different solutions toward those regions on the circle where they are pushed closer together are guaranteed to occur with sufficient long-time-asymptotic regularity. Note, in particular, that if the noise intensity is very small, then it will take a very long time for the synchrony among different solutions to begin to emerge.
3. The stabilization phenomenon of Refs. 1 and 2
In contrast to stationary white noise, a very different type of forcing that one can consider is deterministic35 slowly varying forcing. In particular, in the physics literature, Refs. 1 and 2 considered equations of the form
with having slow dependence on . In both of these papers, the variable in (7) is regarded as representing the phase difference between a unidirectionally coupled pair of phase oscillators (where the driving oscillator has time-variable frequency), so that synchronization between the solutions of (7) starting at different initial conditions corresponds to stabilization of the driven oscillator by the driving oscillator. Physical motivations in Ref. 1 include the van der Pol oscillator subject to aperiodic external driving [where a phase-reduction approximation brings the system to the form (7)], as well as neuron voltage spiking dynamics, where stabilization by external driving is known to occur.36–38 One physical motivation behind Ref. 2 was to develop upon some of the main findings of Refs. 22 and 23 for cardiorespiratory phase synchronization.
If there are times at which the slowly varying function lies in the interval , then during such times, the solutions of (7) will cluster together into an increasingly tight cluster around the “slowly moving sink” .
By contrast, while is outside the interval , solutions move unboundedly round the circle without either synchronizing with each other or becoming desynchronized from each other.
Thus, overall, we have mutual synchronization of solutions if there are times when enters the interval , but not if stays outside the interval . (We will illustrate this further in Sec. II B.)
As in Ref. 1, we can derive an approximation of the average exponential rate of mutual synchronization of solutions, by adiabatically following the Lyapunov exponent of the stable fixed point of the time-frozen vector field when it exists. More precisely, over a time-interval , the approximate average exponential rate of synchronization (taken as negative when such synchronization does occur) is given by
Note that is if never enters the interval .
Now, as in Ref. 2, we can consider of the form for some , some function taking both positive and negative values, and some parameter ; so (7) becomes
This represents the addition of an external forcing to the autonomous system (5). Parameter is somewhat analogous to the noise intensity parameter in (6), except that we are now considering slow-timescale deterministic variation rather than fast-timescale stochastic variation. Fixing the function , if is sufficiently large, then there will be times at which enters the interval , and so the added forcing will induce stabilization.
References 1 and 2 also provide strong numerical support for the above description of the dynamics of (7) and (9). The numerics in Ref. 2 use low-frequency sinusoidal forcing (see also Secs. IV C and IV E 2 of this paper), and Ref. 1 considers various other forms of forcing. In Sec. II B, we will go on to provide further numerical support using a form of forcing deliberately designed to be “unextendible” in the sense of point (ii) in the Introduction.
B. An illustrative example of stabilization by “unextendible” slow-timescale forcing
To illustrate the need for a FTDS framework in order to be able to formulate mathematically the stabilization phenomenon described in Refs. 1 and 2, we consider Eq. (9) with being a function that is only meaningfully defined on a compact time-interval.
One way in which such a function could arise is as an empirically recorded time-series:11 if one defines a nonautonomous dynamical system with reference to an actual empirically measured signal for the external forcing, then the finiteness of the signal duration means that the system is inherently a FTDS, for which traditional infinite-time dynamical systems theory cannot be used as a framework for dynamics analysis. Forcing a fast-timescale Adler equation by a finite-duration empirical signal measured from a relatively slow-timescale physical process will give results in line with the picture described in Sec. II A 3.
But here, we will construct numerically. Specifically, we will generate a sample realization of a Brownian bridge—this is a finite-time stochastic process, which represents the inhomogeneities of a large sample of random times selected with uniform probability from a pre-specified compact time-interval. Then, as in Ref. 1, Sec. III B, we will pass the result through a low-pass filter to obtain our slowly time-dependent forcing. Our choice of using a sample realization of a Brownian bridge is not motivated by any specific physical application but is simply for illustrative purposes as a good example of “unextendible” temporal variations.
1. The forcing and the system parameters
Let us first briefly recall the definition of a Brownian bridge, and its connection to Brownian motion. A Brownian bridge of parameter on a time-interval is a finite-time stochastic process approximated by taking a very large simple random sample of times from the uniform distribution on and then setting
where is the “signed deviation from homogeneity” of the random sample , that is,
This definition is made rigorous by Donsker’s theorem.39 Now, although a Brownian motion is an indefinite-time process, one can construct up to time a zero-drift Brownian motion of diffusion parameter by taking a random variable that is independent of the Brownian bridge and then letting
For each , the variance of is given by
This quadratic expression with respect to is non-negative on but becomes negative when is outside of . Thus, there is no natural way to extend a Brownian bridge on beyond time . [And indeed, there is no way to extend the construction (10) beyond time , as the variance of then exceeds the variance of .]
Now, in our case, we define on a compact interval with ; we constructed by first generating a sample realization of a Brownian bridge on of parameter and then passing the result through a fifth order Butterworth low-pass filter with cut-off frequency Hz. The resulting function is shown is Fig. 1. Further details of this construction and of all numerics in this paper are given in Appendix B. For other parameters in Eq. (9), we take and , and we consider how the dynamics depends on the parameter . Due to the low-pass filter, has very slow dependence on compared to the timescale of the “internal dynamics” of the system as represented by Eq. (5), whose solutions have a frequency of Hz.
Graph of obtained by passing a sample realization of a Brownian bridge on through a low-pass filter of cut-off frequency Hz. Reproduced with permission from Newman et al., Physics of Biological Oscillators, edited by A. Stefanovska and P. V. E. McClintock (Springer, 2021), Chap. 7, pp. 111–129. Copyright 2021 Springer Nature Switzerland AG.
Graph of obtained by passing a sample realization of a Brownian bridge on through a low-pass filter of cut-off frequency Hz. Reproduced with permission from Newman et al., Physics of Biological Oscillators, edited by A. Stefanovska and P. V. E. McClintock (Springer, 2021), Chap. 7, pp. 111–129. Copyright 2021 Springer Nature Switzerland AG.
2. The stabilization phenomenon
Considering (9) over the whole time-interval , the argument described in Sec. II A 3 tells us that if is less than then the solutions of (9) do not synchronize with each other, but if is greater than then the solutions of (9) do synchronize with each other. This is exactly what we observe in numerics: Fig. 2(b) shows a “numerical bifurcation diagram” of (9) where for each -value, the trajectories at time of 50 evenly spaced initial conditions are shown; and in dashed black is marked the value of .
Dynamics of (9) with as in Fig. 1, with varying , over the time-interval of duration in (a)–(c), and over the shorter time-interval of duration in (d)–(f). Other parameters are rad/s and . In (a), (b), (d), and (e), for each -value, results for the evolution of 50 equally spaced initial conditions , , are shown: (a) and (d) show the finite-time Lyapunov exponents , as defined by (11), for these trajectories, with in (a) and with in (d); (b) and (e) show the positions of these trajectories at time in (b) and in (e). In (c) and (f), for each -value, the positions of for the 50 trajectories ending at the points , , are shown, with in (c) and in (f). In (a)–(c), the value is marked in dashed black. In (d)–(f), the value is marked in dashed black. Reproduced (with minor modification) with permission from Newman et al., Physics of Biological Oscillators, edited by A. Stefanovska and P. V. E. McClintock (Springer, 2021), Chap. 7, pp. 111–129. Copyright 2021 Springer Nature Switzerland AG.
Dynamics of (9) with as in Fig. 1, with varying , over the time-interval of duration in (a)–(c), and over the shorter time-interval of duration in (d)–(f). Other parameters are rad/s and . In (a), (b), (d), and (e), for each -value, results for the evolution of 50 equally spaced initial conditions , , are shown: (a) and (d) show the finite-time Lyapunov exponents , as defined by (11), for these trajectories, with in (a) and with in (d); (b) and (e) show the positions of these trajectories at time in (b) and in (e). In (c) and (f), for each -value, the positions of for the 50 trajectories ending at the points , , are shown, with in (c) and in (f). In (a)–(c), the value is marked in dashed black. In (d)–(f), the value is marked in dashed black. Reproduced (with minor modification) with permission from Newman et al., Physics of Biological Oscillators, edited by A. Stefanovska and P. V. E. McClintock (Springer, 2021), Chap. 7, pp. 111–129. Copyright 2021 Springer Nature Switzerland AG.
For , we see the trajectories distributed fairly evenly distributed throughout the circle, just as we would have seen for the unperturbed system (5). We refer to this lack of clear mutual attraction or mutual repulsion between the trajectories of different initial conditions as “neutral stability.” Now, in the setting of infinite-time dynamical systems, one can give a rigorous definition of “neutral stability” in terms of the traditional framework of long-time-asymptotic dynamics, such as we do in Sec. IV A. (The definition there implies, in particular, that all solutions are Lyapunov stable but not asymptotically stable, and have a Lyapunov exponent of zero.)
For , we see that the trajectories are “stabilized,” i.e., they have become mutually synchronized with each other, such that they appear like a single point in Fig. 2(b).
Thus, a clear transition from “neutral stability” to “stability” takes place at . Figure 2(c) shows the “numerical reverse-time bifurcation diagram,” where 50 evenly spaced initial conditions are run in backward time under (9) from time to time ; we see from this that when rises above , the forward-time solutions of (9) are being mutually repelled from a very small region [appearing like a single point in Fig. 2(c)]. So, overall, the picture indicated by plots (b) and (c) of Fig. 2 is rather resemblant of a saddle-node bifurcation in classical autonomous dynamical systems theory, where a lack of equilibria bifurcates into a repelling (unstable) and an attracting (stable) equilibrium. However, the system is a finite-time nonautonomous dynamical system: mathematically rigorous formulation of the “bifurcation” seen in plots (b) and (c) cannot be in terms of traditional “” considerations by which concepts such as “stable” and “unstable” equilibria are defined.
3. Analysis via finite-time Lyapunov exponents
Local stability of solutions of a dynamical system can be quantified in terms of Lyapunov exponents. Traditional infinite-time dynamical systems theory tends to focus on long-time-asymptotic Lyapunov exponents, simply referred to as “Lyapunov exponents” without a qualifier. These Lyapunov exponents are defined as the long-time-asymptotic limit of finite-time Lyapunov exponents (FTLEs). In some contexts, one can also study other long-time-asymptotic features of the set of the FTLEs, such as given by large deviation theory29 or the dichotomy spectrum.40 Now, in our finite-time system, we cannot apply any long-time-asymptotic concepts; but we can still apply the concept of FTLEs within the bounded time-interval .
The finite-time Lyapunov exponent for a solution of (9) over a time-window is calculated by averaging over time the derivative of the time-frozen vector field at , i.e.,
Working over the whole time-interval , Fig. 2(a) shows the values of for the trajectories of 50 initial conditions. For each -value, we see that the 50 trajectories share indistinguishably the same FTLE value as each other (appearing like a single point), being indistinguishable from for and clearly negative for . Again, this suggests a transition from neutral stability to stability as crosses .
4. Restricting to a time-subinterval
Now, for further illustration, let us consider the dynamics of (9) not over the whole time-interval, but rather over a subinterval with . Figure 2(e) shows the numerical bifurcation diagram for simulation only up to time , and likewise Fig. 2(f) shows the numerical reverse-time bifurcation when running initial conditions backward in time from time to time . Here, we see the saddle-node-like “bifurcation” occurring at , again exactly in accordance with the reasoning of Sec. II A 3. In Fig. 2(d) are shown FTLEs of trajectories over the time-window , and again we see a transition from to negative at .
Note that is larger than —i.e., the critical parameter value for the saddle-node-like bifurcation changes when we consider the system over vs when we consider the system over the whole time-interval . This further shows how long-time-asymptotic approaches to considering stability (such as traditional Lyapunov exponents as opposed to finite-time Lyapunov exponents) are completely unsuitable for attempting to analyze the behavior of systems like the one we have just examined.
C. Our goal and main non-trivialities in achieving it
We seek to obtain a rigorous mathematical description, justification and generalization for the above-described stabilization phenomenon exhibited by Eqs. (7) and (9) and the quantification of stability given by Eq. (8).
In seeking to achieve this, the following three non-trivialities arise:
As we have discussed in Sec. II B, the traditional long-time-asymptotic framework of stability analysis and stability quantification via Lyapunov exponents—as used, for example, to describe the stabilization phenomena in Secs. II A 1 and II A 2—cannot generally be used to describe the stabilization phenomenon in Eq. (7) or (9). So, we need to formulate new mathematical definitions of stability within a suitable finite-time-dynamics framework.
The reasoning of Refs. 1 and 2 requires that while , there is no significant net stabilizing or destabilizing of trajectories. It is clear that this is true over timescales comparable with the “fast” timescale of the time-frozen vector field: all trajectories move approximately periodically round the circle with common approximate period . However, it is somewhat less obvious that no significant net stabilizing or destabilizing of trajectories can eventually build up over the “slow” timescale of the forcing.
If passes in and out of the interval multiple times, then each new time that enters the interval , the previously synchronized solutions may experience some level of desynchronization due to a canard phenomenon17 in which the synchronized solutions spend a long time following the slow motion of moving source . This phenomenon requires extremely fine tuning of parameters but we shall see that it still makes it impossible for us to take a “true” limit as in our slow–fast analysis. Rather, as we will prove, we will need that our “limit as ” is allowed to pass over an exponentially vanishing set of “bad” -intervals.
The way in which we address these issues is essentially by adapting the methods used in Ref. 17 to investigate periodic orbits of (9) when is sinusoidal. However, we will develop a much more elementary and more explicitly constructive approach to obtaining the necessary results about behavior while than that used in Ref. 17.
In addition to the above issues, our general results will require us to take into account another dynamical phenomenon that cannot occur in the Adler equation, namely, bifurcation-induced tipping16,41,42 between stable equilibria of the time-frozen vector fields . This is not necessary when considering a forced Adler equation (7) because the time-frozen vector fields have at most one stable equilibrium. However, the presence of such tipping will not add much complication to the proofs.
III. SETUP, DEFINITIONS, AND RESULTS
Throughout this paper, we identify the circle with . (Hence, each tangent space is naturally identified with .)
An arc will always mean a connected proper subset of with non-empty interior. For any two distinct points , we define the “open arc extending anticlockwise from to ”—written as —to be the arc obtained by projecting an interval onto , where is any lift of and is the unique lift of in the interval . For such an open arc , we define ; and for a non-open arc , we set . Just as denotes an open arc, so likewise we use the analogous notations , , and for half-open arcs and closed arcs. For any and , we write for the projection of , where is any lift of .
For any points , we define the unsigned distance
For and , write . So, if , then .
Generally speaking, a variable will denote position on the circle , and a variable will denote “slow time,” which in this paper belongs to the unit interval . Given a function , we write () to denote the th partial derivative with respect to the second input of the th partial derivative with respect to the first input of .
Most results in this section will be proved in Sec. V.
A. Notions of stability for slow–fast FTDSs on the circle
We denote by the set of functions for which the partial derivatives , , , and all exist and are continuous on the whole of . We equip with its natural norm,
where denotes the supremum norm for continuous functions on .
Throughout this paper, we consider the differential equation
where .
Given an arc , for any and , we define the arc to be the image of under the time--to- mapping of (12), that is,
As in traditional dynamical systems theory, one can formulate local notions of stability around trajectories starting at individual initial conditions, as well as global-scale notions of stability that concern the whole ensemble of trajectories of all the initial conditions. Throughout this paper, we only consider such global-scale concepts of stability (and, therefore, we do not include the word “global” in our definitions).
Due to canard phenomena, the exponential stability formulated in Definition 3 will often be too strong, and so we will need to exclude a small set of -values. In the following, we write for the Lebesgue measure on .
As an equivalent formulation, is exponentially vanishing if and only if there exists such that for all sufficiently large ,
We will say that is almost exponentially stable with rate if given any , there is an exponentially vanishing set such that for every , there is an arc with such that for every arc not intersecting , Eq. (14) holds.
All four stability definitions above can equivalently be formulated in terms of FTLEs. For an initial condition , letting be the solution of (12) starting at , we define the corresponding FTLE over a time-window by
Note that is precisely the logarithm of the derivative at of the time--to- mapping of (12). Hence, by the mean value theorem, we immediately have the following:
For any , , with , and any connected subset of with non-empty interior, the following two statements are equivalent
- for every arc ,
- for every ,
Likewise, the corresponding two statements with in place of are equivalent to each other.
Thus, in Definition 1, the statement that Eq. (13) holds for every arc can be reformulated as saying that for every ,
and similarly, in Definition 3 or Definition 5, the statement that Eq. (14) holds for every arc not intersecting can be reformulated as saying that for every ,
B. Zeros, curves of the slow manifold, and fast connections
Throughout the rest of Sec. III, we assume that .
Since we consider small , the dynamics of Eq. (12) will be essentially determined by the zeros of .
A zero of is a point such that . A zero of is called
hyperbolic stable if
hyperbolic unstable if
non-hyperbolic if .
A non-hyperbolic zero is called non-degenerate if and are both non-zero.
A curve of the stable (respectively, unstable) slow manifold is a pair consisting of a set and a continuous function such that for all , is a hyperbolic stable (respectively, unstable) zero of . We will also refer to the function itself as being a curve of the stable (respectively, unstable) slow manifold over .
We emphasize that in Definition 8, is allowed to be the empty set (in which case is the “empty function” ), or a disconnected set, and need not admit a continuous extension to . In particular, if is a shared boundary point of two connected components of and the limits and both exist, these limits do not have to be equal to each other.
Let us now comment on the behavior of locally around its zeros.
Suppose is a hyperbolic stable (respectively, unstable) zero of . Then, by the implicit function theorem, there is a curve of the stable (respectively, unstable) slow manifold over a neighborhood of such that every zero of close to lies on .
Suppose is a non-degenerate non-hyperbolic zero of with . Then, the family of vector fields undergoes a saddle-node bifurcation near as passes through (see also the description at the start of Sec. III G). In particular, over an interval with , there is both a curve of the stable slow manifold and a curve of the unstable slow manifold such that every zero of close to lies on the curve .
Suppose we have and such that and are zeros of . We say that there is a fast connection from to if at least one of the following two statements holds:
is strictly positive on ;
is strictly negative on .
C. Complete curves of the stable slow manifold
For a classical infinite-time autonomous differential equation with a stable equilibrium point , one can consider the set of solutions that approach arbitrarily closely as , and moreover, one can quantify the long-time-asymptotic stability of such solutions using the Lyapunov exponent associated with , defined as . [Likewise, for an infinite-time stationary-noise-driven system such as our example (6) of noise-induced stabilization, one can define analogous concepts,43 with the analog of equilibrium points being invariant random Dirac measures.]
For our system (12), the analogous concept to a stable equilibrium point is what we will call a complete curve of the stable slow manifold.44 Analogous to the arbitrarily close approach of an equilibrium point as is the arbitrarily close tracking of such a curve as (see Sec. III D); and in analogy to the Lyapunov exponent of an equilibrium, we will define the adiabatic Lyapunov exponent associated with a complete curve of the stable slow manifold, which (by Lemma 46) quantifies the stability of solutions that track the curve when is small.
First, we need to introduce a “genericity” assumption on that will be required for us to be able to carry out the above-described analysis.
We will say that is generic if
every non-hyperbolic zero of is non-degenerate
contains no non-hyperbolic zeros of ; and
for each , contains at most one non-hyperbolic zero of .
The first two points imply that every non-hyperbolic zero of is as described in Remark 9(B).
If is generic, then the number of zeros in is even, with half being hyperbolic stable and half being hyperbolic unstable.
We will say that is initially multistable if contains at least two hyperbolic stable zeros.
Note, in particular, that if has no zeros, then is generic and not initially multistable.
The main results of this paper concern the stability properties of (12) when is generic and not initially multistable. (If is initially multistable, then will generally not exhibit the “global-scale” stability properties formulated in Sec. III A.)
Suppose is generic. A curve of the stable slow manifold will be called complete if the following statements hold
is open relative to and has finitely many connected components
there are no zeros of in and
for any that is a shared boundary point of two connected components of ,
the limit exists and is a non-hyperbolic zero of
the limit exists and is a hyperbolic stable zero of and
there is a fast connection from to .
Suppose is generic.
If contains no zeros of , then there exists a unique complete curve of the stable slow manifold. Furthermore, is empty if and only if has no zeros.
For any with being a hyperbolic stable zero of , there exists a unique complete curve of the stable slow manifold for which .
We have the following immediate corollary:
If is generic and not initially multistable, then there exists a unique complete curve of the stable slow manifold.
The key method in the proof of Theorem 14 is continuation of a curve of zeros by virtue of Remark 9. The proof is given in Sec. V B.
As we will see from the proof of Theorem 14, if is generic and initially multistable, then is the same across all hyperbolic stable zeros in ; and letting be the connected component of containing , we have that and are the same across all hyperbolic stable zeros in .
We now define adiabatic Lyapunov exponents, which generalize Eq. (8).
Note that must be finite and non-positive and that if and only if (i.e., if and only if has no zeros).
D. Tracking
So far, we have formulated various definitions connected with the zeros of , but not yet connected with how this relates to the dynamics of (12). We now introduce notions of tracking, similar to that of Ref. 41.
In the following definitions, we assume that we have a set and a function . Where we will apply these definitions, will always be either a curve of the stable slow manifold or a curve of the unstable slow manifold.
Fix . Given , we say that a function -tracks if for every , .
We say that
exhibits strict tracking of if given any , we have that for sufficiently small , (12) exhibits -tracking of ;
almost exhibits strict tracking of if given any , there is an exponentially vanishing set such that for every , (12) exhibits -tracking of ; and
potentially exhibits strict tracking of if given any , there is an open set with such that for every , (12) exhibits -tracking of .
We say that admits a global canard phenomenon if there exists an open set and a curve of the unstable slow manifold over such that potentially exhibits strict tracking of .
We now define what it means for to exhibit “not necessarily strict” tracking of .
Assume that is -compact. We say that exhibits (respectively, almost exhibits, potentially exhibits) tracking of if for every compact subset of , exhibits (respectively, almost exhibits, potentially exhibits) strict tracking of .
Suppose , and we have functions that disagree on at least one point in the interior of ; then, we cannot have both that exhibits tracking of and that potentially exhibits tracking of . However (as in Sec. III E), we may have that almost exhibits tracking of and that potentially exhibits tracking of .
E. Main results
Standing assumption. Throughout this section, if is generic and not initially multistable, then we take to be the unique complete curve of the stable slow manifold, and we take to be the corresponding adiabatic Lyapunov exponent.
In our main result (Theorem 24), we consider functions that are generic and not initially multistable and split into the following three cases: has zero, one, and more than one connected component.
Suppose has no zeros. Then, is robustly neutrally stable.
Suppose is generic and not initially multistable, and is non-empty and connected. Then, exhibits tracking of and is exponentially stable with rate .
Suppose is generic and not initially multistable, and is not connected. Then, almost exhibits tracking of and is almost exponentially stable with rate .
Now, in case (C), a natural question is whether we have that exhibits tracking of . In view of Remark 23, a negative answer is provided by the following result.
Suppose is generic and not initially multistable and is not connected. Then, admits a global canard phenomenon.
Specifically, letting be the lower end point of the second connected component of , we will show that there exists and a curve of the unstable slow manifold over such that potentially exhibits tracking of .
Now, let us consider case (A) further. Define
and
The neutral stability in case (A) obviously implies that , and hence , remains bounded as . This fact also follows immediately from Ref. 17, Theorem 2, but the proof of that result is highly involved and not explicitly constructive, meaning that one cannot easily write down a bound for these quantities as . However, our analysis of the behavior of (12) when has no zeros will be more elementary and explicitly constructive, allowing us to obtain the following explicit bound.
F. Sketches of the proofs and their relation to Ref. 17
Our results in Sec. III E are, in large part, obtained by adapting and generalizing methods used in Ref. 17 to study periodic orbits and their exhibition of the canard phenomenon in the periodic differential equation
In particular, Theorem 24(B) of this paper is crudely analogous to Proposition 4(1) of Ref. 17, Theorem 24(C) of this paper is crudely analogous to Theorem 1(3) of Ref. 17, and Proposition 25 of this paper is crudely analogous to Theorem 1(4) of Ref. 17.
Let us now outline the basic structure of the set of proofs of results in Sec. III E.
1. When F has no zeros
When has no zeros, a kind of neutral stability is obtained in Ref. 17: namely, as we have already said, Theorem 2 of Ref. 17 immediately implies that [as in Eq. (17)] remains bounded as . However, it would be difficult or impossible to obtain from this proof an explicit bound on , or to deduce from this proof that is robustly neutrally stable in the sense of Definition 2.
So, in Sec. V C, we obtain Proposition 26 and Theorem 24(A) by a different approach. Specifically, our strategy is to approximate the nonautonomous differential equation (12) by a differential equation that is piecewise-autonomous on almost the whole time-interval, where on each “piece” all the solutions move strictly periodically round the circle with common period. The pieces are chosen to be of duration exactly equal to that common period, so that solutions do not mutually approach or move away from each other. Since has slow dependence on , the piecewise-autonomous approximation is of high accuracy, and Grönwall’s Lemma is used to obtain that even over the whole time-interval , the inaccuracy of the piecewise-autonomous approximation does not allow mutual synchronization of trajectories to build up.
Now, in addition to the neutral stability, a further issue that needs addressing is the dependence of on given the initial condition , since this will ultimately play a central role in the proof of Theorem 24(C). In the proof of Lemma 2 of Ref. 17, this is addressed by building further upon the abovementioned Theorem 2 of Ref. 17. By contrast, in Corollary 45, we obtain the necessary result [namely, the existence of a strictly positive lower bound on the magnitude of the derivative of with respect to ] as an immediate consequence of the fact that is neutrally stable in the sense of Definition 1.
2. Tracking and stability
In cases (B) and (C) of Theorem 24, we have both a statement about tracking and a statement about stability. In fact, the statement about stability follows from the statement about tracking. This is fairly obvious when is the whole interval ; and when is a proper subset of , we apply Theorem 24(A) to the subintervals of over which has no zeros. Specifically, the statement linking tracking and stability is provided by Lemma 46 in Sec. V D.
3. Theorem 24(B)
In case (B) of Theorem 24, i.e., when is connected, if , then it is not so obvious that exhibits tracking of ; specifically, the question arises of whether, as first enters into , the trajectories of a significant proportion of initial conditions may exhibit the canard phenomenon of spending a long time tracking the curve of hyperbolic unstable zeros of . So, we first study the case that , in Sec. V E; and then [along somewhat similar lines to the proof of Proposition 4(1) of Ref. 17] for the case that , we apply the results of this to the time-reversal of starting at a time slightly after the first entry into and going back to time .
It is not very hard to show that exhibits tracking of when is connected and . In fact, letting be the hyperbolic unstable zero of in , we have (Proposition 50) that exhibits tracking of “away from ”; this is defined in Sec. V D and essentially means that the arc in Definition 19 contains regardless of the value of . [By contrast, in the general definition of exhibiting tracking of , the arc is free to move around as .] As a result of this, by Lemma 46, we have (Proposition 51) that is exponentially stable “away from ” with rate . More precisely, this notion is defined as follows:
Fix . We say that is exponentially stable away from with rate if given any , for sufficiently small , for every arc not intersecting , Eq. (14) holds.
By Proposition 6, Definition 27 is equivalent to saying that converges to uniformly on compact subsets of as .
Section V F then deals with case (B) in the scenario that . To show that exhibits tracking of , we apply Proposition 50 to deal with what happens after has entered , and we apply the exponential stability result of Proposition 51 to the time-reversal of as described above, in order to show that problems do not arise as enters into . Again, Lemma 46 then gives that is exponentially stable with rate .
4. Proposition 25
Having dealt with case (B), we next prove Proposition 25 in Sec. V G. We do this before proving Theorem 24(C), in order to illustrate the canard phenomenon that will need to be avoided outside an exponentially vanishing set of -values in Theorem 24(C). Reference 17 specifically looks for the situation that (18) has an almost-everywhere-attracting stable periodic orbit exhibiting the canard phenomenon; the fact that this occurs for intervals of -values arbitrarily close to is proved by analyzing the time- mapping of (18). In a sense, our task of proving Proposition 25 is easier, in that we do not require any of the trajectories exhibiting the canard phenomenon to have any special additional property like “periodicity.” [For example, the system (18) exhibits the canard phenomenon also for -values where there are no periodic orbits.] But, on the other hand, we are considering a free form of temporal dependence rather than a periodic dynamical system, and so the approach of simply analyzing the shape of the graph of a time- mapping of the system cannot be applied.
The idea of the proof of Proposition 25 is as follows. Take a value that lies strictly in between the first and the second connected component of . The stability results that we have obtained so far for when is connected can be applied over (since is connected) and can also be applied in reverse time over . This gives us two high-density clusters of trajectories at time , one of which moves unboundedly anticlockwise round the circle as decreases, while the other moves unboundedly clockwise round the circle as decreases (Proposition 52), such that the clusters cross each other infinitely many times as . [A similar idea is illustrated in Fig. 5(c) in Sec. IV E 2.] However, for the desired result, we need there to be arbitrarily small -values for which not only do these clusters meet each other, but actually the cluster obtained by evolving (12) forward in time over is entirely contained in the cluster obtained by evolving (12) backward in time over . We achieve this by choosing sufficiently close to the lower end point of the second connected component of that the latter cluster shrinks at a slower rate than the former cluster as .
Dynamics of (23), with varying in (a)–(c) and varying in (d)–(f). In all plots, , s, and . For (a)–(c), we have , and the value is marked by the black dashed line. For (d)–(f), we have , and the value is marked by the black dashed line. In (a), (b), (d), and (e), results for the evolution of 50 equally spaced initial conditions , , are shown: (a) and (d) show the finite-time Lyapunov exponents , as defined by (11), for these trajectories, and also show [defined in Eq. (31)] in gray; (b) and (e) show the positions of these trajectories at time . In (c) and (f), the positions of for the 50 trajectories of (23) with , , are shown. Plots (a)–(c) reproduced with permission from Newman et al., Physics of Biological Oscillators, edited by A. Stefanovska and P. V. E. McClintock (Springer, 2021), Chap. 7, pp. 111–129. Copyright 2021 Springer Nature Switzerland AG.
Dynamics of (23), with varying in (a)–(c) and varying in (d)–(f). In all plots, , s, and . For (a)–(c), we have , and the value is marked by the black dashed line. For (d)–(f), we have , and the value is marked by the black dashed line. In (a), (b), (d), and (e), results for the evolution of 50 equally spaced initial conditions , , are shown: (a) and (d) show the finite-time Lyapunov exponents , as defined by (11), for these trajectories, and also show [defined in Eq. (31)] in gray; (b) and (e) show the positions of these trajectories at time . In (c) and (f), the positions of for the 50 trajectories of (23) with , , are shown. Plots (a)–(c) reproduced with permission from Newman et al., Physics of Biological Oscillators, edited by A. Stefanovska and P. V. E. McClintock (Springer, 2021), Chap. 7, pp. 111–129. Copyright 2021 Springer Nature Switzerland AG.
5. Theorem 24(C)
We prove Theorem 24(C) in Sec. V H by a similar approach to the proof in Ref. 17 that outside small intervals of -values system (18) has an almost-everywhere-attracting stable periodic orbit (Theorem 1, parts 1–3). In particular, Proposition 53 at the start of Sec. V H (which is an almost immediate consequence of Corollary 45 in Sec. V C) plays an analogous role to Lemma 2(1) of Ref. 17.
As before, the main task is to show that almost exhibits tracking of , since Lemma 46 would then yield that is almost exponentially stable with rate . Essentially, the idea is to show that in constructions like the one used to prove Proposition 25, the crossings between the clusters of trajectories only take place during an exponentially vanishing set of -values. Since the clusters are themselves shrinking at an exponential rate as , it is sufficient to find both a lower bound on the velocity (with respect to ) at which the clusters move round the circle and an upper bound on the linear growth (again with respect to ) of the cumulative distance of the circle swept out by the clusters (i.e., an upper bound on the “average velocity” of the clusters). The latter is fairly trivial [being essentially given by Eq. (35) in Sec. V A], while the former is essentially given by Proposition 53.
G. Transition between neutral stability and exponential stability
We now consider the typical behavior of a transition between case (A) and case (B) of Theorem 24 as a parameter of is varied. First, let us recall the analogous scenario for autonomous dynamical systems.
Generically, for a (sufficiently smoothly) parameter-dependent autonomous dynamical system , a transition between the absence and presence of equilibrium points will take place via a “non-degenerate saddle-node bifurcation,” where at the critical bifurcation parameter , letting be the unique zero of , the following non-degeneracies hold:
and
.
The behavior of locally around is then similar to that of the normal form
around . The zeros of this quadratic expression are precisely wherever this is well-defined, and the derivative of at each such zero is given by . Accordingly, for the original parameter-dependent system , sufficiently close to the critical parameter value , we have the following:
For on one side of , there are no equilibria and so all solutions move periodically round the circle with the same period.
- For on the other side of , there is one stable equilibrium and one unstable equilibrium ; thus, almost all solutions converge to at an exponential rate with exponent . Furthermore,as .(19)
Now, for the slow–fast framework (12) with a parameter-dependent , the analogous scenario is a transition between the absence and presence of zeros of . [This is precisely what we see illustrated numerically in Figs. 2(a)–2(c) for the example
and in Figs. 2(d)–2(f) for the example
with as in Sec. II B.] Assuming sufficient smoothness, generically a transition between the absence and presence of zeros of will be as follows:
At the critical parameter , has a unique zero , and and the following non-degeneracies hold:
- the Hessian matrixis invertible;
.
As we will prove, the behavior locally around is then similar to that of the “normal form”
around . We will shortly consider the zeros of this quadratic expression and then state a corresponding result for the original system (12), but first we can automatically say more about the matrix .
Suppose we have with a zero such that and . Then, takes positive, negative, and zero values in an arbitrarily small punctured neighborhood of .
Hence, in the above setup, we must have that . Note that for a real symmetric matrix with positive determinant, the diagonal entries are non-zero and have the same sign; so, we will write for the sign of the diagonal entries of .
Now, returning to consideration of the normal form (20), let us write
The discriminant of the quadratic function is given by
We have that
if , then has two zeros, and the derivative of at these zeros is
if , then has one zero, and the derivative of at this zero is and
if , then has no zeros.
Suppose without loss of generality that and . For , has no zeros. For , we have
and so has zeros as described above. The value of the integral is the negative of the area of a semi-ellipse with principal radii and , namely,
Now, let us make a rigorous statement about the original system (12) with dependence on a parameter .
We equip with the standard -topology. Fix an open interval , and let be the set of all continuous paths in the space for which the functions
are well-defined and continuous on . (For each individual , we apply the same partial derivative notations to the function as were introduced at the start of Sec. III.)
Given , a point is called a critical zero if and . [This implies, in particular, that is a degenerate non-hyperbolic zero of .] We say that a critical zero is non-degenerate if is invertible and is non-zero.
For all , has no zeros and thus is neutrally stable.
- For all , is generic with a unique complete curve of the stable slow manifold, and is non-empty and connected. Thus, is exponentially stable with rate equal to the corresponding adiabatic Lyapunov exponent . Furthermore,as .(21)
Let us emphasize a key point of contrast between Eq. (21) and Eq. (19): namely, the latter has a square-root dependence on while the former has a linear dependence on . So, although we said in Sec. II B that the bifurcation portraits in Fig. 2 bear resemblance of a classical saddle-node bifurcation, one significant way in which plots (a) and (d) differ from a generic saddle-node bifurcation is the following: as rises above and , respectively, the numerical FTLEs appear to grow in magnitude linearly (as opposed to the faster-than-linear growth that one would see in a generic saddle-node bifurcation).
Lemma 29 and Theorem 30 will be proved in Sec. V I.
IV. COMPARISON TO THE TRADITIONAL FRAMEWORK
In this section, we compare the stability formalisms and results in Sec. III to the traditional long-time-asymptotic framework:
We will present definitions of neutral stability and exponential stability for systems on that are closely analogous to Definitions 1 and 27, except now within the traditional framework rather than our framework.
Whereas Secs. II A 1 and II A 2 considered stabilization of the Adler equation by constant forcing and by noise, and described the stabilization in terms of traditional concepts, now we will consider stabilization of the Adler equation by low-frequency periodic forcing (especially sinusoidal17,45–47 forcing) so that both the traditional framework and (by restricting to finite time) the framework of Sec. III can be applied.
In any real-world situation, one will be working with a finite-duration process (as opposed to taking ) subject to “finite-timescale” forcing (as opposed to taking ). So, for a model in which both frameworks make sense, such as a low-frequency-periodically forced system, the question of which of the two frameworks (if either) provides a suitable approximation would need to be determined by context.
First, let us note that the discussion of Eq. (9) in Sec. II A 3 can be applied to the case that for small : If , and if we consider the system
over a time-interval of duration greater than , then the reasoning of Refs. 1 and 2 (as formalized by Theorem 24) gives that
if , then system (23) exhibits neutrally stable dynamics (i.e., no significant mutual synchronization or repulsion of trajectories), and
if , then the Adler equation is stabilized: the trajectories of different initial conditions mutually synchronize into a tight cluster.
In Sec. IV A, we will define some general dynamical properties, especially stability properties, for infinite-time dynamical systems on the circle, within the classical long-time-asymptotic framework.
In Sec. IV B, we will apply these long-time-asymptotic concepts given in Sec. IV A to provide a basic stability analysis of periodically forced Adler equations. In particular, we will consider saddle-node bifurcations of periodic orbits and stabilization of the Adler equation with .
In Sec. IV C, we will use numerical bifurcation diagrams of the same type as in Sec. II B to look at the parameter-dependence of the stability properties of low-frequency-sinusoidally forced Adler equations.
In Sec. IV D, we analyze Eq. (23) over finitely many periods of the forcing in terms of our new framework of Sec. III (in particular, applying Theorem 24). We then consider the numerics of Sec. IV C in the light of this theoretical analysis.
In Sec. IV E, we tie together all the above theoretical and numerical results to discuss how analysis of dynamics under the traditional framework and analysis of dynamics under our new framework relate and compare to each other for periodically forced Adler equations.
A. General notions of stability in the long-time-asymptotic framework
We consider systems of the form
for some continuous function for which the partial derivatives and exist and are continuous on the whole of . The most fundamental examples are the cases that
More advanced examples include quasiperiodic systems, almost-periodic48 systems, systems subject to forcing from a stationary stochastic process or measure-preserving dynamical system,43 and asymptotically autonomous41,49 systems. In the periodic case, we will write for the time--to- mapping of (24), i.e., for any solution of (24) and any .
Now, given an arc , for any , we define the arc to be the image of under the time--to- mapping of (24), that is,
For any and , we define the finite-time Lyapunov exponent
where is the solution of (24) with . We define the (asymptotic) Lyapunov exponent by
if this limit exists in ; the existence and the value of the limit are clearly not dependent on . We also define the (asymptotic) average angular velocity by
where may be any lift of any solution of (24), if this limit exists. Note that the existence and the value of this limit do not depend on the initial condition : if and are lifts of solutions of (24), then cannot be larger than the smallest multiple of above . In the autonomous case , we have
It is also well-known that in the periodic case, exists and has continuous dependence (in the -topology) on .
Now, as in Sec. III, although one can formulate notions of stability and neutral stability locally around individual trajectories, here, we will just present global-scale notions of stability (and, therefore, we do not include the word “global” in our definitions).
Note that if system (24) is neutrally stable, then the Lyapunov exponent associated with every initial condition is .
This is equivalent to saying that uniformly on compact subsets of as . Hence, in particular, the Lyapunov exponent associated with each is .
Suppose (24) is -periodic for some and that (24) is exponentially stable away from a point with rate . Then, considering the graph of yields the following: the solution starting at is -periodic; there is exactly one other -periodic solution; letting be the initial condition of this latter periodic solution, we have ; and is an integer multiple of .
Typically, if (24) is -periodic and is a non-integer rational multiple of , then (24) will admit multiple locally exponentially stable periodic solutions. (However, as we will soon see, this does not have to be the case.)
We have formulated the above definitions for differential equations but the same definitions also apply to infinite-time dynamical systems with non-differentiable solutions. For example, for system (6) presented in Sec. II A, there exists (dependent on ) such that (6) is exponentially stable away from with some -independent rate .
B. A basic classical stability analysis of periodically forced Adler equations
We now apply the concepts of Sec. IV A to Adler equations with periodic additive forcing.
1. The possible behaviors
The following known result is essentially the main result of Ref. 45 (Theorems 1 and 4).
Case (iii) is a kind of “boundary case” between neutral stability and exponential stability; we expect that for “typical” and , if is an integer multiple of then the system will be in case (ii).
2. Periodic saddle-node bifurcations
A transition between case (i) and case (ii) via case (iii) as some parameter is varied corresponds precisely to a saddle-node bifurcation of the time--to- mapping . Let us now describe one such scenario.
In Proposition 37, consider of the form , where we fix the function while considering varying values of . Suppose we have such that for , system (24) is in case (iii) of Proposition 37. Then, sufficiently close to , we have the following:
for on one side of , system (24) is in case (i) of Proposition 37, i.e., is neutrally stable; and
Note that the autonomous system (5) is precisely the case where , and that the system (23) (for fixed and ) is precisely the case where .
Recall that the autonomous case with is as in Sec. II A 1: if , then the system is neutrally stable, but if , then the system is exponentially stable with exponent
which approximates to for near . This is precisely in accordance with the general description of saddle-node bifurcations of autonomous systems given at the start of Sec. III G. So, what Proposition 38 essentially says is that as we now go from the autonomous case to the periodic case, all -parameterized transitions between neutral stability and exponential stability must still likewise take place via a “saddle-node bifurcation of -periodic orbits” exhibiting the same square-root dependence (28).
Proof of Proposition 38
3. Stabilization of the neutrally stable Adler equation
Let us now consider the question of stabilization of the Adler equation. Specifically, we consider the addition of zero-mean periodic forcing to the autonomous system , where . Obviously, without the addition of any forcing [i.e., in Proposition 37], the system belongs to case (i) of Proposition 37. The question is then whether, with the added zero-mean periodic forcing, the forced system now belongs to case (ii) of Proposition 37.
Let us first note that for the forced system, the average angular velocity must lie within the compact subinterval of . This follows immediately from the fact that the term always lies within the range . Since the average angular velocity has continuous dependence on the time--to- mapping of the system, we immediately obtain from Proposition 37 the following corollary about low-frequency forcing: there is no way to send to without passing through the scenario that the system is neutrally stable. Let us phrase this more precisely.
is -periodic for some with as , and
.
System (29) is neutrally stable for an open set of -values arbitrarily close to .
Let us exemplify this with the prototypical case of sinusoidal forcing. Taking
gives the following.
In the most basic case, let us simply fix any value : then, there is an open set of -values arbitrarily close to for which system (23) is neutrally stable, i.e., for which the forcing “fails to stabilize the Adler equation.”
C. Numerics for the sinusoidally forced Adler equation (23)
Having investigated periodically forced Adler equations such as (23) theoretically, we now plot numerical bifurcation diagrams for (23). We cannot “plot the long-time-asymptotic dynamics” simply through numerical simulation of trajectories since the simulations are themselves only of finite duration. However, as is typically done in numerical bifurcation diagrams, we can still plot “long-but-finite-time” results obtained from the finite-time simulations. (So, for example, we cannot calculate asymptotic Lyapunov exponents simply from numerically simulated trajectories, but we can calculate finite-time Lyapunov exponents taken over the entire duration of the simulation.)
Specifically, we will construct the same kind of plots as in Sec. II B. Fix (as in Sec. II B) and (which is the same as the cut-off angular frequency of the low-pass filter in Sec. II B). We will consider both
varying with fixed (as in Sec. II B) and
varying with fixed .
Note that is very small, i.e., we are considering low-frequency forcing; however, we still make sure that the duration of the numerical simulations is long enough to include many complete cycles of the low-frequency forcing. Specifically, we will work with 100 periods of the forcing [which is the same duration as the duration of the simulations represented in Figs. 2(a)–2(c) in Sec. II B]. In other words, we can think of the results as being for the 100th iterate of the circle map . Results are shown in Fig. 3.
Graph of [as defined in Eq. (31)] against for different values of , with . The blue curve for has infinite gradient on the left at where the curve transitions from negative to zero; the orange, gray, and green curves, respectively, have finite gradient , , and on the left, where they transition from negative to zero (see Proposition 43).
Graph of [as defined in Eq. (31)] against for different values of , with . The blue curve for has infinite gradient on the left at where the curve transitions from negative to zero; the orange, gray, and green curves, respectively, have finite gradient , , and on the left, where they transition from negative to zero (see Proposition 43).
In Figs. 3(b) and 3(e), for the various combinations of and , the trajectories at time of 50 evenly spaced initial conditions are shown. Figures 3(c) and 3(f) show the analogous results for the reverse-time system; due to the symmetries of (23), plots (c) and (f) turn out to be the reflection of plots (b) and (e) about . Figures 3(a) and 3(d) show FTLEs for the trajectories shown in Figs. 3(b) and 3(e), respectively. These FTLEs are computed according to Eq. (11), which is precisely the same as Eq. (25) with .
Plots (a)–(c) show a picture somewhat resemblant of a saddle-node bifurcation: recalling that the system is neutrally stable for , we see the persistence of this exhibition of neutrally stable behavior for going up to about , after which the system appears to be clearly stabilized.
Plots (d)–(f) likewise show a picture somewhat resemblant of a saddle-node bifurcation: we see stability for going up to about , after which we see neutrally stable behavior. This is similar to the autonomous case , except with a higher critical -threshold for the transition from stability to neutral stability.
However, plot (d) also reveals a feature distinctly different from a saddle-node bifurcation: as approaches the critical threshold from below, the dependence of the finite-time Lyapunov exponents on appears to be linear (with a gradient of about ) rather than of square-root form. [Plot (a) likewise appears potentially to indicate a linear dependence on as the critical -threshold is approached from above, but this is less clear.]
D. Stability analysis of finite-time low-frequency-sinusoidally forced Adler equations within the framework of Sec. III
Standing assumption. In all subsequent discussion of Eq. (23), we take and .
We now consider Eq. (23) on finite time-intervals, within the slow–fast framework (12). Specifically, we will consider (23) over time-intervals , i.e., over cycles of the periodic forcing, for positive integers . This can be expressed in the form of (12) by taking
with . Obviously, is not initially multistable. We have that is generic if and only if ; in this case, we will denote the adiabatic Lyapunov exponent by , which clearly does not depend on . We extend continuously to cover those -values for which is not generic. Explicitly,
Applying Theorem 24 gives the following.
For as in Eq. (30):
If and , then is neutrally stable.
If
and , or
and , or
and ,
then is exponentially stable with rate .
If
and , or
and ,
then is almost exponentially stable with rate .
Let us mention, in particular, the following cases:
Suppose .
Fixing and letting , we have
if then is neutrally stable, but
if then is almost exponentially stable with rate .
Fixing and and letting , we have
if , then is neutrally stable, but
if , then is almost exponentially stable with rate (with the “almost” not being necessary in the case that and ).
We illustrate case (B) of Corollary 42 with a graph of against for different values of , in Fig. 4. One immediate observation from this figure is the following:
for , i.e., the autonomous case (where a saddle-node bifurcation takes place as crosses ), we see an infinite gradient in the graph as , corresponding to the square-root dependence exactly as described just after the statement of Proposition 38; but
when we now go to the nonautonomous periodic case , the graph has a finite gradient as .
Dynamics of (23) with varying . Other parameters are rad/s and . (a) For each -value, taking (i.e., periods), the finite-time Lyapunov exponents as defined by (11) are shown for the trajectories of 50 equally spaced initial conditions , . The horizontal gray line marks the value of defined in (31). (b) Zoomed-in version of (a); the red points indicate the location of the small intervals of -values for which all initial conditions have zero asymptotic Lyapunov exponent. (c) Forward- and backward-time dynamics over the time-interval ; for each -value, hollow circles show the positions of for the 50 trajectories of (23) with , , while solid circles show the positions of for the 50 trajectories of (23) with , . In both cases, the 50 points are clustered together; the values of where the two curves of clustered points cross correspond to where the red points are marked in (b); see Appendix B for further explanation.
Dynamics of (23) with varying . Other parameters are rad/s and . (a) For each -value, taking (i.e., periods), the finite-time Lyapunov exponents as defined by (11) are shown for the trajectories of 50 equally spaced initial conditions , . The horizontal gray line marks the value of defined in (31). (b) Zoomed-in version of (a); the red points indicate the location of the small intervals of -values for which all initial conditions have zero asymptotic Lyapunov exponent. (c) Forward- and backward-time dynamics over the time-interval ; for each -value, hollow circles show the positions of for the 50 trajectories of (23) with , , while solid circles show the positions of for the 50 trajectories of (23) with , . In both cases, the 50 points are clustered together; the values of where the two curves of clustered points cross correspond to where the red points are marked in (b); see Appendix B for further explanation.
These finite gradients can be calculated using Theorem 30, as follows.
Fixing and letting , the map is right-sided-differentiable at with derivative .
Fixing and letting , the map is left-sided-differentiable at with derivative .
Now, just as one can seek numerical help in investigating the long-time-asymptotic behavior of an infinite-time dynamical system through long-but-finite-time simulations, so likewise one can seek numerical help in investigating the behavior of a dynamical system of form (2) through small-but-positive- simulations. Now, combining the two: suppose we have a finite-time numerical simulation of an infinite-time system subject to external forcing, where the timescale of the forcing in the simulation is much slower than the timescale of the system’s internal dynamics, and the duration of the simulation is very large compared to the timescale of the forcing. Then, exactly the same comment that we made in Remark 32 regarding real-world processes also applies to the simulation: one can interpret it as either an approximation of the behavior or an approximation of the behavior. Note that Fig. 3 comes under exactly this category: is very small, but at the same time, is very large.
Accordingly, let us now reconsider Fig. 3 in the light of Corollary 42. In all six plots, we have indicated the value of or as appropriate by a dashed black line. Additionally, in plots (a) and (d), we have shown in gray the value of as given in Eq. (31); so, the gray curve in plot (d) is the same as the gray curve in Fig. 4. The numerical results in Fig. 3 show perfect agreement with the theoretical predictions of Corollary 42 regarding stability, neutral stability, and quantification of stability, just as the numerics in Sec. II B for “unextendible” finite-time forcing likewise showed perfect agreement with the theoretical predictions of Theorem 24 regarding stability and neutral stability. (Recall that all these theoretical predictions are simply the mathematically precise description of what one would heuristically expect to see by applying the reasoning of Refs. 1 and 2.)
E. Commentary on the above results
So far, we have presented theoretical results within the long-time-asymptotic framework, numerical results, and theoretical results within the finite-time slow–fast framework. Let us now tie these together and draw conclusions.
1. Stable vs neutrally stable dynamics for A > k − a
At the end of Sec. IV B 3, we saw that when , for any fixed value of there are robust -values arbitrarily close to for which the system (23) is neutrally stable in the sense of Sec. IV A. (Recall that this implies, in particular, that all trajectories have an asymptotic Lyapunov exponent of zero.) The proof of this result made no recognition whatsoever of a distinction between and . Yet, Figs. 3(a)–3(c) show a very clear distinction between neutrally stable behavior for and stable behavior exactly as in Corollary 42. The fact that these -values of neutral stability exist arbitrarily close to zero even when indicates that, at such -values, the heuristic reasoning described in Sec. II A 3 must break down.
The cause of this breakdown is precisely the canard phenomenon where solutions spend a long time tracking the motion of the slowly moving source and thus experience mutual desynchronization. It is well-known that the canard phenomenon is an extremely fine-tuned phenomenon; in other words, the open set of -values described at the end of Sec. IV B 3 must consist of extremely narrow -intervals if . Indeed, for the range of parameter-values considered in Ref. 17, it was proved that this set of -values is exponentially vanishing; and similarly in this present paper, we have shown [Theorem 24(B)–(C)] that for any fixed finite-length shape of slow-timescale variation, the set of timescale-separation values for which the canard phenomenon causes the reasoning in Sec. II A 3 to break down is likewise exponentially vanishing. However, the fact that the case requires this fine-tuned canard mechanism of desynchronization in order for the neutral stability (in the sense of Sec. IV A) to be achieved is altogether missed by the bifurcation and stability analysis given in Sec. IV B.
2. Illustration through further numerics
Let us now consider through further numerics how the dynamics of Eq. (23) depends on when . Figures 5(a)–5(b) are FTLE plots similar to those in plots (a) and (d) of Figs. 2 and 3, except that the varied parameter is now rather than or . We take and , so , implying that is exponentially stable for and almost exponentially stable for ; here, as in Fig. 3, we take 100 cycles of the forcing, i.e., the results are shown over a duration of . In gray is shown the value of . For sufficiently small, we see a close match of the FTLEs to . In plot (b) are also indicated the approximate locations of the narrow -intervals for which system (23) is neutrally stable in the sense of Sec. IV A. (The procedure by which this is achieved is described in Appendix B.) Despite the high density of -values for which FTLEs are plotted in plot (b), all the results are close to and none are close to .
For further illustration, we now zoom in around one of the points marked in Fig. 5(b) as being the approximate location of an -interval of neutral stability. In Fig. 6, FTLE results are shown for both 100 cycles and 1000 cycles of the periodic forcing. Despite the extremely high density of -values for which results are shown, all the shown FTLEs approximate the value to an accuracy of at least about 97%.
3. Dependence of Lyapunov exponents on k
The apparently linear dependence of the FTLEs in Fig. 3(d) to the left of is perfectly explained by Corollary 42 and Proposition 43: the left-sided derivative of at is equal to . This is in contrast to Proposition 38, which gives us the following:
for any transition between stability and neutral stability (understood within the framework of Sec. IV A) that arises from keeping the parameters , , and fixed while varying past a critical value , the Lyapunov exponent on the stable side of the transition must have square-root dependence on as approaches .
One question that then naturally arises is the following: if we fix , , and as in Figs. 3(d)–3(f), then over an interval of -values such as, say, , which -values correspond to neutral stability and which -values correspond to exponential stability with small Lyapunov exponent? Nonetheless, the fundamental mechanism of stabilization (as described in Sec. II A 3 and formalized by Theorem 24) that gives rise to what we see in Fig. 3 is essentially blind to the distinction between these two scenarios; indeed, it is exactly this same mechanism of stabilization that also gave rise to the equally clear pictures seen in Fig. 2, where questions of long-time-asymptotic dynamics do not make sense.
V. PROOFS OF RESULTS IN SEC. III
We begin with some further notations.
We will always assume that . Define
Given , define by
So, for fixed , if is a solution of Eq. (12), then
is a solution of Eq. (12) with in place of : denoting this function by , we have
Note that if is generic and , then is also generic.
Recall the finite-time Lyapunov exponents defined in Eq. (15); for convenience, also define the notation
where the first equality is used to define even for . Note that
A. Solution mapping of (12) and its partial derivatives
Define the function
such that, given any , for any solution of (12) and any , we have
Equivalently, given any , for any solution of the differential equation
and any ,
We denote the partial derivative of with respect to its first input and its second input, respectively, by
We now give formulas for these partial derivatives.
It will also be useful to define the function
such that, given any , for any lift of a solution of (12), we have
Since solutions of (12) have , we have that
for all and .
B. Proof of Theorem 14
Assume that is generic.
If has no zeros, then it is clear that is a complete curve of the stable slow manifold (and obviously there is no other).
Now, suppose that has zeros, and let , i.e., is the image of the set of zeros of under . Since is continuous, we obviously have that is closed. Note that if we have a complete curve of the stable slow manifold, then .
By Remark 9(A), if we have such that includes a hyperbolic stable or unstable zero of , then is in the interior of relative to . Hence, for every boundary point of relative to , only contains a non-hyperbolic zero of .
Now, if there are infinitely many for which contains a non-hyperbolic zero, then, in particular, we can find a convergent sequence of distinct non-hyperbolic zeros converging to a zero ; but by Remark 9, no zero of can have non-hyperbolic zeros of arbitrarily close to it. Hence, there are only finitely many for which contains a non-hyperbolic zero. Hence, in particular, has only finitely many boundary points, and, therefore, only finitely many connected components. Furthermore, by Remark 9, no connected component of can be a singleton.
So, let be the connected components of arranged in increasing order. For each connected component of ,
if , then since contains exactly one zero of and this zero is non-hyperbolic, on the basis of Remark 9(B) there must exist and a curve of the stable slow manifold over such that for each , is the only hyperbolic stable zero of in ; but
if (obviously implying, in particular, that ), then for each hyperbolic stable zero of in , on the basis of Remark 9(A), we have that for some , there is a unique curve of the stable slow manifold over for which .
In either case, let be the supremum of the set of all for which there is a unique curve of the stable slow manifold over agreeing with on ; note that if , then will depend on . It is clear that this “supremum” is indeed a maximum, i.e., that there is a unique curve of the stable slow manifold over agreeing with on . So, let us extend the domain of to include . Now, let be a strictly increasing sequence converging to this maximum such that is convergent to some limit . We have that is a zero of ; and so by Remark 9 together with the fact that is continuous on , we have that, in fact, as . If , then cannot be non-hyperbolic and so is a hyperbolic stable zero, and, therefore, the domain of can be extended to include itself.
Thus, if , then we have already defined on the whole of the interior of relative to . So, now suppose that . Note that must be non-hyperbolic, otherwise by Remark 9(A), would not be the supremum of the set of times up to which we can uniquely extend . Since is non-hyperbolic, Remark 9(B) implies that there are no zeros close to with , and, therefore, must contain zeros other than just . So, let be the zero for which there is a fast connection from to . Since is a local extremum of , it is clear that is unique. Since is non-hyperbolic, cannot also be non-hyperbolic and, therefore, must be hyperbolic stable. Hence, Remark 9(A) gives that for some , there is a unique curve of the stable slow manifold over whose right-sided limit at coincides with . So, extend the domain of to include the open interval , with being the unique curve of the stable slow manifold over for which as . Now, define as the maximum of the set of all for which there is a unique curve of the stable slow manifold over agreeing with on , and extend to include . We can then treat the same way we treated earlier; and continuing the procedure as necessary, we obtain an increasing list of terms that terminates at the term for which . Note that this termination must take place due to the fact that there are only finitely many -values for which contains a non-hyperbolic zero.
Thus, overall, we have defined on the set
where . By construction, if , then is the unique complete curve of the stable slow manifold, and if , then for our given , is the unique complete curve of the stable slow manifold fulfilling .
C. When F has no zeros
In this section, we will prove Proposition 26 and Theorem 24(A) as well as obtaining a corollary of Theorem 24(A) that will be needed later for the proof of Theorem 24(C).
For each , let be the continuous function for which is the remainder in the order- Taylor expansion of ; in other words, . Note, in particular, that is strictly increasing on . It is easy to check that for any ,
and
If has no zeros, then we will work with all the notations introduced in Proposition 26, and also let
Proof of Proposition 26
for each , and
;
for each , and
.
We will approximate by Riemann-like sums over the partition of whose set of end points is given by . Note that the quantities , , and are all bounded by the -independent constant , and hence the mesh size of this partition tends to as .
Proof of Theorem 24(A)
The following corollary will play a similar role in the proof of Theorem 24(C) to the role played by Lemma 2 of Ref. 17 in the main results of Ref. 17.
For the sake of completeness, in Appendix A, we give bounds on the limiting range of as .
Now, as an immediate consequence of Corollary 45, we obtain that if has no zeros, then
for all and . [In fact, as one would intuitively expect, it is not hard to show by elementary means that
uniformly across as . Further results on this convergence are given in Ref. 17 between Eqs. (4.20) and (4.22).]
D. More on tracking
We first give the result that provides the connection between tracking and stability in Theorem 24(B) and (C); it is a consequence of Theorem 24(A) or Proposition 26. In the following, denotes the Lebesgue measure on .
Let us now introduce a few further tracking-related definitions. In the following, we assume that we have a set , a function , and a point .
We say that exhibits strict tracking of away from if given any , for sufficiently small , (12) exhibits -tracking of away from .
Assume that is -compact. We say that exhibits tracking of away from if for every compact subset of , exhibits strict tracking of away from .
E. When is connected and 0 ∈ U
Suppose is generic and not initially multistable, and that is connected and . Let be the unique hyperbolic unstable zero of in . Then, exhibits tracking of away from .
In other words, the conclusion of Proposition 50 states that by taking sufficiently small, we can guarantee that solutions that do not start too close to will be close to at all times , where is bounded away from .
This is fairly obvious given the definition of . Unsurprisingly, to write out a rigorous proof would involve no conceptual difficulties or subtleties but would, nonetheless, be technically tedious. Therefore, we will omit a proof.
Combining Proposition 50 with Lemma 46 gives the following immediate consequence:
In the setting of Proposition 50, is exponentially stable away from with rate .
F. Proof of Theorem 24(B) for
Assume that is generic, contains no zeros, and is connected.
To show that exhibits tracking of , we need to show that for any compact and any , if is sufficiently small, then there is an arc of length less of such that every solution of (12) starting outside of -tracks . Fix , and . Let and let . We have that contains exactly one zero of , namely, a non-hyperbolic zero; so, on the basis of Remark 9(B), choose a value such that the only zeros in are and a hyperbolic unstable zero . Note that is generic and not initially multistable, and the corresponding complete curve of the stable slow manifold has
Take any and let . We have that
by Proposition 50 applied to , if is sufficiently small then every solution of (12) with -tracks , and
- by Proposition 51 applied to , since has a neighborhood that does not intersect , the length of the arctends to exponentially as ; and so for sufficiently small .(48)
Combining (a) and (b) gives the desired result.
Having shown that exhibits tracking of , combining this with Lemma 46 gives that is exponentially stable with rate , by exactly the same reasoning as in the proof of Proposition 51.
G. Proof of Proposition 25
We start with the following general result.
Suppose is such that for some ,
has no zeros in
for all , contains exactly two zeros of , namely, a hyperbolic stable zero and a hyperbolic unstable zero ; and
- lettingwe have and for all .
Now, suppose is generic and not initially multistable, and is not connected. Let be the first connected component of and let be the lower end point of the second connected component of . Fix an arbitrary . On the basis of Remark 9(B) applied to the non-hyperbolic zero in and in , we can find and such that and each fulfill the conditions of Proposition 52. For each , let be the hyperbolic unstable zero in . Let
and fix sufficiently close to that
Fix an arbitrary sufficiently small that .
Now, we will show that for every compact and every , there are intervals of -values reaching arbitrarily close to for which one can find an arc of length less than such that every solution of (12) starting outside -tracks . Without loss of generality, take of the form for some . Without loss of generality, take , and let . Since fulfills the conditions of Proposition 52, we have, in particular, that . Fix any . Also define the positive quantities
where denotes the derivative of . Using Theorem 24(B) applied to and Proposition 51 applied to [where in the latter case, we note that has a neighborhood not intersecting the arc ], we can find such that for all , the following statements hold:
- There is an arc of length less than such that, writingwe have
- Writingwe have
We have ; and therefore, for any solution of (12), if , then for all with .
Note that depends continuously on . One can also take and hence to depend continuously on : if , then by Proposition 51 can be taken independent of , and if then one can see from the proof of Theorem 24(B) [see, in particular, Eq. (48)] that can be taken to depend continuously on . By Proposition 52 applied to , moves unboundedly round the circle as . Also, by the tracking statement in Theorem 24(B) applied to , it is clear that the set
remains within an -independent proper subset of for all sufficiently small , and, therefore, applying Proposition 52 to gives that moves unboundedly round the circle as in the opposite direction to . However, by points (1) and (2), we also have that for all sufficiently small . Hence, there are intervals of -values arbitrarily close to for which . For each such , every solution of (12) starting outside has and hence, by point (3), for all with .
H. Proof of Theorem 24(C)
We start with the following general result, which is a consequence of Corollary 45.
Now, suppose is generic and not initially multistable, and has connected components. Let
be the end points of the connected components of . For each , take an arbitrary value .
To show that exhibits tracking of , we need to show that for any compact and any , if is sufficiently small, then there is an arc of length less of such that every solution of (12) starting outside of -tracks . Fix , and for each , let
Without loss of generality, assume that for all , is sufficiently close to that fulfills the conditions of Proposition 52. For each , let be the hyperbolic unstable zero in . Without loss of generality, let be such that for all , . Let for each . Fix , and on the basis of Theorem 24(B) applied to , for all sufficiently small , let be an arc of length less than such that every solution of (12) starting outside -tracks .
For each , pick a value sufficiently close to that fulfills the conditions of Proposition 52. For each , let be the hyperbolic unstable zero in , and let be a neighborhood of such . For each and each , let
Using Proposition 50 applied to for all , we obtain that for every sufficiently small , if
then all solutions of (12) starting outside -track . So, it remains to show that the set of -values for which (49) fails is exponentially vanishing. For each , let
It is clear that a finite union of exponentially vanishing sets is exponentially vanishing, so it is sufficient to show that is exponentially vanishing for each .
Fix . By Proposition 51 applied to and , we can find such that for all sufficiently small , and are both of length less than . Let
Let and be such that and . Let be a lift of the function , and let be a lift of the function . Define by , and let denote the derivative of . For sufficiently small , we have
By Eq. (35) applied to and , we have that
for all . By Proposition 53 applied to and , there exists such that
Applying elementary analysis to Eqs. (50)–(52) yields that is exponentially vanishing. Specifically, this analysis is as follows:
Given and sufficiently small , if
then
and so,
where and . So, letting
we have that
for all sufficiently small . So, it is sufficient to show that the set is exponentially vanishing; this is justified as follows: for each ,
Thus, we have shown that almost exhibits tracking of . Combining this with Lemma 46 gives that is almost exponentially stable with rate , by exactly the same reasoning as in the proof of Proposition 51.
I. Transition between neutral stability and exponential stability
Recall from the discussion of the normal form (20) in Sec. III G that the graph of the map was a semi-ellipse. Since the quadratic function is only an approximation of the behavior of around the critical zero, we will need to consider perturbation of ellipses. So, before addressing the specific setting of Sec. III G, let us first give some general notations and a basic fact regarding ellipses and perturbation of ellipses.
For any and , define the ellipse
i.e., has center and its principal axes are a horizontal axis of radius and a vertical axis of radius . We will use the following notation for perturbation of this ellipse: given with and , define
Now, for , define the solid elliptical annulus
Also, define and to be the intersection, respectively, of and with the lower half-plane .
We now address the question of how strongly one can perturb the ellipse in the manner described above while remaining within .
Now, given a real symmetric matrix and a vector , write
It is easy to verify the following:
If , then for all , the quadratic function takes both positive and negative values.
- If , then , i.e., is well-defined, and furthermore,for all .
Now, for , if we fix and and define a function by
then the second derivative of is given by
It is now straightforward to prove Lemma 29.
Proof of Lemma 29
We now prove Theorem 30.
Standing assumption. Without loss of generality, take and .
For convenience, for all small , define
Note that is strictly positive on . Therefore, by continuity, for all small , we can find such that for all
Now, take sufficiently small that the following statements hold:
for all and
for all .
Define positive finite constants such that the following statements hold:
- for all and all ,
- for all ,
Let . We will prove Theorem 30 in the following steps:
Step 1. There does not exist a sequence converging to such that and for all .
So, we can define sufficiently small that for all , has no zeros in ; and hence, for all , has no zeros at all. We then take in the statement of Theorem 30 to be .
- Step 2. For all , is generic with a unique complete curve of the stable slow manifold, and is non-empty and connected. Writeso that
- Step 4. For any , taking sufficiently close to guarantees that
1. Step 1
Suppose for a contradiction that such a sequence exists. For all sufficiently large , we have that , and so . So, let and with be such that
By Taylor’s theorem, there exists such that, letting
we have
and, therefore,
For sufficiently large , we have and so it follows that
and, therefore,
However, this contradicts the fact that as .
2. Step 2
Fix . Recall that is strictly positive outside and so all zeros of lie inside . For each , we have that is strictly positive on the whole of and so contains at most two zeros, and if contains two zeros, then one is hyperbolic stable [which we denote ], and the other is hyperbolic unstable [which we denote ]. Let
By Remark 9(A), is open and and are continuous on . Now, , and so by the intermediate value theorem, has at least (and hence exactly) two zeros. In other words, . So, let be the connected component of containing . Since the set of zeros of is closed, it is clear that and each contain a zero of , which we denote and , and it is clear that both and converge to as . Hence, in particular, by Remark 9(A), and are non-hyperbolic zeros.
We next show that and are non-degenerate. By definition of , since , we have . Now, take such that
Since and is strictly positive throughout the line segment
we have that
Since , it follows that .
Finally, we show that there are no zeros of other than those which we have already mentioned, namely, those in the set
By definition, all zeros in belong to this set. So, it remains to show that given any
we have . Assume that ; the case that proceeds in exactly the same way. Take and such that
Once again, we have that and is strictly positive throughout the line segment
Therefore, splitting into the cases that
,
,
,
we have the following: In case (i), and so . In case (ii), by the intermediate value theorem, there exists such that, letting , we have
so and hence, again, . Case (iii) is the same, with in place of .
3. Step 3
For convenience, let and . For each , define the set and the negative-valued function on such that
For each , we can write more explicitly as
4. Step 4
Fix , and let be sufficiently small that the area of the elliptical semi-annulus is at most . For each , we have that on and tends to at the boundary points of . Therefore, to show the desired result, it is sufficient to show that for all sufficiently close to we have
For each , let be the smallest value for which all zeros of are contained in . Note that as : for any small , taking gives .
Now, for each , for each , we can apply Taylor’s theorem to the functions , , and , respectively, to obtain expressions
where , , and are, respectively, the values of , , and at certain points in . Since as , letting
we have that converges to uniformly across as . Also, recall that is as . Therefore, in the above three equations, if we substitute the expressions for and given by the first and third equation into the second equation and then rearrange the second equation to make the subject, we obtain an expression of the form
where is as given by the third equation, and takes the form
where
,
is , and
is ,
uniformly across as . Now, by applying Taylor’s theorem to , using Eq. (54), we obtain an expression
where is the value of at some point in . Again, uniformly across as . Therefore, one obtains that, after suitable modification of the coefficients (while keeping the same convergence properties as above), we have
where
Now, for convenience, let us write and , so that
The point lies on the curve
with and as above and
The general inequalities and (understood as valid for all for which they are well-defined) give
So,
and are ,
and are, respectively, and , and hence are both , and
,
uniformly across as . Hence, in particular, taking sufficiently close to will mean that fulfills the condition in Lemma 54 (with ) for all , and hence
This completes the proof.
VI. CONCLUSION
The modern theory of dynamical systems was introduced by Henri Poincaré and Aleksandr Lyapunov to provide a rigorous mathematical basis for defining and investigating qualitative dynamical properties of real-world physical systems—properties such as synchronization, stability, and neutral stability. Using a numerically simulated sample realization of a Brownian bridge as a conceptual representation of inherently finite-time processes, we have illustrated in Fig. 2 how a finite-time system can exhibit precisely such properties in a way that cannot be modeled so as to make the framework of Poincaré and Lyapunov applicable. This is because this framework is defined in terms of the infinite-time behavior of dynamical systems.
Therefore, we have introduced an alternative, finite-time framework for stability analysis by essentially “replacing with ” in the traditional formalisms of qualitative stability analysis, where represents the timescale separation between a system’s “internal timescales” and the slower timescale of a finite-time external forcing process. This non-traditional framework has enabled us to provide a rigorous mathematical statement (Theorem 24) and proof of the stabilization phenomenon of Refs. 1 and 2 exemplified in Fig. 2.
We have also explored how our new framework of stability analysis compares with the traditional framework through the example of low-frequency-periodically forced systems, where both frameworks can be applied. In particular, we saw in Sec. IV E how analysis based on Theorem 24 can more readily yield the basic description of dynamics than seeking to analyze the system within the traditional apparatus of stability analysis (such as asymptotic Lyapunov exponents).
This paper has worked entirely with one-dimensional dynamics but we hope that the work here will also prompt further research into non-traditional qualitative stability analysis of higher-dimensional finite-time systems. Whereas the work of Poincaré was originally motivated by celestial mechanics, we anticipate that finite-time stability theory will increasingly play a fundamental and necessary role in the understanding of more complex “terrestrial” systems such as biological processes and climate systems.
ACKNOWLEDGMENTS
This is TiPES contribution #127. This project received funding from the European Union’s Horizon 2020 Research and Innovation Programme under Grant Agreement No. 820970 (TiPES), the European Union’s Horizon 2020 Research and Innovation programme under the Marie Skłodowska-Curie Grant Agreement No. 642563, an EPSRC Doctoral Prize Fellowship, the DFG (Grant No. CRC 701), and the EPSRC (Grant No. EP/M006298/1). The authors would like to express their gratitude to Peter Ashwin, Boštjan Dolenc, Edgar Knobloch, Colin Lambert, Peter McClintock, Woosok Moon, Arkady Pikovsky, Antonio Politi, Martin Rasmussen, Michael Rosenblum, Janne Ruostekoski, David Sloan, and Yevhen Suprunenko for interesting and insightful discussions.
AUTHOR DECLARATIONS
Conflicts of Interest
The authors have no conflicts to disclose.
DATA AVAILABILITY
Codes for the numerics carried out in this paper (as described in Appendix B) are available from the corresponding author upon reasonable request and are openly available in Lancaster Publications and Research system Pure at https://doi.org/10.17635/lancaster/researchdata/292, Ref. 51.
APPENDIX A: LIMITING BEHAVIOR OF
Proposition 26 can be expressed as a statement about the limiting behavior of as . We now give an analogous statement about the limiting behavior of as . Let us first make a couple of general remarks regarding :
- Suppose is independent of [meaning that (12) is just a time-restricted autonomous dynamical system]. Then, is, by definition, the derivative of at , which is . In other words, we have(A2)
We use the notations present in Proposition 26, as well as the following:
for each and
.
Let us note that the bound obtained in the above proof can probably be considerably improved through more detailed calculation and less estimation; but we have obtained a cruder bound for the sake of a faster proof.
APPENDIX B: NUMERICS
Throughout this paper, additively forced Adler equations were simulated by numerical integration using a fourth order Runge–Kutta scheme, with a time step of 0.01 s. The FTLEs associated with trajectories were calculated simply by taking the time-averaged value of over the time-interval of interest, as in (11). To obtain the initial condition for a given final state , the value of was used as the initial condition of a forward-time simulation of the equation .
In Sec. II B, the function was constructed as follows. First, a sample path of a zero-drift Brownian motion on of diffusion parameter was constructed by cumulative addition of Gaussian random increments over a time step of 0.01 s. Then, the Brownian bridge was constructed as . Then, the result was passed through a fifth order Butterworth low-pass filter with cut-off frequency Hz, performed via cascaded second-order sections (in Python, with the function scipy.signal.sosfilt), and we linearly interpolated the output of the filter.
In Figs. 5 and 6, the -values indicated in red were numerically obtained as follows: For the unwrapped phase as governed by the differential equation
on the real line, setting , it was observed by simulation that increased approximately linearly with , with increments across consecutive values in the -discretization being strictly positive and very small compared to . Hence, it was possible to carry out linear interpolation of the simulated wrapped phase as a function of [with ]. Where this linearly interpolated function of crossed and is where the -values were marked; as in Fig. 5(c), the locations of are indistinguishably the same for the other 49 initial conditions as for .
Dynamics of (23) with varying near a red-marked point in Fig. 5(b). Parameters , , and are as in Fig. 5. For each -value, in hollow blue are shown the finite-time Lyapunov exponents associated with the trajectories of 10 initial conditions with (i.e., 100 periods), and in solid orange are shown the finite-time Lyapunov exponents associated with the trajectories of three initial conditions with (i.e., 1000 periods). The red dashed line indicates the approximate location of a small interval of -values for which all trajectories have zero asymptotic Lyapunov exponent. The horizontal gray line marks the value of defined in (31).
Dynamics of (23) with varying near a red-marked point in Fig. 5(b). Parameters , , and are as in Fig. 5. For each -value, in hollow blue are shown the finite-time Lyapunov exponents associated with the trajectories of 10 initial conditions with (i.e., 100 periods), and in solid orange are shown the finite-time Lyapunov exponents associated with the trajectories of three initial conditions with (i.e., 1000 periods). The red dashed line indicates the approximate location of a small interval of -values for which all trajectories have zero asymptotic Lyapunov exponent. The horizontal gray line marks the value of defined in (31).
The basis for this procedure is as follows: since and , Proposition 41(B) can be applied to the time--to- mapping of (23) to give that for all sufficiently small , maps all points starting outside some small arc into a small arc . By the symmetries of (23), we have that is close to if and only if is close to either or . Now, on the one hand, when and are not close to each other, it is clear by considering the graph of that has a stable fixed point near and an unstable fixed point near , and thus system (23) is exponentially stable in the sense of Definition 35. However, on the other hand, if and cross past each other (which, again, is equivalent to crossing past either or ) as is varied then, again by considering the graph of , during such crossing there must occur an interval of -values for which has no fixed points and, therefore, by Proposition 37, the system (23) is neutrally stable in the sense of Definition 33 (see also Ref. 17).