Previous results have shown that a large class of complex systems consisting of many interacting heterogeneous phase oscillators exhibit an attracting invariant manifold. This result has enabled reduced analytic system descriptions from which all the long term dynamics of these systems can be calculated. Although very useful, these previous results are limited by the restriction that the individual interacting system components have one-dimensional dynamics, with states described by a single, scalar, angle-like variable (e.g., the Kuramoto model). In this paper, we consider a generalization to an appropriate class of coupled agents with higher-dimensional dynamics. For this generalized class of model systems, we demonstrate that the dynamics again contain an invariant manifold, hence enabling previously inaccessible analysis and improved numerical study, allowing a similar simplified description of these systems. We also discuss examples illustrating the potential utility of our results for a wide range of interesting situations.

The dynamics of systems with many coupled dynamical agents is a subject of increasing importance with a very broad range of applications. Much of the progress in this field has flowed from the discovery of solvable paradigmatic “toy” systems. In many such systems, the agents are assumed to have one-dimensional dynamics, and a certain class of such systems has been shown to be in some sense “solvable” via a novel analytic technique. In our work, we consider a more general class of dynamical systems of coupled agents that may have arbitrary dimension. This is a significantly broader class of systems that contains, but is not limited to the previously described class of systems with one-dimensional agents. We then demonstrate that in this broader class of dynamical systems, we can construct an analogous technique that can be used to solve such systems. Our method provides analytic techniques to allow previously inaccessible mathematical analyses of these systems. We give significant examples applying our method to large systems of interacting higher-dimensional agents, with a particular focus on the Kuramoto model generalized to higher dimensions.

Models of systems of many coupled dynamical agents are useful tools for studying a very wide variety of phenomena.1 Examples include flashing fireflies,2,3 circadian rhythms of mammals,4,5 oscillating neutrinos,6 arrays of Josephson junctions,7 oscillation of footbridges,8 biochemical oscillators,9,10 power-grids,11,12 collections of neurons,13–16 flocking dynamics,17–20 and others. In many cases, the states of the individual agents can be described by a single angle-like variable, θ. This class of model systems includes situations for which the dynamical agents are oscillators,1 neurons,13–16 or robots moving on a two-dimensional plane,18 among others. Many such models, possibly involving network-based interactions,16,21,22 such as the Kuramoto model,23 the Kuramoto–Sakaguchi model,22,24 and models of theta neurons,13 among others,25 reduce to the form

θ˙i=ω(ηi,{θ},t)+12ι[H(ηi,{θ},t)eιθiH(ηi,{θ},t)eιθi],
(1)

where θi represents the state of the ith agent, ηi is a (possibly vector) constant parameter that is associated with the ith agent, ω(ηi,{θ},t) is its “natural frequency,” N is the total number of agents, and H(ηi,{θ},t) is a common field that acts on each agent, dependent on the agent’s parameter ηi, and {θ} indicates a dependence on the set of states {θ1,,θN} in the form of an average over i of a function of the angle θi.

For example, the well-studied Kuramoto model23,26 can be expressed in the form of Eq. (1) by choosing H(ηi,{θ},t)=N1jexp(ιθj), independent of ηi, and choosing ω(ηi,{θ},t) independent of {θ} and t, allowing ω(ηi,{θ},t) to be replaced by ωi. Reference 27 introduced an ansatz to analytically achieve substantial reductions in the complexity of problems of the type exemplified by Eq. (1) in the limit of a large number of agents (N). Subsequently, this reduction has been applied in studies of a wide variety of systems (e.g., Refs. 5,7,8,13–16,28, and 29).

Several flocking models employ the Kuramoto model (e.g., Refs. 17–19) to describe orientational alignment of the velocities of individuals in a flock. Since the standard Kuramoto model [in common with other models conforming to the general form of Eq. (1)] describes the dynamics of scalar angles, these models are restricted to describing flock dynamics in a two-dimensional plane. Other work has shown that the Kuramoto model can be generalized to flocks moving in three and higher-dimensional space.30–35 In this case, each agent’s state is assumed to be specified by a unit vector σi(t) in the D-dimensional space. Alternately, we may think of σi as specifying a point on the unit sphere in D-dimensional space. Reference 30 notes that the vector σi can be thought of as representing the opinion of an individual in a group or the orientation of the velocity of a member of a flock. (For the case of flocking of birds, fish, or flying drones, the generalization to D=3 is of most interest.) For D=2, the unit vector σi is determined by its scalar orientation angle θi specifying a point on the unit circle, thus recovering the previous model, Eq. (1) (see Sec. II). References 36–39 have also studied the Kuramoto model and its generalizations to higher dimensions in the contexts of continuous-time consensus protocols, multiagent rendezvous, distributed control, and coalition formation. In this paper, we present a new technique that enables analytic treatment of the dynamics of a large class of systems with higher-dimensional agents, including the aforementioned systems. In particular, in this paper, we focus on the continuum limit of infinitely many higher-dimensional agents, allowing us to use ideas similar to those developed previously in the context of Eq. (1).

The remainder of the paper is organized as follows: In Sec. II, we construct a generalization of Eq. (1) to arbitrary dimensions and describe the infinite system size limit in such systems. Then, in Sec. III, we extend the ansatz of Ref. 27, resulting in a simplified analytic description of this generalized class of systems. In Sec. IV, we demonstrate the utility of our results to example systems, with particular focus on the Kuramoto model generalized to higher dimensions. Finally, in Sec. V, we conclude with a discussion and summary of our results.

In two recent papers,40,41 we constructed a generalization of the Kuramoto model to D dimensions. Here, we consider an even more general setup, where we consider a generalization to Eq. (1) to a system in D dimensions,

σ˙i=[ρ(ηi,{σ},t)(σiρ(ηi,{σ},t))σi]+W(ηi,{σ},t)σi,
(2)

where for each i, σi(t) is a real D-dimensional unit vector, |σi(0)|=1, ρ(ηi,{σ},t) is an arbitrary real D-dimensional vector, which can be thought of as a common field that affects each agent in an ηi dependent fashion, W(ηi,{σ},t) is a real D×D antisymmetric matrix, ηi is a (possibly vector) constant parameter associated with each agent, and, as earlier, {σ} indicates a dependence on the set of all states {σ1,,σN} in the form of the average over i of a function of the unit vectors σi (we further quantify this dependence on {σ} later). For example, in the context of flocking agents in D dimensions, σi represents the orientation of the ith agent, ρ(ηi,{σ},t) represents a “goal” orientation to which the ith agent attempts to align itself, and W(ηi,{σ},t) represents a fixed bias, or a systematic error to the agent dynamics causing the agent to head in a direction that deviates from the direction of ρ.40 Note from the form of Eq. (2) that the dot product of the right-hand side of Eq. (2) with σi is identically zero so that d|σ|/dt=0, as required by our identification of σ as a unit vector. Thus, the dynamics of each σi is restricted to the (D1)-dimensional surface, S, of the unit sphere, |σ|=1. For D=2, choosing σi=(cosθi,sinθi)T, ρ(ηi,{σ},t)=Re[H(ηi,{θ},t)],Im[H(ηi,{θ},t)]T, and

W(ηi,{σ},t)=0ω(ηi,{θ},t)ω(ηi,{θ},t)0

reduces Eq. (2) to Eq. (1), thus justifying Eq. (2) as a D-dimensional generalization of Eq. (1).

We now consider the limit of a large number of agents and denote by F(σ,η,t) the distribution of agents on S, such that F(σ,η,t)dD1σdη is the fraction of agents that lie in the (D1)-dimensional differential element dD1σ on the surface S centered at σ at time t, and have an associated parameter η within the differential element dη centered at η. Since the associated parameter η for each agent is time independent, we define

g(η)=SF(σ,η,t)dD1σ

and

f(σ,η,t)=F(σ,η,t)/g(η).

Noting that Eq. (2) specifies the vector field of the flow controlling the dynamics of the distribution f, we write a continuity equation for f,

f(σ,η,t)/t+S[f(σ,η,t)v(σ,η,t)]=0,
(3)

where the velocity field v(σ,η,t) is given by v(σ,η,t)=(ρ(η,t)(σρ(η,t))σ)+W(η,t)σ, and SA represents the divergence of a vector field A, along the surface S. This can be done if the dependence of ρ and W on {σ} can be specified as a functional of F(σ,η,t) that is not explicitly dependent on σ. [A simple example of such a dependence on {σ} would be the average value of p(σi) for some given function p, which can be written as p(σ)F(σ,η,t)dσdη.] Following Appendix B of Ref. 40, Eq. (3) can be rewritten as

f/t+[Sf(σ,η,t)(D1)f(σ,η,t)σ]ρ(η,t)+(W(η,t)σ)Sf(σ,η,t)=0,
(4)

where SΦ is the gradient of a scalar field Φ projected on the surface S.

For D=2, Refs. 25 and 27 demonstrated that the ansatz that f(θ,t) is in the form

f(θ,η,t)=12π1|α(η,t)|2|eιθα(η,t)|2,
(5)

where α(η,t) is a complex scalar function of η and t, |α(η,0)|<1, reduces Eq. (1) to the following θ-independent form:

αt+ιη+12H(η,t)α2(η,t)H(η,t)=0.
(6)

The form Eq. (5) represents an invariant manifold in the space of possible distributions f, that satisfy the continuity equation Eq. (3) for D=2. Furthermore, previous work25,42 has shown that initial conditions for f are attracted to the invariant manifold Eq. (5) for a large class of possible models of the form Eq. (1). Thus, Eq. (5) can be used to greatly simplify the study of the long-term dynamics of these systems.

Here, we present an ansatz demonstrating the existence of a similar invariant manifold for Eq. (3) in any dimension D. Noting that eιθ can be interpreted as a unit vector in the complex plane and that the complex quantity α can similarly be interpreted as a two-dimensional vector of its real and imaginary parts, based on Eq. (5), we posit the following guess for the form of f(σ,η,t) for arbitrary dimension D:

f(σ,η,t)=ND(α(η,t))|σα(η,t)|βD,
(7)

where α is a real D-dimensional vector such that |α(η,0)|<1, βD is a yet-to-be-determined constant, and ND(α) is a scalar normalization chosen to ensure that

Sf(σ,η,t)dD1σ=1.
(8)

Inserting Eq. (7) into the continuity equation in Eq. (4), we obtain after some algebra,

(1+|α|22ασ)tND(α)βDND(α)(αtασtα)+ND(α){βD(αρ)+[2(D1)βD](ασ)(ρσ)(D1)(ρσ)(1+|α|2)βDσWα}=0.
(9)

For our ansatz Eq. (7) to apply, the above equation must hold for all σ. Focusing on the term in Eq. (9) that is quadratic in σ, i.e., ND(α)[2(D1)βD](ασ)(ρσ), since, in general, α and ρ will not be zero for all t, we require that

βD=2(D1).
(10)

With βD in Eq. (7) determined, we now obtain the normalization constant ND(α). To perform the integral in Eq. (8), without loss of generality we take the vector α to be along the z^ axis. For an arbitrary point σ on S, we denote the angle between σ and z^ by θ. In particular, we note that the distance of the point σ from the z^ axis is sinθ. For a coordinate system on the surface S, we use θ as one of the coordinates, denoting position with respect to z^ on the sphere. From the symmetry of f in Eq. (7) about the direction α, we see that the integrals over these remaining coordinates give the surface area SD1sinD2θ of the (D2) dimensional surface of a sphere with radius sinθ embedded in (D1) dimensions, where SD1=(2π)(D1)/2/Γ((D1)/2) is the area of the sphere of unit radius in D1 dimensional space. Thus, Eq. (8) becomes

1=SD10πND(α)sinD2θdθ(1+|α|22|α|cosθ)D1,
(11)

which can be evaluated to give

1=KD1ND(α)(1|α|2)D1,
(12)

where KD is a constant dependent only on D. This results in

ND(α)=KD(1|α|2)D1,
(13)

giving the form of the ansatz for arbitrary dimensions as

f(σ,η,t)=KD(1|α(η,t)|2)D1|σα(η,t)|2(D1),
(14)

which, for D=2, agrees with Eq. (5).

To determine whether the ansatz Eq. (14) is consistent with Eq. (9), we insert it into Eq. (9). We find that the ansatz with βD given by Eq. (10) indeed is a solution of Eq. (9) and that Eq. (9) reduces to the following equation for α (see the  Appendix for details):

tα=12(1+|α|2)ρ(ρα)α+Wα.
(15)

The key point is that Eq. (15) does not involve σ (and remarkably, also does not involve any dependence on D). Thus, analogously to Eq. (6), we have a σ-independent description of the dynamics of α. This is our main result.

We note that for initial conditions with |α|<1, |α| will remain less than 1 at all finite times since from Eq. (15)t|α|=0 at |α|=1, thus verifying that f given by Eq. (14) does not diverge for t<.

We now consider a few examples illustrating the utility of the generalized ansatz, Eq. (14), to systems of the form given in Eq. (2). We detail the particular example of the Kuramoto model generalized to D dimensions40 as representative of the utility of our main result Eq. (15), and thereafter briefly mention applications of this result to a variety of other systems.

A generalization of the Kuramoto model with homogenous oscillators to arbitrary dimension was introduced by Olfati-Saber in 200630 in the context of flocking dynamics, consensus protocols, and opinion dynamics. This was later generalized to heterogeneous systems by Chandra et al.40 For generalization to D dimensions, a system order parameter, z, can be defined as

z(t)=1Niσi(t).
(16)

The magnitude of z(t) is a measure of the coherence of the set of agents {σ}. The common field ρ is then defined as the ηi-independent function,

ρ(η,{σ},t)=Kz(t)=(K/N)iσi(t),
(17)

where K is a coupling constant. By interpreting the vector parameters ηi in W(ηi,{σ},t) as the D(D1)/2 independent elements of a D-dimensional antisymmetric matrix Wi, we can replace g(η)dη in integrals by G(W)dW, where G(W) is a distribution of antisymmetric matrices. In cases such as these where W(ηi,{σ},t) is independent of {σ} and t, we interpret W(ηi)=Wi as the “natural rotation” of σi.

In the limit of infinite system size, with a distribution of agents given according to Eq. (14),

z(t)=SF(σ,W,t)σdD1σdW,=dWG(W)α(W,t)/|α(W,t)|×0πKD(1|α(W,t)|2)D1cosθsinD2θdθ(1+|α(W,t)|22|α(W,t)|cosθ)D1.
(18)

For D=2 (i.e, the original Kuramoto model) Eq. (18) evaluates to give ρ(t)=Kz(t)=Kdωg(ω)α(ω,t). Equation (15) is then equivalent to Eq. (6) from Ref. 27. For D=3, the integral in Eq. (18) gives

ρ=KdWG(W)α(W,t)/|α(W,t)|×2|α|(1+|α|2)+(1|α|2)2log1|α|1+|α|/4|α|2.
(19)

This now allows us to use Eq. (15) with some given G(W) to numerically integrate for the dynamics of α and the dynamics of the order parameter ρ.

Using this simplification, we can efficiently simulate the dynamics of the full system of agents governed by Eq. (2). We first focus on the case of homogenous agents, i.e., identical natural rotations for each agent, G(W)=δ(WW0), where δ() is the Dirac-delta function. We can then change to a rotating basis in which the natural rotation term of each agent is zero, W00. This makes the W-integral in Eq. (18) trivial, allowing a direct representation of ρ in terms of α. Further, α is only dependent on time (rather than W and t). This represents a very large simplification in the complexity of the dynamics of the system of agents, since Eq. (15) is now a single D-dimensional ordinary differential equation which represents the collective dynamics of the N, D-dimensional system of coupled differential equations in Eq. (2). The utility of this result is demonstrated for D=3 in Fig. 1(a), where we show (plotted in black) the time-series for |ρ(t)| as generated from a system of N=5000 agents (approximating the N limit), compared with the time-series generated from the theory derived in Eq. (15) (orange dashed curve). The initial condition for the full system was chosen such that the agents were uniformly randomly distributed on the sphere. For the theory derived in Eq. (15), i.e., the reduced equations, the initial value of α was chosen to have magnitude 0.01 in an arbitrary direction. Note the remarkably close agreement between the black and the orange dashed curve, demonstrating that the dynamics on the reduced manifold of Eq. (14) indeed gives the large-N dynamics of the full system of interacting agents.

FIG. 1.

(a) and (b) Comparison between the dynamics of the magnitude of the order parameter, |z|, as a function of time via full system modeling of the generalized Kuramoto model with D=3 [Eq. (2) for ρ given by Eq. (19)] using N=5000 agents shown in black, with the modeling of the reduced differential equation Eq. (15) plotted as the orange dashed line. K=2 for both figures. (a) is the case of homogenous agents, i.e., G(W)=δ(WW0). (b) is the case of heterogeneous agents, where the distribution G(W) is nonsingular and chosen as described in the main text. Only N{W}=500 Monte-Carlo samples were required to produce the curve for the reduced system of equations, representing the N limit of the full system, approximated by the noisy curve generated using N=5000 agents for the full system. (c) demonstrates similar agreement for the case of heterogeneous agents in D=4, where the system is evolved at K=1.7 from the uniform incoherent distribution as the initial condition. N=N{W}=106 was used for numerical integration of the two curves. Note how the reduced equations capture the transient behavior of the Instability-Mediated Resetting phenomenon41 (discussed in text). Since the initial finite-size noise is different in the two cases, in order to make the curves for the full system and the reduced equations lie on each other, we shift them in time to align them. See text for further details of initial conditions used.

FIG. 1.

(a) and (b) Comparison between the dynamics of the magnitude of the order parameter, |z|, as a function of time via full system modeling of the generalized Kuramoto model with D=3 [Eq. (2) for ρ given by Eq. (19)] using N=5000 agents shown in black, with the modeling of the reduced differential equation Eq. (15) plotted as the orange dashed line. K=2 for both figures. (a) is the case of homogenous agents, i.e., G(W)=δ(WW0). (b) is the case of heterogeneous agents, where the distribution G(W) is nonsingular and chosen as described in the main text. Only N{W}=500 Monte-Carlo samples were required to produce the curve for the reduced system of equations, representing the N limit of the full system, approximated by the noisy curve generated using N=5000 agents for the full system. (c) demonstrates similar agreement for the case of heterogeneous agents in D=4, where the system is evolved at K=1.7 from the uniform incoherent distribution as the initial condition. N=N{W}=106 was used for numerical integration of the two curves. Note how the reduced equations capture the transient behavior of the Instability-Mediated Resetting phenomenon41 (discussed in text). Since the initial finite-size noise is different in the two cases, in order to make the curves for the full system and the reduced equations lie on each other, we shift them in time to align them. See text for further details of initial conditions used.

Close modal

For the case of heterogeneous agents, α in Eq. (18) depends on W, and we perform the integral in a Monte-Carlo fashion. We randomly choose N{W} values of W from the given distribution G(W) and simulate the dynamics of the corresponding α(W)s. These randomly chosen α(W)s are then used as the Monte-Carlo samples to evaluate z according to Eq. (18), simulating the dynamics of the system in the N limit by only simulating the dynamics of N{W} variables. Here, we choose an isotropic distribution G(W) constructed by choosing each upper triangular element from identical independent normal distributions with zero mean and unit variance, and choosing the remaining elements to make W antisymmetric. Results are shown in Fig. 1(b) for D=3, where N{W}=500 Monte-Carlo samples were chosen to evaluate the |ρ(t)| curve via the theory in Eq. (15), and are compared with the curve obtained for simulating the dynamics of the full system of equations in the N limit, approximated by a simulation of N=5000 agents. Note how simulating the dynamics of N{W}N Monte-Carlo samples yields a smooth curve approximating the noisy curve generated by simulating the individual dynamics of N=5000 agents. Initial conditions for the full system were chosen as a bimodal distribution of σis, independent of the corresponding Wi, with the two peaks being anti-podal to each other, hence representing a distribution explicitly not on the manifold dictated by Eq. (14). The initial condition for the reduced equations, i.e., Eq. (15) were chosen to be uniform on a sphere of radius 0.01, corresponding to an approximately uniform distribution of f(σ,η,t) in σ. Despite not lying on the invariant manifold described by Eq. (14), we observe that the dynamics of the full system rapidly approach the dynamics as predicted by Eq. (15) for the N limit for dynamics on the invariant manifold. This indicates that for the case of heterogeneous agents the invariant manifold Eq. (14) is attracting, as has been proven for the case of D=2.25 Full system simulations with initial conditions described by a uniform distribution in σ [and hence lying on the invariant manifold Eq. (14) for |α|=0] yielded a curve that is not discernibly different from the curve presented in Fig. 1(b).

As demonstrated in Fig. 1, numerical integration of the dynamics on the invariant manifold, via Eq. (15) closely reproduces the time evolution of the order parameter of the Kuramoto model generalized to higher dimensions [Eq. (2) for ρ according to Eq. (19)]. As we demonstrate in Fig. 2, this close similarity between a simulation of the full N-agent dynamics and the simulation of the reduced equation Eq. (15) holds at all values of the coupling constant K. This allows us to recreate the discontinuous phase transition of the Kuramoto model generalized to 3 dimensions reported in Ref. 40. [The continuous phase transition observed through reduced equations of the form Eq. (15) for the standard Kuramoto model in two dimensions has been demonstrated and discussed in Ref. 27.]

FIG. 2.

A simulation of the phase transition to coherence via numerical integration of Eq. (2) for ρ given by Eq. (19) representing the full system dynamics with N=5000 (shown in the black triangular markers), and via numerical integration of Eq. (15) representing the dynamics on the invariant manifold with N{W}=500 (shown as the orange inverted triangles) for D=3. For each value of K, the system is evolved until |ρ| reaches an equilibrium. Note the close agreement between the time asymptotic values of |ρ| at all values of K. The distribution G(W) was chosen as described earlier for heterogeneous agents.

FIG. 2.

A simulation of the phase transition to coherence via numerical integration of Eq. (2) for ρ given by Eq. (19) representing the full system dynamics with N=5000 (shown in the black triangular markers), and via numerical integration of Eq. (15) representing the dynamics on the invariant manifold with N{W}=500 (shown as the orange inverted triangles) for D=3. For each value of K, the system is evolved until |ρ| reaches an equilibrium. Note the close agreement between the time asymptotic values of |ρ| at all values of K. The distribution G(W) was chosen as described earlier for heterogeneous agents.

Close modal

Reference 41 demonstrated that the Kuramoto model generalized to even dimensions D4 exhibits the unusual behavior of Instability-Mediated Resetting: If the coupling strength K is increased abruptly while remaining below the critical coupling strength for the onset to coherence, the Kuramoto model displays a short burst of coherence (see Ref. 41 for further details). This is illustrated by the results shown in Fig. 1(c). In Fig. 1(c), the initial conditions for the σi in the full system simulation were chosen independently to be uniformly random over the sphere |σ|=1. For the reduced equations, initial conditions for α were chosen similar to the earlier discussion on heterogeneous agents, i.e., uniform on a sphere of radius 0.01, corresponding to an approximately uniform distribution of f(σ,η,t) in σ. Figure 1(c) demonstrates that the dynamics of Eq. (15), representing the dynamics on the invariant manifold described by Eq. (14) (shown in the dashed orange curve), accurately captures these short bursts of coherence, further demonstrating the capability of Eq. (15) in capturing the transient dynamics of the Kuramoto model generalized to higher dimensions.

To demonstrate the applicability of Eq. (15) in improving theoretical understanding of such systems, we present an example of a stability analysis of the Kuramoto model generalized to three dimensions via a study of the dynamics on the reduced manifold Eq. (14). In particular, we study the stability of the completely incoherent state for a system of heterogeneous agents, wherein the initial condition of each agent σi is to be distributed independently and uniformly over the sphere |σ|=1. In the N limit, this is the distribution F(σ,η,t)=g(η)/(4π) corresponding to setting |α|=0 in Eq. (14). [In the context of the stability analysis presented in Sec. III B of Ref. 40, we are considering the case of p=0.] Thus, we are interested in the stability analysis of Eq. (15) about |α|=0. Performing a first order expansion of Eq. (15) for |α|1,

α(W,t)/t=ρ(t)/2+Wα(W,t).
(20)

Assuming α(W,t)=α(W)est, we obtain

α(W)=12(s1W)1ρ.
(21)

Note that in the limit of |α|1, Eq. (19) can be written as

ρ=4K3dWG(W)α(W).
(22)

Multiplying Eq. (21) by (4/3)G(W) and integrating, we obtain

ρ=2K3(s1W)1ρdW.
(23)

Note that in three dimensions the linear transformation Wσ can be represented as the cross product ω×σ. Without loss of generality we may choose a basis that block-diagonalizes W, corresponding to the choice of ω=ωz^ and

W=ω010100000.

Thus,

(s1W)1=ss2+ω2ωs2+ω20ωs2+ω2ss2+ω20001s.

This can now be inserted into Eq. (23) and written in a basis independent format as

ρ=G(ω)2K3(ρω^)ω^s+ω×ρs2+ω2+ss2+ω2(ρ(ρω^)ω^)dω.
(24)

We choose the distribution G(ω) to be an “isotropic” distribution (i.e., a distribution that is invariant to orthogonal transformations) which can hence be written as G(ω)dω=g(ω)U(ω^)dωdω^, where U(ω^)=1/(4π) represents the isotropic distribution of rotation directions, and g(ω) is the distribution of the magnitudes of rotation (see Ref. 40 for further discussion on the choice of this distribution and its implications). Integrating over the rotation directions ω^ in Eq. (24) gives us

1=2K313s+2s3g(ω)dωs2+ω2,
(25)

which is identical to the result obtained in Ref. 40. As discussed in Ref. 40, the above equation implies that in the limit of small K,

s=2K/9,
(26)

indicating that this completely incoherent state loses stability at K=0. Thus, using Eq. (15) allows us to perform the stability analysis of a state easily without having to solve the partial differential equation of the dynamics of the distribution of agents in both σ and t as was necessary in Ref. 40.

Extensions appropriate to various contexts may be studied using Eq. (14).

For example, each of the agents in the model described above could have a bias toward a particular subspace, such as birds in a flock that have a preference to align parallel to the surface of the Earth. In this case, the common field of such a system is then defined similar to Eq. (17) as

ρ(η,t)=K[(1c)z+cΠz],
(27)

where Π is the operator that projects onto the preferred subspace (e.g., if x^, y^, and z^ are unit vectors in rectangular coordinates with z^ being vertical, then Π=x^x^T+y^y^T would represent the preference to align to a horizontal surface), and 0c1 models the strength of the preference. Writing z using Eq. (18), along with Eq. (15) then represents the reduced equations for this problem.

Another extension to the Kuramoto model that is often studied is the Kuramoto–Sakaguchi model.24 In this model, the sin(θjθi) coupling term of the Kuramoto model is replaced with sin(θjθi+δ). A possible generalization of this to higher dimensions is represented by defining ρ as ρ=KRz, where R is a given rotation matrix (for D=2, R is the two-dimensional rotation matrix that rotates vectors by an angle of δ).

Another D-dimensional generalization whose analysis can be facilitated by the ansatz Eq. (14) is the consideration of time delay, ρ(t)=Kz(tτ), as studied for D=2 in Ref. 43.

Also, we note that interactions between multiple communities of Kuramoto-like agents has received attention due to a variety of applications (e.g., Refs. 22,44, and 45), as well as the presence of interesting dynamics, such as chimera states.22 For example, for the case of homogenous natural rotations of Wξ within each community ξ,

tαξ=12(1+|αξ|2)ρξ(ρξαξ)αξ+Wξαξ,
(28)

where the subscript ξ denotes quantities applying to community ξ. For a case of generalizing the Kuramoto model, we define the order parameter zξ for community ξ as the average orientation of that community, and take ρξ to be

ρξ=ξKξ,ξzξ,

with Kξ,ξ representing the coupling between community ξ and ξ. The order parameters zξ can be written in terms of αξ using Eq. (18) by writing the distribution of rotations for the community ξ as δ(WWξ).

The Kuramoto model with the order parameter defined as Eq. (16) is the globally coupled Kuramoto model, wherein each agent is coupled to every other agent. In two dimensions, network-based interaction of agents in Kuramoto-like models have been solved for by an application of the ansatz Eq. (5) for a wide range of network topologies, via a mean-field approach.16,21 An analogous analysis will apply for our generalized ansatz, Eq. (14), for network-based interactions of D-dimensional Kuramoto-like units.

There are some strong differences between the case D=2 and the case of D>2 that must be considered in general. In the case of D=2, making the additional assumption that g(η) is a suitable analytic distribution of the scalar parameter η (e.g., a Lorentzian distribution is often employed), allows the integral in Eq. (18) to be performed via a contour integral, and hence requiring the dynamics of α(η) according to Eq. (15) to be calculated for only one or a few particular complex values of η.27 In D=2, this implies that many problems of the form Eq. (1) with heterogeneous ηi reduce to a system of a small number of ordinary differential equations in the N limit. For our generalization to higher dimension (where η is now a vector parameter with at least two components), we are unable to straightforwardly employ contour integration. Thus, while Eq. (14) represents a strong reduction in the dimensionality of the dynamics as compared to the full system in the N limit, i.e., Eq. (3), it is still not a “low-dimensional system” in the sense of Ref. 27, since we must still calculate the dynamics of α(η,t) as a function of the vector parameter η [as opposed to integrating η away via, e.g., a Lorentzian assumption for g(η)].

For the case of homogenous systems, i.e., where g(η) is the Dirac-delta function, the dynamics of the full system Eq. (2) reduces to the single D dimensional differential equation Eq. (15). For the particular case of the Kuramoto model generalized to higher dimensions in the manner given in Sec. IV A, this exactly reproduces recent results by Lohe34 for the case of a finite number of homogenous agents derived in the context of a generalization of the Watanabe–Strogatz (WS) transform.46,47 In 2014, Tanaka35 considered a generalization of the Kuramoto model with higher dimensional “complex” vectors. In this setup (which is different from ours), he derived an extension of the Ott–Antonsen method in the context of a generalized WS transform. In 2008, Pikovsky and Rosenblum48 demonstrated that there is a relationship between the WS transform and the Ott–Antonsen ansatz in the case of the original (D=2 in our notation) Kuramoto model. It is possible that similar relationships may exist between our generalization of the Ott–Antonsen ansatz Eqs. (14) and (15) and the generalization of the WS transform described in Refs. 34 and 35—we leave the study of this relationship to future work.

In conclusion, we have developed a technique to tackle the generalization of several Kuramoto-like systems into higher dimensions. While our analysis has only demonstrated the existence of an invariant manifold to the dynamics of Eq. (3), from numerical experiments, we observe for all examined examples of systems given Eq. (2) with a continuous distribution g(η) that this manifold is attracting. That is, initial conditions set up not satisfying Eq. (14) appear to be rapidly attracted toward this invariant manifold. While, in the case of D=2, it has been shown analytically that for a broad class of models of the form given by Eq. (1), this manifold is a global attractor of the dynamics,25 proof of attraction for D>2 remains an open problem. Given the wide applicability of Eq. (1) and its rich variety of dynamical phenomena, we expect that the generalization to higher dimensions, Eq. (2), may be a useful model system, applicable to diverse situations of interest, while remaining amenable to analysis via the methods developed in this paper.

This work was supported by ONR Grant No. N000141512134 and by AFOSR Grant No. FA9550-15-1-0171.

Inserting the form of f(σ,η,t) from Eq. (14) into Eq. (9), we obtain

(D1)(1|α|2)D2(1+|α|22ασ)(2αtα)(1|α|2)(2αtα2σtα)+(1|α|2)2(αρ)(ρσ)(1+|α|2)2σWα=0.
(A1)

Remarkably, the explicit D dependence of the differential equation cancels out, and a differential equation involving only terms that are linear and constant in σ remains. For this equation to be identically zero for each direction σ, the linear and constant terms must independently be zero. From the constant term, we obtain

(1+|α|2)(2αtα)(1|α|2)(2αtα)+(1|α|2)(2(αρ))=0,

which simplifies to

αtα=(1/2)(1|α|2)(ρα),
(A2)

or alternately

t|α|=1|α|22|α|(ρα).
(A3)

From the σ dependent portion, we get

σ2α(2αtα)+(1|α|2)(2tα)k(1|α|2)(1+|α|2)ρ2(1|α|2)Wα=0.

Since σ is allowed to be in any direction, we can cancel out the σ and obtain a vector equation that must be satisfied. To further simplify this vector expression, we write tα=t(|α|α^)=|α|tα^+α^t|α|, where α^ is a unit vector in the direction of α. We can then use Eqs. (2) and (3) to simplify the expression to obtain

tα^=1+|α|22|α|(ρ(ρα^)α^)+Wα^.
(A4)

Equations (3) and (4) can then be combined to obtain Eq. (15).

1.
A.
Pikovsky
,
M.
Rosenblum
, and
J.
Kurths
,
Synchronization: A Universal Concept in Nonlinear Sciences
(
Cambridge University Press
,
2003
), Vol. 12.
2.
B.
Ermentrout
, “
An adaptive model for synchrony in the firefly Pteroptyx malaccae
,”
J. Math. Biol.
29
,
571
585
(
1991
).
3.
J.
Buck
and
E.
Buck
, “
Mechanism of rhythmic synchronous flashing of fireflies
,”
Science
159
,
1319
1327
(
1968
).
4.
T.
Antonsen, Jr.
,
R.
Faghih
,
M.
Girvan
,
E.
Ott
, and
J.
Platig
,
External periodic driving of large systems of globally coupled phase oscillators
,”
Chaos
18
,
037112
(
2008
).
5.
L. M.
Childs
and
S. H.
Strogatz
, “
Stability diagram for the forced Kuramoto model
,”
Chaos
18
,
043128
(
2008
).
6.
J.
Pantaleone
, “
Stability of incoherence in an isotropic gas of oscillating neutrinos
,”
Phys. Rev. D
58
,
073002
(
1998
).
7.
S. A.
Marvel
and
S. H.
Strogatz
, “
Invariant submanifold for series arrays of Josephson junctions
,”
Chaos
19
,
013132
(
2009
).
8.
M. M.
Abdulrehem
and
E.
Ott
, “
Low dimensional description of pedestrian-induced oscillation of the Millennium Bridge
,”
Chaos
19
,
013129
(
2009
).
9.
S.
Yamaguchi
,
H.
Isejima
,
T.
Matsuo
,
R.
Okura
,
K.
Yagita
,
M.
Kobayashi
, and
H.
Okamura
, “
Synchronization of cellular clocks in the suprachiasmatic nucleus
,”
Science
302
,
1409
1412
(
2003
).
10.
I. Z.
Kiss
,
Y.
Zhai
, and
J. L.
Hudson
, “
Emerging coherence in a population of chemical oscillators
,”
Science
296
,
1676
1678
(
2002
).
11.
B. A.
Carreras
,
V. E.
Lynch
,
I.
Dobson
, and
D. E.
Newman
, “
Complex dynamics of blackouts in power transmission systems
,”
Chaos
14
,
643
652
(
2004
).
12.
A. E.
Motter
,
S. A.
Myers
,
M.
Anghel
, and
T.
Nishikawa
, “
Spontaneous synchrony in power-grid networks
,”
Nat. Phys.
9
,
191
197
(
2013
).
13.
T. B.
Luke
,
E.
Barreto
, and
P.
So
, “
Complete classification of the macroscopic behavior of a heterogeneous network of theta neurons
,”
Neural Comput.
25
,
3207
3234
(
2013
).
14.
D.
Pazó
and
E.
Montbrió
, “
Low-dimensional dynamics of populations of pulse-coupled oscillators
,”
Phys. Rev. X
4
,
011009
(
2014
).
15.
E.
Montbrió
,
D.
Pazó
, and
A.
Roxin
, “
Macroscopic description for networks of spiking neurons
,”
Phys. Rev. X
5
,
021028
(
2015
).
16.
S.
Chandra
,
D.
Hathcock
,
K.
Crain
,
T. M.
Antonsen
,
M.
Girvan
, and
E.
Ott
, “
Modeling the network dynamics of pulse-coupled neurons
,”
Chaos
27
,
033102
(
2017
).
17.
S.-Y.
Ha
,
E.
Jeong
, and
M.-J.
Kang
, “
Emergent behaviour of a generalized Viscek-type flocking model
,”
Nonlinearity
23
,
3139
3156
(
2010
).
18.
N.
Moshtagh
and
A.
Jadbabaie
, “
Distributed geodesic control laws for flocking of nonholonomic agents
,”
IEEE Trans. Automat. Contr.
52
,
681
686
(
2007
).
19.
J.
Zhu
,
J.
Lu
, and
X.
Yu
, “
Flocking of multi-agent non-holonomic systems with proximity graphs
,”
IEEE Trans. Circuits Syst. I Regul. Pap.
60
,
199
210
(
2013
).
20.
W.
Wang
and
J.-J. E.
Slotine
, “
On partial contraction analysis for coupled nonlinear oscillators
,”
Biol. Cybern.
92
,
38
53
(
2005
).
21.
J. G.
Restrepo
and
E.
Ott
, “
Mean-field theory of assortative networks of phase oscillators
,”
Europhys. Lett.
107
,
60006
(
2014
).
22.
D. M.
Abrams
,
R.
Mirollo
,
S. H.
Strogatz
, and
D. A.
Wiley
, “
Solvable model for chimera states of coupled oscillators
,”
Phys. Rev. Lett.
101
,
084103
(
2008
).
23.
Y.
Kuramoto
, “Self-entrainment of a population of coupled non-linear oscillators,” in International Symposium on Mathematical Problems in Theoretical Physics (Springer, 1975), pp. 420–422.
24.
H.
Sakaguchi
and
Y.
Kuramoto
, “
A soluble active rotater model showing phase transitions via mutual entertainment
,”
Prog. Theor. Phys.
76
,
576
581
(
1986
).
25.
E.
Ott
and
T. M.
Antonsen
, “
Long time evolution of phase oscillator systems
,”
Chaos
19
,
23117
(
2009
).
26.
Y.
Kuramoto
,
Chemical Oscillations, Waves, and Turbulence
(
Springer
,
1984
).
27.
E.
Ott
and
T. M.
Antonsen
, “
Low dimensional behavior of large systems of globally coupled oscillators
,”
Chaos
18
,
037113
(
2008
).
28.
B.
Ottino-Löffler
and
S. H.
Strogatz
, “
Volcano transition in a solvable model of frustrated oscillators
,”
Phys. Rev. Lett.
120
,
264102
(
2018
).
29.
J.
Roulet
and
G. B.
Mindlin
, “
Average activity of excitatory and inhibitory neural populations
,”
Chaos
26
,
093104
(
2016
).
30.
R.
Olfati-Saber
, “Swarms on sphere: A programmable swarm with synchronous behaviors like oscillator networks,” in Proceedings of the 45th IEEE Conference on Decision and Control (IEEE, 2006), pp. 5060–5066.
31.
J.
Zhu
, “
Synchronization of Kuramoto model in a high-dimensional linear space
,”
Phys. Lett. A
377
,
2939
2943
(
2013
).
32.
J.
Zhu
, “
High-dimensional Kuramoto model limited on smooth curved surfaces
,”
Phys. Lett. A
378
,
1269
1280
(
2014
).
33.
M.
Lohe
, “
Non-abelian Kuramoto models and synchronization
,”
J. Phys. A Math. Theor.
42
,
395101
(
2009
).
34.
M.
Lohe
, “
Higher-dimensional generalizations of the Watanabe–Strogatz transform for vector models of synchronization
,”
J. Phys. A Math. Theor.
51
,
225101
(
2018
).
35.
T.
Tanaka
, “
Solvable model of the collective motion of heterogeneous particles interacting on a sphere
,”
New J. Phys.
16
,
023016
(
2014
).
36.
J.
Markdahl
and
J.
Goncalves
, “Global convergence properties of a consensus protocol on the n-sphere,” in 2016 IEEE 55th Conference on Decision and Control (CDC) (IEEE, 2016), pp. 3487–3492.
37.
W.
Li
, and
M. W.
Spong
, “
Unified cooperative control of multiple agents on a sphere for different spherical patterns
,”
IEEE Trans. Automat. Contr.
59
,
1283
1289
(
2014
).
38.
A.
Jadbabaie
,
N.
Motee
, and
M.
Barahona
, “On the stability of the Kuramoto model of coupled nonlinear oscillators,” in Proceedings of the American Control Conference 2004 (IEEE, 2004), Vol. 5, pp. 4296–4301.
39.
A.
Sarlette
and
R.
Sepulchre
, “
Consensus optimization on manifolds
,”
SIAM J. Control Optim.
48
,
56
76
(
2009
).
40.
S.
Chandra
,
M.
Girvan
, and
E.
Ott
, “
Continuous versus discontinuous transitions in the d-dimensional generalized Kuramoto model: Odd d is different
,”
Phys. Rev. X
9
,
011002
(
2019
).
41.
S.
Chandra
and
E.
Ott
, “
Observing microscopic transitions from macroscopic bursts: Instability-mediated resetting in the incoherent regime of the d-dimensional generalized Kuramoto model
,”
Chaos
29
,
033124
(
2019
).
42.
E.
Ott
,
B. R.
Hunt
,
T. M.
Antonsen, Jr.
, “
Comment on ‘Long time evolution of phase oscillator systems’ [Chaos 19, 023117 (2009)]
,”
Chaos
21
,
025112
(
2011
).
43.
W. S.
Lee
,
E.
Ott
, and
T. M.
Antonsen
, “
Large coupled oscillator systems with heterogeneous interaction delays
,”
Phys. Rev. Lett.
103
,
044101
(
2009
).
44.
E.
Barreto
,
B.
Hunt
,
E.
Ott
, and
P.
So
, “
Synchronization in networks of networks: The onset of coherent collective behavior in systems of interacting populations of heterogeneous oscillators
,”
Phys. Rev. E
77
,
036107
(
2008
).
45.
E.
Montbrió
,
J.
Kurths
, and
B.
Blasius
, “
Synchronization of two interacting populations of oscillators
,”
Phys. Rev. E
70
,
056125
(
2004
).
46.
S.
Watanabe
and
S. H.
Strogatz
, “
Integrability of a globally coupled oscillator array
,”
Phys. Rev. Lett.
70
,
2391
(
1993
).
47.
S.
Watanabe
and
S. H.
Strogatz
, “
Constants of motion for superconducting Josephson arrays
,”
Physica D
74
,
197
253
(
1994
).
48.
A.
Pikovsky
and
M.
Rosenblum
, “
Dynamics of heterogeneous oscillator ensembles in terms of collective variables
,”
Physica D
240
,
872
881
(
2011
).