We analyze the influence of multiplayer interactions and network adaptation on the stability of equilibrium points in evolutionary games. We consider the Snowdrift game on simplicial complexes. In particular, we consider as a starting point the extension from only two-player interactions to coexistence of two- and three-player interactions. The state of the system and the topology of the interactions are both adaptive through best-response strategies of nodes and rewiring strategies of edges, respectively. We derive a closed set of low-dimensional differential equations using pairwise moment closure, which yields an approximation of the lower moments of the system. We numerically confirm the validity of these moment equations. Moreover, we demonstrate that the stability of the fixed points remains unchanged for the considered adaption process. This stability result indicates that rational best-response strategies in games are very difficult to destabilize, even if higher-order multiplayer interactions are taken into account.
Social systems are characterized by complex networks with interactions of two or more agents (e.g., individuals, group representatives, companies). In game theoretic models of these systems, agents get a payoff depending on their chosen action and their neighbors’ actions. This article extends the well-established class of adaptive two-player games on networks, where the state of the system and the topology of the network change over time, to three-player games on adaptive simplicial complexes. As an example, the Snowdrift game with rational adaption rules is considered. We study the network using direct simulations as well as moment closure, leading to a low-dimensional differential equation. We obtain a stable equilibrium state with coexistence of cooperation and defection, which is remarkably robust across very large ranges of parameters.
I. INTRODUCTION
Complex networks are a well-established tool for the description of dynamical processes with interaction between adjacent nodes/agents. In many real world systems, however, interactions of more than two nodes take place and have an important impact on the dynamics of the system,1 such as transmission of diseases from one infected to many others, social science,2 biological systems,3 neuroscience,4,5 and many more. Here, we are interested in the influence of polyadic (also known as higher-order6) interactions in the context of game theory. So far, these multi-player interactions have been considered on fixed hypergraphs, where the structure or topology remains constant.7–9 In contrast, adaptive coevolutionary networks10,11 have been successfully applied to many model systems with two-node interactions, e.g., in neural processing,12 epidemic spreading,13 opinion forming,14 and evolutionary social games.15–21 In all of these systems, the network topology changes due to adding, deleting, or rewiring of two-player edges. Evolutionary social games are often characterized by a social dilemma, in which the global payoff is not maximal, if individuals optimize their own payoff, as in the prisoner’s dilemma or the Snowdrift game.
Much less is known about adaptive multiplayer games on hypergraphs, where both the hypergraph and the state of the nodes evolve with time. In such systems, the games are not restricted to two-player interactions, governed by usual edges in networks, but also extend to three (or more) player interactions, governed by higher-dimensional hyperedges. Recently, an extension of the voter model to adaptive simplicial complexes has shown that multiplayer peer pressure interaction can lead to stronger polarization of opinions than expected from classical two-node interactions.22,23 In fact, it is understood that polyadic, higher-order coupling for static topologies can already lead to important new effects in many dynamical process; see, e.g., Refs. 24–29. Hence, combining the previously mentioned directions, it becomes a natural question as to how evolutionary social games behave with additional higher-order interactions of more than two players and adaptive topology of the system.
Multiplayer games without adaptivity have been studied as a model class for quite some time. For example, in the multiplayer Snowdrift game, the density of cooperators drops in a replicator dynamics with the number of players and the cost-to-benefit ratio,30 there are multiplayer extensions that are equivalent to a generalized public goods game,31 and spatial extensions have been investigated.32–34 Yet, it remains unclear how adaptivity of the topology influences the dynamics of multiplayer games; therefore, we have to start from basic models.
In this work, we define the adaptive simplicial Snowdrift game by combining explicit three-player interactions with the Snowdrift game on an adaptive simplicial complex. We are interested in the question if multiplayer interactions that increase the individual payoff, such as best response and rewiring, can destabilize the steady states of the system. To study this question, we combine analytical and numerical techniques. On the analytical level, we derive low-dimensional moment equations for the lowest moments and their closures based on pairwise approximation. Numerically, we study the dynamics by direct simulation. We observe good agreement with the time evolution of the moments in both approaches. Second, we analyze the steady states of the moment equations. It turns out that the stability properties of the main attracting steady state are robust under adding polyadic, higher-order interactions beyond the classical two-player scenario. In particular, the more classical adaptive Snowdrift model with only two-player interactions behaves very similar to the variant with additional three-player interactions over large robust parameter ranges. One possible interpretation of this result is that as long as agents behave in a sufficiently rational way, polyadic interactions between them do not destroy the stability of the system. Finally, we numerically evaluate how introducing some partial irrational behavior of the agents could destabilize the system. Even in this case, it is very difficult to find instabilities.
There are two important conclusions that can be drawn from these results. First, one may conjecture that many large-scale stable economic systems remain stable even if very complex polyadic interactions are considered as long as the rules the players follow are sufficiently rational. Second, although it has been shown that higher-order multiplayer interactions can change dynamics in several examples for certain parameters, it should be acknowledged that there are also many cases, where the system dynamics can be very robust to adding such interactions between nodes.
This paper is structured as follows. In Sec. II, we introduce the adaptive simplicial Snowdrift model. In Sec. III, we specify the full moment equations for the system and their closure, with a detailed derivation given in Appendixes A and B and present numerical results from simulation. The stability of equilibria of the closed moment equations is analyzed in Sec. IV. This paper is summarized in Sec. V.
II. ADAPTIVE SIMPLICIAL SNOWDRIFT GAME
A. Multiplayer Snowdrift game
The Snowdrift game is a famous example for a game with a social dilemma.35,36 In this game, the players may or may not contribute to some task with a total cost and a common benefit . The cost is split even among all the cooperators (strategy ), but each player, also the defectors (strategy ), get the same benefit, as long as the task is done. This leads to the most commonly used payoff matrix of the two-player Snowdrift game,32
where the cost is split among the cooperators, while there is a benefit if there is at least one cooperator. We assume that the benefit exceeds the cost, , since otherwise defection becomes the single dominating strategy;32 i.e., for high costs, , the system is equivalent to the prisoner’s dilemma. Choosing implies , which is the defining property of Snowdrift games.32 First, this implies that there is no dominated action and that there are two pure Nash equilibria, and , where deviation leads to smaller payoffs. Second, both strategies can invade a population of opposite players such that there is a mixed evolutionary stable state with a fraction of cooperating players.32 However, for all , the total payoff is smaller than in populations with only cooperators since . Therefore, the Snowdrift game is a so-called social dilemma,32 where maximizing individual payoffs does not maximize the payoff for the whole society.
There are several ways to extend the Snowdrift game to a multiplayer game.30,32–34 We consider the following payoff functions for players, which are defined for cooperating () and defecting () players as30
where is the number of cooperating players C. Here, the total cost of completing the task is shared equally among all cooperating players. For , the payoff matrix in Eq. (1) is recovered.
The properties of the multiplayer Snowdrift game are similar to the two-player game. There are no dominated actions. Best response against all-defecting opponents is to choose cooperation since the payoff increases, . On the other hand, if there are already cooperating opponents, best response is to choose defection because . Again, this implies that all pure strategy profiles, in which exactly one player cooperates, , are pure Nash equilibria and that there is some mixed evolutionary stable strategy. Note that in general, multiplayer games with are not reducible to multiple two-player encounters.24
B. Adaptive networks
We start by defining a model class for evolutionary dynamics of the Snowdrift game on adaptive hypergraphs. A hypergraph with up to -player interactions consists of a discrete set of nodes and a set of (hyper)edges connecting the nodes. Here, is the set of -dimensional hyperedges. The nodes represent individual players, and we assign a state (or label) to each node, which for the Snowdrift game is either cooperation or defection, . In ordinary graphs, only edges are present and represent possible two-player interactions between the corresponding nodes. In hypergraphs also higher-dimensional edges are allowed, e.g., three-node hyperedges . Thus, this framework naturally allows one to generalize two-player games on ordinary networks/graphs to multiplayer games on hypergraphs.
This framework allows for two different possibilities for coevolutionary (also known as adaptive) network dynamics.37 The first is the evolution of the node state, while the set of edges remains constant. The second is the evolution of the set of edges through creation and deletion, while the state of nodes remains unchanged. These two types are called dynamic on and of the network, respectively, and in adaptive networks, both dynamics take place.11
In this work, we restrict the class of hypergraphs to simplicial complexes to keep the analytical complexity of the models more tractable, but our approach will be extended in future work. From the viewpoint of applications, the simplicial complex restriction is applicable to systems, in which interaction of more than two agents implies that each subset of these agents also interacts with each other, e.g., in friendship groups.
A simplicial complex is a set of simplices with
and
for simplices , the intersection satisfies or ,
where is the set of faces of simplex . Thus, the first condition means that every face of simplices in is again in . A simplicial -complex is a simplicial complex with ; i.e., the maximal dimension of simplices in is and there is at least one such simplex. The first step to a generalized multiplayer Snowdrift game is to include interactions of three players.1,38 This means that the coevolutionary network dynamics is realized on a simplicial two-complex consisting of nodes , edges , and simplicial triangles . The corresponding hypergraph is then given by . As before, the nodes correspond to the agents, while the edges and triangles represent two-player and three-player interactions, respectively. Let us remark that in ordinary graphs, one usually calls a set of three nodes a triangle if each is connected to the others directly, . In contrast, a simplicial triangle is a tuple . For simplicity and better distinction, we will call the elements of just simplex in the following and leave the term triangle for the case of three pairwise connected nodes. Note that within a simplicial complex, each simplex implies the existence of the triangle , , and since each face of must be contained, but not vice versa.
The state of the nodes is used to label the elements of the graph as follows. First, we identify with label and with label such that -nodes are cooperating and -nodes are defecting. The number of -nodes in the simplicial complex is , while the number of -nodes is called . Together, they satisfy .
Similarly, the edges are classified into -, -, and -edges. Again, the number of -edges is denoted , and they are counted as , where if and zero else and is the Kronecker delta. Under the dynamics we specify below, the total number of edges will satisfy a conservation law , where is the average degree of nodes in the network.
The simplices are characterized by their number of defecting nodes, and we call a simplex of type if it contains exactly defecting nodes; i.e., . The set of all -type simplices is denoted by . Similarly, triangles are of type if they consist of exactly defecting nodes.
In general, dynamical systems on adaptive networks (or hypergraphs) are characterized by dynamics on the network, i.e., update rules of node status, and dynamics of the network, i.e., creation or deletion of nodes, edges, or simplices. Assuming a fixed set of nodes , this means that their dynamics takes place on a time-dependent simplicial hypergraph. In the following, we specify a set of dynamical rules, which define the adaptive simplicial Snowdrift game.
C. Adaptive simplicial Snowdrift model
The adaptive simplicial Snowdrift model is based on the adaptive simplex voter model.22,23 We consider the generalization to two-simplices, i.e., additional three-player interactions, which often is sufficient for interesting dynamics, such as de-stabilization.24–29 We assume that each player has perfect knowledge about the currently chosen actions of the other players. Based on the structure of the simplicial two-complex, we consider three different update rules on the node status and the set of edges. For all operations, one specific node (corresponding to a player) is selected. This player faces either one opponent along an edge or two opponents through a simplex if this exists. The considered strategies are rewiring, best response on edge, and best response on simplex.
Rewiring is a dynamic of the network topology and changes the simplicial complex. This is well established for networks with only two-player interactions.10–21 The selected player removes the currently chosen edge and establishes a new edge with uniform probability to some other player with node status ; see Fig. 1(a). Rewiring from to strictly increases the payoff for player since for . If the removed edge was part of a simplex , then this simplex is removed as well, and in order to keep the number of simplices constant, a new simplex is created on top of one existing triangle. Hence, this action directly influences the types of existing edges and simplices in the simplicial hypergraph.
Best response describes a change of node states and thus is a dynamic on the network. In best response on edges, the selected player adjusts its own action to the best response against the chosen opponent’s action in a two-player Snowdrift game. Here, best response to each action is the opposite action; see Sec. II A. In particular, if the opposing action is (), the state of the selected player becomes (); see Fig. 1(b). In best response on simplices, the selected player adjusts its own action to the best response against the two opponents on a simplex for the three-player Snowdrift game. This means that if one of the opponents cooperates, , the selected player chooses to defect and the state becomes . On the other hand, if both opponents defect, , the selected player chooses cooperation, ; see Fig. 1(c). Thus, if the state is different from the best-response action, it changes, and otherwise, it stays constant. If it changes, not only the label of the chosen node changes, but also the types of all edges and all simplices, which this node is part of. Note that best-response strategies consider the optimal choice of a single agent based on knowledge of the opponents’ strategy and is thus one of the simplest non-trivial update rules. A more elaborate approach would be to consider so-called Fermi-update rules15,18,39 where a probability to adapt the neighbors’ strategy is given based on the current payoffs of the respective agents.
Based on these three operations, the evolution of the multiplayer Snowdrift game on an adaptive simplicial complex is modeled as follows. Let be a simplicial complex as defined above. We define the probability to execute best response on simplices and the probability to execute rewiring of edges in . First, an edge is randomly chosen in the network.40 The first node in the edge performs the following operations. If the chosen edge is not part of any simplex, then with probability rewiring and with probability , best response on edges is executed by the chosen node . On the other hand, if the chosen edge is part of at least one simplex with probability , best response in simplices is executed by the chosen node , and with probability , an operation on the edge is executed. In the first case, one simplex is chosen uniformly from all simplices of which the edge is part of and node performs best response on this simplex. In the second case, the edge operation is again either rewiring of with probability or best response on the edge with probability .
III. MOMENT EQUATIONS
In order to analyze the dynamics of the system, we derive a set of moment equations for the lowest moments , , and . The other lowest moments follow from the conservation rule for nodes, , and for edges, . For an intuitive understanding, first, we consider the system with only two-player interactions. Second, we present the corresponding moment equations for the adaptive three-player Snowdrift game, derived in detail in Appendix A. The resulting moment equations depend on higher-order moments, such as the distribution of triples, triangles, and simplices.
A. Adaptive two-player game
First, we consider the proposed model, including only two-player interactions. For this, let be a graph with nodes and edges . First, an edge is chosen at random. With probability , the node rewires to a cooperating node. With probability , it performs best response on the chosen edge.
The number of -nodes increases (decreases) due to best response on -edges (-edges), which implies
Here, and are the probabilities that the initial edge is of type and , respectively, while is the probability of best response.
The number of -edges increases due to rewiring when the initial edge is a -edge. Note that each -edge is counted twice, giving a factor of . Furthermore, it decreases (increases) if best response takes place on a -edge (-edge). For a -edge, we have to consider the direct contribution from the edge itself plus all additional -type neighbors. For this, we define the excess degree as the expected number of -type neighbors to a -type node being already connected to other -node; see Appendix B 1. The total contribution of -edges is then given by the probability to perform best response on any -edge multiplied with , where the accounts for the direct contribution of the -edge itself. Similarly, best response on -edges leads to multiplied with the excess degree , which is the expected number of -type neighbors to a -type node being already connected to one -type node. This leads to
Pairwise approximation gives and , see Appendix B 1, such that we obtain the pairwise closed equation
Finally, the number of -edges decreases due to rewiring of -edges, while best response increases (decreases) when taking place on a -edge (-edge). The corresponding contributions of best response on edges are given by the probabilities and multiplied, respectively, with the excess degrees and . The full contribution to is then
Pairwise approximation of the excess degrees, and , see Appendix B1, gives
B. Adaptive three-player game
Three-player interactions take place on simplices. This leads to modifications of the existing terms of the two-player model and additional multiplayer terms. Most importantly, the probability to perform an action on simplices plays a crucial role. For -edges, it is given by the probability that the edge is part of any simplex multiplied with the probability to take such a simplex action, .
The number of cooperating nodes changes due to best response on edges and on simplices. Best response on -edges decreases by one, while best response on -edges increases by one. The corresponding probabilities are modified in comparison with the two-player game by a factor and , respectively. For details, see Appendix A. Best response on simplices decreases the number of cooperators when the initial node cooperates, and there is at least one other cooperator. Similarly, best response on simplices increases the number of cooperators if the action takes place within a fully defecting simplex of type . This can be expressed in terms of probabilities for an -type edge to be part of a simplex of type , conditioned it is part of any simplex; for a full derivation, see Appendix A. Altogether, the number of cooperators changes according to
The number of -edges changes due to rewiring and best response. The contribution from rewiring of edges is similar to the two-player game with an additional factor for not taking a simplex action. The contribution from best response on - and -edges is again given by the direct contribution (for the -edge) and the corresponding excess factors, and ; see Sec. III A and Appendix B 1. Similarly, best response on simplices contributes directly to for and and indirectly from adjacent nodes outside of the considered simplex. For this, the simplex-excess degree is defined as the expected number of -type neighbors of an -type node, which is part of a simplex of type , i.e., which contains defecting nodes. Adding all contributions leads to the following moment equation for , for a detailed derivation, see Appendix A:
Finally, the number of -nodes also changes according to rewiring and best response with a full derivation in Appendix A. Rewiring and best response on edges gives similar contributions as in the two-player game; see Sec. III A. Similarly to , best response on simplices contributes directly within simplices of type and , and indirectly from adjacent nodes outside of the simplex, expressed in terms of simplex-excess degrees . This leads to
C. Closed moment system
We consider pairwise approximation to close Eqs. (9)–(11). Such closure methods are well established in epidemiology and dynamics on two-player networks.41–44 Therefore, we approximate the excess degrees, i.e., the expected numbers of neighbors of type for -type nodes with neighbor of type as ; see detailed derivation in Appendix B. The excess degrees for nodes within simplices are approximated with , , and ; see Appendix B. Detailed approximations for the probabilities and are also given in Appendix B. Furthermore, by definition, we have since -type edges, which are part of any simplex, must be either within or . Applying these approximations to the moment equations leads to the following closed system of equations for the lowest moments:
Each term represents one of the considered actions in the adaptive simplicial Snowdrift game, as specified in Eqs. (9)–(11), with its corresponding implications on the numbers of labeled nodes and edges. However, even in their closed form, a complete analytical treatment is not likely to work. Instead, the expected time evolution of the lowest moments from Eqs. (12)–(14) is evaluated numerically. In the following sections, we compare this to full direct simulations of the adaptive Snowdrift game on simplicial complexes. Note that setting leads to the closed moment equations of the adaptive two-player game; see Sec. III A.
D. Numerical results
The closed moment equations and the approximations of subgraphs, excess degrees, and probabilities used therein from Appendix B are compared in this section with numerical simulations on simplicial complexes. For the simulations, we consider random Erdoső–Rényi graphs45,46 as initial networks, on top of which we add a specific number of simplices in order to get a simplicial complex. Note that this is just one exemplary ensemble, even though the system could be applied to any simplicial complex. We find similar results for the uniform ensemble and the binomial ensemble .
Graphs in consist of nodes and exactly undirected edges (such that the total number of edges is ). Here, we choose such that the average degree of each node is . Graphs in consist of nodes, and each of the possible undirected edges is independently drawn with probability . Here, we obtain the same total number of edges on average by choosing . In order to create a simplicial complex, we assign a fraction of all existing triangles as simplices in . The expected number of triangles in is given by . This asymptotically also holds for with and such that we expect .
In the following, numerical results are presented for the uniform ensemble only, and equivalent results are obtained for the binomial ensemble. We choose nodes, edges (such that the average degree is ), and . For the chosen parameters, we get approximately triangles and simplices (each counted six times). The probability that a random edge is part of at least one simplex is approximately , which gives for the chosen parameters. Furthermore, we consider the probabilities for action on a simplex and for rewiring of edges as and , respectively.
The results for the lowest moments and are illustrated in Fig. 2 for five different realizations of the initial network (blue lines). The simulation is compared to the evolution with the closed moment equations (black lines). We observe that within time steps, the closed moment equations converge to a steady state. The simulation shows oscillations that are in the range of the steady state of the closed moment equations. However, there are larger deviations for the number and of -edges and -edges.
Nevertheless, the closed moment equations are a good approximation to the time evolution of the number of nodes and edges within the adaptive simplicial Snowdrift model. Both simulation and closed system show, in general, the same trends, and the oscillations of the number of nodes and edges in the simulation are close to the non-trivial steady state of the closed moment equations. We account the observed differences to the strong simplifications made in the closure approximations; see Appendix B.
Note that the number of simplices remains constant within each of the realizations (not shown) because due to , there are initially enough triangles left to compensate a potential destruction of simplices by rewiring. For different realizations, however, this number can be different due to the probabilistic number of initial triangles and the proportional dependence of the corresponding simplices. For the corresponding time evolution of the different number of simplex types, see Fig. 9 in Appendix B 2 b.
Moreover, similar good agreement between numerical simulation and moment equations has been checked with additional simulations for different numbers of nodes, edges, and simplices, probabilities for actions on nodes or simplices, and initial binomial random graph .
In Fig. 3, we illustrate how the adaptive simplicial Snowdrift model depends on the probability to choose an action on simplices. For this, the time dependence of the lowest moments , , and is illustrated for different values of as specified in the figure (blue colored lines). This is compared to the corresponding solution of the closed moment equations (gray colored lines). We observe that for all , the lowest moments quickly approach an equilibrium, around which there are fluctuations in the simulations. The observed steady states for the moment equations suggest monotone dependence on the parameter . For example, the fraction of cooperators in the equilibrium decreases from (with zero multiplayer interactions) to approximately (with many multiplayer interactions). This means that increasing the influence of these multiplayer interactions by increasing does not lead to a change in stability or a bifurcation. In contrast, the observed non-trivial steady states seem to be stable for the simplicial Snowdrift game, even when certain irrational perturbations are considered, as discussed in Sec. IV.
IV. STABILITY ANALYSIS
The closed moment equations that describe the evolution of the adaptive simplicial Snowdrift game cannot be examined completely analytically. However, it is possible to analyze steady states and their local stability for the different operations, rewiring, best response on edge, and best response in simplices, separately. For this purpose, we consider the fractions of labeled nodes and edges , , , , and and rewrite the closed moment equations accordingly.
A. Rewiring
The dynamics of rewiring can be extracted from the closed moment equations (12)–(14) by choosing or . Therefore, the corresponding dynamics of the adaptive network in relative variables is given by
This system has a line of steady states . Here, is excluded because without -nodes, there are no -edges, which contradicts in the steady state. Note that in the derivation of the moment equations, Appendix A, it is assumed that there always are enough -nodes, to which the selected edge can be rewired. In networks with a small fraction of -nodes but with high node degrees , this assumption will be violated and Eq. (15) cannot be applied.
The second and third equations in Eq. (15) are independent of , which allows one to reduce the system to the and variables. The Jacobian of the right-hand side of the reduced system is given by
which has two negative real eigenvalues and . Therefore, the steady state is locally asymptotically stable in this reduced system. Since the fraction of cooperators is always constant in the system, the line of steady states defined above is stable in the system with only rewiring.
B. Best response on edges
For the parameter choices or in the closed moment equations (12)–(14), only best response on edges occurs in the adaptive network. In terms of , this is given by
For , this system has a line of trivial steady states . The cases and are excluded since this contradicts and . Note that depending on , there might not be enough possible -edges in simulations on some finite network. The Jacobian in one of the steady state points is given by
with eigenvalues and . The second eigenvalue becomes positive for all if , i.e., if the average degree . This is satisfied for realistic networks. The Hartman–Grobman theorem implies that under this condition, each of the trivial steady states is unstable.
Furthermore, the system Eq. (17) has a non-trivial steady state . Therefore, if the number of edges is sufficiently high relative to the number of nodes , this steady state corresponds to the state in which all node labels and edges are uniformly distributed, i.e., for . Calculating the eigenvalues and applying the Hartman–Grobman theorem reveals that this steady state is asymptotically stable for , which is fulfilled for all reasonable networks. For large , this can be seen as the realization of the only mixed Nash equilibrium of the two-player Snowdrift game globally in the network, where both players select either of the two actions and with the same probability .
C. Best response in simplices
Choosing and a large number of simplices implies that every edge is part of at least one simplex in Eqs. (12)–(14). Thus, only best response in simplices is executed in the adaptive network. In particular, here, we assume that for all -edges and apply pair approximation for the probabilities of -edges to be part of specific simplex types ; see Appendix B 2. This leads to the following system in terms of :
Again, we find a line of trivial steady states for best response in simplices, , which are the same as for best response on edges. Further steady states can only be computed implicitly by the usage of mathematical software. In order to analyze the dynamics of best response in simplices besides the trivial steady states, we assume in the following that for all possible edge and simplex types. This is equivalent to the assumption that the simplex types are uniformly distributed within all simplices; i.e., their total amount is the same . The resulting system in terms of is given by
For this simplified system, we find the nontrivial steady state with . Again, corresponds to the fraction of cooperators in the Nash equilibrium of a three-player Snowdrift game, which is consistent with the assumption of an initial uniform distribution of labels, edges, and simplices.
D. Numerical analysis with MatCont
We perform a numerical stability and bifurcation analysis of the adaptive simplicial Snowdrift model with the help of the software tool MatCont47 as described in Appendix C. The numerical analysis confirms the analytical results of the equations for rewiring, best response on edges, and best response in simplices separately. Furthermore, the analysis in MatCont indicates that the closed moment equations, Eqs. (12)–(14), of the full adaptive simplex Snowdrift model have a non-trivial steady state, which is asymptotically stable for all reasonable parameter choices , , , , and .
An exemplary parameter diagram is shown in Fig. 4 as a function of and for different parameters . The fractions of cooperators and -edges in the equilibrium are shown in panels (a) and (b), while the real parts of the corresponding eigenvalues are shown in (c). Apparently, all eigenvalues are below zero such that the steady states are stable for all parameters. Yet, we observe that the eigenvalues are relatively close to zero so that the stability is relatively weak, which does allow after a perturbation for an extended duration of phases away from the steady state.
E. Robustness
Furthermore, we are interested how robust the presented adaptive simplicial Snowdrift model is against the introduction of irrational actions of players. An action is called irrational if the payoff of the selected player is decreasing (or at least not increasing). For example, rewiring from cooperating to defecting -nodes leads to smaller payoff. Here, we consider irrational replacements for the best-response simplex action in order to understand the effect of multiplayer interactions on the stability of the system. For this, we define the probability to replace the simplex action that is replaced with one of the following irrational strategies. In particular, for , the original adaptive simplicial Snowdrift model is obtained, and for , all best-response actions on simplices are replaced.
For this, we consider (i) the all-defecting strategy, (ii) the worst response strategy, where the opposite of best response in simplices is considered, (iii) the all-cooperating strategy, (iv) the adaption to the majority action within the simplex, (v) copying the neighbors’ action, (vi) always changing the action, (vii)–(ix) increasing the number of -, -, or -edges, and (x)–(xii) decreasing the number of -, -, or -edges, respectively. Each of these extensions leads to additional terms in the moment equations, which are proportional to and depend on the considered action (i)–(xii). We consider the resulting closed moment equations using the approximations of Appendix B. The numerical bifurcation analysis of these extended models is performed in MatCont, see Appendix C, for parameters , with , , , , and . The results (not shown) suggest that the non-trivial steady state remains stable for all reasonable parameter choices and is only shifted under variation of . Yet, the same transient excursions due to weakly stable eigenvalues can be possible as discussed above. Hence, we conclude that the dynamics of the adaptive simplicial Snowdrift model is stable, even if the multiplayer interactions are perturbed.
V. SUMMARY AND OUTLOOK
We propose a multiplayer Snowdrift model on adaptive simplicial complexes. This model contains rewiring rules, changing the topology, and best-response rules, changing the state of the system. For the lowest moments, the number of cooperators and the number of edges between cooperators and between defectors , we derive moment equations based on the dynamical rules of adaption. Based on the structure of simplicial complexes, we derive closure relations with pairwise approximation, relying on the numbers of labeled nodes and edges only. We confirm by numerical comparison that the corresponding closed system leads to a good approximation of the system, even though only the lowest moments are considered. Since the closed system is analytically not fully solvable, we show for specific limiting subsystems, where only one of the considered actions takes place, that the non-trivial steady state is stable for reasonable hypergraphs as long as (sufficient) rationality governs the dynamics. These results are further supported with numerical stability analysis of the full system, including direct numerical simulations of the full hypergraph dynamics as well as numerical continuation calculations for the reduced moment equations.
In total, we observe quite surprising robustness of non-trivial steady states of adaptive multiplayer games, which we attribute to sufficient rational behavior for each player. Furthermore, even considering some irrational, multiplayer update rules does not de-stabilize the non-trivial steady state. We expect this stability to prevail if rational higher-order interactions of more than three players are considered and also if multiple agents are updated with a best response in each step.
This suggests two interesting conclusions: (a) Complex socio-economic systems with many agents and higher-order multiplayer interactions might be quite robust, at least if each player/agent has access to enough information to make sufficiently rational decisions and perturbations from the steady states are sufficiently small. (b) Although several examples of de-stabilization of network dynamical systems by such higher-order interactions have been found,26,29 one should not overlook the possibility that the stability of systems with multiplayer interactions could often reduce to more classical systems with pairwise interactions. Both conclusions are somewhat re-assuring as there are (i) indeed long periods of socio-economic stability in data and (ii) we can still hope to rely on results for more classical pairwise models for certain modeling situations.
Of course, we emphasize that our study is only a step toward a deeper understanding of coevolutionary adaptivity in models with higher-order, multiplayer interactions. Many open questions remain, and we mention a few natural ones. From a structural perspective, it would be important to generalize our results from simplicial complexes to more general hypergraphs. A similar remark applies to the derivation of more detailed sequences of moment equations going beyond second-order moments. Unfortunately, both generalizations become quite involved as the combinatorial complexity increases quickly when higher-order moments or non-homogeneous degree distributions are considered.41–44 Thus, developing an efficient mathematical scheme to algorithmically generate moment equations for hypergraphs would be very desirable.
From the viewpoint of applications, one could investigate other multiplayer games. In fact, we have also cross-validated our results in variants of the prisoner’s dilemma48 with similar results and conclusions. Yet, there could be many other multiplayer games arising in various fields, where adaptivity might have a different impact. In this regard, it would also be interesting to develop a more precise quantifier as to how adaptivity and the amount of rational agent behavior influence stability or can induce bifurcations in behavioral socio-economic systems. One possible direction is the generalization to Fermi-update rules considering individual payoffs instead of rational best response.15,18,39 In order to understand the limitations of the considered closures, one could generalize evolutionary multiplayer games with multiple strategies,24 where pairwise interaction fails to describe the dynamics, to adaptive simplicial complexes or hypergraphs.
ACKNOWLEDGMENTS
K.C. and C.K. thank the VolkswagenStiftung for support via the grant “Dynamics of Self-Adapting Networks” within a Lichtenberg Professorship awarded to C.K. The authors thank the anonymous referees for their helpful suggestions to improve the presentation of the manuscript.
AUTHOR DECLARATIONS
Conflict of Interest
The authors have no conflicts to disclose.
DATA AVAILABILITY
The data that support the findings of this study are available from the corresponding author upon reasonable request.
APPENDIX A: DERIVATION OF MOMENT EQUATIONS
In this section, we derive moment equations for the adaptive simplicial Snowdrift model. We are particularly interested in the lowest moments, i.e., the expected numbers and of and -nodes, as well as the expected numbers of edges , , and . Recall that we consider a fixed total number of nodes and a fixed number of edges . Therefore, it is sufficient to derive moment equations for , , and .
1. Evolution of
The number of cooperating nodes changes due to best response on edges and best response on simplices. Let be the probability that a randomly chosen edge of type , i.e., , is part of at least one simplex and be the probability that it is not part of any simplex.
a. Best response on edges
The number of nodes increases by one for best response on -edges and decreases by one for best response on -edges. Based on the proposed dynamics, the probability to take an action on edges is given by the probability to be not in any simplex plus the probability to be in any simplex times the probability of not taking a simplex action , which gives , where has been used. This leads to the following contributions to :
where and are the probabilities that the chosen edge is of type and , respectively. The other factors account for the probability to perform best response on edges.
b. Best response on simplices
For best response in simplices, we define the probability that an edge of type is part of a simplex with defecting nodes, conditioned that it is part of at least one simplex. Best response on simplices decreases the number of cooperating nodes if the selected node is in state and at least one other node is cooperating. Similarly, it increases the number of nodes if all nodes are defecting. This gives the following contributions to :
Note that is the probability to select an edge, which goes from a -type edge to a -type edge. Since we consider undirected graphs, both types of edges, and , exist in for each such pair of connected nodes. Since we perform the best response on the first node of the selected edge, it is necessary to distinguish from edges. However, since , the probabilities to select either are the same.
c. Resulting equation for
Altogether, the evolution of the number of cooperating -nodes in the adaptive simplex Snowdrift model is governed by the differential equation , which is equivalent to Eq. (9).
2. Evolution of
The number of -edges changes directly due to rewiring, as well as directly and indirectly due to best response on edges and simplices.
a. Rewiring
The number of -edges increases if a -edge is rewired to a -edge. We do not consider the opposite direction since this would decrease the payoff. Respecting the probability to choose rewiring of edges (either in or outside of any simplex), we obtain the following contribution to :
where again, it is respected that only -edges rewire to edges, but not -edges, since in the latter case, the first node that performs the action is already connected to a -type node. Note for each rewired edge, the number of both and -edges decreases by one and the number of -edges increases by such that the total contribution is .
b. Best response on edges
The change in the number of cooperating nodes also influences the number of -edges. In particular, if a cooperating node changes from to , all its adjacent -edges to other -nodes become -edges. The contribution to from the switching node comes from its other neighbors of type . For this, let be the expected number of -type neighbors for a node with type , which is already connected to nodes with type . Together with the probability of best response on edges, this gives the total number of added or removed connections. Altogether, this leads to
accounting for both direct and indirect contributions.
c. Best response in simplices
Best response in simplices also changes the number of -edges directly and indirectly. If the simplex is , two -edges are destroyed due to best response. For simplices, changing the node state from to destroys one -edge in each case. Note that within the simplex, best response does not create new -edges. This implies the contribution
The indirect influence comes from the changes of edge types outside of the simplex due to the change of the node state within the simplex. For this, the simplex-excess degree is defined23 as the expected number of additional neighbors with type of a node with type given that it is part of a simplex of type . In particular, the -node is within the simplex already connected to neighbors of type , where is the Kronecker delta and neighbors of type . With this, the indirect contributions to the change of -type edges can easily be written in terms of the probabilities for best response in the specific simplices multiplied with the expected number of additional -type neighbors. We end with
d. Resulting equation for
Altogether, the evolution of the number of -nodes in the adaptive simplex Snowdrift model is governed by the differential equation , where the factor of reflects the double counting of undirected edges. Altogether, the change in the number of -edges in the adaptive simplicial Snowdrift model is given by Eq. (10).
3. Evolution of
Similar as for , the number of -edges changes due to rewiring and due to best response on edges and simplices, directly and indirectly. Therefore, the derivation follows analogously. Summing up direct and indirect contributions leads to the differential equation in Eq. (11).
We emphasize that these three equations for the lowest moments depend on higher-order moments, such as the distribution of triples through the excess degrees and the distribution of simplices of different types.
APPENDIX B: MOMENT-CLOSURE APPROXIMATIONS
In the following, the moment equations are closed at the level of triples such that the right-hand side of the ODEs depends on the lowest moments , , , , , only. This means that the full information on the network structure and the simplex distribution is reduced to information on the pairs.11,41–44 Note that we focus on structural configurations of pairs, which is different from approaches where three-player interactions are modeled by effective two-player interactions. We consider a system with a fixed number of nodes , a fixed number of edges , and also a fixed number of simplices .
1. Approximation of excess degrees
a. Approximation of
By definition, the excess degree is the expected number of -type neighbors of an -type node, which already has one -type neighbor; see Fig. 5(a). Thus, it is equivalent to the expected number of -triplets containing the -edge. Let be the number of triplets with states , , and ; i.e., . Note that symmetry implies and . The expected number of -triplets is approximately given by the number of -edges multiplied with the expected number of -neighbors of . Therefore, we have
Furthermore, the numbers of triplets are approximated in terms of pairs and nodes as follows. The proportion of edges from -type to -type nodes is given by the number of -edges divided by the total number of edges starting at , which is approximately . Thus, we have . The probability for two neighbors of some type node to be of type and , respectively, is thus approximately . For the total number of -triplets, we have to multiply this with the possible number of ways to choose the neighbors, which is , and with the total number of -nodes, and we get
such that
We emphasize that for this pair approximation of the triplets, the approximative excess degrees of -type nodes are independent on the number of already connected -nodes and, therefore, are simply given by the expected number of -node neighbors.
Note that also implies and , and the terms containing the excess degrees do not contribute. For illustration of the agreement of the closure with simulation, see Fig. 6.
b. Approximation of
The simplex-excess degree is the expected number of -type-neighbors of an -node within a simplex of type ; see Fig. 5(b). In order to apply pair approximation we notice that an -type node within a simplex of type is already connected to neighbors of type . For example, if , , we have and . Similarly, and . If the average degree in the network is large, these excess degrees are approximately . If and , the -node is already connected to one neighbor of type and one neighbor of type . Therefore, we can approximate but also . In pair approximation, both quantities are the same. Similarly, we obtain .
Thus, for large node degrees , the approximations in Eq. (B3) from Subsection 1 a of Appendix B are applied. We illustrate the time dependence of the simplex-excess degrees in Fig. 7, comparing values from the simulation (colored lines) to the corresponding results from the moment-closure system (black lines).
2. Approximation of probabilities
a. Approximation of
First, we consider the probability that a -edge is not part of any simplex. Intuitively, only simplices in and contain -edges, and there are for each type exactly two such edges. Thus, a randomly drawn -edge is part of a specific simplex with probability
because contains two out of all edges of type . Furthermore, we note that if the -edge is part of , then it is also part of any permutative simplex, e.g., , which is of the same type. This means that each simplices are equivalent. Let be the set of all unique simplices defined by this equivalence condition; i.e., . The probability that the -edge is not part of any simplex is thus given by
where the approximation assumes that the simplices in are independent.
Second, edges of -type can only be part of simplices in and . Recall that contains three -nodes and three -edges counted twice, while contains exactly one edge counted twice. Thus, a randomly drawn -edge is part of a simplex with probability
and is part of a simplex with probability
The probability that is not part of any simplex is thus
Analogously, one derives the approximations
Altogether, this approximates the probabilities of some edge of type to be part of any simplex,
with approximations for as given above. Suitable approximations for the numbers of simplices are given at the end of this section.
For a comparison of these approximative probabilities for the three edge types with the numerical simulation, see Figs. 8(a)–8(c).
b. Approximation of
Recall that is the probability that an -type edge is in a specific type of simplex, conditioned on the event that the edge is part of at least one simplex. Considering the possible type of simplices that a specific edge can be part of, these probabilities are given by
These approximated probabilities are compared to the values from numerical simulation in Figs. 8(d)–8(f), where the following approximations for the numbers of simplices are considered.
c. Approximation of
For a simplicial complex as considered in this paper, it is possible to approximate the number of simplices with the numbers of labeled edges in . We assume that the simplices are distributed proportional to the triangles in the network,
where is the number of simplices, some triangle, and the set of all triangles of type in the network. The number of simplices is constant in our model. If a simplex is destroyed due to rewiring, a new simplex is added to the set of triangles. We want to express the probabilities that some triangle is of type ,
in terms of the nodes and edges, where .
For this, we consider a triangle with three nodes of status as an -subgraph, where the and node are connected. For example, the number of -triangles is approximated as the number of -triples, multiplied with the probability that the outer -type nodes are connected, which approximately is . This approximation becomes better for large average node degrees . Altogether, this leads to
For triangles of type , we have to take into account the contributions from -triples, -triples, and -triples. The -triples contribute with multiplied with the probability that the outer -node and -node are connected, which approximately is and the same contribution comes from -triples. The -triples contribute with multiplied with the probability that the outer -type nodes are connected, which approximately is . Altogether, we have
A similar argumentation leads to the following approximations for the number of type- and type- triangles:
These approximations are inserted into Eq. (B12), and we obtain with and
the following approximations for the different types of simplices:
Note that for these equations, we assume that and . Let us emphasize that due to rewiring of edges, the actual number of triangles and also its approximation are not constant in time. However, the considered approximations for the numbers of simplices satisfy for all times. The approximations for the number of triangles and simplices are illustrated in Fig. 9. For the specific probabilities that are used in the closed moment equations, we get
APPENDIX C: STABILITY ANALYSIS WITH MATCONT
MatCont is a Matlab software project for the numerical continuation and bifurcation study of continuous and discrete parameterized dynamical systems.47 In MatCont, the adaptive simplicial Snowdrift model is implemented via its closed moment equations in terms of relative variables. This is done for the system of closed moment equations, Sec. III C, and also separately for the simplified parameter choices from Sec. IV.
For the simulations of the closed moment equations, initial values are selected on a grid like from the admissible range or in small neighborhoods around already known steady states. The analysis allows one to make statements about the local and also global stability. Furthermore, for the bifurcation analysis, we consider initial conditions at a steady state for a specific choice of parameters. This is followed by parameter variation, where one of the parameters changes while the others remain constant. The real parts of the eigenvalues of the Jacobian of the system reveal the stability of the steady state, and MatCont, therefore, detects possible bifurcations. This procedure is done for several steady states, choosing values of and on a grid in . These parameters control the strength of influence of the three different adaptive operations. We also consider different parameters , with and with , which determine the properties of the underlying network.