Long-term temporal correlations in time series in a form of an event sequence have been characterized using an autocorrelation function that often shows a power-law decaying behavior. Such scaling behavior has been mainly accounted for by the heavy-tailed distribution of interevent times, i.e., the time interval between two consecutive events. Yet, little is known about how correlations between consecutive interevent times systematically affect the decaying behavior of the autocorrelation function. Empirical distributions of the burst size, which is the number of events in a cluster of events occurring in a short time window, often show heavy tails, implying that arbitrarily many consecutive interevent times may be correlated with each other. In the present study, we propose a model for generating a time series with arbitrary functional forms of interevent time and burst size distributions. Then, we analytically derive the autocorrelation function for the model time series. In particular, by assuming that the interevent time and burst size are power-law distributed, we derive scaling relations between power-law exponents of the autocorrelation function decay, interevent time distribution, and burst size distribution. These analytical results are confirmed by numerical simulations. Our approach helps to rigorously and analytically understand the effects of correlations between arbitrarily many consecutive interevent times on the decaying behavior of the autocorrelation function.
In general, events in complex systems are correlated with each other. The autocorrelation function for the event series measures the overall diminishing impact of one event at a time on another event in the future (or past). The autocorrelation function in complex systems typically shows a long tail, meaning a long-lasting memory. We mathematically solve the autocorrelation function to understand the origin of such long tails in terms of not only the heavy-tailed distribution of the time interval between two successive events, namely, interevent time, but also correlations between arbitrarily many successive interevent times.
I. INTRODUCTION
It is not straightforward to devise a model or process that can answer this question, because the heavy tail of the burst size distribution typically implies that arbitrarily many consecutive interevent times may be correlated with each other. It is worth noting that correlations between two consecutive interevent times have been quantified in terms of the memory coefficient,49 local variation,50 and mutual information;51 they were implemented using, e.g., a copula method52,53 and a correlated Laplace Gillespie algorithm in the context of many-body systems.54,55 Correlations between an arbitrary number of consecutive interevent times have been modeled by means of, e.g., the two-state Markov chain,42 self-exciting point processes,56 the interevent time permutation method,57 and a model inspired by the burst-tree decomposition method.48 Although scaling behaviors of the autocorrelation function were studied in some of mentioned works,42,53,56,57 the scaling relation has not been clearly understood due to the lack of analytical solutions of the autocorrelation function.
In this work, we devise a model for generating a time series with arbitrary functional forms of the interevent time distribution and burst size distribution. Assuming power-law tails for interevent time and burst size distributions, our model generates correlations between an arbitrary number of consecutive interevent times. By theoretically analyzing the model, we derive asymptotically exact solutions of the autocorrelation function from the model time series, thereby enabling us to find the scaling relation . These analytical results will help us to better understand temporal scaling behaviors in empirical time series.
The paper is organized as follows. In Sec. II, we introduce the model with arbitrary functional forms of interevent time and burst size distributions. In Sec. III, we provide an analytical framework for the derivation of the autocorrelation function for the model time series. In Sec. IV, by assuming power-law distributions of interevent times and burst sizes, we derive analytical solutions of the autocorrelation function, hence the decay exponent as a function of and . We also compare the obtained analytical results with numerical simulations. Finally, we conclude our paper in Sec. V.
II. MODEL
Let us introduce the following model for generating event sequences in discrete time, where is the number of discrete times, for given interevent time distribution and burst size distribution. By definition, if an event occurs at time , and otherwise. By construction, the minimum interevent time is . Furthermore, we only consider bursts with throughout this work. In other words, we regard that events occurring in consecutive times form a burst, including the case in which the burst contains only one event.
The event sequence is generated using an interevent time distribution for , denoted by , and a burst size distribution . Note that is normalized. To generate an event sequence, we first randomly draw a burst size from to set for . Then, we randomly draw an interevent time from to set for . Note that . We draw another burst size from and another interevent time from , respectively, to set for and for . We repeat this procedure until reaches . See Fig. 1(a) for an example.
III. ANALYTICAL FRAMEWORK
Let us consider the case in which is non-zero, i.e., and . As depicted in Fig. 1(a), the time series in a period of is typically composed of several alternating bursts and interevent times larger than one. Here, the consecutive interevent times of forms a burst and the sum of such interevent times of is equal to the burst size minus one. Therefore, the time lag is written as a sum of burst sizes (each minus one) of bursts appeared in the period of and interevent times between those bursts. We note that the first burst contains an event at time and that the last burst contains an event at time .
IV. POWER-LAW CASE
We now divide the entire range of into several cases to derive the analytical solution of the autocorrelation function in each case. Considering the symmetric nature of in Eq. (39), the following cases are sufficient to get the complete picture of the result.
A. Case with α = β = 2
B. Case with α ≠ 2, β = 2
C. Case with 1 < α, β < 2
D. Case with α, β > 2
E. Case with 1 < α < 2, β > 2
F. Numerical simulation
For the simulations, we use and to generate different event sequences for each combination of and . Then, their autocorrelation functions are calculated using Eq. (89). As shown in Fig. 3, simulation results in terms of for several combinations of parameters of and are in good agreement with corresponding analytical solutions of in most cases. In some cases, we observe systematic deviations of analytical solutions from the simulation results, which may be due to ignorance of higher-order terms when deriving analytical solutions and/or finite-size effects of simulations.
V. CONCLUSION
To study the combined effects of the interevent time distribution and the burst size distribution on the autocorrelation function , we have devised a model for generating time series using and as inputs. Our model is simple but takes correlations between an arbitrary number of consecutive interevent times into account in terms of bursty trains.42 We are primarily interested in temporal scaling behaviors observed in when (except at ) and are assumed. We have derived the analytical solutions of for arbitrary values of interevent time power-law exponent and burst-size power-law exponent to obtain the autocorrelation function decay power-law exponent as a function of and [Eq. (86); see also Fig. 2].
We remark that our model has assumed that interevent times with and burst sizes in the time series are independent of each other. However, there are observations indicating the presence of correlations between consecutive burst sizes and even higher-order temporal structure.48 Thus, it would be interesting to see whether such higher-order structure affects the decaying behavior of the autocorrelation function.
So far, we have focused on the analysis of the single time series observed for a single phenomenon or for a system as a whole. However, there are other complex systems in which each element of the system has its own bursty activity pattern or a pair of elements have their own bursty interaction pattern, such as calling patterns between mobile phone users.61,62 In recent years, such systems have been studied in the framework of temporal networks,9,63,64 where interaction events are heterogeneously distributed among elements as well as over the time axis. Modeling temporal networks is important to understand collective dynamics, such as spreading or diffusion,65,66 taking place in those networks. Some recent efforts for modeling temporal networks are mostly concerned with heavy-tailed interevent time distributions for each element or a pair of elements.67,68 Our model can be extended to generate more realistic temporal networks in which activity patterns of elements or interaction patterns between elements are characterized by bursty time series with higher-order temporal structure beyond the interevent time distribution.
ACKNOWLEDGMENTS
H.-H.J. and T.B. acknowledge financial support by the National Research Foundation of Korea (NRF) grant funded by the Korea government (MSIT) (No. 2022R1A2C1007358). N.M. acknowledges financial support by the Japan Science and Technology Agency (JST) Moonshot R&D (under Grant No. JPMJMS2021), the National Science Foundation (under Grant Nos. 2052720 and 2204936), and JSPS KAKENHI (under Grant Nos. JP 21H04595 and 23H03414).
AUTHOR DECLARATIONS
Conflict of Interest
The authors have no conflicts to disclose.
Author Contributions
Hang-Hyun Jo: Conceptualization (lead); Formal analysis (lead); Funding acquisition (equal); Investigation (equal); Software (lead); Visualization (lead); Writing – original draft (lead); Writing – review & editing (equal). Tibebe Birhanu: Formal analysis (supporting); Validation (equal); Writing – review & editing (equal). Naoki Masuda: Formal analysis (equal); Funding acquisition (equal); Writing – original draft (equal); Writing – review & editing (equal).
DATA AVAILABILITY
Data sharing is not applicable to this article as no new data were created or analyzed in this study.