Air transportation is a complex system characterized by a plethora of interactions at multiple temporal and spatial scales; as a consequence, even simple dynamics like sequencing aircraft for landing can lead to the appearance of emergent behaviors, which are both difficult to control and detrimental to operational efficiency. We propose a model, based on a modulated Markov jitter, to represent ordinal pattern properties of real landing operations in European airports. The parameters of the model are tuned by minimizing the distance between the probability distributions of ordinal patterns generated by the real and synthetic sequences, as estimated by the Permutation Jensen–Shannon Distance. We show that the correlation between consecutive hours in the landing flow changes between airports and that it can be interpreted as a metric of efficiency. We further compare the dynamics pre and post COVID-19, showing how this has changed beyond what can be attributed to a simple reduction of traffic. We finally draw some operational conclusions and discuss the applicability of these findings in a real operational environment.

Air traffic flows compose a complex dynamics, a result of the multiple interactions that may emerge between aircraft. To illustrate, airports have a limited landing capacity; the late arrival of one aircraft in a saturated airport may force other aircraft to delay their respective landings, creating a knock-off effect. Identifying such chains of events is not always simple; yet, their characterization, and especially the quantification of the temporal scale over which such interactions propagate, is a key element for evaluating the performance of operations. If directly identifying interactions is not an option, a solution is to analyze the fingerprint they leave in time series representing the aggregated dynamics of the system—in this case, in time series representing hourly landing volumes. We here use a simple dynamical model (specifically, a modulated Markov jitter) to represent such dynamics and tune it by implementing a recently introduced ordinal approach on real data. The result is used to extract a mean lifetime, representing, for each airport, how long can interactions between landings propagate. In more general terms, this contribution illustrates yet another example of how statistical physics concepts can be used to obtain insights about real-world technical systems, even when only macro-scale information is available.

Studying the dynamics of complex systems for which we have limited information is a major challenge, which researchers frequently have to face when dealing with many real-world problems. If proper knowledge about the underlying structure and dynamics is not available, and thus a micro-scale model cannot be reconstructed, the natural solution is to resort to the study of macro-scale observable, i.e., to a data-driven approach. This has led, in recent years, to the widespread adoption of Machine Learning and Deep Learning in science1–3—in spite of some major drawbacks, including their black-box nature, and hence the lack of interpretability.4 Mixed approaches, combining simple principled models and data tuning, are nevertheless not new in physics and can be traced back to the first models of our solar system.5 They present the advantage of being easily interpretable, thus enabling the analysis of specific aspects of the system; but also of being simplified representations tuned according to real data, and hence not requiring a complete knowledge.

Within this vast field, of special interest is the creation of models able to reproduce some characteristics of a dynamical process (i.e., a time series) based on a limited set of parameters. These parameters can be fitted against real data, in order to understand the underlying properties of the real system; but can further be modified to simulate how the system would react to internal or external perturbations. Examples of this, of relevance for the present study, include the use of modulated short-range correlated noise to represent the daily sampled sunspot number sequence6 and temperature fluctuation in air avalanches.7 More concretely, these models are based on a high-frequency Markov process, multiplied by a long-term component defining the modulated Markov jitter.6 

A system that has mostly been neglected by the physical community is air transport, and specifically the problem of understanding the mechanisms governing air traffic flows. In spite of being a highly engineered and regulated system, and thus being completely man-made, it is also defined by the interactions among numerous elements, and thus by a highly complex dynamics;8 as a result, unexpected (emergent) patterns frequently appear. To illustrate, airport and airspaces have a limited capacity, constraining the number of aircraft that can operate within them in a given time window. In a saturated context, the late arrival of one aircraft (i.e., its arrival in a time window that is not the originally planned one) may result in another aircraft to be delayed and in a knock-off (or avalanche) effect. The study of this problem has mainly been tackled through mathematical models,9–14 which are nevertheless limited by the lack of complete knowledge about the underlying interactions. On the other hand, macroscopic analyses, e.g., based on the characterization of real time series from the viewpoint of statistical physics, are scant at best. Some examples include the study of landing volume sequences through multifractal analysis,15,16 visibility graphs,17,18 or the study of the irreversibility of delay time series.19 

In this contribution, we propose the use of a Markov-modulated model to represent the ordinal pattern properties of the low- and high-frequency dynamical components of hourly landing flows. More specifically, we consider two dynamical components: a high-frequency term, given by an auto-regressive process; and a low-frequency one, simulating the inactivity during nights and the reduced activity around mid-day (as observed in real data). The parameters of this model are tuned to match the ordinal dynamics observed in real data, by minimizing the distance between these and the generated time series; such distance is estimated using the Permutation Jensen–Shannon Distance (PJSD), i.e., the distance between the probability distribution of permutation patterns20–22 observed in the two time series. Recently, it has been shown that a wide range of complex phenomena can be scrutinized with this ordinal symbolic quantitative metric.22 Taking into account the robustness to noise effects and the invariance under scaling of the data associated with the ordinal symbolization approach,21 together with numerous applications of the corresponding distribution,23–36 the PJSD arises as a quantitative metric especially suited for the analysis of real-world signals. We also consider this approach to be versatile because the hypothesis to be tested can easily be setup by conveniently choosing the time series taken as a reference.

The proposed model is tested using data about real landing operations in ten major European airports between the years 2018 and 2020. We first describe the synthetic model and explore how the resulting dynamics is changed by its defining parameters. We then recover the best parameters describing the observed dynamics and show how the resulting synthetic time series retains a great part of the original information. We further study how the correlation between consecutive values in the high-frequency term of the dynamics changes between airports. This represents how the landing of one aircraft depends on what happened in the previous hours, or, in other words, the memory term in the landing dynamics and can thus be used as a metric of airport efficiency in handling arrival operations. We finally compare the dynamics pre- and post-COVID-19 and show how this has changed beyond what can be attributed to a simple reduction of traffic. We conclude by drawing some conclusions on the operational values of these findings.

Ordinal patterns are defined by two parameters: the order of the permutation symbols D2 (DN, the pattern length) and the lag τ (τN, the time separation between the values). Any one-dimensional time series, X(t)={xt;t=1,,M}, can be mapped into subsets of length D of consecutive (τ=1) or non-consecutive (τ>1) values, generated by (t)(xt,xt+τ,,xt+(D2)τ,xt+(D1)τ), which assigns to each time t the D-dimensional vector of values at times t, t+τ,.,t+(D1)τ. Each element of the vector is subsequently replaced by a number related to its relative ranking, i.e., the smallest value by zero and the largest one by D1. By the ordinal pattern corresponding to the time (t), we, therefore, mean the permutation πi of 0,1,,D1, representing the relative amplitude (strength) of each element in the original vector. Whenever values X(t) are drawn from continuous distribution, equal values are very unusual,37 digitized data with low resolution or discrete measurements could nevertheless have a considerable number of equalities. In those cases, the most used recipe is to break these ties by adding a small amount of noise.20 

By counting the number of times each ordinal pattern πi appears in the symbolized time series X(t), normalized by the total number of ordinal patterns M(D1)τ, we can compute an ordinal pattern probability distribution function,

pi=#(πi)M(D1)τ,i=1,2,,D!,
(1)

where #(πi) stands for the cardinality of πi. To illustrate the ordinal pattern probability reconstruction process, we consider the simple case of a time series with ten (M=10) values X={1,5,7,9,6,10,0,12,1,15}, pattern length D=3, and lag τ=1, which gives eight possible ordinal patterns. The first two triplets, (1,5,7) and (5,7,9), are mapped to the pattern (012) since the values are already sorted in ascending order. On the other hand, (7,9,6) and (6,10,0) correspond to the pattern (120) since xt+2<xt<xt+1, while (9,6,10), (10,0,12), and (12,1,15) are mapped to the ordinal pattern (102) since xt+1<xt<xt+2. Lastly, the triplet (0,12,1) maps to the pattern (021). The associated probabilities of the six ordinal patterns are, therefore, p(012)=p(120)=1/4, p(102)=3/8, p(021)=1/8, and p(201)=p(210)=0.

Taking into account that there are D! possible permutations of a D-dimensional vector, the condition MD! must be satisfied in order to obtain a reliable statistics;20 consequently, the maximum pattern length is limited by the length of the time series under analysis. Although in their seminal paper20 Bandt and Pompe suggested to fix τ=1, it has been demonstrated that the analysis with lagged data points, i.e., τ2, may be useful for reaching a better comprehension of the underlying dynamics of some systems, as it physically corresponds to multiples of the sampling time δt.38–41 In the present analysis, we set D=3, as it gives a clearer graphical observation of the hierarchy of the ordinal patterns probability distribution, and due to the limited length of the time series under analysis; τ>1 for representing the low-frequency daily dynamics of the landing flow, and specifically, τ=1 for quantifying short-term correlations.

The PJSD was recently introduced as a versatile metric to measure the degree of similarity between the symbolic ordinal sequence statistics of two time series.22 It is defined in terms of the Jensen–Shannon divergence42 between two ordinal pattern probability distributions P={p1,,pN} and Q={q1,,qN} associated with the two time series under analysis,

DJS(P,Q)=S((P+Q)/2)S(P)/2S(Q)/2,
(2)

where S(P)=i=1Npilnpi is the classical Shannon entropy. The PJSD is, hence, obtained by calculating the square root of Eq. (2), and its normalized version reads

PJSD(P,Q)=DJS(P,Q)ln2.
(3)

Since it constitutes a measure of distinguishability between two probability distributions, the ordinal patterns composition between different sequences can be quantitatively compared through this metric. Obviously, larger values of this quantifier indicate less similarity between the symbolic mapping of the signals and vice versa. It is intuitively expected that signals coming from the same underlying dynamics would have small estimated values of this ordinal distance (close to but not exactly zero as a consequence of finite-size effects), whereas larger values (significantly different from zero) will be found when the signals have different dynamics. Actually, in the former instance, the PJSD has been shown to asymptotically converge to zero with the series size.22 

We consider the landing activity from ten major European airports in two different periods: from June 1st, 2018 to June 1st, 2019; and from June 1st, 2020 to June 1st, 2021. Table I lists the airports considered in this work classified by their number of runways (one or two) dedicated to landings operations. Additionally, the second column reports their four-letter code defined by the International Civil Aviation Organization (ICAO). Hereinafter, airports will be identified by this code.

TABLE I.

List of airports considered in this study. First column: Airports location. Second column: four-digit ICAO identification code. Third column: median length of the inactivity daily interval, respectively, pre- and post-COVID-19 pandemic. Fourth column: median number of landings, pre- and post-COVID-19 pandemic.

AirportsICAOInac. (h)#Landings
One runway    
Brussels EBBR 3/3 13/4 
Dusselforf EDDL 5/6 14/3 
Munich EDDM 4/5 29/3 
London-Heathrow EGLL 5/5 26/11 
Milan-Malpensa LIMC 2/2 13/5 
Vienna LOWW 3/4 22/5 
Zurich LSZH 2/6 27/6 
Two runways    
Amsterdam EHAM 2/3 32/8 
Frankfurt del Meno EDDF 4/5 38/12 
Madrid-Barajas LEMD 2/3 22/8 
AirportsICAOInac. (h)#Landings
One runway    
Brussels EBBR 3/3 13/4 
Dusselforf EDDL 5/6 14/3 
Munich EDDM 4/5 29/3 
London-Heathrow EGLL 5/5 26/11 
Milan-Malpensa LIMC 2/2 13/5 
Vienna LOWW 3/4 22/5 
Zurich LSZH 2/6 27/6 
Two runways    
Amsterdam EHAM 2/3 32/8 
Frankfurt del Meno EDDF 4/5 38/12 
Madrid-Barajas LEMD 2/3 22/8 

The time of landing of all aircraft arriving at each airport has been extracted from ADS-B position reports, obtained from the OpenSky Network (https://opensky-network.org).43 ADS-B (Automatic Dependent Surveillance-Broadcast) is a technology allowing aircraft to continuously send radio messages, stating their position and other information of relevance;44,45 these messages are then received by ground stations and integrated into coherent reports. For each airport, flights in their final approach have been identified when the last known position was within a radius of 3 nautical miles from the center of the airport, and the last reported altitude below 500 m above ground level; the landing (touch down) moment has then been obtained by modeling the last seconds of the flight. Note that this is an estimation of the landing time and, therefore, that observational noise exists in the result. Once all landings have been identified for each airport, these are transformed into a time series of landing flows, by simply calculating the number of landings in temporal windows of δt=1 h. As a representative example, in Fig. 1 we show the landing flow in a 4 day period for Milan-Malpensa airport (LIMC). At first view, the daily activity period is clearly identified, followed by inactivity intervals for which no landings are observed (i.e., corresponding to nights). Moreover, a secondary long-term component during the activity time can be observed, i.e., a decreased number of landings after midday.

FIG. 1.

Four-day evolution of the number of landings over a temporal window δt=1 h, for Milan-Malpensa (LIMC) airport. This dynamic is representative of all landing flows considered in this work.

FIG. 1.

Four-day evolution of the number of landings over a temporal window δt=1 h, for Milan-Malpensa (LIMC) airport. This dynamic is representative of all landing flows considered in this work.

Close modal

Inactivity periods are not fixed and, in fact, fluctuate. The third column of Table I lists the median of the inactivity intervals in hours during the pre- and post-COVID-19 periods. Similarly, the fourth column lists the median of the number of landing operations per hour.

We further report in Fig. 2 the ordinal probability distributions as a function of τ for LIMC and EHAM airports, being representative of airports with, respectively, one and two runways dedicated to landings. We want to stress that, hereinafter, a small amount of noise has been added to break the ties present in the sequences. As expected, in both cases, the probabilities oscillate regularly with a 24 h periodicity. Note that the six ordinal patterns are equally probable for τ=24,48, since the added random perturbation breaks the equal amplitude values originally obtained when the lag matches the oscillation period and its multiples. This feature has been observed in oscillations with additive noise46 and stochastic oscillations.40 In the case of LIMC, we observe that ordinal probabilities tend to cluster into two groups for almost all values of τ, as opposed to EHAM, for which a different clustered structure is observed. It is important to stress that these results are representative of all the airports considered in this work.

FIG. 2.

Ordinal pattern probabilities as a function of the lag τ for LIMC (the top panel) and EHAM (the bottom panel). Probabilities estimated from the annual period between June 1st, 2018 and June 1st, 2019.

FIG. 2.

Ordinal pattern probabilities as a function of the lag τ for LIMC (the top panel) and EHAM (the bottom panel). Probabilities estimated from the annual period between June 1st, 2018 and June 1st, 2019.

Close modal

Aiming to represent sunspot activity, Blanter et al.47 introduced a simple model of a modulated noise, more specifically a modulated Markov jitter, which is a high-frequency Markov signal multiplied by a long-term component. The sequence ψ(t) is mathematically defined as

ψ(t)=F(t)η(t),
(4)

where the function F(t) represents any kind of long-frequency dynamics, while the high-frequency term η(t) is an auto-regressive process of first order AR(1). The latter term is, thus, defined as

η(ti+1)=αη(ti)+ξ(ti+1),
(5)

where ξ(t) is an independent random variable uniformly distributed on the interval [0,1], and the parameter α (α[0,1)) characterizes the correlation between two consecutive values. Note that for α=0, η(t) is equal to ξ(t) and is a totally uncorrelated variable. For a sampling interval δt=ti+1ti, the mean lifetime of the process (5) is defined as7 

θ=δt1α.
(6)

In order to simulate daily landing flow dynamics, we consider the two basic low-frequency regularities previously identified in the real data. These long-term components are modeled as

F(t;ω,ϕ,c)=sin(ωti+γζi+ϕ)+c,
(7)

where ζi is an independent random variable uniformly distributed on the interval [0,1], with γ defining its weight and thus controlling the skewness of the activity period. Additionally, ϕ is the phase; and non-negative values are guaranteed with c1. The parameter ω is used to introduce the observed periodicities in the reconstructed dynamics. We, therefore, consider a first daily regularity, representing the overall envelope of the landing volumes and obtained for ω1=2π/T; note that T=24ν h, where ν is the night inactivity period for which F(t,ω)=0—see Table I for real values. The second daily regularity encodes the reduction of activity observed around midday and is obtained for ω2=2π/(T/2).

It follows that a simple model of the landing flow fluctuations can be defined as

V(t)=η(t)[F(t;ω1,ϕ1,c1)+βF(t;ω2,ϕ2,c2)],
(8)

where the parameter β controls the decreasing number of landings at midday and η(t) is the auto-regressive process AR(1) given by Eq. (5). Table II summarizes the role of each parameter and the meaning and value of all constants.

TABLE II.

Summary of the parameters and constants of the Markov-modulated model.

ParametersQuantifiesValue
α High-frequency correlation … 
β Decrease of landings after midday … 
γ Skewness of activity period … 
Constants Meaning Value 
ν Duration of the inactivity interval see Table I  
T Period of the activity oscillation 24-ν 
ω1 Activity oscillation frequency 2π/T 
ω2 Midday oscillation frequency 2π/(T/2) 
ϕ1 Activity oscillation phase π/2 
ϕ2 Midday oscillation phase π/2 
c1 Guarantees positive values 
c2 Guarantees positive values 
ParametersQuantifiesValue
α High-frequency correlation … 
β Decrease of landings after midday … 
γ Skewness of activity period … 
Constants Meaning Value 
ν Duration of the inactivity interval see Table I  
T Period of the activity oscillation 24-ν 
ω1 Activity oscillation frequency 2π/T 
ω2 Midday oscillation frequency 2π/(T/2) 
ϕ1 Activity oscillation phase π/2 
ϕ2 Midday oscillation phase π/2 
c1 Guarantees positive values 
c2 Guarantees positive values 

The left panels in Fig. 3 show one realization of the model for three different ensembles of the parameter triplet {α;β;γ}, with a sampling window of 1 h and an activity period of T=18 h, i.e., ν=6. Note that α is kept constant at 0.7 to better visualize the effects of the other two parameters on the modulation. In all cases, the dominating low-frequency component is the 24 h period (18 h of activity plus 6 h of no landing). For the triplet {0.7;0.5;0} (the top left panel), a symmetric daily modulation is obtained since no stochastic component is added to the phase (γ=0); and a small decrease in landings is appreciated around midday (β=0.5). In the case of {0.7;0;0.5} (the middle left panel), the symmetry between the opening and closing times of activities is slightly broken, and no decrease in activity is observed at midday as it is expected since β=0. Finally, for the triplet {0.7;1;1} (the bottom left panel), the broken symmetry and the midday modulation are even more evident. By comparing these synthetic time series with the real landing flow of LIMC in Fig. 1, we conjecture that, by appropriately tuning the parameter triplet, a simple and adequate qualitative modeling of the landing flows can be achieved.

FIG. 3.

(Left panels) Four-day evolution of the normalized Markov-modulated model V(t) for α=0.7 with β=0.5 and γ=0 (the top left panel), β=0 and γ=0.5 (the middle left panel), and β=1 and γ=1 (the bottom left panel). (Right panels) Corresponding ordinal pattern probabilities as a function of τ, for synthetic time series representing one year of activity. Points represent the average of one hundred independent realizations, and error bars indicate one standard deviation. ν=6 for all cases.

FIG. 3.

(Left panels) Four-day evolution of the normalized Markov-modulated model V(t) for α=0.7 with β=0.5 and γ=0 (the top left panel), β=0 and γ=0.5 (the middle left panel), and β=1 and γ=1 (the bottom left panel). (Right panels) Corresponding ordinal pattern probabilities as a function of τ, for synthetic time series representing one year of activity. Points represent the average of one hundred independent realizations, and error bars indicate one standard deviation. ν=6 for all cases.

Close modal

Low-frequency components can be characterized by analyzing the evolution of the ordinal pattern probability distribution as a function of τ. The right panels of Fig. 3 depict the evolution of the ordinal pattern probabilities of the corresponding model realizations shown on the left. In all the cases, the probabilities oscillate regularly with a period of 24 h. More specifically, for the triplet {0.7;0.5;0}, we obtain a daily oscillation of the probabilities (the top right panel), with a clustering of ordinal patterns into two groups for all temporal scales, i.e., p123=p321 and p132=p213=p231=p312. This clustered structure has been theoretically validated for Gaussian processes with stationary increments48 and also numerically and experimentally observed in noisy oscillations46 and real-world fluctuations.49 On the other hand, for the case of {0.7;0;0.5} and {0.7;1;1} (middle and bottom right panels, respectively), these two pattern probability clusters are broken. When compared with the hierarchical ordinal structures as a function of τ obtained for the real landing flows (Fig. 2), they present enough similarities to confirm that a good approximation of the ordinal pattern probability distribution of the long-term oscillations of the real landing flows can be obtained.

Once the model has been defined, the next logical step involves tuning it to retrieve the dynamics observed in each airport. We here propose to make use of the PJSD to estimate the set of parameters that better reproduce the ordinal hierarchy of real landing flows. This involves obtaining the set of parameters that minimize the PJSD between the model and the real data, with τ=1, i.e., defining an ensemble of parameter estimators {α^,β^,γ^}, as the set of values that minimize the PJSD,

{α^,β^,γ^}={α,β,γ:PJSD(PM,QC)is minimum},
(9)

where PM and QC are the ordinal pattern distributions for the model and the control sequence, respectively.

It has previously been shown that, from an ordinal pattern point of view, temporal correlations in fractional Gaussian noises are better quantified from the integrated fluctuations rather than using the fluctuations themselves,22,49 especially when crossovers between different scaling regimes are present.41 It should be added here that for integration of a sequence X(t) we mean its cumulative sum: tM(xtX). With this in mind, we have compared the minimization procedure of the PJSD when using the modulated fluctuation and its integration. To keep the comparison simple, we fix the parameters γ=0.5 and β=0.8 and minimize the PJSD between a control sequence characterized by αc=0.5 and the Markov-modulated model with α free. Observational noise has been added to the sequences to simulate the landing time uncertainty. These results are depicted in Fig. 4. We found that, when noisy fluctuation is considered, the value of α for which the PJSD reached a minimum is significantly smaller than αc (see the top panel in Fig. 4). This contrasts with the results obtained for the integrated sequences, for which a more robust identification of the temporal correlation is confirmed (see the bottom panel in Fig. 4). This analysis leads to conclude that the minimization procedure applied on the integrated fluctuations allows to obtain a better high-frequency optimization of the Markov-modulated model especially within noisy environments.

FIG. 4.

PJSD between one control realization with αc=0.5, βc=0.8, and γc=0.5, and the model (with βc, γc, and α free), using the fluctuation (the top panel) and its integration (the bottom panel). The noise level, NL, is defined as a multiple of the standard deviation of the originally added Markov noise. Data points correspond to the average of over one hundred independent realizations, and error bars to one standard deviation. ν=6 for all cases.

FIG. 4.

PJSD between one control realization with αc=0.5, βc=0.8, and γc=0.5, and the model (with βc, γc, and α free), using the fluctuation (the top panel) and its integration (the bottom panel). The noise level, NL, is defined as a multiple of the standard deviation of the originally added Markov noise. Data points correspond to the average of over one hundred independent realizations, and error bars to one standard deviation. ν=6 for all cases.

Close modal

To further illustrate the tuning procedure, we perform a minimization of the PJSD between a control sequence obtained with the model, with αc=βc=0.5 and γc=0.3; and sequences generated from the proposed model with the following ranges of parameters 0β1, 0γ1, and 0α<1. Taking into account the results obtained previously, this optimization analysis is performed directly on the integrated fluctuations. The evolution of the PJSD as a function of α for different values of the modulation parameters is depicted in Fig. 5. For the sake of clarity, we have depicted results for some selected pairs of values of β and γ. Moreover, a baseline, that takes into account finite-size and amplitude distribution effects,22 is established by estimating the PJSD between two independent realizations of the model. On the one hand, we found that β strongly affects the minimization, as opposed to γ, which has a much less noticeable effect. This is because γ only quantifies the stochastic fluctuation of the intra-day phase, with a minimal impact on the associated ordinal pattern probability distributions at τ=1. On the other hand, a global minimum is obtained for values of α and β near the control parameters αc and βc (see the solid black line). More specifically, the global minimum happens at α^=0.51±0.02, β^=0.52±0.04, and γ^=0.34±0.23. The large standard deviation of γ^ suggests that its estimation becomes irrelevant in this context. The minimum distance reaches the baseline range, indicating that the ordinal pattern probability distribution of the control sequence can accurately be reproduced by the proposed model.

FIG. 5.

PJSD between the Markov-modulated model with free parameters, and one control realization with αc=0.5, βc=0.5, γc=0.3, and ν=6. The analysis is performed on the integrated fluctuations and the average of over one hundred independent realizations is plotted. Solid and dashed gray lines indicate, respectively, the mean and ±1 standard deviation of the baseline obtained by estimating the PJSD between two independent realizations of the model.

FIG. 5.

PJSD between the Markov-modulated model with free parameters, and one control realization with αc=0.5, βc=0.5, γc=0.3, and ν=6. The analysis is performed on the integrated fluctuations and the average of over one hundred independent realizations is plotted. Solid and dashed gray lines indicate, respectively, the mean and ±1 standard deviation of the baseline obtained by estimating the PJSD between two independent realizations of the model.

Close modal

Moving to a deeper analysis, the real landing data have been used to tune the parameters α and β of the model; a different instance of the model has been considered for each airport, in order to recover the ordinal pattern probability distribution of the hourly evolution of the landing flow for each of them. Note that we use d=3 and τ=1 in this analysis, thus each ordinal pattern encodes temporal information about the landing flow throughout 3 h.

We first consider a complete year of operations, spanning between June 1st, 2018 and June 1st, 2019. The evolution of the PJSD between the integrated real and synthetic time series has been obtained, varying the parameters 0α<0.95, 0β1, and 1γ1, with a step of 0.05. Additional constants include c1=c2=1, ϕ1=ϕ2=π/2, δt=1 h, and ν being equal to the median of the inactivity intervals as per Table I—see also Table II for a synthesis. As an example, Fig. 6 reports the result for LIMC. As it has previously been observed for control sequences, for a given value of β, the stochastic parameter γ becomes irrelevant to estimate the temporal correlation, i.e., the behavior of the PJSD as a function of α is independent of γ for practical purposes (at least for D=3 and τ=1); its estimation has, thus, been discarded in what follows. The global minimum reached in this figure allows to estimate the optimal parameters for modeling the hourly landing flow of LIMC airport, namely, α^=0.55±0.01 and β^=0.52±0.05 (see the solid black line in Fig. 6). As a summary, Fig. 7 depicts the evolution of the PJSD as a function of α for all airports (all other parameters having already been optimized); for the sake of clarity, the top panel reports results for airports with one landing runway and the bottom panel for two runways. Deviations from the baseline reference are found; this is not much surprising, considering that the present model is a simple one based on a modulated linear noise and that a plethora of additional phenomena (e.g., weather, technical failures, and so forth) impact on real operations. Moreover, the unavoidable presence of observational noise tends to move the PJSD value at the minimum upwards, as it was numerically shown in Fig. 4.

FIG. 6.

PJSD between the integrated realization of the Markov-modulated model (ν=2 h) and the integrated hourly landing flow of the LIMC airport. Solid and dashed gray lines indicate, respectively, the mean and ±1 standard deviation of the baseline obtained by estimating the PJSD between two independent realizations of the model. Average of over one hundred independent realizations is plotted.

FIG. 6.

PJSD between the integrated realization of the Markov-modulated model (ν=2 h) and the integrated hourly landing flow of the LIMC airport. Solid and dashed gray lines indicate, respectively, the mean and ±1 standard deviation of the baseline obtained by estimating the PJSD between two independent realizations of the model. Average of over one hundred independent realizations is plotted.

Close modal
FIG. 7.

PJSD between integrated realizations of the Markov-modulated model (for ν see Table I) and the integrated landing flow for all airports. Solid and dashed gray lines indicate, respectively, the mean and ±1 standard deviation of the baseline obtained by estimating the PJSD between two independent realizations of the model. Average of over one hundred independent realizations is plotted.

FIG. 7.

PJSD between integrated realizations of the Markov-modulated model (for ν see Table I) and the integrated landing flow for all airports. Solid and dashed gray lines indicate, respectively, the mean and ±1 standard deviation of the baseline obtained by estimating the PJSD between two independent realizations of the model. Average of over one hundred independent realizations is plotted.

Close modal

Top and bottom left panels in Fig. 8, respectively, show the estimations of α^ and β^ for each airport. We observe no significant differences between the results of airports with one and two runways. In all cases, we found a medium to high degree of correlation, with LOWW being the airport with the largest α^=0.73±0.02 and EDDL being the one with the smallest α^=0.43±0.02. On the other hand, estimations of β^ are quite similar across airports, except for LIMC.

FIG. 8.

Average estimated values α^ (top panels) and β^ (bottom panels) for all airports considered in this study, for a one-year window pre- (left panels) and post- (right panels) COVID-19 pandemics. Blue bars correspond to airports with one landing runway, and red ones to airports with two landing runways.

FIG. 8.

Average estimated values α^ (top panels) and β^ (bottom panels) for all airports considered in this study, for a one-year window pre- (left panels) and post- (right panels) COVID-19 pandemics. Blue bars correspond to airports with one landing runway, and red ones to airports with two landing runways.

Close modal

In order to study the impact that the COVID-19 pandemic had on the dynamics of the landing flow, we have considered a second year window, spanning between June 1st, 2020 and June 1st, 2021. This, thus, includes the same months as the original one, taking seasonal effects into account and avoiding March and April 2020, which had a completely different dynamics and a major reduction in operations. The estimations of α^ and β^ for this period are, respectively, shown in the top and bottom right panels of Fig. 8. A significant decrease in the correlations is found in all cases; Brussels airport (EBBR) presents the most extreme one, with α^ dropping from 0.52 to 0. This implies a purely aleatory high-frequency dynamics. In the case of β^, we estimate heterogeneous values, as opposed to the results obtained for the pre-pandemic period; these differences will further be discussed and explained below.

As common with any synthetic model, a natural question that ought to be tackled is what share of the original dynamics is retained by the synthetic time series; or, in other words, if the Markov-modulated model here used is enough to represent the specificities of landing dynamics. We here transform this question in a classification problem, in which a Deep Learning model50 is used to identify time series belonging to a pair of airports. Specifically, in each classification task, two sets of time series are used as input—one set for each considered airport. The model is then asked to predict the airport corresponding to a new time series; the fraction of time this prediction is correct (also known as the accuracy) is then averaged and used as an indicator of the classification score. The underlying idea is that, if the classification score between two airports remains high when using the synthetic time series, we can then conclude that what makes each airport unique (or its identifiability) is also preserved and, hence, that the corresponding synthetic time series are a good representation of the real dynamics.

We resorted to a Residual Network (ResNet) Deep Learning model, i.e., an artificial neural network in which connections between layers are not sequential, but is instead characterized by the presence of links between two distant layers without involving the intervening ones.51,52 These layers are organized in blocks, each one composed of a convolutional layer, followed by a batch normalization and a rectifier linear unit. The final layer of each block is added to the input layer of the same. Finally, the output layer is again a fully connected layer with a softmax activation. This model has been chosen for its high performance in many real-world problems.52–54 

As a first analysis, the left blue violin plot of Fig. 9 reports the distribution of the score obtained by classifying the real landing flow time series—values correspond to all airport pairs, and 10 realizations of each classification task. It can be appreciated that the mode of the score (represented by the white circle) is very close to 1 and, thus, that the ResNet model is able to correctly identify the source of the time series almost all the times. Second, the middle green violin plot represents the same distribution when only using synthetic time series. In this latter case, the score is even higher, suggesting that the model creates time series that are highly unique, hence distinguishable and identifiable, for each airport. Finally, the latter violin plot represents the score when the ResNet model is trained using the real time series, but then evaluated on the synthetic ones. While the median of the score substantially drops, it is still above 85%. This indicates that, while part of the information is lost, a great share of what makes each airport unique is retained in the synthetic time series and, thus, that these still represent the essential elements of each airport’s dynamics.

FIG. 9.

Distributions of the scores obtained in classification tasks executed over sets of time series representing the dynamics of pairs of airports, using a Residual Network Deep Learning model—see the main text for details. From left to right, the three violin plots correspond to: the classification of the real time series; the classification of the time series yielded by the model; and tasks in which the model is trained with the real data, but validated using the synthetic ones. White dots represent the median of the distribution; black vertical bars the 2575 percentiles.

FIG. 9.

Distributions of the scores obtained in classification tasks executed over sets of time series representing the dynamics of pairs of airports, using a Residual Network Deep Learning model—see the main text for details. From left to right, the three violin plots correspond to: the classification of the real time series; the classification of the time series yielded by the model; and tasks in which the model is trained with the real data, but validated using the synthetic ones. White dots represent the median of the distribution; black vertical bars the 2575 percentiles.

Close modal

Due to the very nature of the ADS-B technology used to reconstruct landing events, flights may be missing from the data set—as, e.g., a receiver may not be online all the time, may have a bad reception, and can thus miss some position reports, or technical problems may prevent a correct integration of the information. Due to such potential incompleteness, we here propose a numerical experiment to evaluate the impact of missing flights in the estimation of short-range correlations.

Specifically, starting with the real time series corresponding to each airport, a fraction p of landing events have been randomly deleted, for then estimating the new correlation α^. The evolution of the new α^ as a function of p is shown in top and middle panels in Fig. 10. As may be expected, the former decreases with the latter, yet the decay of α^ is quite slow. Due to the sampling temporal window of δt=1 h, a large p is needed to break the ordinal ranking of the 3-h patterns (D=3) and, hence, to significantly disrupt the dynamics. As might be expected, airports with less traffic volume show a slightly faster decay of the correlation, such as EDDL (represented by the red open square in the top panel of Fig. 10).

FIG. 10.

Correlation parameter α^ as a function of the percentage of missing flights for airports with one and two landing runways, top and middle panels, respectively. Bottom panel: α^ estimated from the post-pandemic period vs α^ estimated in the pre-pandemic period but with adjusted traffic. Values correspond to the average of one hundred independent realizations, and error bars indicate one standard deviation.

FIG. 10.

Correlation parameter α^ as a function of the percentage of missing flights for airports with one and two landing runways, top and middle panels, respectively. Bottom panel: α^ estimated from the post-pandemic period vs α^ estimated in the pre-pandemic period but with adjusted traffic. Values correspond to the average of one hundred independent realizations, and error bars indicate one standard deviation.

Close modal

A natural question that could be posed involves the nature (and causes) of the change in dynamics seen after the COVID-19 pandemic, specifically in Fig. 8. It is well known that traffic was substantially reduced even one year after the pandemics, mainly due to the restrictions enforced on international mobility. As seen above, this can result in a decrease of α^, yet other factors can also have contributed.

To answer this question, we performed an additional numerical experiment, comparing the correlations after COVID-19 with those obtained from the pre-pandemic time series, with the latter ones being adjusted to include a similar number of operations; in other words, landing events in the pre-pandemic period have been randomly deleted to achieve the same traffic volume observed in the post-pandemic period. The bottom panel of Fig. 10 depicts the scatterplot of α^ estimated in the post-pandemic period as a function of the estimated α^ for the pre-pandemic period with adjusted traffic. It is observed that the correlations after COVID-19 are considerably smaller. This suggests that the increase in the randomness observed after COVID-19 is not only due to a reduction in traffic; or at least that the correlations reduced more than what would be expected if interactions between aircraft would have been maintained irrespectively of the traffic volume.

Lastly, one of the most relevant parameters that can be estimated is the mean lifetime θ. This can be interpreted as the mean duration of the dissipation of the airport landing events or as how long do perturbations propagate in landing operations. This parameter can directly be estimated from the correlation parameter α^ by using Eq. (6). Figure 11 shows the mean lifetime as a function of the median of the hourly volume for all airports, considering both pre- (top panel) and post- (bottom panel) pandemic data. A non-trivial correlation between θ and the traffic volume can be observed. Additionally, the slope is larger (i.e., θ increases faster with increasing traffic) in the pre-pandemic period; this suggests that airports were closer to a saturated dynamics, in which perturbations were difficult to dissipate and could hence propagate for a long time. The implication of these results will be discussed in Sec. VI.

FIG. 11.

Mean lifetime θ as a function of the median of the landing volume per hour, for pre- and post-COVID-19 periods, respectively, top and bottom panels.

FIG. 11.

Mean lifetime θ as a function of the median of the landing volume per hour, for pre- and post-COVID-19 periods, respectively, top and bottom panels.

Close modal

In this contribution, we have presented the possibilities offered by the use of a Markov-modulated model to study the dynamics of landing events at an airport. Such model is extremely simple and effectively only depends on two parameters (α and β). Additionally, the tuning of those parameters has been aimed at reproducing the structure of permutation patterns observed in the real data—as opposed to a minimization of an amplitude-based distance metric. In spite of these simplifications, the time series synthesized by the model reproduces quite well the real dynamics, as demonstrated through a Deep Learning task—see Fig. 9. Most notably, the model can then be used to extract an estimation of the mean lifetime θ for each airport and to compare it in different conditions—e.g., before and after the COVID-19 pandemic, as shown in Fig. 11.

The parameter θ represents the average duration of correlations between landing operations; or, in other words, the time scale over which landing aircraft can influence each other. This represents a well known dynamics in air traffic control; due to the limited capacity of airports, an external event (e.g., adverse weather) may force a set of aircraft to delay their landing, in turn forcing later flights to also delay their landings in a cascade effect. In spite of the conceptual simplicity, the detection of these cascades is not a trivial task, as many other factors (e.g., the capacity of nearby airspaces) may also intervene. This contribution shows how the cascade effect can be detected by relying on a tailored model and on statistical physics concepts; and additionally, how information about the micro-scale interactions between aircraft can be extracted from macro-scale observables.

Focusing on θ, a general correlation between this and the traffic volume is observed. This is to be expected, as landing aircraft can interact only in a congested environment, i.e., when the availability of the landing runway is not guaranteed. The fact that such relation is not perfect is also to be expected, as many factors influence the capacity of a runway—as, for instance, the separation required to avoid wake vortex turbulences between consecutive landing aircraft depends on their relative size and wind speed and direction. The comparison of the θ obtained for two different airports should, thus, be performed with due care. Still, it stands to reason to expect a non-linear behavior of θ as a function of the traffic volume, for instance, a supra-linear increase. This can easily be visualized by considering the extreme situation of traffic volumes approaching the maximum landing capacity: perturbation may propagate for an infinite amount of time and, hence, θ.

Provided the capacity of a given airport remains constant, the proposed approach could be used as a metric for assessing the evolution of its efficiency, the latter understood as the capacity of handling a given volume of traffic while generating the minimum amount of interactions between aircraft. For instance, θ could be estimated in one-week windows; if the obtained value substantially deviates from what is observed in other windows with a similar traffic volume, it can then be concluded that operations were disrupted and that a deeper analysis may be required. It is yet important to highlight that a comparison between two θs can only be performed caeteris paribus, as otherwise an increase in the value of the mean lifetime of perturbations does not imply a reduction of efficiency stricto sensu. To illustrate, one may conclude that the most efficient airport is one where no aircraft lands such that no interactions can propagate and θ=0; while true from a numerical perspective, such airport would make no operational sense and would not be economically efficient or socially useful.

Several additional aspects will have to be studied, before the idea here proposed could be deployed in an operational context. First, we have here considered 1 h windows, as this is the standard to define the capacity of airports—in spite of alternative solutions having been proposed decades ago.55 Other window lengths could nevertheless be tested; and it could even be hypothesized that such length should be tuned for each airport, to account for the different time separations at landing—due, e.g., to different baseline traffic volumes. Using shorter time windows would also increase the quantity of available data for each day, hence improving the tuning process. At the same time, it is not clear how the estimation of the parameters of the model is affected by the temporal resolution of the data; this could be relevant if a real-time solution is to be achieved. Finally, the whole solution must be validated, possibly relying on the feedback of expert users and airport managers.

In conclusion, while this contribution only proposes a first example, it also demonstrates the possibilities offered by an analysis of macro-scale aeronautical data, and the information about the micro-scale dynamics that statistical physics allows to extract from them.

This project has received funding from the European Research Council (ERC) under the European Union’s Horizon 2020 Research and Innovation Programme (Grant Agreement No. 851255). M.Z. and F.O. acknowledge the Spanish State Research Agency through María de Maeztu Project No. CEX2021-001164-M funded by MCIN/AEI/10.13039/501100011033. L.Z. gratefully acknowledges financial support from Consejo Nacional de Investigaciones Científicas y Técnicas (CONICET), Argentina.

The authors have no conflicts to disclose.

F. Olivares: Conceptualization (equal); Formal analysis (equal); Investigation (equal); Methodology (equal); Writing – original draft (equal); Writing – review & editing (equal). L. Zunino: Conceptualization (equal); Investigation (equal); Methodology (equal); Writing – review & editing (equal). M. Zanin: Conceptualization (equal); Formal analysis (equal); Investigation (equal); Methodology (equal); Writing – original draft (equal); Writing – review & editing (equal).

The data that support the findings of this study are available from the corresponding author upon reasonable request.

1.
G. B.
Goh
,
N. O.
Hodas
, and
A.
Vishnu
, “
Deep learning for computational chemistry
,”
J. Comput. Chem.
38
,
1291
1307
(
2017
).
2.
T.
Ching
,
D. S.
Himmelstein
,
B. K.
Beaulieu-Jones
,
A. A.
Kalinin
,
B. T.
Do
,
G. P.
Way
,
E.
Ferrero
,
P.-M.
Agapow
,
M.
Zietz
,
M. M.
Hoffman
, and
W.
Xie
, “
Opportunities and obstacles for deep learning in biology and medicine
,”
J. R. Soc. Interface
15
,
20170387
(
2018
).
3.
A.
Tanaka
,
A.
Tomiya
, and
K.
Hashimoto
,
Deep Learning and Physics
(
Springer
,
2021
).
4.
X.
Li
,
H.
Xiong
,
X.
Li
,
X.
Wu
,
X.
Zhang
,
J.
Liu
,
J.
Bian
, and
D.
Dou
, “
Interpretable deep learning: Interpretation, interpretability, trustworthiness, and beyond
,”
Knowl. Inf. Syst.
64
,
3197
3234
(
2022
).
5.
A.
Murschel
, “
The structure and function of Ptolemy’s physical hypotheses of planetary motion
,”
J. Hist. Astron.
26
,
33
61
(
1995
).
6.
E. M.
Blanter
,
M. G.
Shnirman
, and
J.-L.
Le Mouël
, “
Solar variability: Evolution of correlation properties
,”
J. Atmos. Sol.-Terr. Phys.
67
,
521
534
(
2005
).
7.
C.
Crouzeix
,
J.-L.
Le Mouël
,
F.
Perrier
,
M. G.
Shnirman
, and
E. M.
Blanter
, “
Long-term persistence of the spatial organization of temperature fluctuation lifetime in turbulent air avalanches
,”
Phys. Rev. E
74
,
036308
(
2006
).
8.
A.
Cook
,
H. A. P.
Blom
,
F.
Lillo
,
R. N.
Mantegna
,
S.
Micciche
,
D.
Rivas
,
R.
Vázquez
, and
M.
Zanin
, “
Applying complexity science to air traffic management
,”
J. Air Transp. Manag.
42
,
149
158
(
2015
).
9.
A. M.
Bayen
,
R. L.
Raffard
, and
C. J.
Tomlin
, “
Adjoint-based control of a new Eulerian network model of air traffic flow
,”
IEEE Trans. Control Syst. Technol.
14
,
804
818
(
2006
).
10.
H.
Zhang
,
L.
Yang
,
Y.
Bie
, and
S.
Yin
, “
Analysis on generalized following behavior and complex phase-transition law of approaching traffic flow in terminal airspace
,”
Acta Aeronaut. Astronaut. Sin.
36
,
949
961
(
2015
).
11.
H.
Zhang
,
W.
Fan
,
Z.
Liao
, and
J.
Jiang
, “
Impacts of parallel runway operation modes on air traffic flow characteristics in terminal areas
,”
J. Transp. Syst. Eng. Inf. Technol.
17
,
198
204
(
2017
).
12.
P. K.
Menon
,
G. D.
Sweriduk
,
T.
Lam
,
G. M.
Diaz
, and
K. D.
Bilimoria
, “
Computer-aided Eulerian air traffic flow modeling and predictive control
,”
J. Guid. Control Dyn.
29
,
12
19
(
2006
).
13.
L.
Yang
,
S.
Yin
,
K.
Han
,
J.
Haddad
, and
M.
Hu
, “
Fundamental diagrams of airport surface traffic: Models and applications
,”
Transp. Res. B: Methodol.
106
,
29
51
(
2017
).
14.
P.
Wei
,
Y.
Cao
, and
D.
Sun
, “
Total unimodularity and decomposition method for large-scale air traffic cell transmission model
,”
Transp. Res. B: Methodol.
53
,
1
16
(
2013
).
15.
X.
Zhang
,
H.
Liu
,
Y.
Zhao
, and
X.
Zhang
, “
Multifractal detrended fluctuation analysis on air traffic flow time series: A single airport case
,”
Phys. A: Stat. Mech. Appl.
531
,
121790
(
2019
).
16.
H.
Liu
,
X.
Zhang
, and
X.
Zhang
, “
Multiscale complexity analysis on airport air traffic flow volume time series
,”
Phys. A: Stat. Mech. Appl.
548
,
124485
(
2020
).
17.
H.
Liu
,
X.
Zhang
, and
X.
Zhang
, “
Exploring dynamic evolution and fluctuation characteristics of air traffic flow volume time series: A single waypoint case
,”
Phys. A: Stat. Mech. Appl.
503
,
560
571
(
2018
).
18.
S.
Li
,
C.
Wang
, and
J.
Wang
, “
Exploring dynamic characteristics of multi-state air traffic flow: A time series approach
,”
IEEE Access
8
,
64565
64577
(
2020
).
19.
M.
Zanin
, “
Assessing time series irreversibility through micro-scale trends
,”
Chaos
31
,
103118
(
2021
).
20.
C.
Bandt
and
B.
Pompe
, “
Permutation entropy: A natural complexity measure for time series
,”
Phys. Rev. Lett.
88
,
174102
(
2002
).
21.
I.
Leyva
,
J. H.
Martínez
,
C.
Masoller
,
O. A.
Rosso
, and
M.
Zanin
, “
20 years of ordinal patterns: Perspectives and challenges
,”
Europhys. Lett.
138
,
31001
(
2022
).
22.
L.
Zunino
,
F.
Olivares
,
H. V.
Ribeiro
, and
O. A.
Rosso
, “
Permutation Jensen-Shannon distance: A versatile and fast symbolic tool for complex time-series analysis
,”
Phys. Rev. E
105
,
045310
(
2022
).
23.
M.
Zanin
, “
Forbidden patterns in financial time series
,”
Chaos
18
,
013119
(
2008
).
24.
J. H.
Martínez
,
J. L.
Herrera-Diestra
, and
M.
Chavez
, “
Detection of time reversibility in time series by ordinal patterns analysis
,”
Chaos
28
,
123111
(
2018
).
25.
M.
McCullough
,
M.
Small
,
T.
Stemler
, and
H. H.-C.
Iu
, “
Time lagged ordinal partition networks for capturing dynamics of continuous dynamical systems
,”
Chaos
25
,
053101
(
2015
).
26.
M.
McCullough
,
K.
Sakellariou
,
T.
Stemler
, and
M.
Small
, “
Counting forbidden patterns in irregularly sampled time series. I. The effects of under-sampling, random depletion, and timing jitter
,”
Chaos
26
,
123103
(
2016
).
27.
M.
McCullough
,
K.
Sakellariou
,
T.
Stemler
, and
M.
Small
, “
Regenerating time series from ordinal networks
,”
Chaos
27
,
035814
(
2017
).
28.
A. F.
Bariviera
,
L.
Zunino
, and
O. A.
Rosso
, “
An analysis of high-frequency cryptocurrencies prices dynamics using permutation-information-theory quantifiers
,”
Chaos
28
,
075511
(
2018
).
29.
K.
Sakellariou
,
M.
McCullough
,
T.
Stemler
, and
M.
Small
, “
Counting forbidden patterns in irregularly sampled time series. II. Reliability in the presence of highly irregular sampling
,”
Chaos
26
,
123104
(
2016
).
30.
C. W.
Kulp
,
J. M.
Chobot
,
B. J.
Niskala
, and
C. J.
Needhammer
, “
Using forbidden ordinal patterns to detect determinism in irregularly sampled time series
,”
Chaos
26
,
023107
(
2016
).
31.
C. W.
Kulp
and
L.
Zunino
, “
Discriminating chaotic and stochastic dynamics through the permutation spectrum test
,”
Chaos
24
,
033116
(
2014
).
32.
C.
Quintero-Quiroz
,
L.
Montesano
,
A. J.
Pons
,
M. C.
Torrent
,
J.
García-Ojalvo
, and
C.
Masoller
, “
Differentiating resting brain states using ordinal symbolic analysis
,”
Chaos
28
,
106307
(
2018
).
33.
A. M.
Yamashita Rios de Sousa
and
J.
Hlinka
, “
Assessing serial dependence in ordinal patterns processes using chi-squared tests with application to EEG data analysis
,”
Chaos
32
,
073126
(
2022
).
34.
M.
Barreiro
,
A. C.
Marti
, and
C.
Masoller
, “
Inferring long memory processes in the climate network via ordinal pattern analysis
,”
Chaos
21
,
013101
(
2011
).
35.
F.
Olivares
,
M.
Zanin
,
L.
Zunino
, and
D. G.
Pérez
, “
Contrasting chaotic with stochastic dynamics via ordinal transition networks
,”
Chaos
30
,
063101
(
2020
).
36.
X.
Sun
,
M.
Small
,
Y.
Zhao
, and
X.
Xue
, “
Characterizing system dynamics with a weighted and directed network constructed from time series data
,”
Chaos
24
,
024402
(
2014
).
37.
D.
Cuesta-Frau
,
M.
Varela-Entrecanales
,
A.
Molina-Picó
, and
B.
Vargas
, “
Patterns with equal values in permutation entropy: Do they really matter for biosignal classification?
,”
Complexity
2018
,
1324696
(
2018
).
38.
L.
Zunino
,
M. C.
Soriano
,
I.
Fischer
,
O. A.
Rosso
, and
C. R.
Mirasso
, “
Permutation-information-theory approach to unveil delay dynamics from time-series analysis
,”
Phys. Rev. E
82
,
046212
(
2010
).
39.
M. C.
Soriano
,
L.
Zunino
,
L.
Larger
,
I.
Fischer
, and
C. R.
Mirasso
, “
Distinguishing fingerprints of hyperchaotic and stochastic dynamics in optical chaos from a delayed optoelectronic oscillator
,”
Opt. Lett.
36
,
2212
2214
(
2011
).
40.
L.
Zunino
,
M. C.
Soriano
, and
O. A.
Rosso
, “
Distinguishing chaotic and stochastic dynamics from time series by using a multiscale symbolic approach
,”
Phys. Rev. E
86
,
046210
(
2012
).
41.
F.
Olivares
and
L.
Zunino
, “
Multiscale dynamics under the lens of permutation entropy
,”
Phys. A: Stat. Mech. Appl.
559
,
125081
(
2020
).
42.
J.
Lin
, “
Divergence measures based on the Shannon entropy
,”
IEEE Trans. Inf. Theory
37
,
145
151
(
1991
).
43.
M.
Schäfer
,
M.
Strohmeier
,
V.
Lenders
,
I.
Martinovic
, and
M.
Wilhelm
, “Bringing up Opensky: A large-scale ADS-B sensor network for research,” in IPSN-14 Proceedings of the 13th International Symposium on Information Processing in Sensor Networks (IEEE, 2014), pp. 83–94.
44.
G.
Williams
, “
GPS for the sky: A survey of Automatic Dependent Surveillance-Broadcast (ADS-B) and its implementation in the United States
,”
J. Air Law Commer.
74
,
473
(
2009
).
45.
R.
Salcido
,
A.
Kendall
, and
Y.
Zhao
, “Analysis of Automatic Dependent Surveillance-Broadcast data,” in 2017 AAAI Fall Symposium Series (AAAI Press, 2017).
46.
L.
Carpi
and
C.
Masoller
, “
Persistence and stochastic periodicity in the intensity dynamics of a fiber laser during the transition to optical turbulence
,”
Phys. Rev. A
97
,
023842
(
2018
).
47.
E. M.
Blanter
,
J.-L. L.
Mouël
,
F.
Perrier
, and
M.
Shnirman
, “
Short-term correlation of solar activity and sunspot: Evidence of lifetime increase
,”
Sol. Phys.
237
,
329
350
(
2006
).
48.
C.
Bandt
and
F.
Shiha
, “
Order patterns in time series
,”
J. Time Ser. Anal.
28
,
646
665
(
2007
).
49.
F.
Olivares
,
L.
Zunino
, and
O. A.
Rosso
, “
Quantifying long-range correlations with a multiscale ordinal pattern approach
,”
Phys. A: Stat. Mech. Appl.
445
,
283
294
(
2016
).
50.
Y.
LeCun
,
Y.
Bengio
, and
G.
Hinton
, “
Deep learning
,”
Nature
521
,
436
444
(
2015
).
51.
K.
He
,
X.
Zhang
,
S.
Ren
, and
J.
Sun
, “Deep residual learning for image recognition,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (IEEE Computer Society, 2016), pp. 770–778.
52.
Z.
Wang
,
W.
Yan
, and
T.
Oates
, “Time series classification from scratch with deep neural networks: A strong baseline,” in 2017 International Joint Conference on Neural Networks (IJCNN) (IEEE, 2017), pp. 1578–1585.
53.
M.
Zanin
, “
Can deep learning distinguish chaos from noise? Numerical experiments and general considerations
,”
Commun. Nonlinear Sci. Numer. Simul.
114
,
106708
(
2022
).
54.
I.
Ivanoska
,
L.
Pastorino
, and
M.
Zanin
, “
Assessing identifiability in airport delay propagation roles through deep learning classification
,”
IEEE Access
10
,
28520
28534
(
2022
).
55.
E. P.
Gilbo
, “
Airport capacity: Representation, estimation, optimization
,”
IEEE Trans. Control Syst. Technol.
1
,
144
154
(
1993
).