Spatiotemporal forecasting in various domains, like traffic prediction and weather forecasting, is a challenging endeavor, primarily due to the difficulties in modeling propagation dynamics and capturing high-dimensional interactions among nodes. Despite the significant strides made by graph-based networks in spatiotemporal forecasting, there remain two pivotal factors closely related to forecasting performance that need further consideration: time delays in propagation dynamics and multi-scale high-dimensional interactions. In this work, we present a Series-Aligned Multi-Scale Graph Learning (SAMSGL) framework, aiming to enhance forecasting performance. In order to handle time delays in spatial interactions, we propose a series-aligned graph convolution layer to facilitate the aggregation of non-delayed graph signals, thereby mitigating the influence of time delays for the improvement in accuracy. To understand global and local spatiotemporal interactions, we develop a spatiotemporal architecture via multi-scale graph learning, which encompasses two essential components: multi-scale graph structure learning and graph-fully connected (Graph-FC) blocks. The multi-scale graph structure learning includes a global graph structure to learn both delayed and non-delayed node embeddings, as well as a local one to learn node variations influenced by neighboring factors. The Graph-FC blocks synergistically fuse spatial and temporal information to boost prediction accuracy. To evaluate the performance of SAMSGL, we conduct experiments on meteorological and traffic forecasting datasets, which demonstrate its effectiveness and superiority.
REFERENCES
1.
T.
Liu
, X.
Zhao
, P.
Sun
, and J.
Zhou
, “A hybrid proper orthogonal decomposition and next generation reservoir computing approach for high-dimensional chaotic prediction: Application to flow-induced vibration of tube bundles
,” Chaos
34
, 033125
(2024
). 2.
X.
Wang
, J.
Feng
, Y.
Xu
, and J.
Kurths
, “Deep learning-based state prediction of the Lorenz system with control parameters
,” Chaos
34
, 033108
(2024
). 3.
A.
Aksoy
, “A Monte Carlo approach to understanding the impacts of initial-condition uncertainty, model uncertainty, and simulation variability on the predictability of chaotic systems: Perspectives from the one-dimensional logistic map
,” Chaos
34
, 011102
(2024
). 4.
Y.
Kwon
, J.-H.
Jung
, and Y.-H.
Eom
, “Global efficiency and network structure of urban traffic flows: A percolation-based empirical analysis
,” Chaos
33
, 113104
(2023
). 5.
H.
Wu
, H.
Zhou
, M.
Long
, and J.
Wang
, “Interpretable weather forecasting for worldwide stations with a unified deep model
,” Nat. Mach. Intell.
5
, 602
–611
(2023
). 6.
S.
Cheng
, Y.
Guo
, and R.
Arcucci
, “A generative model for surrogates of spatial-temporal wildfire nowcasting
,” IEEE Trans. Emerging Top. Comput. Intell.
7
, 1420
–1430
(2023
). 7.
M.
Titz
, F.
Kaiser
, J.
Kruse
, and D.
Witthaut
, “Predicting dynamic stability from static features in power grid models using machine learning
,” Chaos
34
, 013139
(2024
). 8.
L.
Xiong
, Y.
Tang
, S.
Mao
, H.
Liu
, K.
Meng
, Z.
Dong
, and F.
Qian
, “A two-level energy management strategy for multi-microgrid systems with interval prediction and reinforcement learning
,” IEEE Trans. Circuits Syst. I
69
, 1788
–1799
(2022
). 9.
E.
Macioszek
and A.
Kurek
, “Road traffic distribution on public holidays and workdays on selected road transport network elements
,” Transp. Probl.
16
, 127
(2021
). 10.
N.
Boers
, B.
Goswami
, A.
Rheinwalt
, B.
Bookhagen
, B.
Hoskins
, and J.
Kurths
, “Complex networks reveal global pattern of extreme-rainfall teleconnections
,” Nature
566
, 373
–377
(2019
). 11.
Y.
Tang
, J.
Kurths
, W.
Lin
, E.
Ott
, and L.
Kocarev
, “Introduction to focus issue: When machine learning meets complex systems: Networks, chaos, and nonlinear dynamics
,” Chaos
30
, 063151
(2020
). 12.
P.
Ji
, J.
Ye
, Y.
Mu
, W.
Lin
, Y.
Tian
, C.
Hens
, M.
Perc
, Y.
Tang
, J.
Sun
, and J.
Kurths
, “Signal propagation in complex networks
,” Phys. Rep.
1017
, 1
–96
(2023
). 13.
C.
Chen
, K.
Petty
, A.
Skabardonis
, P.
Varaiya
, and Z.
Jia
, “Freeway performance measurement system: Mining loop detector data
,” Transp. Res. Rec.
1748
, 96
–102
(2001
). 14.
R.
Lam
, A.
Sanchez-Gonzalez
, M.
Willson
, P.
Wirnsberger
, M.
Fortunato
, F.
Alet
, S.
Ravuri
, T.
Ewalds
, Z.
Eaton-Rosen
, W.
Hu
, A.
Merose
, S.
Hoyer
, G.
Holland
, O.
Vinyals
, J.
Stott
, A.
Pritzel
, S.
Mohamed
, and P.
Battaglia
, “Learning skillful medium-range global weather forecasting
,” Science
382
, 1416
–1421
(2023
). 15.
T. N.
Kipf
and M.
Welling
, “Semi-supervised classification with graph convolutional networks,” in Proceedings of the 5th International Conference on Learning Representations (ICLR, 2017).16.
M.
Li
and Z.
Zhu
, “Spatial-temporal fusion graph neural networks for traffic flow forecasting,” in Proceedings of the AAAI Conference on Artificial Intelligence (AAAI Press, 2021), Vol. 35, pp. 4189–4196.17.
H.
Yu
, T.
Li
, W.
Yu
, J.
Li
, Y.
Huang
, L.
Wang
, and A.
Liu
, “Regularized graph structure learning with semantic knowledge for multi-variates time-series forecasting,” in Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence, IJCAI-22 (International Joint Conferences on Artificial Intelligence Organization, 2022), pp. 2362–2368.18.
W.
Shao
, Z.
Jin
, S.
Wang
, Y.
Kang
, X.
Xiao
, H.
Menouar
, Z.
Zhang
, J.
Zhang
, and F.
Salim
, “Long-term spatio-temporal forecasting via dynamic multiple-graph attention,” in Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence, IJCAI-22 (International Joint Conferences on Artificial Intelligence Organization, 2022), pp. 2225–2232.19.
L.
Bai
, L.
Yao
, C.
Li
, X.
Wang
, and C.
Wang
, “Adaptive graph convolutional recurrent network for traffic forecasting,” in Advances in Neural Information Processing Systems (Curran Associates, Inc., 2020), Vol. 33, pp. 17804–17815.20.
R.
Jiang
, Z.
Wang
, J.
Yong
, P.
Jeph
, Q.
Chen
, Y.
Kobayashi
, X.
Song
, S.
Fukushima
, and T.
Suzumura
, “Spatio-temporal meta-graph learning for traffic forecasting,” in Proceedings of the AAAI Conference on Artificial Intelligence (AAAI Press, 2023), Vol. 37, pp. 8078–8086.21.
S.
Guo
, Y.
Lin
, N.
Feng
, C.
Song
, and H.
Wan
, “Attention based spatial-temporal graph convolutional networks for traffic flow forecasting,” in Proceedings of the AAAI Conference on Artificial Intelligence (AAAI Press, 2019), Vol. 33, pp. 922–929.22.
R.
Li
, F.
Zhang
, T.
Li
, N.
Zhang
, and T.
Zhang
, “DMGAN: Dynamic multi-hop graph attention network for traffic forecasting
,” IEEE Trans. Knowl. Data Eng.
9088
, 9101
(2022
).23.
J.
Bruna
, W.
Zaremba
, A.
Szlam
, and Y.
LeCun
, “Spectral networks and deep locally connected networks on graphs,” in Proceedings of the 2nd International Conference on Learning Representations (ICLR, 2014).24.
M.
Defferrard
, X.
Bresson
, and P.
Vandergheynst
, “Convolutional neural networks on graphs with fast localized spectral filtering,” in Proceedings of the 30th International Conference on Neural Information Processing Systems (Curran Associates, Inc., 2016), Vol. 29, pp. 3844–3852.25.
M.
Ju
, S.
Hou
, Y.
Fan
, J.
Zhao
, Y.
Ye
, and L.
Zhao
, “Adaptive kernel graph neural network,” in Proceedings of the AAAI Conference on Artificial Intelligence (AAAI Press, 2022), Vol. 36, pp. 7051–7058.26.
K.
Guo
, K.
Zhou
, X.
Hu
, Y.
Li
, Y.
Chang
, and X.
Wang
, “Orthogonal graph neural networks,” in Proceedings of the AAAI Conference on Artificial Intelligence (AAAI Press, 2022), Vol. 36, pp. 3996–4004.27.
B.
Jiang
, L.
Wang
, J.
Cheng
, J.
Tang
, and B.
Luo
, “Gpens: Graph data learning with graph propagation-embedding networks
,” IEEE Trans. Neural Networks Learn. Syst.
34
, 3925
–3938
(2023
). 28.
T.
Zhang
, Q.
Wu
, and J.
Yan
, “Learning high-order graph convolutional networks via adaptive layerwise aggregation combination
,” IEEE Trans. Neural Networks Learn. Syst.
34
, 5144
–5155
(2023
). 29.
K.
Bose
and S.
Das
, “Can graph neural networks go deeper without over-smoothing? yes, with a randomized path exploration!
,” IEEE Trans. Emerging Top. Comput. Intell.
1595
, 1604
(2023
).30.
R.
Sawhney
, S.
Agarwal
, A.
Wadhwa
, and R.
Shah
, “Exploring the scale-free nature of stock markets: Hyperbolic graph learning for algorithmic trading,” in Proceedings of the Web Conference (IEEE, 2021), pp. 11–22.31.
W.
Guo
, X.
Sun
, D.
Lv
, W.
Ma
, W.
Niu
, Z.
Gao
, and Y.
Wang
, “Motion states identification of underwater glider based on complex networks and graph convolutional networks
,” Chaos
34
, 023108
(2024
). 32.
X.
Ta
, Z.
Liu
, X.
Hu
, L.
Yu
, L.
Sun
, and B.
Du
, “Adaptive spatio-temporal graph neural network for traffic forecasting
,” Knowl.-Based Syst.
242
, 108199
(2022
). 33.
Y.
Chen
, L.
Wu
, and M.
Zaki
, “Iterative deep graph learning for graph neural networks: Better and robust node embeddings,” in Advances in Neural Information Processing Systems (Curran Associates, Inc., 2020), Vol. 33, pp. 19314–19326.34.
Z.
Zhang
, Y.
Chen
, D.
Zhang
, Y.
Qian
, and H.
Wang
, “CTFNet: Long-sequence time-series forecasting based on convolution and time–frequency analysis
,” IEEE Trans. Neural Networks Learn. Syst.
(published online).35.
L.
Feng
, T.
Gao
, W.
Xiao
, and J.
Duan
, “Early warning indicators via latent stochastic dynamical systems
,” Chaos
34
, 031101
(2024
). 36.
S.
Kothapalli
and S.
Totad
, “A real-time weather forecasting and analysis,” in 2017 IEEE International Conference on Power, Control, Signals and Instrumentation Engineering (IEEE, 2017), pp. 1567–1570.37.
H.
Shao
and B.-H.
Soong
, “Traffic flow prediction with long short-term memory networks (LSTMs),” in IEEE Region 10 Conference (IEEE, 2016), pp. 2986–2989.38.
A.
Rebei
, M.
Amayri
, and N.
Bouguila
, “FSNet: A hybrid model for seasonal forecasting
,” IEEE Trans. Emerging Top. Comput. Intell.
1167
, 1180
(2023
).39.
S.
Jiang
, Z.-G.
Yu
, V. V.
Anh
, T.
Lee
, and Y.
Zhou
, “An ensemble multi-scale framework for long-term forecasting of air quality
,” Chaos
34
, 013110
(2024
). 40.
H.
Wu
, T.
Hu
, Y.
Liu
, H.
Zhou
, J.
Wang
, and M.
Long
, “TimesNet: Temporal 2D-variation modeling for general time series analysis,” in Proceedings of the Eleventh International Conference on Learning Representations (ICLR, 2022).41.
Y.
Zhang
and J.
Yan
, “Crossformer: Transformer utilizing cross-dimension dependency for multivariate time series forecasting,” in Proceedings of the Eleventh International Conference on Learning Representations (ICLR, 2022).42.
R.-G.
Cirstea
, C.
Guo
, B.
Yang
, T.
Kieu
, X.
Dong
, and S.
Pan
, “Triformer: Triangular, variable-specific attentions for long sequence multivariate time series forecasting—Full version,” arXiv:2204.13767 (2022).43.
J.
Jiang
, C.
Han
, W. X.
Zhao
, and J.
Wang
, “PDFormer: Propagation delay-aware dynamic long-range transformer for traffic flow prediction,” in Proceedings of the AAAI Conference on Artificial Intelligence (AAAI Press, 2023), Vol. 37, pp. 4365–4373.44.
Y.
Zou
, H.
Zhang
, H.
Wang
, and J.
Hu
, “Predicting Braess’s paradox of power grids using graph neural networks
,” Chaos
34
, 013127
(2024
). 45.
C.
Nauck
, M.
Lindner
, K.
Schürholt
, and F.
Hellmann
, “Toward dynamic stability assessment of power grid topologies using graph neural networks
,” Chaos
33
, 103103
(2023
). 46.
L.
Zhao
, Y.
Song
, C.
Zhang
, Y.
Liu
, P.
Wang
, T.
Lin
, M.
Deng
, and H.
Li
, “T-gcn: A temporal graph convolutional network for traffic prediction
,” IEEE Trans. Intell. Transp. Syst.
21
, 3848
–3858
(2020
). 47.
Y.
Li
, R.
Yu
, C.
Shahabi
, and Y.
Liu
, “Diffusion convolutional recurrent neural network: Data-driven traffic forecasting,” in Proceedings of the 6th International Conference on Learning Representations (ICLR, 2018).48.
H.
Lin
, Z.
Gao
, Y.
Xu
, L.
Wu
, L.
Li
, and S. Z.
Li
, “Conditional local convolution for spatio-temporal meteorological forecasting,” in Proceedings of the AAAI Conference on Artificial Intelligence (AAAI Press, 2022), Vol. 36, pp. 7470–7478.49.
Y.
Seo
, M.
Defferrard
, P.
Vandergheynst
, and X.
Bresson
, “Structured sequence modeling with graph convolutional recurrent networks,” in Neural Information Processing: 25th International Conference (Springer International Publishing, 2018), pp. 362–373.50.
A.
Cini
, I.
Marisca
, F. M.
Bianchi
, and C.
Alippi
, “Scalable spatiotemporal graph neural networks,” in Proceedings of the AAAI Conference on Artificial Intelligence (AAAI Press, 2023), Vol. 37, pp. 7218–7226.51.
B.
Yu
, H.
Yin
, and Z.
Zhu
, “Spatio-temporal graph convolutional networks: A deep learning framework for traffic forecasting,” in Proceedings of the 27th International Joint Conference on Artificial Intelligence (AAAI Press, 2018), pp. 3634–3640.52.
S.
Rasp
, P. D.
Dueben
, S.
Scher
, J. A.
Weyn
, S.
Mouatadid
, and N.
Thuerey
, “Weatherbench: A benchmark data set for data-driven weather forecasting
,” J. Adv. Model. Earth Syst.
12
, e2020MS002203
(2020
). 53.
B. N.
Oreshkin
, D.
Carpov
, N.
Chapados
, and Y.
Bengio
, “N-beats: Neural basis expansion analysis for interpretable time series forecasting,” in Proceedings of the 7th International Conference on Learning Representations (ICLR, 2019).54.
H.
Wu
, J.
Xu
, J.
Wang
, and M.
Long
, “Autoformer: Decomposition transformers with auto-correlation for long-term series forecasting,” in Advances in Neural Information Processing Systems (Curran Associates, Inc., 2021), Vol. 34, pp. 22419–22430.© 2024 Author(s). Published under an exclusive license by AIP Publishing.
2024
Author(s)
You do not currently have access to this content.
