TY - JOUR
T1 - An explainable Machine Learning model for Large-Scale Travelling Ionospheric Disturbances forecasting
AU - Ventriglia, Vincenzo
AU - Guerra, Marco
AU - Cesaroni, Claudio
AU - Spogli, Luca
AU - Altadill, David
AU - Segarra, Antoni
AU - Galkin, Ivan
AU - Barta, Veronika
AU - Verhulst, Tobias G.W.
AU - De Paula, Víctor
AU - Navas-Portella, Víctor
AU - Berényi, Kitti A.
AU - Belehaki, Anna
N1 - Publisher Copyright:
© 2025 EDP Sciences, Inc. All rights reserved.
PY - 2025
Y1 - 2025
N2 - Large-Scale Travelling Ionospheric Disturbances (LSTIDs) are wave-like ionospheric fluctuations, generally triggered by geomagnetic storms, which play a critical role in space weather dynamics. In this work, we present a machine learning model able to forecast the occurrence of LSTIDs over the European continent up to three hours in advance. The model is based on CatBoost, a gradient boosting framework. It is trained on a human-validated LSTID catalogue with the various physical drivers, including ionogram information, geomagnetic, and solar activity indices. There are three forecasting modes depending on the demanded scenarios with varying relative costs of false positives and false negatives. It is crucial to make the model predictions explainable, so that the output contribution of each physical factor input is visualised through the game-theoretic SHapley Additive exPlanation (SHAP) formalism. The validation procedure consists of a global-level evaluation and interpretation step, firstly, followed by an event-level validation against independent detection methods, which highlights the model-s predictive robustness and suggests its potential for real-time space weather forecasting. Depending on the operating mode, we report an improvement ranging from +72% to +93% over the performance of a rule-based benchmark. Our study concludes with a comprehensive analysis of future research directions and actions to be taken towards full operability. We discuss probabilistic forecasting approaches from a cost-sensitive learning perspective, along with performance-centric model monitoring. Finally, through the lens of the conformal prediction framework, we further comment on the uncertainty quantification for end-user risk management and mitigation.
AB - Large-Scale Travelling Ionospheric Disturbances (LSTIDs) are wave-like ionospheric fluctuations, generally triggered by geomagnetic storms, which play a critical role in space weather dynamics. In this work, we present a machine learning model able to forecast the occurrence of LSTIDs over the European continent up to three hours in advance. The model is based on CatBoost, a gradient boosting framework. It is trained on a human-validated LSTID catalogue with the various physical drivers, including ionogram information, geomagnetic, and solar activity indices. There are three forecasting modes depending on the demanded scenarios with varying relative costs of false positives and false negatives. It is crucial to make the model predictions explainable, so that the output contribution of each physical factor input is visualised through the game-theoretic SHapley Additive exPlanation (SHAP) formalism. The validation procedure consists of a global-level evaluation and interpretation step, firstly, followed by an event-level validation against independent detection methods, which highlights the model-s predictive robustness and suggests its potential for real-time space weather forecasting. Depending on the operating mode, we report an improvement ranging from +72% to +93% over the performance of a rule-based benchmark. Our study concludes with a comprehensive analysis of future research directions and actions to be taken towards full operability. We discuss probabilistic forecasting approaches from a cost-sensitive learning perspective, along with performance-centric model monitoring. Finally, through the lens of the conformal prediction framework, we further comment on the uncertainty quantification for end-user risk management and mitigation.
KW - Explainable Artificial Intelligence
KW - Forecasting
KW - Ionosphere
KW - Large Scale Travelling Ionospheric Disturbances
KW - Machine Learning
UR - https://www.scopus.com/pages/publications/105010635878
U2 - 10.1051/swsc/2025020
DO - 10.1051/swsc/2025020
M3 - Article
AN - SCOPUS:105010635878
SN - 2115-7251
VL - 15
JO - Journal of Space Weather and Space Climate
JF - Journal of Space Weather and Space Climate
M1 - 25
ER -