Benchmarking Lightweight Machine Learning for Disaster Prediction: Accuracy, Latency, and Readiness
DOI:
https://doi.org/10.29207/resti.v10i4.7570Keywords:
disaster early warning systems, edge computing, inference latency, lightweight machine learning, XGBoostAbstract
Natural disaster early warning systems are often constrained by high computational latency, which impedes the timely dissemination of critical information. This study proposes a disaster impact prediction framework designed to optimize inference speed through a lightweight machine learning approach. Utilizing a comprehensive historical dataset from the Indonesian National Board for Disaster Management (BNPB) comprising 28,773 disaster records across 34 provinces from January 2018 to May 2024, this research evaluates the performance of XGBoost and LightGBM against a Gated Recurrent Unit (GRU) model for predicting infrastructure damage. SMOTE was applied exclusively during the training phase to address class imbalance without affecting inference speed. The results demonstrate that tree-based models significantly outperform GRU in both accuracy and speed. XGBoost achieved the lowest Mean Absolute Error (MAE of 1.1649) and the fastest inference latency (0.0026 ms per sample), followed by LightGBM (MAE of 1.4006, latency of 0.0064 ms), while GRU yielded a substantially higher error (MAE of 1.4189) and latency (0.2493 ms). Statistical validation via the Wilcoxon signed-rank test confirmed the significance of these performance differences (p < 0.001). Beyond technical benchmarking, these findings support the development of Intelligent Decision Support Systems for disaster mitigation, where organizational readiness and technology acceptance are critical for successful adoption. This study discusses practical implications for deploying lightweight models on resource-constrained edge computing devices such as Raspberry Pi 4, demonstrating sub-millisecond response speed, horizontal scalability, and affordability under $100 per node.
Downloads
References
Y. Zhang, C. Zhan, Q. Huang, and D. Sornette, "Forecasting future earthquakes with deep neural networks: application to California," Geophys. J. Int., vol. 240, no. 1, pp. 81--95, 2025, doi: 10.1093/gji/ggae373.
K. Sathupadi, S. Achar, S. V. Bhaskaran, N. Faruqui, M. Abdullah-Al-Wadud, and J. Uddin, “Edge-Cloud Synergy for AI-Enhanced Sensor Network Data: A Real-Time Predictive Maintenance Framework,” Sensors, vol. 24, no. 24, pp. 1–31, 2024, doi: 10.3390/s24247918.
H. Jain, R. Dhupper, A. Shrivastava, D. Kumar, and M. Kumari, “Leveraging machine learning algorithms for improved disaster preparedness and response through accurate weather pattern and natural disaster prediction,” Front. Environ. Sci., vol. 11, no. November, pp. 1–14, 2023, doi: 10.3389/fenvs.2023.1194918.
X. Ge et al., “Disaster Prediction Knowledge Graph Based on Multi-Source Spatio-Temporal Information,” Remote Sens. (Basel)., vol. 14, no. 5, 2022, doi: 10.3390/rs14051214.
H. Peng, S. Shen, H. Zhang, F. Wang, F. Guo, and R. Zhang, “Enhancing disaster prediction with Bayesian deep learning: a robust approach for uncertainty estimation,” Front. Appl. Math. Stat., vol. 11, 2025, doi: 10.3389/fams.2025.1653562.
O. C. Pasche, J. Wider, Z. Zhang, J. Zscheischler, and S. Engelke, “Validating Deep Learning Weather Forecast Models on Recent High-Impact Extreme Events,” Artificial Intelligence for the Earth Systems, vol. 4, no. 1, 2025, doi: 10.1175/aies-d-24-0033.1.
Z. Ma, G. Mei, and N. Xu, Generative deep learning for data generation in natural hazard analysis: motivations, advances, challenges, and opportunities, vol. 57, no. 6. Springer Netherlands, 2024. doi: 10.1007/s10462-024-10764-9.
F. Yasmin, M. Hasan, A. Sinha, and S. Mondal, “AI-driven hazard assessment: a comprehensive study of machine and deep learning approaches,” Asian Journal of Civil Engineering, 2025, doi: 10.1007/s42107-025-01598-z.
O. Singh, A. Kumar Pandey, and A. Sande, “Natural Disaster Prediction Using Machine Learning,” vol. 11, no. 11, pp. 2529–2532, 2025. [Online]. Available: https://ijirt.org/publishedpaper/IJIRT175219_PAPER.pdf
S. Al Shafian and D. Hu, “Integrating Machine Learning and Remote Sensing in Disaster Management: A Decadal Review of Post-Disaster Building Damage Assessment,” Buildings, vol. 14, no. 8, 2024, doi: 10.3390/buildings14082344.
C. Fang et al., “A globally distributed dataset of coseismic landslide mapping via multi-source high-resolution remote sensing images,” Earth Syst. Sci. Data, vol. 16, no. 10, pp. 4817–4842, 2024, doi: 10.5194/essd-16-4817-2024.
D. Sykas, D. Zografakis, and K. Demestichas, “Deep Learning Approaches for Wildfire Severity Prediction: A Comparative Study of Image Segmentation Networks and Visual Transformers on the EO4WildFires Dataset,” Fire, vol. 7, no. 11, 2024, doi: 10.3390/fire7110374.
A. Manoj, C. Misbah, R. Monica Singh, M. Vaishnavi, and N. Madhusudhanan, “Latency Analysis for Emergency Networks Using IoT,” Proceedings - 2023 7th International Conference on Design Innovation for 3 Cs Compute Communicate Control, ICDI3C 2023, pp. 137–140, 2023, doi: 10.1109/ICDI3C61568.2023.00036.
Z. Lu et al., “Advancements in Technologies and Methodologies of Machine Learning in Landslide Susceptibility Research: Current Trends and Future Directions,” Applied Sciences (Switzerland), vol. 14, no. 21, 2024, doi: 10.3390/app14219639.
N. S. Pawar and K. V. Sharma, “Comprehensive review of remote sensing integration with deep learning in landslide forecasting and future directions,” Natural Hazards, vol. 121, no. 20, pp. 23687–23721, 2025, doi: 10.1007/s11069-025-07171-w.
M. Roohi, H. R. Ghafouri, and S. M. Ashrafi, “Advancing flood disaster management: leveraging deep learning and remote sensing technologies,” Acta Geophysica, vol. 73, no. 1, pp. 557–575, 2025, doi: 10.1007/s11600-024-01481-6.
K. M. P. Ebrahim, A. Fares, N. Faris, and T. Zayed, “Exploring time series models for landslide prediction: a literature review,” Geoenvironmental Disasters, vol. 11, no. 1, 2024, doi: 10.1186/s40677-024-00288-3.
V. Linardos, M. Drakaki, P. Tzionas, and Y. L. Karnavas, "Machine Learning in Disaster Management: Recent Developments in Methods and Applications," pp. 446--473, 2022, doi: 10.3390/make4020020.
M. Kappi and B. Mallikarjuna, “Artificial intelligence and machine learning for disaster prediction: a scientometric analysis of highly cited papers,” Natural Hazards, vol. 120, no. 12, pp. 10443–10463, 2024, doi: 10.1007/s11069-024-06616-y.
A. M. Proma, M. S. Islam, S. Ciko, R. A. Baten, and E. Hoque, “NADBenchmarks -- a compilation of Benchmark Datasets for Machine Learning Tasks related to Natural Disasters,” Association for the Advancement of Artificial Intelligence, 2022, [Online]. Available: http://arxiv.org/abs/2212.10735
S. Stockman, D. Lawson, and M. Werner, “EarthquakeNPP: Benchmark Datasets for Earthquake Forecasting with Neural Point Processes,” 2024, [Online]. Available: http://arxiv.org/abs/2410.08226
P. C. Oddo, J. D. Bolten, S. V. Kumar, and B. Cleary, “Deep Convolutional LSTM for improved flash flood prediction,” Frontiers in Water, vol. 6, 2024, doi: 10.3389/frwa.2024.1346104.
Q. Zhou et al., “A deep-learning-Technique-based data-driven model for accurate and rapid flood predictions in temporal and spatial dimensions,” Hydrol. Earth Syst. Sci., vol. 27, no. 9, pp. 1791–1808, 2023, doi: 10.5194/hess-27-1791-2023.
P. Duraisamy and Y. Natarajan, “Twitter Disaster Prediction Using Different Deep Learning Models,” SN Comput. Sci., vol. 5, no. 1, p. 179, 2024, doi: 10.1007/s42979-023-02520-7.
J. Demšar, “Statistical comparisons of classifiers over multiple data sets,” Journal of Machine Learning Research, vol. 7, pp. 1–30, 2006. [Online]. Available: https://dl.acm.org/doi/10.5555/1248547.1248548
S. Lin, Z. Liang, H. Guo, Q. Hu, X. Cao, and H. Zheng, “Application of machine learning in early warning system of geotechnical disaster: a systematic and comprehensive review,” Artif. Intell. Rev., vol. 58, no. 6, 2025, doi: 10.1007/s10462-025-11175-0.
Raghav Sai Cheedalla, “Predictive mobile AI: Transforming emergency response from reactive to preventative,” World Journal of Advanced Engineering Technology and Sciences, vol. 15, no. 3, pp. 1818–1826, 2025, doi: 10.30574/wjaets.2025.15.3.1108.
P. Shetty, S. Varma, S. Tripathi, and C. Bhole, “Advancements in Disaster Prediction: A Systematic Review of Earthquake, Flood, and Cyclone Forecasting Techniques,” 4th International Conference on Sustainable Expert Systems, ICSES 2024 - Proceedings, pp. 1665–1673, 2024, doi: 10.1109/ICSES63445.2024.10763136.
K. Luxshi, “AI-Driven Disaster Prediction and Early Warning Systems: A Systematic Literature Review,” International Journal of Research in Computing, vol. 3, no. 1, p. 44, 2024, doi: 10.64701/ijrc/345/8906.
D. Maudiana, "Indonesia Natural Disaster Dataset (BNPB Records)," Kaggle, 2025. [Online]. Available: https://www.kaggle.com/datasets/maudiana/indonesia-natural-disaster-dataset-bnpb-records. [Accessed: 16-Feb-2026]
Downloads
Published
Issue
Section
License
Copyright in each article belongs to the author
- The author acknowledges that the RESTI Journal (System Engineering and Information Technology) is the first publisher to publish with a license Creative Commons Attribution 4.0 International License.
- Authors can enter writing separately, arrange the non-exclusive distribution of manuscripts that have been published in this journal into other versions (eg sent to the author's institutional repository, publication in a book, etc.), by acknowledging that the manuscript has been published for the first time in the RESTI (Rekayasa Sistem dan Teknologi Informasi) journal ;
