Linear and Non-Linear Spatio-Temporal Input Selection In Wireless Traffic Networks Prediction using Recurrent Neural Networks
Bahasa Inggris
Abstract
For the optimization of computer networks with high bandwidth requirements, it is necessary to predict the traffic of the wireless network. Its goal is to reduce maintenance costs and improve internet services. Feature selection is a major issue in multivariate time series (MTS) spatio-temporal modeling. Another problem is the dependency between input features, time lags, and spatial factors, so an appropriate model is needed. This study aims to provide solutions to two problems. The first is to improve a feature extraction and selection process in spatio-temporal MTS data for relevant features using Detrended Partial Cross-Correlation Analysis (DPPCA) and nonredundant features associated with linear using Pearson's correlation (PC) filters and non-linear associations using Symmetrical Uncertainty (SU) and a combination of both PCSUF. The second is to develop a spatiotemporal framework model using recurrent neural networks (RNNs) to get better performance than the traditional model. These methods are combined and tested using a data set of cellular networks with one hour intervals during November in three locations. Testing the effectiveness of the feature selection technique showed that 27.6% of the total extracted features were. The forecasting model with the DPCCA-SU-RNN combination method is the best performance by having RMSE = 380.7, R2 = 97% and MAPE = 10%.
Downloads
References
References
Y. Liu, B. Li, X. Sun, and Z. Zhou, “A fusion model of SWT, QGA and BP neural network for wireless network traffic prediction,” Int. Conf. Commun. Technol. Proceedings, ICCT, pp. 769–774, 2013, doi: 10.1109/ICCT.2013.6820478.
L. G, W. Q, and L. H, “Network traffic prediction based on wavelet neural network improved by genetic algorithm,” Int. J. Inf., vol. 16, no. 2, pp. 1047–1052, 2013.
J. H. Faghmous and V. Kumar, “Spatio-temporal Data Mining for Climate Data: Advances, Challenges, and Opportunities,” Stud. Big Data, vol. 1, pp. 83–116, 2014, doi: 10.1007/978-3-642-40837-3_3.
S. Mukherjee, R. Ray, R. Samanta, M. H. Khondekar, and G. Sanyal, “Nonlinearity and chaos in wireless network traffic,” Chaos, Solitons & Fractals, vol. 96, pp. 23–29, Mar. 2017, doi: 10.1016/J.CHAOS.2017.01.005.
Q. Jiang, X. Yan, and B. Huang, “Performance-Driven Distributed PCA Process Monitoring Based on Fault-Relevant Variable Selection and Bayesian Inference,” IEEE Trans. Ind. Electron., vol. 63, no. 1, pp. 377–386, Jan. 2016, doi: 10.1109/TIE.2015.2466557.
L. Nie, D. Jiang, S. Yu, and H. Song, “Network traffic prediction based on deep belief network in wireless mesh backbone networks,” IEEE Wirel. Commun. Netw. Conf. WCNC, May 2017, doi: 10.1109/WCNC.2017.7925498.
C. Zhang, H. Zhang, D. Yuan, and M. Zhang, “Citywide Cellular Traffic Prediction Based on Densely Connected Convolutional Neural Networks,” IEEE Commun. Lett., vol. 22, no. 8, pp. 1656–1659, Aug. 2018, doi: 10.1109/LCOMM.2018.2841832.
M. Li, Y. Wang, Z. Wang, and H. Zheng, “A deep learning method based on an attention mechanism for wireless network traffic prediction,” Ad Hoc Networks, vol. 107, p. 102258, Oct. 2020, doi: 10.1016/J.ADHOC.2020.102258.
G. L. Santos, P. Rosati, T. Lynn, J. Kelner, D. Sadok, and P. T. Endo, “Predicting Short-term Mobile Internet Traffic from Internet Activity using Recurrent Neural Networks,” Int. J. Netw. Manag., vol. 32, no. 3, Oct. 2020, doi: 10.1002/nem.2191.
G. Siracusano and A. La Corte, “Forecasting Mobile Traffic with Spatiotemporal correlation using Deep Regression,” Jul. 2019, Accessed: Jul. 05, 2023. [Online]. Available: https://arxiv.org/abs/1907.10865v1
D. Zhang, L. Liu, C. Xie, B. Yang, and Q. Liu, “Citywide Cellular Traffic Prediction Based on a Hybrid Spatiotemporal Network,” Algorithms 2020, Vol. 13, Page 20, vol. 13, no. 1, p. 20, Jan. 2020, doi: 10.3390/A13010020.
L. Wang, Z. Wang, and S. Liu, “An effective multivariate time series classification approach using echo state network and adaptive differential evolution algorithm,” Expert Syst. Appl., vol. 43, pp. 237–249, Jan. 2016, doi: 10.1016/J.ESWA.2015.08.055.
A. Bagnall, J. Lines, A. Bostrom, J. Large, and E. Keogh, “The great time series classification bake off: a review and experimental evaluation of recent algorithmic advances,” Data Min. Knowl. Discov., vol. 31, no. 3, pp. 606–660, May 2017, doi: 10.1007/S10618-016-0483-9/FIGURES/17.
G. Barlacchi et al., “A multi-source dataset of urban life in the city of Milan and the Province of Trentino,” Sci. Data 2015 21, vol. 2, no. 1, pp. 1–15, Oct. 2015, doi: 10.1038/sdata.2015.55.
S. Astutik, N. Iriawan, Suhartono, and Sutikno, “Hybrid state-space model and adjusting procedure based on Bayesian approaches for spatio-temporal rainfall disaggregation,” ICSSBE 2012 - Proceedings, 2012 Int. Conf. Stat. Sci. Bus. Eng. "Empowering Decis. Mak. with Stat. Sci., pp. 24–27, 2012, doi: 10.1109/ICSSBE.2012.6396520.
M. E. Banihabib, A. Ahmadian, and F. S. Jamali, “Hybrid DARIMA-NARX model for forecasting long-term daily inflow to Dez reservoir using the North Atlantic Oscillation (NAO) and rainfall data,” GeoResJ, vol. 13, pp. 9–16, Jun. 2017, doi: 10.1016/J.GRJ.2016.12.002.
B. Bonev, F. Escolano, and M. Cazorla, “Feature selection, mutual information, and the classification of high-dimensional patterns: Applications to image classification and microarray data analysis,” Pattern Anal. Appl., vol. 11, no. 3–4, pp. 309–319, Sep. 2008, doi: 10.1007/S10044-008-0107-0/METRICS.
E. Y. Arini, R. Hidayat, and A. Faqih, “Rainfall Simulation Using RegCM4 Model in Kalimantan during El Nino Southern Oscillation,” Procedia Environ. Sci., vol. 24, pp. 70–86, Jan. 2015, doi: 10.1016/J.PROENV.2015.03.011.
A. Saikhu, A. Z. Arifin, and C. Fatichah, “Non-Linear Spatio-Temporal Input Selection for Rainfall Forecasting Using Recurrent Neural Networks,” Proceeding - 2018 Int. Semin. Intell. Technol. Its Appl. ISITIA 2018, pp. 351–356, Jul. 2018, doi: 10.1109/ISITIA.2018.8710864.
X.-Y. Qian, Y.-M. Liu, Z.-Q. Jiang, B. Podobnik, W.-X. Zhou, and H. E. Stanley, “Detrended partial cross-correlation analysis of two nonstationary time series influenced by common external forces,” Phys. Rev. E - Stat. Nonlinear, Soft Matter Phys., vol. 91, no. 6, Apr. 2015, doi: 10.1103/PhysRevE.91.062816.
N. Yuan, Z. Fu, H. Zhang, L. Piao, E. Xoplaki, and J. Luterbacher, “Detrended Partial-Cross-Correlation Analysis: A New Method for Analyzing Correlations in Complex System,” Sci. Reports 2015 51, vol. 5, no. 1, pp. 1–7, Jan. 2015, doi: 10.1038/srep08143.
C. Shen, “Analysis of detrended time-lagged cross-correlation between two nonstationary time series,” Phys. Lett. A, vol. 379, no. 7, pp. 680–687, Mar. 2015, doi: 10.1016/J.PHYSLETA.2014.12.036.
J. Tang, S. Alelyani, and H. Liu, “Feature selection for classification: A review,” Data Classif. Algorithms Appl., pp. 37–64, Jan. 2014, doi: 10.1201/B17320.
M. K. Ebrahimpour and M. Eftekhari, “Ensemble of feature selection methods: A hesitant fuzzy sets approach,” Appl. Soft Comput., vol. 50, pp. 300–312, Jan. 2017, doi: 10.1016/J.ASOC.2016.11.021.
Y. Yu, M. Wang, L. Lin, and C. Zhang, “Human Motion Sequence Recognition Based on Feature Selection and Support Vector Machine,” IOP Conf. Ser. Mater. Sci. Eng., vol. 646, no. 1, p. 012012, Oct. 2019, doi: 10.1088/1757-899X/646/1/012012.
K. Mohammadi, S. Shamshirband, S. Motamedi, D. Petković, R. Hashim, and M. Gocic, “Extreme learning machine based prediction of daily dew point temperature,” Comput. Electron. Agric., vol. 117, pp. 214–225, Sep. 2015, doi: 10.1016/J.COMPAG.2015.08.008.
N. Ngoc Thach et al., “Spatial pattern assessment of tropical forest fire danger at Thuan Chau area (Vietnam) using GIS-based advanced machine learning algorithms: A comparative study,” Ecol. Inform., vol. 46, pp. 74–85, Jul. 2018, doi: 10.1016/J.ECOINF.2018.05.009.
N. D. C. Lewis, Neural networks for time series forecasting with R : an intuitive step by step blueprint for beginners.
R. Pascanu, T. Mikolov, and Y. Bengio, “On the difficulty of training Recurrent Neural Networks,” 30th Int. Conf. Mach. Learn. ICML 2013, no. PART 3, pp. 2347–2355, Nov. 2012, Accessed: Jul. 05, 2023. [Online]. Available: https://arxiv.org/abs/1211.5063v2
N. Challita, M. Khalil, and P. Beauseroy, “New technique for feature selection: Combination between elastic net and relief,” 2015 3rd Int. Conf. Technol. Adv. Electr. Electron. Comput. Eng. TAEECE 2015, pp. 262–267, May 2015, doi: 10.1109/TAEECE.2015.7113637.
Copyright (c) 2023 Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi)
This work is licensed under a Creative Commons Attribution 4.0 International License.
Copyright in each article belongs to the author
- The author acknowledges that the RESTI Journal (System Engineering and Information Technology) is the first publisher to publish with a license Creative Commons Attribution 4.0 International License.
- Authors can enter writing separately, arrange the non-exclusive distribution of manuscripts that have been published in this journal into other versions (eg sent to the author's institutional repository, publication in a book, etc.), by acknowledging that the manuscript has been published for the first time in the RESTI (Rekayasa Sistem dan Teknologi Informasi) journal ;
