Comparative Analysis of Recurrent Neural Network Models Performance in Predicting Bitcoin Prices
Abstract
The recurring neural network is a deep learning algorithm that is commonly used to develop prediction systems. There are many variants of RNN such as RNN itself, long-short-term memory (LSTM), and gated recurring unit, so it is frequently debatable which algorithm from the RNN family has the most optimal efficiency and computation time. When developing a prediction system, sequential or time series data is required so that an accurate prediction can be made. Sequential or time series data involve data arranged in a time sequence, such as weather data, financial data, carbon emission data, and traffic data recorded over time. This research will be carried out by predicting the three RNN models against historical Bitcoin value data. The research method used is Experimental Design by comparing the performance between the three models on bitcoin value time series data, testing is done by involving hyperparameters such as Tanh, Sigmoid, and ReLU activation functions, batch size, and epochs. The aim of this research is to find out which RNN model can produce the most optimal performance and find out what performance measures can be used to evaluate and compare the performance between the three models. The results of the study show that LSTM is the most effective model with RMSE 0.012441 and MSE 0.000155 but inefficient because it takes 3 minutes 24 seconds to run the computation; in the meantime, the Tanh activation function gives the most optimal prediction than Sigmoid and RelU and therefore should be the main candidate to be used with RNN models when predicting Bitcoin prices.
Downloads
References
A. Pranolo, Y. Mao, Y. Tang, Haviluddin, and A. P. Wibawa, “A Long Short Term Memory Implemented for Rainfall Forecasting,” 2020 6th Int. Conf. Sci. Inf. Technol. Embrac. Ind. 4.0 Towar. Innov. Disaster Manag. ICSITech 2020, pp. 194–197, 2020, doi: 10.1109/ICSITech49800.2020.9392056.
Z. Shen, Q. Wan, and D. J. Leatham, “Bitcoin Return Volatility Forecasting: A Comparative Study between GARCH and RNN,” J. Risk Financ. Manag., vol. 14, no. 7, 2021, doi: 10.3390/jrfm14070337.
M. Liu, W. Luo, Z. Cai, X. Du, J. Zhang, and S. Li, “Numerical-discrete-scheme-incorporated recurrent neural network for tasks in natural language processing,” CAAI Trans. Intell. Technol., vol. 8, no. 4, pp. 1415–1424, 2023, doi: 10.1049/cit2.12172.
Y. Liu, Y. Wang, and H. Shi, “A Convolutional Recurrent Neural-Network-Based Machine Learning for Scene Text Recognition Application,” Symmetry (Basel)., vol. 15, no. 4, 2023, doi: 10.3390/sym15040849.
A. ur Rehman, S. B. Belhaouari, M. A. Kabir, and A. Khan, “On the Use of Deep Learning for Video Classification,” Appl. Sci., vol. 13, no. 3, p. 2007, Feb. 2023, doi: 10.3390/app13032007.
P. Rani, J. Kaur, and S. Kaswan, “Automatic Video Classification: A Review,” EAI Endorsed Trans. Creat. Technol., vol. 7, no. 24, p. 163996, 2020, doi: 10.4108/eai.13-7-2018.163996.
S. Ahmed, I. E. Nielsen, A. Tripathi, S. Siddiqui, R. P. Ramachandran, and G. Rasool, “Transformers in Time-Series Analysis: A Tutorial,” Circuits, Syst. Signal Process., vol. 42, no. 12, pp. 7433–7466, Dec. 2023, doi: 10.1007/s00034-023-02454-8.
C. Zhao, P. Hu, X. Liu, X. Lan, and H. Zhang, “Stock Market Analysis Using Time Series Relational Models for Stock Price Prediction,” Mathematics, vol. 11, no. 5, 2023, doi: 10.3390/math11051130.
H. Abdollahi, “A novel hybrid model for forecasting crude oil price based on time series decomposition,” Appl. Energy, vol. 267, no. February, p. 115035, 2020, doi: 10.1016/j.apenergy.2020.115035.
I. Salehin, I. M. Talha, M. Mehedi Hasan, S. T. Dip, M. Saifuzzaman, and N. N. Moon, “An Artificial Intelligence Based Rainfall Prediction Using LSTM and Neural Network,” Proc. 2020 IEEE Int. Women Eng. Conf. Electr. Comput. Eng. WIECON-ECE 2020, pp. 5–8, 2020, doi: 10.1109/WIECON-ECE52138.2020.9398022.
Y. Li, “Forecasting Chinese carbon emissions based on a novel time series prediction method,” Energy Sci. Eng., vol. 8, no. 7, pp. 2274–2285, 2020, doi: 10.1002/ese3.662.
J. Zheng and M. Huang, “Traffic flow forecast through time series analysis based on deep learning,” IEEE Access, vol. 8, pp. 82562–82570, 2020, doi: 10.1109/ACCESS.2020.2990738.
A. F. M. Shahen Shah et al., “On the Vital Aspects and Characteristics of Cryptocurrency—A Survey,” IEEE Access, vol. 11, no. February, pp. 9451–9468, 2023, doi: 10.1109/ACCESS.2023.3240103.
I. E. Livieris, N. Kiriakidou, S. Stavroyiannis, and P. Pintelas, “An advanced CNN-LSTM model for cryptocurrency forecasting,” Electron., vol. 10, no. 3, pp. 1–16, 2021, doi: 10.3390/electronics10030287.
Y. Li, Z. Zheng, and H.-N. Dai, “Enhancing Bitcoin Price Fluctuation Prediction Using Attentive LSTM and Embedding Network,” Appl. Sci., vol. 10, no. 14, p. 4872, Jul. 2020, doi: 10.3390/app10144872.
M. Musfiroh, D. C. R. Novitasari, P. K. Intan, and G. G. Wisnawa, “Penerapan Metode Principal Component Analysis (PCA) dan Long Short-Term Memory (LSTM) dalam Memprediksi Prediksi Curah Hujan Harian,” Build. Informatics, Technol. Sci., vol. 5, no. 1, pp. 1–11, 2023, doi: 10.47065/bits.v5i1.3114.
D. Z. Haq et al., “Long Short-Term Memory Algorithm for Rainfall Prediction Based on El-Nino and IOD Data,” Procedia Comput. Sci., vol. 179, no. 2019, pp. 829–837, 2021, doi: 10.1016/j.procs.2021.01.071.
P. L. Seabe, C. R. B. Moutsinga, and E. Pindza, “Forecasting Cryptocurrency Prices Using LSTM, GRU, and Bi-Directional LSTM: A Deep Learning Approach,” Fractal Fract., vol. 7, no. 2, pp. 1–18, 2023, doi: 10.3390/fractalfract7020203.
R. Sari, K. Kusrini, T. Hidayat, and T. Orphanoudakis, “Improved LSTM Method of Predicting Cryptocurrency Price Using Short-Term Data,” IJCCS (Indonesian J. Comput. Cybern. Syst., vol. 17, no. 1, p. 33, 2023, doi: 10.22146/ijccs.80776.
S. Hansun, A. Wicaksana, and A. Q. M. Khaliq, “Multivariate cryptocurrency prediction: comparative analysis of three recurrent neural networks approaches,” J. Big Data, vol. 9, no. 1, 2022, doi: 10.1186/s40537-022-00601-7.
M. J. Hamayel and A. Y. Owda, “A Novel Cryptocurrency Price Prediction Model Using GRU, LSTM and bi-LSTM Machine Learning Algorithms,” AI, vol. 2, no. 4, pp. 477–496, 2021, doi: 10.3390/ai2040030.
M. L. Pratama and H. Utama, “Pendekatan Deep Learning Menggunakan Metode LSTM Untuk Prediksi Harga Bitcoin,” vol. 2, no. 2, pp. 43–50, 2023.
A. Dutta, S. Kumar, and M. Basu, “A Gated Recurrent Unit Approach to Bitcoin Price Prediction,” J. Risk Financ. Manag., vol. 13, no. 2, 2020, doi: 10.3390/jrfm13020023.
Moch Farryz Rizkilloh and Sri Widiyanesti, “Prediksi Harga Cryptocurrency Menggunakan Algoritma Long Short Term Memory (LSTM),” J. RESTI (Rekayasa Sist. dan Teknol. Informasi), vol. 6, no. 1, pp. 25–31, 2022, doi: 10.29207/resti.v6i1.3630.
K. Smagulova and A. P. James, “A survey on LSTM memristive neural network architectures and applications,” Eur. Phys. J. Spec. Top., vol. 228, no. 10, pp. 2313–2324, 2019, doi: 10.1140/epjst/e2019-900046-x.
Merinda Lestandy, Abdurrahim Abdurrahim, and Lailis Syafa’ah, “Analisis Sentimen Tweet Vaksin COVID-19 Menggunakan Recurrent Neural Network dan Naïve Bayes,” J. RESTI (Rekayasa Sist. dan Teknol. Informasi), vol. 5, no. 4, pp. 802–808, 2021, doi: 10.29207/resti.v5i4.3308.
F. Zhou, Y. Chen, and J. Liu, “Application of a New Hybrid Deep Learning Model That Considers Temporal and Feature Dependencies in Rainfall–Runoff Simulation,” Remote Sens., vol. 15, no. 5, 2023, doi: 10.3390/rs15051395.
S. Hochreiter and J. Schmidhuber, “Long Short-Term Memory,” Neural Comput., vol. 9, no. 8, pp. 1735–1780, 1997, doi: 10.1162/neco.1997.9.8.1735.
H. Widiputra, Adele Mailangkay, and Elliana Gautama, “Prediksi Indeks BEI dengan Ensemble Convolutional Neural Network dan Long Short-Term Memory,” J. RESTI (Rekayasa Sist. dan Teknol. Informasi), vol. 5, no. 3, pp. 456–465, 2021, doi: 10.29207/resti.v5i3.3111.
F. Azizi and W. C. Wibowo, “Intermittent Demand Forecasting Using LSTM With Single and Multiple Aggregation,” J. RESTI (Rekayasa Sist. dan Teknol. Informasi), vol. 6, no. 5, pp. 855–859, 2022, doi: 10.29207/resti.v6i5.4435.
H. Widiputra, A. Mailangkay, and E. Gautama, “Multivariate CNN-LSTM Model for Multiple Parallel Financial Time-Series Prediction,” Complexity, vol. 2021, 2021, doi: 10.1155/2021/9903518.
Sabar Sautomo and Hilman Ferdinandus Pardede, “Prediksi Belanja Pemerintah Indonesia Menggunakan Long Short-Term Memory (LSTM),” J. RESTI (Rekayasa Sist. dan Teknol. Informasi), vol. 5, no. 1, pp. 99–106, 2021, doi: 10.29207/resti.v5i1.2815.
T. Sap et al., “Long-Short Term Memory Technique for Monthly Rainfall,” Symmetry (Basel)., vol. 14, no. 1599, pp. 1–24, 2022.
J. Chung, C. Gulcehre, K. Cho, and Y. Bengio, “Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling,” pp. 1–9, 2014, [Online]. Available: http://arxiv.org/abs/1412.3555
Cornelius Stephanus Alfredo and D. A. Adytia, “Time Series Forecasting of Significant Wave Height using GRU, CNN-GRU, and LSTM,” J. RESTI (Rekayasa Sist. dan Teknol. Informasi), vol. 6, no. 5, pp. 776–781, 2022, doi: 10.29207/resti.v6i5.4160.
X. Wang, J. Xu, W. Shi, and J. Liu, “OGRU: An Optimized Gated Recurrent Unit Neural Network,” J. Phys. Conf. Ser., vol. 1325, no. 1, 2019, doi: 10.1088/1742-6596/1325/1/012089.
Copyright (c) 2024 Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi)
This work is licensed under a Creative Commons Attribution 4.0 International License.
Copyright in each article belongs to the author
- The author acknowledges that the RESTI Journal (System Engineering and Information Technology) is the first publisher to publish with a license Creative Commons Attribution 4.0 International License.
- Authors can enter writing separately, arrange the non-exclusive distribution of manuscripts that have been published in this journal into other versions (eg sent to the author's institutional repository, publication in a book, etc.), by acknowledging that the manuscript has been published for the first time in the RESTI (Rekayasa Sistem dan Teknologi Informasi) journal ;
