Application of the NARX neural network for predicting a one-dimensional time series

Authors

DOI:

https://doi.org/10.15587/1729-4061.2021.242442

Keywords:

one-dimensional time series, NARX model, forecasting, neural network, nonlinear autoregression

Abstract

Time series data analysis and forecasting tool for studying the data on the use of network traffic is very important to provide acceptable and good quality network services, including network monitoring, resource management, and threat detection. More and more, the behavior of network traffic is described by the theory of deterministic chaos. The traffic of a modern network has a complex structure, an uneven rate of packet arrival for service by network devices. Predicting network traffic is still an important task, as forecast data provide the necessary information to solve the problem of managing network flows. Numerous studies of actually measured data confirm that they are nonstationary and their structure is multicomponent. This paper presents modeling using Nonlinear Autoregression Exogenous (NARX) algorithm for predicting network traffic datasets. NARX is one of the models that can be used to demonstrate non-linear systems, especially in modeling time series datasets. In other words, they called the categories of dynamic feedback networks covering several layers of the network. An artificial neural network (ANN) was developed, trained and tested using the LM learning algorithm (Levenberg-Macwardt). The initial data for the prediction is the actual measured network traffic of the packet rate. As a result of the study of the initial data, the best value of the smallest mean-square error MSE (Mean Squared Error) was obtained with the epoch value equal to 18. As for the regression R, its output ANN values in relation to the target for training, validation and testing were 0.97743. 0.9638 and 0.94907, respectively, with an overall regression value of 0.97134, which ensures that all datasets match exactly. Experimental results (MSE, R) have proven the method's ability to accurately estimate and predict network traffic

Author Biographies

Tansaule Serikov, S. Seifullin Kazakh Agro Technical University

PhD

Department of Radio Engineering, Electronics and Telecommunications

Ainur Zhetpisbayeva, S. Seifullin Kazakh Agro Technical University

PhD

Department of Radio Engineering, Electronics and Telecommunications

Sharafat Mirzakulova, Turan University

PhD, Assistant Professor

Department of Radio Engineering, Electronics and Telecommunications

Kairatbek Zhetpisbayev, LLP «NTS Design»

PhD

Zhanar Ibrayeva, International University of Information Technology

Master, Senior Lecturer

Department of Radio Engineering, Electronics and Telecommunications

Lyudmila Sobolevа, S. Seifullin Kazakh Agro Technical University

Master, Senior Lecturer

Department of Radio Engineering, Electronics and Telecommunications

Arai Tolegenova, S. Seifullin Kazakh Agro Technical University

PhD, Head of Department

Department of Radio Engineering, Electronics and Telecommunications

Berik Zhumazhanov, Nazarbayev University

Doctoral Student

School of Engineering and Digital Sciences

References

  1. Oliveira, T. P., Barbar, J. S., Soares, A. S. (2016). Computer network traffic prediction: a comparison between traditional and deep learning neural networks. International Journal of Big Data Intelligence, 3 (1), 28. doi: https://doi.org/10.1504/ijbdi.2016.073903
  2. Romirer-Maierhofer, P., Schiavone, M., D’Alconzo, A. (2015). Device-Specific Traffic Characterization for Root Cause Analysis in Cellular Networks. Lecture Notes in Computer Science, 64–78. doi: https://doi.org/10.1007/978-3-319-17172-2_5
  3. Joshi, M., Hadi, T. H. (2015). A Review of Network Traffic Analysis and Prediction Techniques. arXiv.org. Available at: https://arxiv.org/ftp/arxiv/papers/1507/1507.05722.pdf
  4. Ramakrishnan, N., Soni, T. (2018). Network Traffic Prediction Using Recurrent Neural Networks. 2018 17th IEEE International Conference on Machine Learning and Applications (ICMLA). doi: https://doi.org/10.1109/icmla.2018.00035
  5. Cirstea, R.-G., Micu, D.-V., Muresan, G.-M., Guo, C., Yang, B. (2018). Correlated Time Series Forecasting using Multi-Task Deep Neural Networks. Proceedings of the 27th ACM International Conference on Information and Knowledge Management. doi: https://doi.org/10.1145/3269206.3269310
  6. Tian, C., Ma, J., Zhang, C., Zhan, P. (2018). A Deep Neural Network Model for Short-Term Load Forecast Based on Long Short-Term Memory Network and Convolutional Neural Network. Energies, 11 (12), 3493. doi: https://doi.org/10.3390/en11123493
  7. Weerakody, P. B., Wong, K. W., Wang, G., Ela, W. (2021). A review of irregular time series data handling with gated recurrent neural networks. Neurocomputing, 441, 161–178. doi: https://doi.org/10.1016/j.neucom.2021.02.046
  8. Khedkar, S. P., Canessane, R. A., Najafi, M. L. (2021). Prediction of Traffic Generated by IoT Devices Using Statistical Learning Time Series Algorithms. Wireless Communications and Mobile Computing, 2021, 1–12. doi: https://doi.org/10.1155/2021/5366222
  9. Liu, Z., Wang, Z., Yin, X., Shi, X., Guo, Y., Tian, Y. (2019). Traffic Matrix Prediction Based on Deep Learning for Dynamic Traffic Engineering. 2019 IEEE Symposium on Computers and Communications (ISCC). doi: https://doi.org/10.1109/iscc47284.2019.8969631
  10. Adeleke, O. A. (2019). Echo-State Networks for Network Traffic Prediction. 2019 IEEE 10th Annual Information Technology, Electronics and Mobile Communication Conference (IEMCON). doi: https://doi.org/10.1109/iemcon.2019.8936255
  11. Ruiz, L., Cuéllar, M., Calvo-Flores, M., Jiménez, M. (2016). An Application of Non-Linear Autoregressive Neural Networks to Predict Energy Consumption in Public Buildings. Energies, 9 (9), 684. doi: https://doi.org/10.3390/en9090684
  12. Abdellah, A. R., Mahmood, O. A. K., Paramonov, A., Koucheryavy, A. (2019). IoT traffic prediction using multi-step ahead prediction with neural network. 2019 11th International Congress on Ultra Modern Telecommunications and Control Systems and Workshops (ICUMT). doi: https://doi.org/10.1109/icumt48472.2019.8970675
  13. Andalib, A., Atry, F. (2009). Multi-step ahead forecasts for electricity prices using NARX: A new approach, a critical analysis of one-step ahead forecasts. Energy Conversion and Management, 50 (3), 739–747. doi: https://doi.org/10.1016/j.enconman.2008.09.040
  14. Li, X., Yang, C. (2014). Research and Application of Data Mining and NARX Neural Networks in Load Forecasting. International Journal of Database Theory and Application, 7 (2), 13–24. doi: https://doi.org/10.14257/ijdta.2014.7.2.02
  15. Chandra, R. (2015). Competition and Collaboration in Cooperative Coevolution of Elman Recurrent Neural Networks for Time-Series Prediction. IEEE Transactions on Neural Networks and Learning Systems, 26 (12), 3123–3136. doi: https://doi.org/10.1109/tnnls.2015.2404823
  16. Haviluddin, Alfred, R. (2015). Performance of modeling time series using nonlinear autoregressive with eXogenous input (NARX) in the network traffic forecasting. 2015 International Conference on Science in Information Technology (ICSITech). doi: https://doi.org/10.1109/icsitech.2015.7407797
  17. Boussaada, Z., Curea, O., Remaci, A., Camblong, H., Mrabet Bellaaj, N. (2018). A Nonlinear Autoregressive Exogenous (NARX) Neural Network Model for the Prediction of the Daily Direct Solar Radiation. Energies, 11 (3), 620. doi: https://doi.org/10.3390/en11030620
  18. Serikov, T., Zhetpisbayeva, A., Аkhmediyarova, А., Mirzakulova, S., Kismanova, A., Tolegenova, A., Wójcik, W. (2021). City Backbone Network Traffic Forecasting. International Journal of Electronics and Telecommunications, 67 (3), 319–324. doi: https://doi.org/10.24425/ijet.2021.135983
  19. McCulloch, W. S., Pitts, W. (1943). A logical calculus of the ideas immanent in nervous activity. The Bulletin of Mathematical Biophysics, 5 (4), 115–133. doi: https://doi.org/10.1007/bf02478259

Downloads

Published

2021-10-29

How to Cite

Serikov, T., Zhetpisbayeva, A., Mirzakulova, S., Zhetpisbayev, K., Ibrayeva, Z., Sobolevа L., Tolegenova, A., & Zhumazhanov, B. (2021). Application of the NARX neural network for predicting a one-dimensional time series . Eastern-European Journal of Enterprise Technologies, 5(4 (113), 12–19. https://doi.org/10.15587/1729-4061.2021.242442

Issue

Section

Mathematics and Cybernetics - applied aspects