Building a model of network interaction between the components of a multiagent system of mobile robots
DOI:
https://doi.org/10.15587/1729-4061.2020.213989Keywords:
multi-agent systems, mobile robots, machine learning, network model, WEB interface, WebSocketAbstract
The results reported here represent the first stage in the development of a full-featured laboratory system aimed at studying machine learning algorithms. The relevance of the current work is predetermined by the lack of network small-size mobile robots and appropriate control software that would make it possible to conduct field experiments in real time. This paper reports the selection of network data transmission technology for managing mobile robots in real time. Based on the chosen data transmission protocol, a complete stack of technologies of the network model of a multi-agent system of mobile robots has been proposed. This has made it possible to build a network model of the system that visualizes and investigates machine learning algorithms. In accordance with the requirements set by the OSI network model for constructing such systems, the model includes the following levels:
1) the lower level of data collection and controlling elements – mobile robots;
2) the top level of the model includes a user interface server and a business logic support server.
Based on the built diagram of the protocol stack and the network model, the software and hardware implementation of the obtained results has been carried out. This paper employed the JavaScript library React with a SPA technology (Single Page Application), a Virtual DOM technology (Document Object Model), stored in the device's RAM and synchronized with the actual DOM. That has made it possible to simplify the process of control over the clients and reduce network traffic.
The model provides the opportunity to:
1) manage the prototypes of robot clients in real time;
2) reduce the use of network traffic, compared to other data transmission technologies;
3) reduce the load on the CPU processors of robots and servers;
4) virtually simulate an experiment;
5) investigate the implementation of machine learning algorithms
References
- Stepanov, P. P. (2019). Application of group control and machine learning algorithms on the example of the "Battlecode" game. Cybernetics and programming, 1, 75–82. doi: https://doi.org/10.25136/2306-4196.2019.1.23527
- Yang, E., Gu, D. (2004). Multiagent Reinforcement Learning for Multi-Robot Systems: A Survey. Available at: https://www.researchgate.net/profile/Dongbing_Gu/publication/2948830_Multiagent_Reinforcement_Learning_for_Multi-Robot_Systems_A_Survey/links/53f5ac820cf2fceacc6f4f1a.pdf
- Elhajj, I. H., Goradia, A., Xi, N., Kit, C. M., Liu, Y. H., Fukuda, T. (2003). Design and analysis of internet-based tele-coordinated multi-robot systems. Autonomous Robots, 15, 237–254. doi: http://doi.org/10.1023/A:1026266703684
- Cao, Y. U., Fukunaga, A. S., Kahng, A. B. (1997). Cooperative mobile robotics: antecedents and directions. Autonomous Robots, 4, 7–27. doi: http://doi.org/10.1023/A:1008855018923
- Van der Zwaan, S., Moreira, J. A. A., Lima, P. U. (2000). Cooperative learning and planning for multiple robots. Proceedings of the 2000 IEEE International Symposium on Intelligent Control. Held Jointly with the 8th IEEE Mediterranean Conference on Control and Automation (Cat. No.00CH37147). doi: https://doi.org/10.1109/isic.2000.882949
- Asada, M., Uchibe, E., Hosoda, K. (1999). Cooperative behavior acquisition for mobile robots in dynamically changing real worlds via vision-based reinforcement learning and development. Artificial Intelligence, 110 (2), 275–292. doi: https://doi.org/10.1016/s0004-3702(99)00026-0
- Touzet, C. F. (2000). Robot awareness in cooperative mobile robot learning. Autonomous Robots, 8, 87–97. doi: https://doi.org/10.1023/A:1008945119734
- Mataric, M. J. (1997). Reinforcement learning in the multi-robot domain. Autonomous Robots, 4, 73–83. doi: https://doi.org/10.1023/A:1008819414322
- Michaud, F., Mataríc, M. J. (1998). Learning from history for behavior-based mobile robots in non-stationary conditions. Machine Learning, 31, 141–167. doi: https://doi.org/10.1023/A:1007496725428
- Fernandez, F., Parker, L. E. (2001). Learning in large cooperative multi-robot domains. International Journal of Robotics and Automation, 16 (4), 217–226.
- Bowling, M., Veloso, M. (2003). Simultaneous adversarial multi-robot learning. IJCAI'03: Proceedings of the 18th international joint conference on Artificial intelligence, 699–704. Available at: http://www.cs.cmu.edu/~mmv/papers/03ijcai-grawolf.pdf
- Liu, J., Wu, J. (2001). Multiagent Robotic Systems. CRC Press, 328. doi: https://doi.org/10.1201/9781315220406
- Matarić, M. J. (2001). Learning in behavior-based multi-robot systems: policies, models, and other agents. Cognitive Systems Research, 2 (1), 81–93. doi: https://doi.org/10.1016/s1389-0417(01)00017-1
- Srinivasan, L., Scharnagl, J., Schilling, K. (2013). Analysis of WebSockets as the New Age Protocol for Remote Robot Tele-operation. IFAC Proceedings Volumes, 46 (29), 83–88. doi: https://doi.org/10.3182/20131111-3-kr-2043.00032
- Introducing Hooks (2020). React. Available at: https://en.reactjs.org/docs/hooks-intro.html
- Diduk, V. A., Savchenko, B. S. (2020). Robototekhnichna systema z viddalenym keruvanniam. Vseukrainska naukovo-praktychna Internet-konferentsiya “Avtomatyzatsiya ta kompiuterno-intehrovani tekhnolohiyi u vyrobnytstvi ta osviti: stan, dosiahnennia, perspektyvy rozvytku”. Cherkasy, 46–49. Available at: https://conference.ikto.net/pub/akit_2020_16-22march.pdf
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2020 Vitalii Diduk, Valerii Hrytsenko, Andrii Yeromenko
This work is licensed under a Creative Commons Attribution 4.0 International License.
The consolidation and conditions for the transfer of copyright (identification of authorship) is carried out in the License Agreement. In particular, the authors reserve the right to the authorship of their manuscript and transfer the first publication of this work to the journal under the terms of the Creative Commons CC BY license. At the same time, they have the right to conclude on their own additional agreements concerning the non-exclusive distribution of the work in the form in which it was published by this journal, but provided that the link to the first publication of the article in this journal is preserved.
A license agreement is a document in which the author warrants that he/she owns all copyright for the work (manuscript, article, etc.).
The authors, signing the License Agreement with TECHNOLOGY CENTER PC, have all rights to the further use of their work, provided that they link to our edition in which the work was published.
According to the terms of the License Agreement, the Publisher TECHNOLOGY CENTER PC does not take away your copyrights and receives permission from the authors to use and dissemination of the publication through the world's scientific resources (own electronic resources, scientometric databases, repositories, libraries, etc.).
In the absence of a signed License Agreement or in the absence of this agreement of identifiers allowing to identify the identity of the author, the editors have no right to work with the manuscript.
It is important to remember that there is another type of agreement between authors and publishers – when copyright is transferred from the authors to the publisher. In this case, the authors lose ownership of their work and may not use it in any way.