HYBRID TRAINING METHOD OF ARTIFICIAL NEURAL NETWORK ON THE BASIS OF THE MODIFIED ANT ALGORITHM
DOI:
https://doi.org/10.15587/1729-4061.2012.4521Keywords:
neural network, ant colony optimization, back propagation algorithm, hybrid algorithm, neural network trainingAbstract
Back propagation of error algorithm is one of the training methods of artificial neural network. Its creation gave an additional incitement to the development of artificial neural network theory. An increase and appearance of the new tasks had led to the appearance of hybrid algorithms based on classical and stochastic ones. They emphasize the advantages and decrease the drawbacks of each other. The article suggests the hybrid training algorithm of neural network based on the ant colony and back propagation of error algorithms. The ant colony algorithm is used to choose the priority ways of moving along the neural network and to change the network balance with the help of pheromones. In comparison with the basic algorithm the ant colony one is changed. Instead of distance records between each pair of connected nodes and total network error records, they use the record of error value on the each exit node at the end of each ant travel. In the modified algorithm, each network weight changes the coefficient with the glance of the value of pheromone matrix elements, the error on the each node of exit layer and suggested function for pheromone accounting. The algorithm performance was checked on the famous databases [http://archive.ics.uci.edu/ml/]. The results of the experiments show that in comparison with another algorithm the modified one accelerates the training of neural network. The algorithm implementation was approved on the Microsoft SQL Server 2005 in Analysis Services. It will help to apply suggested algorithm to solve another problems of classification.References
- Саймон Хайкин, Нейронные сети полный курс второе издание – М. Вильямс, 2006, 1104 с.
- Anil K. Jain, Jianchang Mao, K.M. Mohiuddin Artificial Neural Networks: A Tutorial, Computer, Vol.29, No.3, March/1996, pp. 31-44. Translated from the original English version and reprinted with permission. (IEEE)
- Галушкин А. И. Синтез многослойных систем распознавания образов. – М.: «Энергия», 1974.
- Werbos P. J., Beyond regression: New tools for prediction and analysis in the behavioral sciences. Ph.D. thesis, Harvard University, Cambridge, MA, 1974.
- Rumelhart D.E., Hinton G.E., Williams R.J., Learning Internal Representations by Error Propagation. In: Parallel Distributed Processing, vol. 1, pp. 318 – 362. Cambridge, MA, MIT Press. 1986.
- Барцев С. И., Охонин В. А. Адаптивные сети обработки информации. Красноярск: Ин-т физики СО АН СССР, 1986. Препринт N 59Б. – 20 с.
- Neural Network Based on Ant Colony Clustering Algorithm Applied to Predict the Stability of the Roof in Coal Mining, ISDA '06 Proceedings of the Sixth International Conference on Intelligent Systems Design and Applications – Volume 01, 2006
- Evolving Neural Networks Using the Hybrid of Ant Colony Optimization and BP Algorithms, Advances in Neural Networks – ISNN 2006, Lecture Notes in Computer Science, 2006, Volume 3971/2006, 714-722, DOI: 10.1007/11759966_105
- Study on the Feed forward Neural Network Based on Ant Colony Optimization, Journal of Wuhan University of Technology [Transportation Science & Engineering], 2009-03.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2014 Евгений Владимирович Котляров, Татьяна Ивановна Петрушина
This work is licensed under a Creative Commons Attribution 4.0 International License.
The consolidation and conditions for the transfer of copyright (identification of authorship) is carried out in the License Agreement. In particular, the authors reserve the right to the authorship of their manuscript and transfer the first publication of this work to the journal under the terms of the Creative Commons CC BY license. At the same time, they have the right to conclude on their own additional agreements concerning the non-exclusive distribution of the work in the form in which it was published by this journal, but provided that the link to the first publication of the article in this journal is preserved.
A license agreement is a document in which the author warrants that he/she owns all copyright for the work (manuscript, article, etc.).
The authors, signing the License Agreement with TECHNOLOGY CENTER PC, have all rights to the further use of their work, provided that they link to our edition in which the work was published.
According to the terms of the License Agreement, the Publisher TECHNOLOGY CENTER PC does not take away your copyrights and receives permission from the authors to use and dissemination of the publication through the world's scientific resources (own electronic resources, scientometric databases, repositories, libraries, etc.).
In the absence of a signed License Agreement or in the absence of this agreement of identifiers allowing to identify the identity of the author, the editors have no right to work with the manuscript.
It is important to remember that there is another type of agreement between authors and publishers – when copyright is transferred from the authors to the publisher. In this case, the authors lose ownership of their work and may not use it in any way.
