INFORMATION TECHNOLOGY FOR THE INTEGRATED ASSESSMENT OF EXPERT COMPETENCY
DOI:
https://doi.org/10.30837/2522-9818.2018.5.044Keywords:
information technology, complex assessment, expert competency, group of experts, methods for assessing the quality of expertsAbstract
The subject matter of the study is the processes of selecting and assessing the competency of experts. The goal of the study is to increase the objectivity of expert assessment by developing and applying a model and information technology for the integrated assessment of the competency of experts, which will enable selecting experts for participation in expert groups on a high qualitative level. The following tasks were solved: methods and models for assessing the quality and competency of experts were reviewed; a model for the integrated assessment of the competency of experts was developed; an applied information technology for a comprehensive assessment of the competency of experts was designed and implemented in software. The methodology of the study was based on the following methods: methods of heuristic, test and statistical evaluation were used to develop the model for the integrated assessment of the competency of experts; principles of system analysis and methods of object-oriented design were used to develop the applied information technology for the integrated assessment of the competency of experts. The following results were obtained: the problem of assessing the quality of experts was considered; based on the authors’ practical experience and analysis of literature sources, the structural diagram of the properties of experts and their assessment was developed; five main groups of existing methods for assessing the quality of experts were analyzed; existing models of an integrated assessment of the competency of experts were reviewed; a two-stage method for the integrated assessment of the competency of experts was developed by integrating the methods of heuristic, test and statistical assessment; the main groups of users and functional requirements to the information system for assessing the competency of experts were identified; the database and user interface of the information system were developed; the developed information technology of the integrated assessment of the competency of experts was tested on actual data for selecting an expert group to choose the methodology of project management. Conclusions. The problem of selecting and assessing the competency of experts is one of the most difficult in the theory and practice of expert surveys. It cannot be solved by applying singular methods of assessment; its solution requires that complex methods, including both quantitative and qualitative methods for assessing the competency of specialists should be applied. The applied information technology was developed for this purpose; it can be used at various enterprises, institutions and organizations that are interested in automating the process of expert survey and in building quality expert groups.References
Irzaev, G. Kh. (2008), "Choice system of the competent experts for the decision of the design-production problems", Automation. Modern Technology, No. 1, P. 40–46.
Orlov, A. I. (2002), Expert assessments : Textbook [Ekspertnye otsenki : Uchebnoe posobie], Moscow, 31 p.
Leonov, V. V., Vorovych, B. O. (2014), "Methods of assessing the competence of experts in the development of proposals for policy documents" ["Metodyka otsinky kompetentnosti ekspertiv u protsesi rozrobky propozytsii do prohramnykh dokumentiv"], Research papers collection of the Center of military and strategic studies of the National Defence University of Ukraine named after Ivan Chernyakhovsky, No. 3 (52), P. 13–18.
Irzaev, G. Kh. (2002), "A model for assessing the quality of an expert in predicting the technological effectiveness of electronic tools" ["Model’ otsenki kachestva eksperta pri prognozirovanii tekhnologichnosti elektronnykh sredstv"], Osnovnye nauchnye napravleniya DagGTU, Makhachkala : DGTU.
Raikhman, E. P., Azgaldov, G. G. (1974), Expert methods in assessing the quality of goods [Ekspertnye metody v otsenke kachestva tovarov], Moscow : Economy, 151 p.
Chernysheva, T. Yu. (2008), "Model of multi-criteria expert evaluation" ["Model’ mnogokriterial’noy otsenki ekspertov"], Al’manakh sovremennoy nauki i obrazovaniya, No. 9 (16), P. 242–245.
Dubrovskiy, S. A. (1979), "Definition of expert competence in the method of pairwise comparisons" ["Opredelenie kompetentnosti ekspertov v metode parnykh sravneniy"], Voprosy kibernetiki. Ekspertnye otsenki, No. 58, P. 157–162.
Lyaskovskiy, V. L., Smirnov, S. S., Pronin, A. Yu. (2013), "Methods of assessing the competence of experts in the process of formation of the proposals in the draft policy documents", Armament and Economics, No. 3 (24), P. 54–59.
Adamov, A. P., Gadzhiiev, Yu. A., Pirbudagov, G. M., Sotskay, A. N. (1989), "On determining the competence of experts by mutual evaluation", Avtomatika i Telemekhanika, No. 3, P. 185–189.
Voloshyn, O. F., Hnatiienko, H. M. (1993), "Procedures for determining the competence of experts" ["Protsedury vyznachennia kompetentnosti ekspertiv"], Bulletin of Taras Shevchenko National University of Kyiv Series: Physics & Mathematics, No. 3, P. 102–111.
Melnik, P. B. (2017), "Methodology of formation of expert pools and groups for conduction of expert-analytical researches", The collection of scientific works "Innovatics and Expert Examination", No. 1 (19), P. 39–54.
Postnikov, V. M. (2012), "Analysis of approaches to formation of expert group membership focused on preparing and making decisions", Science and Education of Bauman MSTU, No. 5, P. 333–346. DOI: https://dx.doi.org/10.7463/0512.0360720.
Neshati, M., Beigy, H., Hiemstra, D. (2014), "Expert group formation using facility location analysis", Information Processing & Management, Vol. 50 (2), P. 361–383. DOI: https://doi.org/10.1016/j.ipm.2013.10.001.
Neshati, M., Beigy, H., Hiemstra, D. (2012), "Multi-aspect group formation using facility location analysis", In Proceedings of the seventeenth Australasian Document Computing Symposium, ADCS`12, New York, NY, USA, P. 62–71.
Yue, Z. (2012), "Approach to group decision making based on determining the weights of experts by using projection method", Applied Mathematical Modelling, Vol. 36 (7), P. 2900–2910. DOI: https://doi.org/10.1016/j.apm.2011.09.068.
Tsyganok, V. V., Kadenko, S. V. & Andriichuk, O. V. (2012), "Significance of expert competence consideration in group decision making using AHP", International Journal of Production Research, Vol. 50 (17), P. 4785–4792. DOI: https://doi.org/10.1080/00207543.2012.657967.
Shanteau, J. (1992), "Competence in experts: The role of task characteristics", Organizational behavior and human decision processes, Vol. 53, Issue 2, P. 252–266. DOI: https://doi.org/10.1016/0749-5978(92)90064-E.
Pavlenko, P. & Tolbatov, S. (2014), "Competence assessment method of the expert group", Proceedings of the National Aviation University, No. 61 (4), P. 82–86. DOI: http://dx.doi.org/10.18372/2306-1472.61.7591.
Lobach, O., Babych, I. (2017), "Information technology for the integrated assessment of expert competency while selecting the management methodology" ["Informatsiina tekhnolohiia kompleksnoi otsinky kompetentnosti ekspertiv pry vybori metodolohii upravlinnia"], Abstracts of the XV International Scientific and Practical Conference "Modern information technologies in the economy and management of enterprises, programs and projects", Kharkiv : National Aerospace University "Kharkiv Aviation Institute", P. 18-20.
Gurin, V., Persiyanova, E. (2017), "General principles of building the model of development and operation of heterogeneous teams for project management", Innovative Technologies and Scientific Solutions for Industries, No. 1 (1), P. 21–27. DOI: https://doi.org/10.30837/2522-9818.2017.1.021.
Grynchenko, M., Ponomaryov, O., Lobach, O.(2018), "Leadership as a factor for building a project team", Innovative Technologies and Scientific Solutions for Industries, No. 1 (3), P. 13–21. DOI: https://doi.org/10.30837/2522-9818.2018.3.013.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2018 Olena Lobach, Igor Babych, Elena Persiyanova
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
Our journal abides by the Creative Commons copyright rights and permissions for open access journals.
Authors who publish with this journal agree to the following terms:
Authors hold the copyright without restrictions and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License (CC BY-NC-SA 4.0) that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
Authors are able to enter into separate, additional contractual arrangements for the non-commercial and non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
Authors are permitted and encouraged to post their published work online (e.g., in institutional repositories or on their website) as it can lead to productive exchanges, as well as earlier and greater citation of published work.
