Comparative assessment of the competence of experts in the field of higher education by different methods

Authors

  • Oleh Velychko State Enterprise “All-Ukrainian State Scientific and Production Centre for Standardization, Metrology, Certification and Protection of Consumer” (SE “Ukrmetrteststandard”) Metrologychna str., 4, Kyiv, Ukraine, 03143, Ukraine https://orcid.org/0000-0002-6564-4144
  • Tetyana Gordiyenko Odessa State Academy of Technical Regulation and Quality Kovalska str., 15, Odessa, Ukraine, 65020, Ukraine https://orcid.org/0000-0003-0324-9672
  • Antonina Gaber Odessa State Academy of Technical Regulation and Quality Kovalska str., 15, Odessa, Ukraine, 65020, Ukraine https://orcid.org/0000-0001-7670-9911

DOI:

https://doi.org/10.15587/1729-4061.2018.142663

Keywords:

competence, expert, evaluation criteria, higher education, data uncertainty, analytic hierarchy

Abstract

The methods and means of assessing the competence of experts in the field of higher education are explored. An assessment of the competence of experts in the field of higher education using the methods for assessing the competence of experts, taking into account data uncertainty and on the basis of the analytical hierarchy process according to established criteria was carried out. The results are processed by specialized software “Competence DU 2.1” and “Competence of AHP 1.0”. Specialized software takes into account data uncertainty and applies the analytical hierarchy method. The ratio of the averages for the criteria used to assess the competence of experts in higher education was estimated.

The comparative analysis of the obtained data was carried out. The results of the analysis showed the convergence and correlation of the obtained data, and also confirmed the suitability of methods for assessing the competence of experts in the field of higher education. The obtained results showed a small dispersion of average values for the criteria for assessing the competence of experts in the range from 3.7 to 6.6, which indicates a balance. The comparative analysis showed a high coincidence of the results of quantitative assessment of the competence of experts using specialized software, which is based on different methods of evaluation. The scatter of the values obtained by the applied methods indicates the presence of a correlation.

The methods for assessing the competence of experts, taking into account data uncertainty and on the basis of the analytical hierarchy, are useful for comparative evaluation of the competence of experts in the field of higher education. This will allow rejecting insufficiently competent specialists, forming competent groups of experts, obtaining more reliable group expert assessments or ensuring the qualified work of agencies, specialized commissions and councils.

Author Biographies

Oleh Velychko, State Enterprise “All-Ukrainian State Scientific and Production Centre for Standardization, Metrology, Certification and Protection of Consumer” (SE “Ukrmetrteststandard”) Metrologychna str., 4, Kyiv, Ukraine, 03143

Doctor of Technical Sciences, Professor, Director

Scientific and Production Institute of Electromagnetic Measurements

Tetyana Gordiyenko, Odessa State Academy of Technical Regulation and Quality Kovalska str., 15, Odessa, Ukraine, 65020

Doctor of Technical Sciences, Associate Professor, Head of Department

Department of standardization, conformity assessment and quality

Antonina Gaber, Odessa State Academy of Technical Regulation and Quality Kovalska str., 15, Odessa, Ukraine, 65020

PhD, Senior Lecturer

Department of standardization, conformity assessment and quality

References

  1. Litvak, B. G. (1996). Ekspertnye ocenki i prinyatie resheniy. Moscow: Patent, 271.
  2. Pavlov, A. N., Sokolov, B. V. (2005). Metody obrabotki ekspertnoy informacii. Sankt-Peterburg: GUAP, 42.
  3. Orlov, A. I. (2002). Ekspertnye ocenki. Moscow, 31.
  4. Velychko, O., Gordiyenko, T., Kolomiets, L. (2017). A comparative analysis of the assessment results of the competence of technical experts by different methods. Eastern-European Journal of Enterprise Technologies, 4 (3 (88)), 4–10. doi: https://doi.org/10.15587/1729-4061.2017.106825
  5. Chernysheva, T. Yu. (2009). Ierarhicheskaya model' ocenki i otbora ekspertov. Doklady TUSUR. Upravleniya, vychislitel'naya tekhnika i informatika, 1 (19), 168–173.
  6. Harvey, L. (1995). Beyond TQM. Quality in Higher Education, 1(2), 123–146. doi: https://doi.org/10.1080/1353832950010204
  7. Babyn, I. I., Hrynevych, L. M., Likarchuk, I. L. et. al. (2011). Analitychna dopovid pro stan monitorynhu yakosti osvity v Ukraini. Kharkiv: Fakt, MBO «Tsentr testovykh tekhnolohiy i monitorynhu yakosti osvity», 96.
  8. Standards and Guidelines for Quality Assurance in the European Higher Education Area (2009). Helsinki, 41.
  9. Larichev, O. I. (2002). Teoriya i metody prinyatiya resheniy. Moscow: Logos, 392.
  10. Kolpakova, T. A. (2011). Opredelenie kompetentnosti ekspertov pri prinyatii gruppovyh resheniy. Radioelektronika, informatyka, upravlinnia, 1, 40–43.
  11. Xia, M., Chen, J. (2015). Consistency and consensus improving methods for pairwise comparison matrices based on Abelian linearly ordered group. Fuzzy Sets and Systems, 266, 1–32. doi: https://doi.org/10.1016/j.fss.2014.07.019
  12. Koczkodaj, W. W., Szybowski, J., Wajch, E. (2016). Inconsistency indicator maps on groups for pairwise comparisons. International Journal of Approximate Reasoning, 69, 81–90. doi: https://doi.org/10.1016/j.ijar.2015.11.007
  13. Pereira, C. A., Araujo, J. F. F. E., de Lourdes Machado-Taylor, M. (2018). The Brazilian higher education evaluation model: “SINAES” sui generis? International Journal of Educational Development, 61, 5–15. doi: https://doi.org/10.1016/j.ijedudev.2017.11.007
  14. Hoffmann, T. (1999). The meanings of competency. Journal of European Industrial Training, 23 (6), 275–286. doi: https://doi.org/10.1108/03090599910284650
  15. Echeverria-Villagomez, S., Flores-Campos, M., Pantoja-Lesso, R., Rodriguez-Damian, N., Valganon-Argueta, B. (2006). Human Resource and Knowledge Management System for Competences in Metrology using Information Technologies. XVIII IMEKO World Congress. Rio de Janeiro, 11.
  16. Saaty, T. L. (1992). The Hierarchon: A Dictionary of Hierarchies. Pittsburgh, Pennsylvania: RWS Publications.
  17. Saati, T. L. (2008). Prinyatie resheniy pri zavisimostyah i obratnyh svyazyah: Analiticheskie seti. Moscow: Izd-vo LKI, 360.
  18. Drake, P. R. (1998). Using the Analytic Hierarchy Process in Engineering Education. International Journal of Engineering Education, 14 (3), 191–196.
  19. Hrabovetskyi, B. Ye. (2010). Metody ekspertnykh otsinok: teoriya, metodolohiya, napriamy vykorystannia. Vinnytsia: VNTU, 171.
  20. Kalinina, I. O., Hozhyi, O. P., Musenko, H. O. (2013). Vrakhuvannia kompetentnosti ekspertiv u metodakh bahatokryterialnoho analizu v zadachakh ratsionalnoho vyboru. Nauk. pratsi Chornomor. derzh. univer. Kompiuterni tekhnolohiyi, 191 (179), 116–123.
  21. Navneet, B. (2004). Strategic Decision Making: Applying the Analytic Hierarchy Process. London: Springer-Verlag, 172. doi: https://doi.org/10.1007/b97668
  22. Velychko, O. M., Karpenko, S. R., Gordiyenko, T. B., Kolomiets, L. V. (2015). Special software for experts evaluation. Metallurgical and Mining Industry, 7, 401–407.
  23. Velychko, O. M., Gordiyenko, T. B., Kolomiets, L. V. (2015). Hardware-software complexes for evaluation of competence level of experts. Metallurgical and Mining Industry, 7, 396–401.
  24. Velychko, O., Gordiyenko, T. (2018). The evaluation of the expert competence in field of metrology difference methods. Journal of Physics: Conference Series, 1044, 012066. doi: https://doi.org/10.1088/1742-6596/1044/1/012066
  25. Velychko, O., Gordiyenko, T. (2015). Evaluation of competence of the experts in field of metrology and instrumentations. XXI IMEKO World Congress “Measurement in research and industry”. Prague, 5. doi: https://doi.org/10.13140/RG.2.1.2624.9365
  26. Velichko, O. N., Gordienko, T. B., Gaber, A. A., Kolomiec, L. V. (2015). Osobennosti ocenki kompetentnosti ekspertov s uchetom harakteristik neopredelennosti dannyh. Systemy obrobky informatsiyi, 2 (127), 114–117.
  27. Margolin, E. (2006). Metodika obrabotki dannyh ekspertnogo oprosa. Poligrafiya, 5, 14–16.
  28. Podinovskiy, V. V., Nogin, V. D. (1982). Pareto-optimal'nye resheniya mnogokriterial'nyh zadach. Moscow: Nauka, 256.

Downloads

Published

2018-09-20

How to Cite

Velychko, O., Gordiyenko, T., & Gaber, A. (2018). Comparative assessment of the competence of experts in the field of higher education by different methods. Eastern-European Journal of Enterprise Technologies, 5(3 (95), 25–32. https://doi.org/10.15587/1729-4061.2018.142663

Issue

Vol. 5 No. 3 (95) (2018): Control processes

Section

Control processes

License

Copyright (c) 2018 Oleh Velychko, Tetyana Gordiyenko, Antonina Gaber

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

The consolidation and conditions for the transfer of copyright (identification of authorship) is carried out in the License Agreement. In particular, the authors reserve the right to the authorship of their manuscript and transfer the first publication of this work to the journal under the terms of the Creative Commons CC BY license. At the same time, they have the right to conclude on their own additional agreements concerning the non-exclusive distribution of the work in the form in which it was published by this journal, but provided that the link to the first publication of the article in this journal is preserved.

A license agreement is a document in which the author warrants that he/she owns all copyright for the work (manuscript, article, etc.).
The authors, signing the License Agreement with TECHNOLOGY CENTER PC, have all rights to the further use of their work, provided that they link to our edition in which the work was published.
According to the terms of the License Agreement, the Publisher TECHNOLOGY CENTER PC does not take away your copyrights and receives permission from the authors to use and dissemination of the publication through the world's scientific resources (own electronic resources, scientometric databases, repositories, libraries, etc.).
In the absence of a signed License Agreement or in the absence of this agreement of identifiers allowing to identify the identity of the author, the editors have no right to work with the manuscript.
It is important to remember that there is another type of agreement between authors and publishers – when copyright is transferred from the authors to the publisher. In this case, the authors lose ownership of their work and may not use it in any way.