DOI: https://doi.org/10.15587/1729-4061.2018.140796

Development of a method for ranking factors that influence the maturity of project quality management processes

Iryna Lazko

Abstract


According to the results of the theoretical analysis of well-known and widely practically applied standards of quality management and project management, as well as models of maturity assessment of processes, 13 key risk-dominant factors influencing the maturity of project quality management processes have been identified.

A methodology of ranking risk-dominant factors, which highly influence the organizational maturity of quality management processes in projects, has been developed. The basis of the developed methodology is the expert method. A distinctive feature of the methodology when it is implemented is to obtain a nomenclature of ranked key risk-dominant factors, taking into account the expertise of experts. This result is achieved through the involvement of two target groups, «Process Implementers» and «Consumers of the Process Results and Stakeholders», for peer review. A systematic scientifically-based ranking of risk-dominant factors in accordance with the proposed methodology contributes to the objective assessment of the potential of quality management processes in projects. In addition, it will increase the likelihood of obtaining expected results of processes and will determine the priority directions of growth and organizational changes of processes to achieve the target levels of maturity. The proposed methodology can be implemented in the processes of certification, self-assessment and auditing in a QMS.

The practical testing of the proposed methodology was carried out using the example of the «Project Launch» process. According to the results of the expert evaluation of the «Process Implementers», it has been established that the factor «The degree of documenting the process» and, to a lesser extent, the «The degree of applicability of the process evaluation results for its improvement» is influenced to a greater extent by the maturity of the investigated process. According to the results of the expert evaluation «Consumers of the Process Results and Stakeholders», the following has been established. To a greater extent, the maturity of the investigated process is influenced by the factor «The degree of the possibility of integrating the process with other internal and external processes. «To a lesser extent, the factor is «Behaviour of the process implementers». There is a high degree of consistency between expert assessments within each group and a significant connection between the assessments of the two groups of experts.


Keywords


risk-dominant factor; project quality management; organizational maturity of processes; expert evaluation

References


DSTU ISO 9001:2015 (ISO 9001:2015, IDT) (2016). Systemy upravlinnia yakistiu. Vymohy. Kyiv, 22.

ISO 9001:2015. Quality management systems – Requirements (2015). International Organization for Standardization, 29.

Harrington, H. J. (2006). Project Management Excellence: The Art of Excelling in Project Management. Paton Press, 214.

Belaychuka, A. A., Eliferova, V. G. (Eds.) (2016). Svod znaniy po upravleniyu biznes processami: BPM CBOK 3.0. Moscow, 480.

Ahen, D. M. (2005). CMMI: Kompleksniy podhod k sovershenstvovaniyu processov. Prakticheskoe vvedenie v model'. Moscow: MFK, 300.

Repin, V. (2013). Biznes processy. Modelirovanie, vnedrenie, upravlenie. Moscow, 511.

DSTU ISO/IEC 33001:2016 (ISO/IEC 33001:2015, IDT) (2016). Informatsiyni tekhnolohiyi. Otsiniuvannia protsesu. Poniattia ta terminolohiya. Kyiv, 20.

ISO/IEC 33001:2015 (2015). Information technology – Process assessment – Concepts and terminology. International Organization for Standardization, 19.

Litvak, B. G. (1996). Ekspertnye ocenki i prinyatie resheniy. Moscow: Patent, 271.

Hrabovetskyi, B. Ye. (2010). Metody ekspertnykh otsinok: teoriya, metodolohiya, napriamy vykorystannia. Vinnytsia: VNTU, 171.

Kryuchkovskiy, V. V. Petrov, E. G., Sokolova, N. A., Hodakov, V. E. (2011). Introspektivniy analiz. Metody i sredstva ekspertnogo ocenivaniya. Herson: Grin' D.S., 168.

Lavrish, I. I. (2011). Samoorganizaciya ob'ektov upravleniya i mery soglasovaniya interesov sub'ekta i ob'ekta upravleniy. Avtomatizaciya i sovremennye tekhnologii, 3, 36–41.

Radkevych, A. V., Netesa, A. M. (2017). Determination and ranging of organizational and technological factors that define the rational decisions of re-bars connection. Science and Transport Progress. Bulletin of Dnipropetrovsk National University of Railway Transport, 3 (69), 171–181. doi: https://doi.org/10.15802/stp2017/104543

Hrabovetskyi, B. Ye., Zianko, V. V. (2013). Identyfikatsiya zmistu ta ranzhuvannia faktoriv, shcho obmezhuiut rozvytok venchurnoho biznesu, na osnovi metodu ekspertnykh otsinok Delfi. Visnyk Vinnytskoho politekhnichnoho instytutu, 4, 46–54.

Hrabovetskyi, B. Ye., Prytsiuk, L. A. (2011). Otsinka priorytetnosti faktoriv, shcho vplyvaiut na zrostannia obsiahiv realizatsiyi avtomobiliv, zapasnykh chastyn, dokhodu vid nadannia posluh na osnovi metodu ekspertnykh otsinok Delfi. Visnyk Khmelnytskoho natsionalnoho universytetu, 2 (5), 258–264.

Maslennikov, E. V. (2017). Opportunities of use of expert knowledge as the source of concepts of development of the organizations. Moscow State University Bulletin. Series 18. Sociology and Political Science, 23 (2), 229–249. doi: https://doi.org/10.24290/1029-3736-2017-23-2-229-249

Martino, Dzh. (1997). Tekhnologicheskoe prognozirovanie. Moscow: Progress, 591.

Beshelev, S. D., Gurvich, F. G. (1980). Matematiko-statisticheskie metody ekspertnyh ocenok. Moscow: Statistika, 263.

Serenkov, P. S., Romanchak, V. M., Gurevich, V. L. (2010). Minimizaciya pogreshnostey ocenivaniya pokazateley kachestva ekspertnymi sistemami. Pribory i metody izmereniy, 1, 141–146.

DSTU ISO 10006:2005 (ISO 10006:2003, IDT) (2007). Systemy upravlinnia yakistiu. Nastanovy shchodo upravlinnia yakistiu v proektakh. Kyiv, 27.

ISO 10006:2017. Quality management – Guidelines for quality management in projects (2017). International Organization for Standardization, 34.

ISO 21500:2012. Guidance on project management (2012). International Organization for Standardization, 36.

DSTU ISO/IEC 33020:2016 (ISO/IEC 33020:2015, IDT) (2016). Informatsiyni tekhnolohiyi. Otsiniuvannia protsesu. Struktura vymiriuvannia protsesu dlia otsiniuvannia mozhlyvostei protsesu. Kyiv, 18.

ISO/IEC 33020:2015 (2015). Information technology – Process assessment – Process measurement framework for assessment of process capability. International Organization for Standardization, 18.

Hammer, M. (2010). Faster Cheaper Better: The 9 Levers for Transforming how Work Gets Done. Crown Business, 302.

Askol'skaya, E. A. (2010). Nekotorye aspekty metodiki otbora ekspertov na osnove ocenki stepeni doveriya k urovnyu professional'nogo suzhdeniya // Izvestiya OGAU, 4 (28), 170–172.

Kryvda, O. V., Voitiuk, O. V. (2014). Model Delfi yak tekhnolohiya pryiniattia hospodarskykh rishen. Suchasni problemy ekonomiky ta pidpryiemnytsta, 14, 257–262.

Horbatko, V., Petrenko, I. (2008). Metod «Delfi» ta spetsyfika yoho zastosuvannia u prohnoznykh rozrobkakh. Politychnyi menedzhment, 6, 174–182.

Kurtov, A. I., Polikashyn, O. V., Potikhenskyi, A. I., Aleksandrov, V. M. (2017). Ekspertni otsinky. Metod "Delfi" yak tekhnolohiya pryiniattia upravlinskykh rishen. Zbirnyk naukovykh prats Kharkivskoho universytetu Povitrianykh Syl, 1, 118–122.

Buharin, S. N., Divueva, N. A., Maryshev, E. A. (2014). Vybor rezul'tiruyushchego ranzhirovaniya v processe nauchno-tekhnicheskoy ekspertizi innovacionnyh proektov. Innovatika i ekspertiza, 1, 114–120.

Ruposov, V. L. (2015). Metody opredeleniya kolichestva ekspertov. Vestnik IrGTU, 3 (98), 286–292.

Postnikova, V. (2012). Analysis of approaches to formation of expert group membership focused on preparing and making decisions. Science and Education of the Bauman MSTU, 12 (5), 333–346. doi: https://doi.org/10.7463/0512.0360720

Korobov, V. B. (2005). Sravnitel'niy analiz metodov opredeleniya vesovyh koefficientov «vliyayushchih faktorov». Sociologiya: metodologiya, metody, matematicheskoe modelirovanie (4M), 20, 54–73.

Chernysheva, T. Yu. (2009). Ierarhicheskaya model' ocenki i otbora ekspertov. Doklady TUSUR. Upravleniya, vychislitel'naya tekhnika i informatika, 1 (19), 168–173.

Putivtseva, N. P., Igrunova, S. V., Beketova, E. Y., Capitan, S. A. (2016). Implementation of the hyerarchical multicriteria procedure of the evaluation of experts’ quality. Research Result. Information technologies, 1 (1). doi: https://doi.org/10.18413/2518-1092-2016-1-1-39-47

Buharin, S. N., Divueva, N. A. (2013). Problema ocenki kompetentnosti s uchetom psihologicheskih svoystv. Innovatika i ekspertiza, 1 (10), 108–115.

Korobov, V. B. (2003). Organizaciya provedeniya ekspertnyh oprosov pri razrabotke klassifikacionnyh modeley. Sociologicheskie issledovaniya, 11, 102–108.

Azgal'dov, G. G. (2012). Kvalimetriya dlya vsekh. Moscow: ID InformZnanie, 165.

Velychko, O., Gordiyenko, T., Kolomiets, L. (2017). A comparative analysis of results of the group expert assessment of metrological assurance of measurements. Eastern-European Journal of Enterprise Technologies, 6 (9 (90)), 30–37. doi: https://doi.org/10.15587/1729-4061.2017.114468

Korobov, V. B. (2013). Nekotorye problemy primeneniya ekspertnyh metodov na praktike. Nauchniy dialog. Estestvoznanie. Ekologiya. Nauki o zemle, 3 (15), 94–108.

Velychko, O. M., Hordienko, T. B., Kolomiets, L. V. (2014). Metodyka otsinky kompetentnosti ekspertiv z urakhuvanniam kharakterystyk nevyznachenosti danykh. Metallurh. y hornorud. prom-st., 3 (288), 135–137.

Velychko, O., Gordiyenko, T. (2015). Evaluation of competence of the experts in field of metrology and instrumentations. XXI IMEKO World Congress “Measurement in research and industry”. Prague, Czech Republic, 5. doi: https://doi.org/10.13140/rg.2.1.2624.9365

Velychko, O., Gordiyenko, T., Kolomiets, L. (2017). A comparative analysis of the assessment results of the competence of technical experts by different methods. Eastern-European Journal of Enterprise Technologies, 4 (3 (88)), 4–10. doi: https://doi.org/10.15587/1729-4061.2017.106825

Velychko, O. M., Hordienko, T. B., Haber, A. A., Kolomiets, L. V. (2014). Otsiniuvannia kompetentnosti ekspertiv u sferi vyshchoi osvity. Zbirnyk naukovykh prats ODATRIa, 2 (5), 32–37.

Davydenko, Ye. O. (2012). Formalizatsiya protsesu formuvannia skladu ekspertnoi hrupy dlia analizu ryzykiv IT-proektiv. Vestnyk KhNTU, 1 (44), 163–168.

Karatanov, A. V., Druzhinin, E. A. (2014). Informacionnye tekhnologii ekspertnogo ocenivaniya proektnyh resheniy pri formirovanii edinogo informacionnogo prostranstva. Zbirnyk naukovykh prats Kharkivskoho universytetu Povitrianykh Syl, 3 (40), 155–160.

Kalinina, I. O., Hozhyi, O. P., Musenko, H. O. (2013). Vrakhuvannia kompetentnosti ekspertiv u metodakh bahatokryterialnoho analizu v zadachakh ratsionalnoho vyboru. Naukovi pratsi [Chornomorskoho derzhavnoho universytetu imeni Petra Mohyly]. Ser.: Kompiuterni tekhnolohiyi, 191 (179), 116–123.

Leonov, V. V., Voronych, B. O. (2014). Metodyka otsinky kompetentnosti ekspertiv u protsesi rozrobky propozytsiy do prohramnykh dokumentiv. Zbirnyk naukovykh prats Tsentru voienno-stratehichnykh doslidzhen «Natsionalnoho universytetu oborony Ukrainy imeni Ivana Cherniakhovskoho, 3 (52).

Rayhman, E. P., Azgal'dov, G. G. (1974). Ekspertnye metody v ocenke kachestva tovarov. Moscow: Ekonomika, 151.

Podolianchuk, S. V. (2014). Vyznachennia kompetentnosti ekspertiv z otsiniuvannia naukovoi diyalnosti u vyshchomu pedahohichnomu navchalnomu zakladi. Teoriya i praktyka upravlinnia sotsialnymy systemamy, 4, 112–122.

Hordienko, T. B., Velychko, O. M. (2014). Metodyka otsinky kompetentnosti ekspertiv iz zastosuvanniam metoda analizu ierarkhiy. Metallurg. i gornorud. prom-st', 2 (287), 86–89.

Kadenko, S. V., Tsyhanok, V. V. (2017). Vyznachennia vidnosnoi kompetentnosti ekspertiv pid chas ahrehatsiyi parnykh porivnian. Reiestratsiya, zberihannia i obrobka danykh, 19 (2), 69–83.

Polegen'ko, A. F., Knyazskiy, A. V. (2014). Ocenka otnositel'noy kompetentnosti ekspertov v ekspertnoy gruppe s ispol'zovaniem matric parnyh sravneniy. Ozbroiennia ta viyskova tekhnika, 3, 49–55.

Kolpakova, T. A. (2011). Opredelenie kompetentnosti ekspertov pri prinyatii gruppovyh resheniy. Radioelektronika, informatyka, upravlinnia, 1, 40–43.

Koczkodaj, W. W., Szybowski, J., Wajch, E. (2016). Inconsistency indicator maps on groups for pairwise comparisons. International Journal of Approximate Reasoning, 69, 81–90. doi: https://doi.org/10.1016/j.ijar.2015.11.007

Popov, G. A., Popov, A. G. (2017). Rezul'tiruyushchaya ocenka pri nalichii neskol'kih variantov ocenivaniya na primere zadach informacionnoy bezopasnosti // Vestn. Astrahan. gos. tekhn. un-ta. Ser.: Upravlenie, vychislitel'naya tekhnika i informatika, 1, 48–61.

Gucykova, S. V. (2011). Metod ekspertnyh ocenok. Teoriya i praktika. Moscow: In-t psihologii RAN, 144.

Zadeh, L. A. (1965). Fuzzy sets. Information and Control, 8, 338–353.

Zadeh, L. A. (1992). Knowledge Representation in Fuzzy Logic. An Introduction to Fuzzy Logic Applications in Intelligent Systems, 1–25. doi: https://doi.org/10.1007/978-1-4615-3640-6_1

Saaty, T. L. (1980). The analytic hierarchy process. N.-Y.: McGraw Hill, 288.

Saaty, T. L. (2008). Relative measurement and its generalization in decision making why pairwise comparisons are central in mathematics for the measurement of intangible factors the analytic hierarchy/network process. Revista de la Real Academia de Ciencias Exactas, Fisicas y Naturales. Serie A. Matematicas, 102 (2), 251–318. doi: https://doi.org/10.1007/bf03191825

Podinovskiy, V. V., Podinovskaya O. V. (2011). O nekorrektnosti metoda analiza ierarhiy. Problemy upravleniya, 1, 8–13.

Podinovskiy, V. V., Podinovskaya, O. V. (2012). Eshche raz o nekorrektnosti metoda analiza ierarhiy. Problemy upravleniya, 4, 75–78.

Korobov, V. B., Tutygin, A. G. (2010). Preimushchestva i nedostatki metoda analiza ierarhiy. Izvestiya Rossiyskogo gosudarstvennogo pedagogicheskogo universiteta im. A. I. Gercena, 122, 108–115.

Kendall, M. G., Smith, B. B. (1939). The problem of m rankings. The Annals of Mathematical Statistics, 10, 275–287. doі: https://doi.org/10.1214/aoms/1177732186

Kendell, M. Dzh. (1975). Rangovye korrelyacii. Zarubezhnye statisticheskie issledovaniya. Moscow: Izdatel'stvo «Statistika», 216.

Kobzar', A. I. (2006). Prikladnaya matematicheskaya statistika. Dlya inzhenerov i nauchnyh rabotnikov. Moscow: FIZMATLIT, 816.

Orlov, A. I. (2015). Analiz ekspertnyh uporyadocheniy. Nauchniy zhurnal KubGAU, 112 (08). Available at: http://ej.kubagro.ru/2015/08/pdf/02.pdf

Orlov, A. I. (2014). Noviy podhod k izucheniyu ustoychivosti vyvodov v matematicheskih modelyah. Politematicheskiy setevoy elektronnyy nauchniy zhurnal Kubanskogo gosudarstvennogo agrarnogo universiteta, 100, 146–176.

Kemeni, Dzh., Snell, Dzh. (1972). Kiberneticheskoe modelirovanie: Nekotorye prilozheniya. Moscow: Sovetskoe radio, 192.

Buharin, S. N., Divueva, N. A., Maryshev, E. A. (2014). Vybor rezul'tiruyushchego ranzhirovaniya v processe nauchno-tekhnicheskoy ekspertizy innovacionnyh proektov. Innovatika i ekspertiza, 1 (12), 114–120.

Zhukov, M. S., Orlov, A. I. (2016). Zadacha issledovaniya itogovogo ranzhirovaniya mneniy gruppy ekspertov s pomoshch'yu mediany Kemeni. Nauchniy zhurnal KubGAU, 122 (08).

Dvoenko S. D., Pshenichniy D. O., Popov A. V. (2017). Gruppovoe ranzhirovanie na osnove mediany Kemeni s metricheskimi svoystvami. Izvestiya Tul'skogo gosudarstvennogo universiteta. Tekhnicheskie nauki, 10, 11–24.

Karatanov, A. V., Druzhinin, E. A. (2014). Informacionnye tekhnologii ekspertnogo ocenivaniya proektnyh resheniy pri formirovanii edinogo informacionnogo prostranstva. Zbirnyk naukovykh prats Kharkivskoho universytetu Povitrianykh Syl, 3, 155–160.

Lazko, I. Shaping managerial system by quality in project with use the flexible modules. Eastern-European Journal of Enterprise Technologies, 5 (2 (71)), 56–61. doi: https://doi.org/10.15587/1729-4061.2014.28336

Lazko, I. (2018). Formation of quality management system rational model in projects. Proceedings XIV International Conference “Strategy of Quality in Industri and Education”. Varna, Bulgaria, 355–361.

Schucany, W. R., Frawley, W. H. (1973). A rank test for two group concordance. Psychometrika, 38 (2), 249–258. doi: https://doi.org/10.1007/bf02291117


GOST Style Citations


DSTU ISO 9001:2015 (ISO 9001:2015, IDT). Systemy upravlinnia yakistiu. Vymohy. Kyiv, 2016. 22 p.

ISO 9001:2015. Quality management systems – Requirements. International Organization for Standardization, 2015. 29 p.

Harrington H. J. Project Management Excellence: The Art of Excelling in Project Management. Paton Press, 2006. 214 p.

Svod znaniy po upravleniyu biznes processami: BPM CBOK 3.0 / A. A. Belaychuka, V. G. Eliferova (Eds.). Moscow, 2016. 480 p.

Ahen D. M. CMMI: Kompleksniy podhod k sovershenstvovaniyu processov. Prakticheskoe vvedenie v model'. Moscow: MFK, 2005. 300 p.

Repin V. Biznes processy. Modelirovanie, vnedrenie, upravlenie. Moscow, 2013. 511 p.

DSTU ISO/IEC 33001:2016 (ISO/IEC 33001:2015, IDT). Informatsiyni tekhnolohiyi. Otsiniuvannia protsesu. Poniattia ta terminolohiya. Kyiv, 2016. 20 p.

ISO/IEC 33001:2015. Information technology – Process assessment – Concepts and terminology. International Organization for Standardization, 2015. 19 p.

Litvak B. G. Ekspertnye ocenki i prinyatie resheniy. Moscow: Patent, 1996. 271 p.

Hrabovetskyi B. Ye. Metody ekspertnykh otsinok: teoriya, metodolohiya, napriamy vykorystannia. Vinnytsia: VNTU, 2010. 171 p.

Introspektivniy analiz. Metody i sredstva ekspertnogo ocenivaniya: monografiya / Kryuchkovskiy V. V. Petrov E. G., Sokolova N. A., Hodakov V. E. Herson: Grin' D.S., 2011. 168 p.

Lavrish I. I. Samoorganizaciya ob'ektov upravleniya i mery soglasovaniya interesov sub'ekta i ob'ekta upravleniy // Avtomatizaciya i sovremennye tekhnologii. 2011. Issue 3. P. 36–41.

Radkevych A. V., Netesa A. M. Determination and ranging of organizational and technological factors that define the rational decisions of re-bars connection // Science and Transport Progress. Bulletin of Dnipropetrovsk National University of Railway Transport. 2017. Issue 3 (69). P. 171–181. doi: https://doi.org/10.15802/stp2017/104543 

Hrabovetskyi B. Ye., Zianko V. V. Identyfikatsiya zmistu ta ranzhuvannia faktoriv, shcho obmezhuiut rozvytok venchurnoho biznesu, na osnovi metodu ekspertnykh otsinok Delfi // Visnyk Vinnytskoho politekhnichnoho instytutu. 2013. Issue 4. P. 46–54.

Hrabovetskyi B. Ye., Prytsiuk L. A. Otsinka priorytetnosti faktoriv, shcho vplyvaiut na zrostannia obsiahiv realizatsiyi avtomobiliv, zapasnykh chastyn, dokhodu vid nadannia posluh na osnovi metodu ekspertnykh otsinok Delfi // Visnyk Khmelnytskoho natsionalnoho universytetu. 2011. Vol. 2, Issue 5. P. 258–264.

Maslennikov E. V. Opportunities of use of expert knowledge as the source of concepts of development of the organizations // Moscow State University Bulletin. Series 18. Sociology and Political Science. 2017. Vol. 23, Issue 2. P. 229–249. doi: https://doi.org/10.24290/1029-3736-2017-23-2-229-249 

Martino Dzh. Tekhnologicheskoe prognozirovanie. Moscow: Progress, 1997. 591 p.

Beshelev S. D., Gurvich F. G. Matematiko-statisticheskie metody ekspertnyh ocenok. 2-e izd., pererab. i dop. Moscow: Statistika, 1980. 263 p.

Serenkov P. S., Romanchak V. M., Gurevich V. L. Minimizaciya pogreshnostey ocenivaniya pokazateley kachestva ekspertnymi sistemami // Pribory i metody izmereniy. 2010. Issue 1. P. 141–146.

DSTU ISO 10006:2005 (ISO 10006:2003, IDT). Systemy upravlinnia yakistiu. Nastanovy shchodo upravlinnia yakistiu v proektakh. Kyiv, 2007. 27 p.

ISO 10006:2017. Quality management – Guidelines for quality management in projects. International Organization for Standardization, 2017. 34 p.

ISO 21500:2012. Guidance on project management. International Organization for Standardization, 2012. 36 p.

DSTU ISO/IEC 33020:2016 (ISO/IEC 33020:2015, IDT). Informatsiyni tekhnolohiyi. Otsiniuvannia protsesu. Struktura vymiriuvannia protsesu dlia otsiniuvannia mozhlyvostei protsesu. Kyiv, 2016. 18 p.

ISO/IEC 33020:2015. Information technology – Process assessment – Process measurement framework for assessment of process capability. International Organization for Standardization, 2015. 18 p.

Hammer M. Faster Cheaper Better: The 9 Levers for Transforming how Work Gets Done. Crown Business, 2010. 302 р.

Askol'skaya E. A. Nekotorye aspekty metodiki otbora ekspertov na osnove ocenki stepeni doveriya k urovnyu professional'nogo suzhdeniya // Izvestiya OGAU. 2010. Issue 4 (28). P. 170–172.

Kryvda O. V., Voitiuk O. V. Model Delfi yak tekhnolohiya pryiniattia hospodarskykh rishen // Suchasni problemy ekonomiky ta pidpryiemnytsta. 2014. Issue 14. P. 257–262.

Horbatko V., Petrenko I. Metod «Delfi» ta spetsyfika yoho zastosuvannia u prohnoznykh rozrobkakh // Politychnyi menedzhment. 2008. Issue 6. P. 174–182.

Ekspertni otsinky. Metod "Delfi" yak tekhnolohiya pryiniattia upravlinskykh rishen / Kurtov A. I., Polikashyn O. V., Potikhenskyi A. I., Aleksandrov V. M. // Zbirnyk naukovykh prats Kharkivskoho universytetu Povitrianykh Syl. 2017. Issue 1. P. 118–122.

Buharin S. N., Divueva N. A., Maryshev E. A. Vybor rezul'tiruyushchego ranzhirovaniya v processe nauchno-tekhnicheskoy ekspertizi innovacionnyh proektov // Innovatika i ekspertiza. 2014. Issue 1. P. 114–120.

Ruposov V. L. Metody opredeleniya kolichestva ekspertov // Vestnik IrGTU. 2015. Issue 3 (98). P. 286–292.

Postnikova V. Analysis of approaches to formation of expert group membership focused on preparing and making decisions // Science and Education of the Bauman MSTU. 2012. Vol. 12, Issue 5. P. 333–346. doi: https://doi.org/10.7463/0512.0360720 

Korobov V. B. Sravnitel'niy analiz metodov opredeleniya vesovyh koefficientov «vliyayushchih faktorov» // Sociologiya: metodologiya, metody, matematicheskoe modelirovanie (4M). 2005. Issue 20. P. 54–73.

Chernysheva T. Yu. Ierarhicheskaya model' ocenki i otbora ekspertov // Doklady TUSUR. Upravleniya, vychislitel'naya tekhnika i informatika. 2009. Issue 1 (19). P. 168–173.

Implementation of the hyerarchical multicriteria procedure of the evaluation of experts’ quality / Putivtseva N. P., Igrunova S. V., Beketova E. Y., Capitan S. A. // Research Result. Information technologies. 2016. Vol. 1, Issue 1. doi: https://doi.org/10.18413/2518-1092-2016-1-1-39-47 

Buharin S. N., Divueva N. A. Problema ocenki kompetentnosti s uchetom psihologicheskih svoystv // Innovatika i ekspertiza. 2013. Issue 1 (10). P. 108–115.

Korobov V. B. Organizaciya provedeniya ekspertnyh oprosov pri razrabotke klassifikacionnyh modeley // Sociologicheskie issledovaniya. 2003. Issue 11. P. 102–108.

Azgal'dov G. G. Kvalimetriya dlya vsekh: ucheb. pos. Moscow: ID InformZnanie, 2012. 165 p.

Velychko O., Gordiyenko T., Kolomiets L. A comparative analysis of results of the group expert assessment of metrological assurance of measurements // Eastern-European Journal of Enterprise Technologies. 2017. Vol. 6, Issue 9 (90). P. 30–37. doi: https://doi.org/10.15587/1729-4061.2017.114468 

Korobov V. B. Nekotorye problemy primeneniya ekspertnyh metodov na praktike // Nauchniy dialog. Estestvoznanie. Ekologiya. Nauki o zemle. 2013. Issue 3 (15). P. 94–108.

Velychko O. M., Hordienko T. B., Kolomiets L. V. Metodyka otsinky kompetentnosti ekspertiv z urakhuvanniam kharakterystyk nevyznachenosti danykh // Metallurh. y hornorud. prom-st. 2014. Issue 3 (288). P. 135–137.

Velychko O., Gordiyenko T. Evaluation of competence of the experts in field of metrology and instrumentations // XXI IMEKO World Congress “Measurement in research and industry”. Prague, Czech Republic, 2015. 5 p. doi: https://doi.org/10.13140/rg.2.1.2624.9365 

Velychko O., Gordiyenko T., Kolomiets L. A comparative analysis of the assessment results of the competence of technical experts by different methods // Eastern-European Journal of Enterprise Technologies. 2017. Vol. 4, Issue 3 (88). P. 4–10. doi: https://doi.org/10.15587/1729-4061.2017.106825 

Otsiniuvannia kompetentnosti ekspertiv u sferi vyshchoi osvity / Velychko O. M., Hordienko T. B., Haber A. A., Kolomiets L. V. // Zbirnyk naukovykh prats ODATRIa. 2014. Issue 2 (5). P. 32–37.

Davydenko Ye. O. Formalizatsiya protsesu formuvannia skladu ekspertnoi hrupy dlia analizu ryzykiv IT-proektiv // Vestnyk KhNTU. 2012. Issue 1 (44). P. 163–168.

Karatanov A. V., Druzhinin E. A. Informacionnye tekhnologii ekspertnogo ocenivaniya proektnyh resheniy pri formirovanii edinogo informacionnogo prostranstva // Zbirnyk naukovykh prats Kharkivskoho universytetu Povitrianykh Syl. 2014. Issue 3 (40). P. 155–160.

Kalinina I. O., Hozhyi O. P., Musenko H. O. Vrakhuvannia kompetentnosti ekspertiv u metodakh bahatokryterialnoho analizu v zadachakh ratsionalnoho vyboru // Naukovi pratsi [Chornomorskoho derzhavnoho universytetu imeni Petra Mohyly]. Ser.: Kompiuterni tekhnolohiyi. 2013. Vol. 191, Issue 179. P. 116–123.

Leonov V. V., Voronych B. O. Metodyka otsinky kompetentnosti ekspertiv u protsesi rozrobky propozytsiy do prohramnykh dokumentiv // Zbirnyk naukovykh prats Tsentru voienno-stratehichnykh doslidzhen «Natsionalnoho universytetu oborony Ukrainy imeni Ivana Cherniakhovskoho. 2014. Issue 3 (52).

Rayhman E. P., Azgal'dov G. G. Ekspertnye metody v ocenke kachestva tovarov. Moscow: Ekonomika, 1974. 151 p.

Podolianchuk S. V. Vyznachennia kompetentnosti ekspertiv z otsiniuvannia naukovoi diyalnosti u vyshchomu pedahohichnomu navchalnomu zakladi // Teoriya i praktyka upravlinnia sotsialnymy systemamy. 2014. Issue 4. P. 112–122.

Hordienko T. B., Velychko O. M. Metodyka otsinky kompetentnosti ekspertiv iz zastosuvanniam metoda analizu ierarkhiy // Metallurg. i gornorud. prom-st'. 2014. Issue 2 (287). P. 86–89.

Kadenko S. V., Tsyhanok V. V. Vyznachennia vidnosnoi kompetentnosti ekspertiv pid chas ahrehatsiyi parnykh porivnian // Reiestratsiya, zberihannia i obrobka danykh. 2017. Vol. 19, Issue 2. P. 69–83.

Polegen'ko A. F., Knyazskiy A. V. Ocenka otnositel'noy kompetentnosti ekspertov v ekspertnoy gruppe s ispol'zovaniem matric parnyh sravneniy // Ozbroiennia ta viyskova tekhnika. 2014. Issue 3. P. 49–55.

Kolpakova T. A. Opredelenie kompetentnosti ekspertov pri prinyatii gruppovyh resheniy // Radioelektronika, informatyka, upravlinnia. 2011. Issue 1. P. 40–43.

Koczkodaj W. W., Szybowski J., Wajch E. Inconsistency indicator maps on groups for pairwise comparisons // International Journal of Approximate Reasoning. 2016. Vol. 69. P. 81–90. doi: https://doi.org/10.1016/j.ijar.2015.11.007 

Popov G. A., Popov A. G. Rezul'tiruyushchaya ocenka pri nalichii neskol'kih variantov ocenivaniya na primere zadach informacionnoy bezopasnosti // Vestn. Astrahan. gos. tekhn. un-ta. Ser.: Upravlenie, vychislitel'naya tekhnika i informatika. 2017. Issue 1. P. 48–61.

Gucykova S. V. Metod ekspertnyh ocenok. Teoriya i praktika. Moscow: In-t psihologii RAN, 2011. 144 p.

Zadeh L. A. Fuzzy sets // Information and Control. 1965. Issue 8. Р. 338–353.

Zadeh L. A. Knowledge Representation in Fuzzy Logic // An Introduction to Fuzzy Logic Applications in Intelligent Systems. 1992. P. 1–25. doi: https://doi.org/10.1007/978-1-4615-3640-6_1 

Saaty T. L. The analytic hierarchy process. N.-Y.: McGraw Hill, 1980. 288 p.

Saaty T. L. Relative measurement and its generalization in decision making why pairwise comparisons are central in mathematics for the measurement of intangible factors the analytic hierarchy/network process // Revista de la Real Academia de Ciencias Exactas, Fisicas y Naturales. Serie A. Matematicas. 2008. Vol. 102, Issue 2. P. 251–318. doi: https://doi.org/10.1007/bf03191825 

Podinovskiy V. V., Podinovskaya O. V. O nekorrektnosti metoda analiza ierarhiy // Problemy upravleniya. 2011. Issue 1. P. 8–13.

Podinovskiy V. V., Podinovskaya O. V. Eshche raz o nekorrektnosti metoda analiza ierarhiy // Problemy upravleniya. 2012. Issue 4. P. 75–78.

Korobov V. B., Tutygin A. G. Preimushchestva i nedostatki metoda analiza ierarhiy // Izvestiya Rossiyskogo gosudarstvennogo pedagogicheskogo universiteta im. A. I. Gercena. 2010. Issue 122. P. 108–115.

Kendall M. G., Smith B. B. The problem of m rankings // The Annals of Mathematical Statistics. 1939. Vol. 10. P. 275–287. doі: https://doi.org/10.1214/aoms/1177732186 

Kendell M. Dzh. Rangovye korrelyacii. Zarubezhnye statisticheskie issledovaniya. Moscow: Izdatel'stvo «Statistika», 1975. 216 p.

Kobzar' A. I. Prikladnaya matematicheskaya statistika. Dlya inzhenerov i nauchnyh rabotnikov. Moscow: FIZMATLIT, 2006. 816 p.

Orlov A. I. Analiz ekspertnyh uporyadocheniy // Nauchniy zhurnal KubGAU. 2015. Issue 112 (08). URL: http://ej.kubagro.ru/2015/08/pdf/02.pdf

Orlov A. I. Noviy podhod k izucheniyu ustoychivosti vyvodov v matematicheskih modelyah // Politematicheskiy setevoy elektronnyy nauchniy zhurnal Kubanskogo gosudarstvennogo agrarnogo universiteta. 2014. Issue 100. P. 146–176.

Kemeni Dzh., Snell Dzh. Kiberneticheskoe modelirovanie: Nekotorye prilozheniya. Moscow: Sovetskoe radio, 1972. 192 p.

Buharin S. N., Divueva N. A., Maryshev E. A. Vybor rezul'tiruyushchego ranzhirovaniya v processe nauchno-tekhnicheskoy ekspertizy innovacionnyh proektov // Innovatika i ekspertiza. 2014. Issue 1 (12). P. 114–120.

Zhukov M. S., Orlov A. I. Zadacha issledovaniya itogovogo ranzhirovaniya mneniy gruppy ekspertov s pomoshch'yu mediany Kemeni // Nauchniy zhurnal KubGAU. 2016. Issue 122 (08).

Dvoenko S. D., Pshenichniy D. O., Popov A. V. Gruppovoe ranzhirovanie na osnove mediany Kemeni s metricheskimi svoystvami // Izvestiya Tul'skogo gosudarstvennogo universiteta. Tekhnicheskie nauki. 2017. Issue 10. P. 11–24.

Karatanov A. V., Druzhinin E. A. Informacionnye tekhnologii ekspertnogo ocenivaniya proektnyh resheniy pri formirovanii edinogo informacionnogo prostranstva // Zbirnyk naukovykh prats Kharkivskoho universytetu Povitrianykh Syl. 2014. Issue 3. P. 155–160.

Lazko I. Shaping managerial system by quality in project with use the flexible modules // Eastern-European Journal of Enterprise Technologies. 2014. Vol. 5, Issue 2 (71). P. 56–61. doi: https://doi.org/10.15587/1729-4061.2014.28336 

Lazko I. Formation of quality management system rational model in projects // Proceedings XIV International Conference “Strategy of Quality in Industri and Education”. Varna, Bulgaria, 2018. P. 355–361.

Schucany W. R., Frawley W. H. A rank test for two group concordance // Psychometrika. 1973. Vol. 38, Issue 2. P. 249–258. doi: https://doi.org/10.1007/bf02291117 







Copyright (c) 2018 Iryna Lazko

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.

ISSN (print) 1729-3774, ISSN (on-line) 1729-4061