Methods of expert evaluation of construction projects according to qualitative criteria

The article discusses methods of individual and group expert assessment of construction projects in order to select the most promising for implementation. The proposed model for obtaining a generalized assessment of the quality of construction projects by one expert is based on a mathematical model of expert assessment using one or more criteria reflecting the requirements for construction projects. In addition to the traditional method of analyzing hierarchies, alternative methods based on the method of latent variables and correlation analysis have been proposed. For group expert assessment, a method for processing expert information is suggested with the competence of experts accounted for. The method is based on the assumption that the expert’s competence is proportional to how closely the expert’s opinion on all projects coincides with the average opinion of all experts on the same set of projects. In this way, the influence of unscrupulous or incompetent experts on the results of evaluating construction projects will be reduced. In addition, a method for processing group expertise based on the theory of latent variables has been proposed. The method being suggested is based on the Rasch model for estimating latent variables. The proposed models make it possible to increase the efficiency of decision-making when choosing construction projects.

1. Kravchenko K.A. Organizational building and personnel management of a large company. Moscow, Academic project; 2005. 557 p. (In Russ.).

2. Barkalov S.A., Karpovich M.A., Moiseev S.I. Hierarchy Analysis Method: An approach based on latent variable theory. Vestnik Yuzhno-Ural'skogo gosudarstvennogo universiteta. Seriya: Komp'yuternyye tekhnologii, upravleniye, radioelektronika = Bulletin of the South Ural State University. Series: Computer technologies, control, radio electronics. 2022;22(2):58–66. (In Russ.).

3. Anan'ev A.V., Ivannikov K.S., Moiseev S.I. Application of the theory of latent variables to analyze the elemental basis of signal processing devices based on the method of paired comparisons. Sistemy upravlenija i informacionnye tehnologii = Management systems and information technologies. 2022;89(3):35–38. (In Russ.).

4. Ponomareva A.N. Using the hierarchy analysis method in the selection of priority criteria for analyzing the innovative activities of enterprises. Aktual'nye voprosy jekonomicheskih nauk = Current issues in economic sciences. 2010;11(1):235–240. (In Russ.).

5. Saaty T., Kearns K.M. Analytical planning. Organization of systems. Translated from English. Moscow, Radio and communications; 1991. 224 p. (In Russ.).

6. Lootsma F.A. Scale sensitivity in the multiplicative AHP and SMART. J. Multi-Criteria Decision Analysis. 1993:2.

7. Maslak A.A., Moiseev S.I. Rasch model for estimating latent variables and its properties. Voronezh, SPC Nauchnaya kmoga; 2016. 177 p. (In Russ.).

8. Barkalov S.A., Kireev Ju.V., Kobelev V.S., Moiseev S.I. A model for assessing the attractiveness of alternatives in the Rasch analysis approach. Sistemy upravlenija i informacionnye tehnologii = Control systems and information technology. 2014;57(3.2):209–213. (In Russ.).

9. Moiseev S.I. Rasch model of latent variable estimation based on the method of least squares. Sistemy upravlenija i informacionnye tehnologii = Economics and management of control systems. 2015;16(2.1):166–172. (In Russ.).

10. Maslak A.A., Moiseev S.I., Osipov S.A. Comparative analysis of Rasch model parameter estimates obtained by maximum likelihood and least squares methods. Problemy upravlenija = Management problems. 2015;(5):58–66. (In Russ.).