Collection and processing of expert data in the method of evaluating the quality of information systems "Inspector"

his article discusses the process of assessing the consistency of expert data and calculating the final value of the desired (resulting) indicators for the quality assurance methodology for the “Auditor” information systems. The purpose of the study is to solve the problem of selecting and adapting survey methods (online questioning) of experts; assessment of the consistency of the data; calculating the final value of the resulting indicators according to experts. To conduct an online survey of experts, the Delphi method was adapted. Its modification consists in the following: after conducting a round of questioning, it is necessary to determine the consistency of expert opinions on each indicator to be evaluated, and if the consistency of experts on any of the sets of assessments is not achieved, it is necessary: 1) to receive comments from experts on assessments of “problematic” ones ( inconsistent) indicators; 2) to organize a second round of the survey, while before the start of the second round, each participant receives expert comments on each of the uncoordinated issues. This stage will be repeated until the opinions of experts are agreed upon. It is proposed to evaluate the consistency of expert opinions by calculating the value of the confidence interval. To evaluate the total values of indicators, it is recommended to use the median. The materials of the article are of practical value for organizations of various fields, conducting an assessment of the quality of their own information systems independently, and for IT companies providing services for this assessment.

1. Dennis Louise A., Michael Fisher, Nicholas K. Lincoln, Alexei Lisitsa, Sandor M. Practical verification of decision-making in agent-based autonomous systems. Automated Software Engineering. 2016;23(3):305-359.

2. Gurvirender Tejay, Gurpreet Dhillon, Amita Goyal Chin. Data quality dimensions for information systems security: a theoretical exposition (invited paper). Security management, Integrity, and Internal Control in Information system. 2006;193:21-39.

3. Knyazeva O.M., Mustafaeva N.N. The techniques of assessment of quality of university data processing systems. Vestnik of Astrakhan State Technical University. Series: Management, Computer Science and Informatics. 2017;2:69-79.

4. Azhmuhamedov I.M., Knyazeva O.M. A comprehensive criterion for assessing the quality of information systems. Actual problems of the humanities and natural sciences. 2017:4-6: 14-17.

5. Romanova O.M., Kurguzkin K.N. Development of the software concept of the technique of assessment of quality of information systems "Inspector". Modeling, Optimization and Information Technologies. 2018;2(21):354-367.

6. Vetrenko YU.I. "Delphi" method in the enterprise management system. Interuniversity collection of scientific papers “Economics. Society. Human". 2016:132-135.

7. Saparova G.B., ZHusupova E.M. Features of the application of the “Delphi” method in companies in the field of consulting services. News of Osh Technological University. 2016;1:44-47.

8. Alieva M.YU., Arslanhanova F.A. Delphi method and features of its application in economic analysis. Collection of articles of the VIII International scientific-practical conference: in 2 parts "Innovative research: theory, methodology, practice". 2017:65-68.

9. Kuznecova N.V. The Delphi method as a tool for updating the core competencies of an individual in the process of training managerial personnel. Sociosphere. 2016;4:69-73.

10. Kupriyanova A.S. Specificity of the Delphi Method as a Remote Brainstorming. Materials of the student scientific conference "Management Methods: teams, solutions, consulting", 2015:264-267.

11. CHernousova M.V. metody ekspertnyh ocenok. Delphi Method. International scientific and technical conference of young scientists BSTU IM. V.G. Shukhov. 2017:6575-6579.

12. Slabinskaya I.A., Slabinskij D.V., Benderskaya O.B. Features of the modern stage of development of a comprehensive analysis of economic activity. Belgorod Economic Bulletin. 2015;1(77):95-100.