INFORMATION RECEIVING IN ONLINE TRAINING PROCESS MANAGEMENT BASED ON COMPLEX OPEN ENDED ASSIGNMENTS SCORING

Information gathering stage is one of the most important stages in management. The efficiency of management depends on received information. Information gathering methods depend on an object of management specificity. Testing results are the main information in training process management in training systems. Collected statistics of the testing results is the base for decision-making. A problem occurs when a training course contains tasks, implementation results of which cannot be checked by means of tests. Such tasks are complex open ended assignments. Different methods are used for scoring such tasks in learning management systems and massive open online course platforms. The methods are addressed in the paper. Method classes such as: methods implemented by standard tools of training systems (student self assessment, peer assessment, tutor or external expert manual assessment), methods implemented by extending the functional possibilities of training systems (situational assignment), methods implemented by external programs (special methods for specific domain) are described. Applicability of methods for information gathering in online training process management is identified. Reliable and complete information can be received only by using situational assignment and special methods for specific domain.

1. Latypova V.A. Slozhnye otkrytye zadachi v smeshannom i distantsionnom avtomatizirovannom obuchenii // Inzhenernyy vestnik Dona. 2015. №3. S. 58. URL: ivdon.ru/ru/magazine/archive/n3y2015/3211.

2. Evtushenko K.N., Satarov A.V. Avtomatizirovannaya proverka laboratornykh rabot v TulGU// Informatsionnye tekhnologii v obrazovanii: III Vseros. nauch.-prakt. konf. 2011. URL: saratov.ito.edu.ru/2011/section/179/index.html.

3. Tikhonenko T. V. Avtomatizatsiya protsessa proverki vypolneniya laboratornykh rabot // Problemy sovremennogo obrazovaniya v tekhnicheskom vuze: materialy III Resp. nauch.-metod. konf., Gomel', 31 okt.–1 noyab. 2013 g. Gomel': GGTU im. P. O. Sukhogo, 2013. S. 38-40.

4. Sychev O. A., Pakhomov D. A. Generatsiya opisaniya regulyarnogo vyrazheniya na estestvennom yazyke kak instrument pomoshchi sostavitelyu regulyarnogo vyrazheniya// Izvestiya VolgGTU. Vyp. 22. 2014. № 25. S. 86- 94

5. Willems C., Meinel C. Online assessment for hands-on cyber security training in a virtual lab // Proceedings of the Global engineering education conference (IEEE EDUCON), 17-20 April 2012, Marrakech, Morocco. IEEE Press, 2012. URL: researchgate.net/profile/Christian_Willems/publications.

6. Latypova V.A. Metodiki proverki rabot so slozhnym rezul'tatom v usloviyakh smeshannogo i distantsionnogo avtomatizirovannogo obucheniya// Internetzhurnal «Naukovedenie». 2015. Tom 7. №3. S. 110. URL: naukovedenie.ru/PDF/170TVN315.pdf.

7. Latypova V.A. Metodiki proverki mnogoshagovykh zadach v usloviyakh smeshannogo i distantsionnogo avtomatizirovannogo obucheniya // Internetzhurnal «Naukovedenie». 2015. Tom 7. №4. S. 83. URL: naukovedenie.ru/PDF/58TVN415.pdf

8. Latypova V.A. Metodiki provedeniya i proverki laboratornykh rabot pri smeshannom i distantsionnom avtomatizirovannom obuchenii // Inzhenernyy vestnik Dona. 2015. №3. S. 35. URL: ivdon.ru/ru/magazine/archive/n3y2015/3129.

9. Balfour S. Assessing writing in MOOCs: automated essay scoring and calibrated peer review // Research & Practice in Assessment. 2013. Vol. 8. pp 40-48.

10. Tuned models of peer assessment in MOOCs / C. Piech, J. Huang, Z. Chen, C. Do, A. Ng, D. Koller // Proceedings of the 6th Intern. Conf. on Educational Data Mining. July 6-9, Memphis, TN, USA. International Educational Data Mining Society, 2013. pp.153-160.

11. Grading the graders: motivating peer graders in a MOOC / Y. Lu, J. Warren, C. Jermaine, S. Chaudhuri, S. Rixner // 24th Intern. WWW Conf., 2015. URL: www2015.it/documents/proceedings/proceedings/p680.pdf.

12. Wang Y. Focus and attitude in computer-mediated peer assessment: ePortfolios methods in Chinese context // Computational Science – ICCS 2007, 7th International Conf., Beijing, China, May 27 - 30, Proceedings, Part III. Berlin Heidelberg: Springer, 2007. pp. 501-507.

13. Vogelsang T., Ruppertz L. On the validity of peer grading and a cloud teaching assistant system//Proceedings of the 5th Intern. Conf. on Learning Analytics And Knowledge, March 16-20, 2015. N.Y., US: ACM, 2015. pp.41-50.

14. Alekseev S.N. Kompetentnostno-orientirovannaya model' kursovogo proektirovaniya v vuzakh MChS Rossii: avtoref. dis. ... kand. ped. nauk: 13.00.08. SPb, 2011. 23 s.

15. Dyatlov R.N. Proektirovanie elektronnykh uchebnykh zadach dlya distantsionnoy podderzhki uchebnogo protsessa//Metody obucheniya i organizatsiya uchebnogo protsessa v vuze: Materialy IV Vseros. nauch.- metod. konf., Ryazan', Ryazanskiy gos. radiotekhn. un-t., 2015, s.348-349.

16. Krapivko Yu. A. Predstavlenie khoda resheniya zadachi v komp'yuternoy obuchayushchey sisteme // Molodezh' i nauka: Sb. materialov VIII Vseros. nauch.-tekhn. konf. studentov, aspirantov i molodykh uchenykh, posvyashchennoy 155-letiyu so dnya rozhdeniya K. E. Tsiolkovskogo. Krasnoyarsk: Sib. fed. un-t, 2012. URL: conf.sfukras.ru/sites/mn2012/section12.html.

17. Ovcharenko O.I., Plaksienko E.A. Sovershenstvovanie sistemy proverki kompetentsiy studentov na baze ispol'zovaniya sovremennykh informatsionnykh tekhnologiy i situatsionnykh zadaniy // Vestnik Taganrogskogo instituta upravleniya i ekonomiki. 2012. № 1(15). C. 84-87.