Abstract
Assessment of the competency development level (CDL) is one of the key tasks in the implementation of e-learning, especially in the dynamics. There is a difficulty in combining competency profiles with respect to the different knowledge blocks (courses and their groups), which allows justifying pedagogical influence. The paper considers the Intelligent Tutoring System (ITS) mechanisms responsible for integration of competency profiles at curriculum level. For this purpose, the mechanism of expert systems (based on Shortliffe criterion) is used. The results of the experiment on supporting the learning process of the master’s degree students of the specialty “Informatics and Computer Science” have shown that the CDL assessment method allows recording the individual and group dynamics of competency development. Star diagrams, Cognitive Maps of Knowledge Diagnosis and UGVA method are chosen as the basis for visualization of course-level and curriculum-level competency profiles. It is shown that all of them not only can be built into the ITS automated decision-making chain, but also into the process of synthesizing the text explaining these decisions.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
References
Arrieta, A.B., et al.: Explainable Artificial Intelligence (XAI): concepts, taxonomies, opportunities and challenges toward responsible AI. Inf. Fusion 58, 82–115 (2020)
Baker, R.S.: Stupid tutoring systems, intelligent humans. Int. J. Artif. Intell. Educ. 26, 600–614 (2016)
Bodily, R., Verbert, K.: Trends and issues in student-facing learning analytics reporting systems research. In: Proceedings of the Seventh International Learning Analytics and Knowledge Conference (LAK 2017), pp. 309–318. Association for Computing Machinery, New York, NY, USA (2017). https://doi.org/10.1145/3027385.3027403
Bolsunovsky, N.: Implementation of the expert system constructor as a network service. In: Proceedings of the XIV All-Russian Conference Robotics and Artificial Intelligence, pp. 138–143. Litrra-Print, Krasnoyarsk, Russia (2022). https://aesfu.ru/local/conference/_docs/2022/RAI-22_print.pdf
Buchanan, B., Shortliffe, E.: Rule-Based Expert System: The MYCIN Experiments of the Stanford Heuristic Programming Project. Addison-Wesley, New York (1984)
Gavrilova, T.A., Kokoulina, L.: Using ontology engineering to design an artificial intelligence course. In: Uskov, V.L., Howlett, R.J., Jain, L.C. (eds.) Smart Education and e-Learning 2019. SIST, vol. 144, pp. 201–207. Springer, Singapore (2019). https://doi.org/10.1007/978-981-13-8260-4_19
Henry, N.W.: Latent structure analysis. Encyclopedia Stat. Sci. 6 (2004)
Huang, Y., Brusilovsky, P., Guerra, J., Koedinger, K., Schunn, C.: Supporting skill integration in an intelligent tutoring system for code tracing. J. Comput. Assist. Learn. 39(2), 477–500 (2023). https://doi.org/10.1111/jcal.12757
Ilves, K., Leinonen, J., Hellas, A.: Supporting self-regulated learning with visualizations in online learning environments. In: Proceedings of the 49th ACM Technical Symposium on Computer Science Education (SIGCSE 2018), pp. 257–262. Association for Computing Machinery, New York, NY, USA (2018)
Jensen, M.L., Mondrup, F., Lippert, F., Ringsted, C.: Using e-learning for maintenance of ALS competence. Resuscitation 80(8), 903–908 (2009). https://doi.org/10.1016/j.resuscitation.2009.06.005
Likert, R.: A technique for the measurement of attitudes. Arch. Psychol. 140, 44–53 (1932)
Litovkin, D., Anikin, A., Kulyukin, K., Sychev, O.: Intelligent tutor for designing function interface in a programming language. In: Crossley, S., Popescu, E. (eds.) Intelligent Tutoring Systems, pp. 293–302. Springer, Cham (2022). https://doi.org/10.1007/978-3-031-09680-8_27
Miller, G.: The magical number seven, plus or minus two: some limits on our capacity for processing information. Psychol. Rev. 63(2), 81–97 (1956)
Pawlowski, E., Soroui, J.: Analysing PIAAC data with the international data explorer (IDE). In: Large-Scale Cognitive Assessment: Analyzing PIAAC Data, pp. 93–115 (2020). https://doi.org/10.1007/978-3-030-47515-4_5
Phobun, P., Vicheanpanya, J.: Adaptive intelligent tutoring systems for e-learning systems. Procedia. Soc. Behav. Sci. 2(2), 4064–4069 (2010). https://doi.org/10.1016/j.sbspro.2010.03.641
Rust, J., Golombok, S.: Modern Psychometrics: The Science of Psychological Assessment. Routledge, NY (2014)
Rybina, G.: Intelligent tutoring systems: analysis of basic architectures and features of the application of the ontological approach (on the example of the experience of developing and practical use of tutoring integrated expert systems). Instrum. Syst. Monit. Control Diagn. 2, 23–43 (2023). https://doi.org/10.25791/pribor.2.2023.1388. (in Russian)
Shute, V., Towle, B.: Adaptive e-learning. In: Educational Psychologist, pp. 105–114. Routledge (2018)
Uglev, V., Dobronets, B.: Methodic of automatic measurement and estimation of the level of competences development. Inf. Educ. 281(2), 61–65 (2017). https://info.infojournal.ru/jour/article/view/149/150. (in Russian)
Uglev, V., Gavrilova, T.: Cross-cutting visual support of decision making for forming personalized learning spaces. In: Krouska, A., Troussas, C., Caro, J. (eds.) Novel & Intelligent Digital Systems: Proceedings of the 2nd International Conference (NiDS 2022). LNNS, vol. 556, pp. 3–12. Springer, Cham (2023). https://doi.org/10.1007/978-3-031-17601-2_1
Uglev, V., Sychev, O.: Concentrating competency profile data into cognitive map of knowledge diagnosis. In: Basu, A., Stapleton, G., Linker, S., Legg, C., Manalo, E., Viana, P. (eds.) Diagrams 2021. LNCS (LNAI), vol. 12909, pp. 443–446. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-86062-2_46
Uglev, V., Sychev, O.: Evaluation, comparison and monitoring of multiparameter systems by Unified Graphic Visualization of Activity method on the example of learning process. Algorithms 15(21), 468 (2022). https://doi.org/10.3390/a15120468
Uglev, V.A., Ustinov, V.A.: The new competencies development level expertise method within intelligent automated educational systems. In: Bajo Perez, J., et al. (eds.) Trends in Practical Applications of Heterogeneous Multi-Agent Systems. The PAAMS Collection. AISC, vol. 293, pp. 157–164. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-07476-4_19
Weber, S., Achtenhagen, F.: Competence domains and vocational-professional education in Germany. In: Competence-Based Vocational and Professional Education: Bridging the Worlds of Work and Education, pp. 337–359 (2017)
Woloszynski, T., Kurzynski, M.: On a new measure of classifier competence in the feature space. Comput. Recognit. Syst. 3, 285–292 (2009)
Zadeh, L.A., Aliev, R.A.: Fuzzy Logic Theory and Applications: Part I and Part II. World Scientific Publishing, Singapore (2018)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Uglev, V., Shangina, E. (2023). Assessment and Visualization of Course-Level and Curriculum-Level Competency Profiles. In: Gervasi, O., et al. Computational Science and Its Applications – ICCSA 2023 Workshops. ICCSA 2023. Lecture Notes in Computer Science, vol 14104. Springer, Cham. https://doi.org/10.1007/978-3-031-37105-9_32
Download citation
DOI: https://doi.org/10.1007/978-3-031-37105-9_32
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-37104-2
Online ISBN: 978-3-031-37105-9
eBook Packages: Computer ScienceComputer Science (R0)