Abstract
This work presents the intelligent tutoring system, EvoLogic, developed to assist students in problems of natural production in propositional logic. EvoLogic has been modeled as a multiagent system composed of three autonomous agents: interface, pedagogical and specialist agents. It supports pedagogical strategies inspired by the theory of example-based learning based on the use of an automated model tracing mechanism. This mechanism eliminates the necessity of the teacher to manually design every possible interaction between students and EvoLogic. It also includes several examples for each propositional rule. A specific study carried out with a set of 10 exercises taken from a real-world scenario is then presented to evaluate EvoLogic’s performance and compare it to that of an earlier ITS (Heráclito) developed for the same purpose. The study showed that EvoLogic was able to provide different (and correct) solutions for the exercises analyzed. By having these solutions available, the model tracing mechanism was able to follow the students’ steps, providing help that was consistent with the line of reasoning pursued by each student. A direct comparison between EvoLogic and Heráclito, which operates using one single line of reasoning for each theorem proof, showed that the model tracing mechanism of EvoLogic was more accurate in guiding students in the exercises. In addition to this positive outcome, EvoLogic’s model tracing mechanism is novel in its use of genetic algorithms to build solutions on the fly for propositional logic exercises started by the students.
Similar content being viewed by others
References
Anderson, J. R. (1983). The Architecture of Cognition. Harvard University Press.
Anderson, J. R., Conrad, F. G., & Corbett, A. T. (1989). Skill acquisition and the LISP tutor. Cognitive Science, 13(4), 467–505.
Anderson, J. R. (1993). Rules of the Mind. Lawrence Erlbaum Associates.
Anderson, J. R., Corbett, A. T., Koedinger, K. R., & Pelletier, R. (1995). Cognitive tutor: Lesson learned. The Journal of the Learning Sciences, 4(2), 167–207.
Aleven, V., McLaren, B. M., Sewall, J., & Koedinger, K. R. (2009). A new paradigm for intelligent tutoring systems: Example-tracing tutors. International Journal of Artificial Intelligence in Education (IJAIED), 19(2), 105–154.
Aleven, V., McLaren, B.M., Sewall, J. nóet al. (2016) Example-Tracing Tutors: Intelligent Tutor Development for Non-programmers. International Journal of Artificial Intelligence in Education (IJAIED), 26, 224–269.
Bertot, Y., & Castéran, P. (2004) Interactive Theorem Proving and Program Development: Coq’Art: The Calculus of Inductive Constructions. Springer-Verlag Berlin Heidelberg.
Bornat, R., & Sufrin, B. (1999). A Minimal Graphical User Interface for the Jape Proof Calculator. Formal Aspects of Computing, 11, 244–271.
Broda, K., Ma, J., Sinnadurai, G., & Summers, A. (2007). Pandora: A Reasoning Toolbox using Natural Deduction Style. Logic Journal of the IGPL, 15(4), 293–304.
Dorri, A., Kanhere, S.S., Jurdak, R.: Multi-agent systems: A survey. Ieee Access6, 28573–28593 (2018)
FIPA ACL. (2002). Message Structure Specification. Technical report.
Galafassi C., Galafassi F. F. P., Reategui E. B., & Vicari R.M. (2020) EvoLogic: Intelligent Tutoring System to Teach Logic. In: Cerri R., Prati R.C. (eds) Intelligent Systems. BRACIS 2020. Lecture Notes in Computer Science, 12319 (pp. 110-121). Springer, Cham.
Galafassi, F.F.P., Galafassi, C., Gluz, J.C., Vicari, R.M., & Peres R.K. (2017) Heráclito: Learning Environment to Teach Logic. In: Demazeau Y., Davidsson P., Bajo J., Vale Z. (eds) Advances in Practical Applications of Cyber-Physical Multi-Agent Systems: The PAAMS Collection. PAAMS 2017. Lecture Notes in Computer Science, 10349 (pp. 316-320). Springer, Cham.
Galafassi, F. F. P., Galafassi, C., Vicari, R., & J. C. Gluz. (2019a) Identifying Knowledge from the Application of Natural Deduction Rules in Propositional Logic. Advances in Practical Applications of Survivable Agents and Multi-Agent Systems: The PAAMS Collection, 66-77.
Galafassi F.F.P., Galafassi C., Vicari R.M., & Gluz J.C. (2019b) Heráclito: Intelligent Tutoring System for Logic. In: Demazeau Y., Matson E., Corchado J., De la Prieta F. (eds) Advances in Practical Applications of Survivable Agents and Multi-Agent Systems: The PAAMS Collection. PAAMS 2019. Lecture Notes in Computer Science, 11523 (pp. 251-254). Springer, Cham.
Gluz, J. C., Penteado, F. F., Mossmann, M., Gomes, L., & Vicari, R. (2013) Heraclito: a Dialectical Tutor for Logic. In: Portuguese Conference on Artificial Intelligence, EPIA. 16th Portuguese Conference on Artificial Intelligence, New York: Springer. 8154 (pp. 1-2).
Holland, J. H. (1975) Adaptation in Natural and Artificial Systems. University of Michigan Press, Ann Arbor, Michigan.
Koedinger, K. R., Aleven, V., Heffernan, N., McLaren, B., & Hockenberry, M. (2004). Opening the door to non-programmers: Authoring intelligent tutor behavior by demonstration. In J. C. Lester, R. M. Vicario, & F. Paraguaçu (Eds.), Proceedings of seventh International Conference on Intelligent Tutoring Systems, ITS 2004 (pp. 162–174). Berlin: Springer.
Lesta, L., Yacef, K. (2002) An Intelligent Teaching Assistant System for Logic. In: Cerri S.A., Gouardères G., Paraguaçu F. (eds) Intelligent Tutoring Systems. Lecture Notes in Computer Science, 2363, (pp. 421-431). Springer, Berlin, Heidelberg.
Lukins, S.; Levicki, A. & Burg, J. (2002) A Tutorial Program for Propositional Logic with Human/Computer Interactive Learning. Proceedings of the 33rd SIGCSE Technical Symposium on Computer Science Education, 381-385.
MacLellan, C., Koedinger, K. R., & Matsuda, N. (2014). Authoring tutors with SimStudent: An evaluation of efficiency and model quality. In S. Trausan-Matu, K. E. Boyer, M. Crosby, & K. Panourgia (Eds.), Proceedings of the 12th International Conference on Intelligent Tutoring Systems, ITS 2014 (pp. 551– 560).
Matsuda, N., Cohen, W. W., & Koedinger, K. R. (2015). Teaching the teacher: Tutoring SimStudent leads to more effective Cognitive Tutor authoring. International Journal of Artificial Intelligence in Education (IJAIED), 25(1), 1–34.
McCune, W. (2005) Prover9 and Mace4 website. https://www.cs.unm.edu/~mccune/prover9/. Accessed 03 February 2021.
Nipkow, T., Wenzel, M., & Paulson, L. C. (2002). Isabelle/HOL: A Proof Assistant for Higher-Order Logic. Berlin, Heidelberg: Springer-Verlag.
Pospesel, H. (1999) Introduction to Logic: Propositional Logic, Revised Edition. Pearson, 3rd ed.
Renkl, A. (2011) Instruction based on examples. In Richard E. Mayer, Patricia A. Alexander (eds) Handbook of research on learning and instruction. New York: Routledge. (pp. 272-295).
Renkl, A. (2014). Toward an instructionally oriented theory of example-based learning. Cognitive Science., 38(1), 1–37.
Ritter, S., Blessing, S., Wheeler, L. (2003) User Modeling and Problem-Space Representation in the Tutor Runtime Engine. In: Brusilovsky P., Corbett A., de Rosis F. (eds) User Modeling 2003. UM 2003. Lecture Notes in Computer Science, vol 2702. Springer, Berlin, Heidelberg.
Schulz, S., Cruanes, S., & Vukmirović, P. (2019) Faster, Higher, Stronger: E 2.3. In: Fontaine P. (eds) Automated Deduction – CADE 27. CADE 2019. Lecture Notes in Computer Science, 11716, (pp. 495-507). Springer, Cham.
Sieg, W. (2007). The AProS project: Strategic thinking & computational logic. Logic Journal of IGPL, 15(4), 359–368.
van Gog, T., & Rummel, N. (2010). Example-based learning: Integrating cognitive and social-cognitive research perspectives. Educational Psychology Review., 22(2), 155–174.
Viccari, R. M., & Coelho, H. (1987) A Prolog tutor for logic programming. In: PEG-Prolog Education Group- Annual Conference, Exeter.
Viccari, R. M., Flores, C. D., Silvestre, A. M., Seixas, L., Ladeira, M., & Coelho, H. (2003). A Multi-Agent Intelligent Environment for Medical Knowledge. Artificial Intelligence in Medicine, Elsevier Science, 27, 335–366.
Weidenbach, C., Dimova, D., Fietzke, A., Kumar R., Suda M., & Wischnewski P. (2009) SPASS Version 3.5. In: Schmidt R.A. (eds) Automated Deduction – CADE-22. Lecture Notes in Computer Science, 5663, (pp. 140-145). Springer, Berlin, Heidelberg.
Weitekamp, D., Harpstead, E. & Koedinger, K. R. (2020) An Interaction Design for Machine Teaching to Develop AI Tutors. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, 1–11.
Yacef, K. (2005). The Logic-ITA in the classroom: a medium scale experiment. International Journal of Artificial Intelligence in Education (IJAIED), 15, 41–62.
Acknowledgments
This study was financed in part by the Coordenação de Aperfeiçoamento de Pessoal de Nível Superior – Brasil (CAPES) – Finance Code 001.
Funding
Coordenação de Aperfeiçoamento de Pessoal de Nível Superior – Brasil (CAPES) – Finance Code 001
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Galafassi, C., Galafassi, F.F.P., Vicari, R.M. et al. EvoLogic: Toward an ITS for Teaching Propositional Logic. Int J Artif Intell Educ 33, 35–58 (2023). https://doi.org/10.1007/s40593-021-00287-7
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s40593-021-00287-7