Abstract
Domain modeling is an important task in designing, developing, and deploying intelligent tutoring systems and other adaptive instructional systems. We focus here on the more specific task of automatically extracting a domain model from textbooks. In particular, this paper explores using multiple textbook indexes to extract a domain model for computer programming. Our approach is based on the observation that different experts, i.e., authors of intro-to-programming textbooks in our case, break down a domain in slightly different ways, and identifying the commonalities and differences can be very revealing. To this end, we present automated approaches to extracting domain models from multiple textbooks and compare the resulting common domain model with a domain model created by experts. Specifically, we use approximate string-matching approaches to increase coverage of the resulting domain model and majority voting across different textbooks to discover common domain terms related to computer programming. Our results indicate that using approximate string matching gives more accurate domain models for computer programming with increased precision and recall. By automating our approach, we can significantly reduce the time and effort required to construct high-quality domain models, making it easy to develop and deploy tutoring systems. Furthermore, we obtain a common domain model that can serve as a benchmark or skeleton that can be used broadly and adapted to specific needs by others.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Alpizar-Chacon, I., Sosnovsky, S.: Knowledge models from pdf textbooks. New Rev. Hypermedia Multimed. 27(1–2), 128–176 (2021)
Banjade, R.: Domain model discovery from textbooks for computer programming intelligent tutors. In: FLAIRS Conference Proceedings, p. 34 (2021)
Banjade, R., Oli, P., Tamang, L.J., Rus, V.: Preliminary experiments with transformer based approaches to automatically inferring domain models from textbooks. In: Proceedings of the 15th International Conference on Educational Data Mining, p. 667 (2022)
Chau, H., Labutov, I., Thaker, K., He, D., Brusilovsky, P.: Automatic concept extraction for domain and student modeling in adaptive textbooks. Int. J. Artif. Intell. Educ. 31(4), 820–846 (2021)
Cohen, W.W., Ravikumar, P., Fienberg, S.E., et al.: A comparison of string distance metrics for name-matching tasks. In: IIWeb, vol. 3, pp. 73–78 (2003)
Daniel Liang, Y.: Introduction to java programming (2007)
Devlin, J., Chang, M.W., Lee, K., Toutanova, K.: Bert: pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018)
Grootendorst, M.: Polyfuzz: fuzzy string matching, grouping, and evaluation (2020). https://doi.org/10.5281/zenodo.4461050
Hjørland, B.: What is knowledge organization (KO)? Knowl. Organ. 35 (2008). https://doi.org/10.5771/0943-7444-2008-2-3-86
Horstmann, C.S.: Big Java: Early Objects. John Wiley & Sons, Hoboken (2016)
Hosseini, R., Brusilovsky, P.: Javaparser: a fine-grain concept indexing tool for java problems. In: CEUR Workshop Proceedings, vol. 1009, pp. 60–63 (2013)
Ji, Z., Wei, Q., Xu, H.: Bert-based ranking for biomedical entity normalization. AMIA Summits Transl. Sci. Proc. 2020, 269 (2020)
Kumar, A.N.: Model-based reasoning for domain modeling in a web-based intelligent tutoring system to help students learn to debug C++ programs. In: Cerri, S.A., Gouardères, G., Paraguaçu, F. (eds.) ITS 2002. LNCS, vol. 2363, pp. 792–801. Springer, Heidelberg (2002). https://doi.org/10.1007/3-540-47987-2_79
Li, B., Zhou, H., He, J., Wang, M., Yang, Y., Li, L.: On the sentence embeddings from pre-trained language models. In: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 9119–9130 (2020)
Miller, G.A.: Wordnet: a lexical database for English. Commun. ACM 38(11), 39–41 (1995)
Navarro, G.: A guided tour to approximate string matching. ACM Comput. Surv. (CSUR) 33(1), 31–88 (2001)
Olney, A.M.: Extraction of concept maps from textbooks for domain modeling. In: Aleven, V., Kay, J., Mostow, J. (eds.) ITS 2010. LNCS, vol. 6095, pp. 390–392. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-13437-1_80
Paul, D., Harvey, D.: Java-how to program (2012)
Recchia, G., Louwerse, M.M.: A comparison of string similarity measures for toponym matching. Comp. J. South. Comp. Lit. Assoc. (2013)
Rivers, K., Harpstead, E., Koedinger, K.R.: Learning curve analysis for programming: which concepts do students struggle with? In: ICER, vol. 16, pp. 143–151 (2016)
Seehorn, D., et al.: CSTA k-12 computer science standards: Revised 2011. Technical report, New York, NY, USA (2011)
Tew, A.E., Guzdial, M.: Developing a validated assessment of fundamental cs1 concepts. In: Proceedings of the 41st ACM Technical Symposium on Computer Science Education, pp. 97–101 (2010)
Wang, S., Thompson, L., Iyyer, M.: Phrase-bert: improved phrase embeddings from bert with an application to corpus exploration. In: EMNLP, pp. 10837–10851 (2021)
Wu, Z., Li, Z., Mitra, P., Giles, C.L.: Can back-of-the-book indexes be automatically created? In: Proceedings of the 22nd ACM international conference on Information & Knowledge Management, pp. 1745–1750 (2013)
Zechmeister, J.S., Zechmeister, E.B.: Introductory textbooks and psychology’s core concepts. Teach. Psychol. 27(1), 6–11 (2000)
Zhang, Y., Baldridge, J., He, L.: Paws: Paraphrase adversaries from word scrambling. arXiv preprint arXiv:1904.01130 (2019)
Acknowledgments
This work has been supported by the following grants awarded to Dr. Vasile Rus: the Learner Data Institute (NSF award 1934745); CSEdPad: Investigating and Scaffolding Students’ Mental Models during Computer Programming Tasks to Improve Learning, Engagement, and Retention (NSF award 1822816), and Department of Education, Institute for Education Sciences (IES award R305A220385). The opinions, findings, and results are solely the authors’ and do not reflect those of NSF or IES.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Banjade, R., Oli, P., Rus, V. (2023). Automated Extraction of Domain Models from Textbook Indexes for Developing Intelligent Tutoring Systems. In: Frasson, C., Mylonas, P., Troussas, C. (eds) Augmented Intelligence and Intelligent Tutoring Systems. ITS 2023. Lecture Notes in Computer Science, vol 13891. Springer, Cham. https://doi.org/10.1007/978-3-031-32883-1_11
Download citation
DOI: https://doi.org/10.1007/978-3-031-32883-1_11
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-32882-4
Online ISBN: 978-3-031-32883-1
eBook Packages: Computer ScienceComputer Science (R0)