Skip to main content
SpringerLink
Log in

Research on a new automatic generation algorithm of concept map based on text analysis and association rules mining

  • Original Research
  • Published:
Journal of Ambient Intelligence and Humanized Computing Aims and scope Submit manuscript

Abstract

As an important knowledge visualization tool, concept map has become a research hotspot in educational data mining. Traditional concept map generation algorithms are difficult to generate concept maps quickly because of their strong reliance on experts’ experience. A hybrid TA-ARM algorithm for automatic generation of concept map based on text analysis and association rule mining is proposed. The TA-ARM algorithm fully considers the association rules between concepts, uses the text classification algorithm in text analysis technology instead of manually classify the questions into concepts, and combines the association rule mining method to generate concept maps. The experimental result shows that the TA-ARM algorithm can automatically and rapidly generate the concept map, which not only reduces the impact of outside experts, but can also dynamically adjusts the concept map based on the parameters such as the threshold of confidence between test questions. The concept map generated by the TA-ARM algorithm expresses the association rules between the concepts and the degree of closeness through the associated pairs and relevant degree, and can clearly show the structural associations between concepts. The contrast experiment shows that the quality of the concept map automatically generated by the TA-ARM has a high quality and can visualize the associations between concepts and provide optimization and guidance for knowledge visualization.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  • Acharya A, Sinha D (2015) Construction of automated concept map of learning using hashing technique advances. Intell Syst Comput 327:567–578

    Google Scholar 

  • Acharya A, Sinha D (2017) An educational data mining approach to concept map construction for web based learning. Inf Econ 21:41–58. https://doi.org/10.12948/issn14531305/21.4.2017.04

    Article  Google Scholar 

  • Agrawal R, Imielinski T, Swami AN (1993) Mining association rules between sets of items in large databases. In: SIGMOD Conference

  • Atapattu T, Falkner K, Falkner N (2017) A comprehensive text analysis of lecture slides to generate concept maps. Comput Educ 115:96–113

    Article  Google Scholar 

  • Bai SM, Chen SM (2008) Automatically constructing concept maps based on fuzzy rules for adapting learning systems. Expert Syst Appl 35:41–49

    Article  Google Scholar 

  • Baker RS (2014) Educational data mining: an advance for intelligent systems in education. IEEE Intell Syst 29:78–82

    Article  Google Scholar 

  • Bertsimas D, King A (2017) Logistic regression: from art to science. Stat Sci 32:367–384. https://doi.org/10.1214/16-STS602

    Article  MathSciNet  MATH  Google Scholar 

  • Booth DE (2007) Data mining methods and models. Technometrics 49:500–500

    Article  Google Scholar 

  • Cao P (2016) On the transforming paths to future school—orientation and sustainable development of “internet + education”. Educ Res 41:46–51

    Google Scholar 

  • Caputo GM, Ebecken NFF (2011) Concept map construction applying natural language processing on text extracted from e-commerce web pages. In: Nature and biologically inspired computing, 2011 Third World Congress on, IEEE, pp 409–414

  • Chen SM, Sue PJ (2013) Constructing concept maps for adaptive learning systems based on data mining techniques. Expert Syst Appl 40:2746–2755

    Article  Google Scholar 

  • Chen NS, Kinshuk P, Wei CW, Chen HJ (2006) Mining e-learning domain concept map from academic articles. In: IEEE international conference on advanced learning technologies, pp 694–698

  • Coffey JW, Hoffman RR, Cañas AJ, Ford KM (2002) A concept map-based knowledge modeling approach to expert knowledge sharing. In: Boumedine M (Ed), proceedings of IKS 2002—the IASTED international

  • Cohen KB (2004) Natural language processing for online applications: text retrieval, extraction and categorization (review). Language 80:510–511

    Google Scholar 

  • Cowan AM (2002) Data Mining in Finance: Advances in Relational and Hybrid Methods: Boris Kovalerchuk and Evgenii Vityaev (Eds.), Kluwer Academic Publishers, Norwell, Massachusetts, 2000, HB US $120, ISBN 0-7923-7804-0. Int J Forecast 18:155–156

    Article  Google Scholar 

  • El-Khair IA (2009) TF*IDF Encyclopedia of Database Systems 13:3085–3086

    Google Scholar 

  • Heiner C, Heffernan N (2014) Educational data mining. Stud Comput Intell 1(1):467–474

    Google Scholar 

  • Hirashima T, Yamasaki K, Fukuda H, Funaoi H (2015) Framework of kit-build concept map for automatic diagnosis and its preliminary use research & practice. Technol Enhanc Learn 10:17

    Article  Google Scholar 

  • Hirschman L, Park JC, Tsujii J, Wong L, Wu CH (2002) Accomplishments and challenges in literature data mining for biology. Bioinformatics 18:1553–1561

    Article  Google Scholar 

  • Huang X, Yang K, Lawrence VB (2015) An efficient data mining approach to concept map generation for adaptive learning. In: Industrial conference on data mining, pp 247–260

    Google Scholar 

  • Islam A, Inkpen D, Kiringa I (2008) Applications of corpus-based semantic similarity and word segmentation to database schema matching. Vldb Journal 17:1293–1320

    Article  Google Scholar 

  • Jiang Y, Tian F, Wang X, Zhang X, Dai G, Wang H (2009) Structuring and manipulating hand-drawn concept maps. In: Universal communication symposium, pp 457–462

  • Kaddoura M, Vandyke O, Cheng B, Shea-Foisy K (2016) Impact of concept mapping on the development of clinical judgment skills in nursing students teaching & learning. Nursing 11:101–107

    Google Scholar 

  • Kurbatow A (2015) The research of text preprocessing effect on text documents classification efficiency. In: “stability and control processes” in memory of V.i. Zubov, pp 653–655

  • Lai CF et al (2017) Using information retrieval to construct an intelligent E-book with. Keyword Concept Map 13:6637–6647

    Google Scholar 

  • Larose DT (2004) k-nearest neighbor algorithm. Wiley, New York

    Book  Google Scholar 

  • Li L et al (2004) Data mining techniques for cancer detection using serum proteomic profiling. Artif Intell Med 32:71–83

    Article  Google Scholar 

  • Markham KM, Mintzes JJ, Jones MG (2010) The concept map as a research and evaluation tool: Further evidence of validity. J Res Sci Teach 31:91–101

    Article  Google Scholar 

  • Matsumoto T, Sunayama W, Hatanaka Y, Ogohara K (2017) Data analysis support by combining data mining and text mining. In: Iiai international congress on advanced applied informatics, pp 313–318

  • Mccallum A (1998) A comparison of event models for naive bayes text classification. In: AAAI-98 workshop on learning for text categorization, pp 41–48

  • Melucci M (2017) Vector-space model. In: Liu L, Özsu M (eds) Encyclopedia of database systems. Springer, New York, pp 1–6. https://doi.org/10.1007/978-1-4899-7993-3

    Chapter  Google Scholar 

  • Moschitti A (2003) A Study on optimal parameter tuning for rocchio text classifier lecture notes. in Computer Science 2633:420–435

    MATH  Google Scholar 

  • Noble WS (2006) What is a support vector machine? Nat Biotechnol 24:1565–1567

    Article  Google Scholar 

  • Novak JD, Cañas AJ (2007) Theoretical origins of concept maps, how to construct them, and uses in education. Reflect Educ 3(1):29–42

    Google Scholar 

  • Novak JD, Gowin DB (1984) Learning how to learn. Cambridge University Press, Cambridge

    Book  Google Scholar 

  • Nugumanova A et al (2015) Automatic generation of concept maps based on collection of teaching materials. In: International conference on data management technologies and applications, pp 248–254

  • Oppl S, Stary C (2017) Effects of a tabletop interface on the co-construction of concept maps. In: Human-computer interaction—INTERACT 2011—Ifip Tc 13 international conference, Lisbon, Portugal, September 5–9, 2011, proceedings, pp 443–460

  • Paul RS (2012) A review of “learning, creating, and using knowledge: concept maps as facilitative tools in schools and corporation”. Inf Soc 28:57–59

    Article  Google Scholar 

  • Qasim I, Jeong JW, Heu JU, Lee DH (2013) Concept map construction from text documents using affinity propagation. J Inf Sci 39:719–736

    Article  Google Scholar 

  • Romero C, Ventura S (2007) Educational data mining: a survey from 1995 to 2005. Expert Syst Appl 33:135–146

    Article  Google Scholar 

  • Santos V (2018) Concept maps construction using natural language processing to support studies selection. In: SAC 2018, Pau, France, 9–13 April 2018, ACM. https://doi.org/10.1145/2851613.2851735. ISBN 978-1-4503-5191-1/18/04

  • Slater S, Joksimovic S, Kovanovic V, Baker RS, Gasevic D (2018) Tools for educational data mining: a review. J Open Learn 42:85–106

    Google Scholar 

  • Steinbach MA (2000) comparison of document clustering techniques. In: World text mining conference

  • Toivonen H (2011) Apriori algorithm. In: Sammut C, Webb GI (eds) Encyclopedia of machine learning. Springer, Boston, MA. https://doi.org/10.1007/978-1-4899-7687-1

    Chapter  Google Scholar 

  • Tseng SS, Sue PC, Su JM, Weng JF, Tsai WN (2007) A new approach for constructing the concept map. Comput Educ 49:691–707

    Article  Google Scholar 

  • Zhang HP, Zhou N, Chen YY (2007) Research on application of concept map in knowledge organization. Inf Sci 25(10):1570–1574

    Google Scholar 

  • Zhang S, Li X, Zong M, Zhu X, Cheng D (2017) Learning k for kNN. Classif ACM Trans Intell Syst Technol 8:43

    Google Scholar 

Download references

Acknowledgements

The authors are grateful to the anonymous reviewers for their constructive comments and invaluable contributions to enhance the presentation of this paper. This work was supported by National Natural Science Foundation of China (no. 71672154), Humanities and Social Sciences Foundation of the Ministry of Education of China (no. 16YJA630038), Joint Research Project between Southwest Jiaotong University and Cornell University (No. 268SWJTU15WTD01), China Postdoctoral Science Foundation (no. 2016M592697), Key Science and Technology Project of Shandong Province of China (no. 2014GGH201022), and Chang Jiang Scholars Program of China.

Author information

Authors and Affiliations

  1. School of Data Science and Computer Science, Shandong Women’s University, Jinan, 250002, China

    Zengzhen Shao, Xuechen Zhao & Yanhui Guo

  2. School of Information Science and Engineering, Shandong Normal University, Jinan, 250014, China

    Zengzhen Shao, Yancong Li & Xiao Wang

Authors
  1. Zengzhen Shao
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yancong Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Xiao Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Xuechen Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Yanhui Guo
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zengzhen Shao.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Appendix: Supplementary material

Appendix: Supplementary material

Supplementary data associated with this article can be found, in the online version, at https://github.com/diligentlee/TA-ARM-data-sets.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Shao, Z., Li, Y., Wang, X. et al. Research on a new automatic generation algorithm of concept map based on text analysis and association rules mining. J Ambient Intell Human Comput 11, 539–551 (2020). https://doi.org/10.1007/s12652-018-0934-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12652-018-0934-9

Keywords

Search

Navigation