skip to main content
10.1145/3603287.3651221acmconferencesArticle/Chapter ViewAbstractPublication Pagesacm-seConference Proceedingsconference-collections
short-paper
Free Access

MNIST-Fraction: Enhancing Math Education with AI-Driven Fraction Detection and Analysis

Published:27 April 2024Publication History

ABSTRACT

Mathematics education, a crucial and basic field, significantly influences students' learning in related subjects and their future careers. Utilizing artificial intelligence to interpret and comprehend math problems in education is not yet fully explored. This is due to the scarcity of quality datasets and the intricacies of processing handwritten information. In this paper, we present a novel contribution to the field of mathematics education through the development of MNIST-Fraction, a dataset inspired by the renowned MNIST, specifically tailored for the recognition and understanding of handwritten math fractions. Our approach is the utilization of deep learning, specifically Convolutional Neural Networks (CNNs), for the recognition and understanding of handwritten math fractions to effectively detect and analyze fractions, along with their numerators and denominators. This capability is pivotal in calculating the value of fractions, a fundamental aspect of math learning. The MNIST-Fraction dataset is designed to closely mimic real-world scenarios, providing a reliable and relevant resource for AI-driven educational tools. Furthermore, we conduct a comprehensive comparison of our dataset with the original MNIST dataset using various classifiers, demonstrating the effectiveness and versatility of MNIST-Fraction in both detection and classification tasks. This comparative analysis not only validates the practical utility of our dataset but also offers insights into its potential applications in math education. To foster collaboration and further research within the computational and educational communities. Our work aims to bridge the gap in high-quality educational resources for math learning, offering a valuable tool for both educators and researchers in the field.

References

  1. Muhammad Zeshan Afzal, Khurram Azeem Hashmi, Alain Pagani, Marcus Liwicki, and Didier Stricker. 2022. DeHyFoNet: Deformable Hybrid Network for Formula Detection in Scanned Document Images. (2022).Google ScholarGoogle Scholar
  2. Francisco Álvaro, Joan-Andreu Sánchez, and José-Miguel Benedí. 2016. An Integrated Grammar-based Approach for Mathematical Expression Recognition. Pattern Recognition 51 (2016), 135--147.Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Li Chen, Song Wang, Wei Fan, Jun Sun, and Naoi Satoshi. 2015. Deep Learning based Language and Orientation Recognition in Document Analysis. In 2015 13th International Conference on Document Analysis and Recognition (ICDAR). IEEE, Tunis, Tunisia, 436--440.Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Gregory Cohen, Saeed Afshar, Jonathan Tapson, and Andre Van Schaik. 2017. EMNIST: Extending MNIST to Handwritten Letters. In 2017 international joint conference on neural networks (IJCNN). IEEE, Anchorage, Alaska, 2921--2926.Google ScholarGoogle Scholar
  5. Juan Du. 2018. Understanding of Object Detection based on CNN Family and YOLO. In Journal of Physics: Conference Series, Vol. 1004. IOP Publishing, 012029.Google ScholarGoogle Scholar
  6. Seyum Getenet and Rosemary Callingham. 2021. Teaching Interrelated Concepts of Fraction for Understanding and Teacher's Pedagogical Content Knowledge. Mathematics Education Research Journal 33 (2021), 201--221.Google ScholarGoogle ScholarCross RefCross Ref
  7. Dan Hendrycks, Collin Burns, Saurav Kadavath, Akul Arora, Steven Basart, Eric Tang, Dawn Song, and Jacob Steinhardt. 2021. Measuring Mathematical Problem Solving with the Math Dataset. arXiv preprint arXiv:2103.03874 (2021).Google ScholarGoogle Scholar
  8. Karl W Kosko, Temitope Egbedeyi, and Enrico Gandolfi. [n.d.]. Exploring Preservice Teachers' Embodied Noticing of Students' Fraction Division. ([n.d.]).Google ScholarGoogle Scholar
  9. Karl W Kosko, Yuxin Yang, Christine Austin, Qiang Guan, Enrico Gandolfi, and Z Go. 2021. Examining Preservice Teachers' Professional Noticing of Students' Mathematics through 360 Video and Machine Learning. Psychology of Mathematics Education-North America 43 (2021).Google ScholarGoogle Scholar
  10. Vinay Kukreja et al. 2022. Segmentation and Contour Detection for Handwritten Mathematical Expressions Using OpenCV. In 2022 international conference on decision aid sciences and applications (DASA). IEEE, Chiangrai, Thailand, 305--310.Google ScholarGoogle Scholar
  11. Chris Lenart, Pegah Ahadian, Yuxin Yang, Simon Suo, Ashton Corsello, Karl Kosko, and Qiang Guan. 2023. Gaze Analysis System for Immersive 360° Video for Preservice Teacher Education. In Proceedings of the 31st ACM International Conference on Multimedia. Ottawa, ON, 8608--8616.Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Bohan Li, Ye Yuan, Dingkang Liang, Xiao Liu, Zhilong Ji, Jinfeng Bai, Wenyu Liu, and Xiang Bai. 2022. When Counting Meets HMER: Counting-aware Network for Handwritten Mathematical Expression Recognition. In European Conference on Computer Vision. Springer, 197--214.Google ScholarGoogle Scholar
  13. Lidong Lu and Lingming Cao. 2023. Handwritten Mathematical Expression Recognition based on ResNet and Transformer. In Third International Conference on Computer Vision and Pattern Analysis (ICCPA 2023), Vol. 12754. SPIE, Hangzhou, China, 850--856.Google ScholarGoogle ScholarCross RefCross Ref
  14. Ali Mehrban and Pegah Ahadian. 2023. Evaluating BERT and ParsBERT for Analyzing Persian Advertisement Data. International Journal on Natural Language Computing (IJNLC) Vol 12 (2023).Google ScholarGoogle ScholarCross RefCross Ref
  15. Wataru Ohyama, Masakazu Suzuki, and Seiichi Uchida. 2019. Detecting Mathematical Expressions in Scientific Document Images Using a U-net Trained on a Diverse Dataset. IEEE Access 7 (2019), 144030--144042.Google ScholarGoogle ScholarCross RefCross Ref
  16. Jing-Hao Qu, Xiao-Ran Qin, Chen-Di Li, Rong-Mei Peng, Ge-Ge Xiao, Jian Cheng, Shao-Feng Gu, Hai-Kun Wang, and Jing Hong. 2023. Fully Automated Grading System for the Evaluation of Punctate Epithelial Erosions Using Deep Neural Networks. British Journal of Ophthalmology 107, 4 (2023), 453--460.Google ScholarGoogle ScholarCross RefCross Ref
  17. Xuedong Tian and Jiameng Wang. 2021. Retrieval of Scientific Documents based on HFS and BERT. IEEE Access 9 (2021), 8708--8717.Google ScholarGoogle ScholarCross RefCross Ref
  18. Ye Yuan, Xiao Liu, Wondimu Dikubab, Hui Liu, Zhilong Ji, Zhongqin Wu, and Xiang Bai. 2022. Syntax-aware Network for Handwritten Mathematical Expression Recognition. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. Nashville, TN, 4553--4562.Google ScholarGoogle ScholarCross RefCross Ref
  19. Richard Zanibbi and Dorothea Blostein. 2012. Recognition and Retrieval of Mathematical Expressions. International Journal on Document Analysis and Recognition (IJDAR) 15 (2012), 331--357.Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Xinyu Zhang, Han Ying, Ye Tao, Youlu Xing, and Guihuan Feng. 2023. General Category Network: Handwritten Mathematical Expression Recognition with Coarse-Grained Recognition Task. In ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, Rhodes Island, Greece, 1--5.Google ScholarGoogle Scholar
  21. Yijia Zhang, Tiancheng Zhang, Peng Xie, Minghe Yu, and Ge Yu. 2023. BEM-SM: A BERT-Encoder Model with Symmetry Supervision Module for Solving Math Word Problem. Symmetry 15, 4 (2023), 916.Google ScholarGoogle ScholarCross RefCross Ref
  22. Maryam Zolfaghari, Christine K Austin, and Karl W Kosko. 2021. Exploring Teachers' Pedagogical Content Knowledge of Teaching Fractions. Investigations R@in Mathematics Learning 13, 3 (2021), 230--248.Google ScholarGoogle Scholar
  23. Maryam Zolfaghari, Karl W Kosko, and Christine K Austin. 2022. Examining the Nature of Pedagogical Content Knowledge (PCK) with a Validation Argument for the PCK-Fractions Measure. North American Chapter of the International Group for the Psychology of Mathematics Education (2022).Google ScholarGoogle Scholar

Index Terms

  1. MNIST-Fraction: Enhancing Math Education with AI-Driven Fraction Detection and Analysis

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        ACM SE '24: Proceedings of the 2024 ACM Southeast Conference
        April 2024
        337 pages
        ISBN:9798400702372
        DOI:10.1145/3603287

        Copyright © 2024 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 27 April 2024

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • short-paper
        • Research
        • Refereed limited

        Acceptance Rates

        ACM SE '24 Paper Acceptance Rate44of137submissions,32%Overall Acceptance Rate178of377submissions,47%
      • Article Metrics

        • Downloads (Last 12 months)26
        • Downloads (Last 6 weeks)26

        Other Metrics

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader