Skip to main content
SpringerLink
Log in

Math Word Problem Generation with Memory Retrieval

  • Conference paper
  • First Online:
Pattern Recognition and Computer Vision (PRCV 2022)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 13536))

Included in the following conference series:

  • 1650 Accesses

Abstract

The task of math word problem generation (MWPG), which generates a math word problem (MWP) given an equation and several topic words, has increasingly attracted researchers’ attention. In this work, we propose a memory retrieval model to better take advantage of the training data. We first record training MWPs into a memory. Later we use the given equation and topic words to retrieve relevant items from the memory. The retrieved results are then used to complement the process of the MWP generation and improve the generation quality. In addition, we also propose a low-resource setting for MWPG, where only a small number of paired MWPs and a large amount of unpaired MWPs are available. Extensive experiments verify the superior performance and effectiveness of our method.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Cai, D., et al.: Skeleton-to-response: dialogue generation guided by retrieval memory. In: NAACL (2019)

    Google Scholar 

  2. Cai, D., Wang, Y., Li, H., Lam, W., Liu, L.: Neural machine translation with monolingual translation memory. In: ACL, pp. 7307–7318 (2021)

    Google Scholar 

  3. Chen, X., et al.: Microsoft coco captions: Data collection and evaluation server. arXiv preprint arXiv:1504.00325 (2015)

  4. Cho, K., et al.: Learning phrase representations using rnn encoder-decoder for statistical machine translation. arXiv preprint arXiv:1406.1078 (2014)

  5. Deane, P., Sheehan, K.: Automatic item generation via frame semantics: natural language generation of math word problems (2003)

    Google Scholar 

  6. Dong, L., et al.: Unified language model pre-training for natural language understanding and generation. In: Advances in Neural Information Processing Systems 32 (2019)

    Google Scholar 

  7. Gu, J., Zhao, H., Lin, Z., Li, S., Cai, J., Ling, M.: Scene graph generation with external knowledge and image reconstruction. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 1969–1978 (2019)

    Google Scholar 

  8. Han, F.X., Niu, D., Chen, H., Lai, K., He, Y., Xu, Y.: A deep generative approach to search extrapolation and recommendation. In: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. pp. 1771–1779 (2019)

    Google Scholar 

  9. Hashimoto, T.B., Guu, K., Oren, Y., Liang, P.: A retrieve-and-edit framework for predicting structured outputs. In: NeurIPS (2018)

    Google Scholar 

  10. Huang, D., Shi, S., Lin, C.Y., Yin, J., Ma, W.Y.: How well do computers solve math word problems? large-scale dataset construction and evaluation. In: ACL, pp. 887–896 (2016)

    Google Scholar 

  11. Huang, S., Wang, J., Xu, J., Cao, D., Yang, M.: Recall and learn: A memory-augmented solver for math word problems. In: Findings of the Association for Computational Linguistics: EMNLP 2021, pp. 786–796. Association for Computational Linguistics, Punta Cana, Dominican Republic (Nov 2021). 10.18653/v1/2021.findings-emnlp.68, https://aclanthology.org/2021.findings-emnlp.68

  12. Karpicke, J.D.: Retrieval-based learning: active retrieval promotes meaningful learning. Curr. Dir. Psychol. Sci. 21, 157–163 (2012)

    Article  Google Scholar 

  13. Karpicke, J.D., Roediger, H.L.: The critical importance of retrieval for learning. Science 319, 966–968 (2008)

    Google Scholar 

  14. Kingma, D.P., Ba, J.: Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)

  15. Koncel-Kedziorski, R., Roy, S., Amini, A., Kushman, N., Hajishirzi, H.: MAWPS: A math word problem repository. In: Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. pp. 1152–1157. Association for Computational Linguistics, San Diego, California (Jun 2016). https://doi.org/10.18653/v1/N16-1136,https://aclanthology.org/N16-1136

  16. Lan, Y., et al.: Mwptoolkit: an open-source framework for deep learning-based math word problem solvers. arXiv preprint arXiv:2109.00799 (2021)

  17. Lavie, A., Agarwal, A.: Meteor: an automatic metric for mt evaluation with high levels of correlation with human judgments. In: Proceedings of the Second Workshop on Statistical Machine Translation, pp. 228–231 (2007)

    Google Scholar 

  18. Lin, C.Y.: Rouge: A package for automatic evaluation of summaries. In: Text summarization branches out, pp. 74–81 (2004)

    Google Scholar 

  19. Liu, T., Fang, Q., Ding, W., Wu, Z., Liu, Z.: Mathematical word problem generation from commonsense knowledge graph and equations. In: EMNLP (2021)

    Google Scholar 

  20. Liu, T., Fang, Q., Ding, W., Li, H., Wu, Z., Liu, Z.: Mathematical word problem generation from commonsense knowledge graph and equations. arXiv preprint arXiv:2010.06196 (2020)

  21. Nandhini, K., Balasundaram, S.R.: Math word question generation for training the students with learning difficulties. In: Proceedings of the International Conference & Workshop on Emerging Trends in Technology, pp. 206–211 (2011)

    Google Scholar 

  22. Papineni, K., Roukos, S., Ward, T., Zhu, W.J.: Bleu: a method for automatic evaluation of machine translation. In: ACL, pp. 311–318 (2002)

    Google Scholar 

  23. Pennington, J., Socher, R., Manning, C.D.: Glove: global vectors for word representation. In: EMNLP, pp. 1532–1543 (2014)

    Google Scholar 

  24. Polozov, O., O’Rourke, E., Smith, A.M., Zettlemoyer, L., Gulwani, S., Popovic, Z.: Personalized mathematical word problem generation. In: IJCAI (2015)

    Google Scholar 

  25. Qian, Q., Huang, M., Zhao, H., Xu, J., Zhu, X.: Assigning personality/profile to a chatting machine for coherent conversation generation. In: IJCAI, pp. 4279–4285 (2018)

    Google Scholar 

  26. Radford, A., et al.: Language models are unsupervised multitask learners. OpenAI Blog 1, 9 (2019)

    Google Scholar 

  27. Rohrer, D., Pashler, H.: Recent research on human learning challenges conventional instructional strategies. Educ. Res. 39, 406–412 (2010)

    Article  Google Scholar 

  28. See, A., Liu, P., Manning, C.: Get to the point: summarization with pointer-generator networks. In: ACL (2017)

    Google Scholar 

  29. Song, Z., Hu, Z., Hong, R.: Efficient and self-adaptive rationale knowledge base for visual commonsense reasoning. In: Multimedia Systems, pp. 1–10 (2022)

    Google Scholar 

  30. Vaswani, A., et al.: Attention is all you need. NeurIPS 30 (2017)

    Google Scholar 

  31. Verschaffel, L., Schukajlow, S., Star, J., Van Dooren, W.: Word problems in mathematics education: a survey. ZDM 52, 1–16 (2020)

    Article  Google Scholar 

  32. Walkington, C.A.: Using adaptive learning technologies to personalize instruction to student interests: the impact of relevant contexts on performance and learning outcomes. J. Educ. Psychol. 105, 932 (2013)

    Article  Google Scholar 

  33. Wang, L., Zhang, D., Gao, L., Song, J., Guo, L., Shen, H.T.: Mathdqn: solving arithmetic word problems via deep reinforcement learning. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 32 (2018)

    Google Scholar 

  34. Wang, Y., Liu, X., Shi, S.: Deep neural solver for math word problems. In: EMNLP, pp. 845–854 (2017)

    Google Scholar 

  35. Wang, Z., Lan, A., Baraniuk, R.: Math word problem generation with mathematical consistency and problem context constraints. In: EMNLP (2021)

    Google Scholar 

  36. Weston, J., Dinan, E., Miller, A.H.: Retrieve and refine: Improved sequence generation models for dialogue. In: EMNLP (2018)

    Google Scholar 

  37. Williams, S.: Generating mathematical word problems. In: AAAI (2011)

    Google Scholar 

  38. Wu, Y., Wei, F., Huang, S., Wang, Y., Li, Z., Zhou, M.: Response generation by context-aware prototype editing. In: AAAI, vol. 33 (2019)

    Google Scholar 

  39. Zhang, J., et al.: Teacher-student networks with multiple decoders for solving math word problem. IJCAI (2020)

    Google Scholar 

  40. Zhang, Z., Li, J., Zhu, P., Zhao, H., Liu, G.: Modeling multi-turn conversation with deep utterance aggregation. arXiv preprint arXiv:1806.09102 (2018)

  41. Zhou, Q., Huang, D.: Towards generating math word problems from equations and topics. In: ICNLG (2019)

    Google Scholar 

Download references

Acknowledgements

This work was supported by the NSFC NO. 62172138 and 61932009. This work was also partially supported by The University Synergy Innovation Program of Anhui Province NO. GXXT-2021-007.

Author information

Authors and Affiliations

  1. Hefei University of Technology, Hefei, China

    Xiaowei Wang, Wei Qin, Zhenzhen Hu & Richang Hong

  2. Institute of Artificial Intelligence Hefei Comprehensive National Science Center, Hefei, China

    Wei Qin, Zhenzhen Hu & Richang Hong

  3. Singapore Management University, Singapore, Singapore

    Lei Wang

  4. China East Normal University, Shanghai, China

    Yunshi Lan

Authors
  1. Xiaowei Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Wei Qin
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Zhenzhen Hu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Lei Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Yunshi Lan
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Richang Hong
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zhenzhen Hu .

Editor information

Editors and Affiliations

  1. Southern University of Science and Technology, Shenzhen, China

    Shiqi Yu

  2. Institute of Automation, Chinese Academy of Sciences, Beijing, China

    Zhaoxiang Zhang

  3. Hong Kong Baptist University, Hong Kong, China

    Pong C. Yuen

  4. Northwestern Polytechnical University, Xi'an, China

    Junwei Han

  5. Institute of Automation, Chinese Academy of Sciences, Beijing, China

    Tieniu Tan

  6. Hong Kong Baptist University, Hong Kong, China

    Yike Guo

  7. Sun Yat-sen University, Guangzhou, China

    Jianhuang Lai

  8. Southern University of Science and Technology, Shenzhen, China

    Jianguo Zhang

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Wang, X., Qin, W., Hu, Z., Wang, L., Lan, Y., Hong, R. (2022). Math Word Problem Generation with Memory Retrieval. In: Yu, S., et al. Pattern Recognition and Computer Vision. PRCV 2022. Lecture Notes in Computer Science, vol 13536. Springer, Cham. https://doi.org/10.1007/978-3-031-18913-5_29

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-18913-5_29

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-18912-8

  • Online ISBN: 978-3-031-18913-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation