Abstract
At present STEM education beyond middle school is largely inaccessible to visually impaired students in countries like India. Access to equations, tables, charts and figures are the key bottleneck. With the increased penetration of screen reading software, effective audio rendering of equations can significantly help in making many of the e-texts accessible. Unfortunately, linear syntactic rendering of equations can create considerable cognitive load even for relatively simple equations. In this paper we propose an architecture to extract contextual semantic of equations based on the local definitions. This will help in adapting audio rendering of equations based on their contextual semantics.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Almomen, R.: Context classification for improved semantic understanding of mathematical formulae. PhD thesis, University of Birmingham (2018)
Bansal, A., Balakrishnan, M., Sorge, V.: Comprehensive accessibility of equations by visually impaired. Accessibil. Comput. 126, 1 (2020)
Bansal, A., Balakrishnan, M., Sorge, V.: Evaluating cognitive complexity of algebraic equations. J. Technol. Persons Disabill. 170, 170–200 (2021)
Bansal, A., Kumar, P., Sorge, V., Balakrishnan, M.: Locating mathematical definitions in a document. In: 4th International Workshop on Digitization and E-Inclusion in Mathematics and Science (2021)
Cervone, D., Krautzberger, P., Sorge, V.: New accessibility features in MathJax. J. Technol. Persons Disabil. 4, 167–175 (2016)
Doush, I.A., Alkhateeb, F., Al Maghayreh, E.: Towards meaningful mathematical expressions in e-learning. In: Proceedings of the 1st International Conference on Intelligent Semantic Web-Services and Applications, pp. 1–5 (2010)
Frankel, L., Brownstein, B., Soiffer, N.: Navigable, customizable TTS for algebra. In: 28th Annual International Technology and Persons with Disabilities Conference Scientific/Research Proceedings. California State University, Northridge (2014)
Ginev, D., Jucovschi, C., Anca, S., Grigore, M., David, C., Kohlhase, M.: An architecture for linguistic and semantic analysis on the arxmliv corpus. Informatik 2009-Im Focus das Leben (2009)
Grigore, M., Wolska, M., Kohlhase, M.: Towards context-based disambiguation of mathematical expressions. In: Joint Conference of ASCM, pp. 262–271 (2009)
Nghiem, M.-Q., Kristianto, G.Y., Topić, G., Aizawa, A.: A hybrid approach for semantic enrichment of MathML mathematical expressions. In: Carette, J., Aspinall, D., Lange, C., Sojka, P., Windsteiger, W. (eds.) CICM 2013. LNCS (LNAI), vol. 7961, pp. 278–287. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-39320-4_18
Nghiem, M.-Q., Yoko, G., Matsubayashi, Y., Aizawa, A.: Towards mathematical expression understanding. inftyreader.org (2014)
Pennington, J., Socher, R., Manning, C.D.: GloVe: global vectors for word representation. In: Empirical Methods in Natural Language Processing (2014)
Shan, R., Youssef, A.: Towards math terms disambiguation using machine learning. In: Kamareddine, F., Sacerdoti Coen, C. (eds.) CICM 2021. LNCS (LNAI), vol. 12833, pp. 90–106. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-81097-9_7
Stathopoulos, Y., Teufel, S.: Mathematical information retrieval based on type embeddings and query expansion. In: 26th International Conference on Computational Linguistics (2016)
Stuber, J., Van den Brand, M.: Extracting mathematical semantics from +LATEX documents. In: International Workshop on Principles and Practice of Semantic Web Reasoning, pp. 160–173. Springer (2003). https://doi.org/10.1007/978-3-540-24572-8_11
List of mathematical symbols by subject. Wikipedia (2020)
wink-nlp - npm. https://www.npmjs.com/package/wink-nlp (2022)
Wolska, M., Grigore, M.: Symbol Declarations in Mathematical Writing. Masaryk University Press (2010)
Wolska, M., Grigore, M., Kohlhase, M.: Using Discourse Context to Interpret Object-Denoting Mathematical Expressions. Masaryk University Press (2011)
Yamaguchi, K., Komada, T., Kawane, F., Suzuki, M.: New features in math accessibility with Infty software. In: Miesenberger, K., Klaus, J., Zagler, W., Karshmer, A. (eds.) ICCHP 2008. LNCS, vol. 5105, pp. 892–899. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-70540-6_134
Yokoi, K., Nghiem, M.-Q., Matsubayashi, Y., Aizawa, A.: Contextual analysis of mathematical expressions for advanced mathematical search. Polibits 43, 81–86 (2011)
Acknowledgement
This project is supported by the Google Faculty Award for Inclusion Research. MathJax work was supported in part by Simons Foundation Grant, No. 514521.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 Springer Nature Switzerland AG
About this paper
Cite this paper
Bansal, A., Sorge, V., Balakrishnan, M., Aggarwal, A. (2022). Towards Semantically Enhanced Audio Rendering of Equations. In: Miesenberger, K., Kouroupetroglou, G., Mavrou, K., Manduchi, R., Covarrubias Rodriguez, M., Penáz, P. (eds) Computers Helping People with Special Needs. ICCHP-AAATE 2022. Lecture Notes in Computer Science, vol 13341. Springer, Cham. https://doi.org/10.1007/978-3-031-08648-9_5
Download citation
DOI: https://doi.org/10.1007/978-3-031-08648-9_5
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-08647-2
Online ISBN: 978-3-031-08648-9
eBook Packages: Computer ScienceComputer Science (R0)