skip to main content
10.1145/3587281.3587293acmotherconferencesArticle/Chapter ViewAbstractPublication Pagesw4aConference Proceedingsconference-collections
research-article

AutoChemplete - Making Chemical Structural Formulas Accessible

Published:30 April 2023Publication History

ABSTRACT

Despite their interests, blind and low vision students avoid STEM subjects. Research attributes this to a lack of accessible material. Annotating STEM content such as chemical structural formulas requires expert domain knowledge, is time consuming, and frustrating. We conduct interviews with blind and low vision chemists and accessibility professionals to derive requirements for tool support. On this basis, we develop AutoChemplete, an interactive labeling tool for chemical structural formulas. It ingests images and uses machine learning to predict the molecule. With a similarity search in the solution space, we enable even novices to simply pick from options. From this we are able to generate accessible representations. We conduct fifteen think-aloud sessions with participants of varying domain expertise and find support of different annotation styles simultaneously. Not only does AutoChemplete strike a balance in skill-support, participants even find it entertaining.

Skip Supplemental Material Section

Supplemental Material

References

  1. Obead Alhadreti and Pam Mayhew. 2018. Rethinking Thinking Aloud: A Comparison of Three Think-Aloud Protocols. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems(CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3173574.3173618Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Saleema Amershi, Maya Cakmak, William Bradley Knox, and Todd Kulesza. 2014. Power to the People: The Role of Humans in Interactive Machine Learning. AI Magazine 35, 4 (Dec. 2014), 105–120. https://doi.org/10.1609/aimag.v35i4.2513 Number: 4.Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Saleema Amershi, Dan Weld, Mihaela Vorvoreanu, Adam Fourney, Besmira Nushi, Penny Collisson, Jina Suh, Shamsi Iqbal, Paul N. Bennett, Kori Inkpen, Jaime Teevan, Ruth Kikin-Gil, and Eric Horvitz. 2019. Guidelines for Human-AI Interaction. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems(CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3290605.3300233Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Katrin Angerbauer, Nils Rodrigues, Rene Cutura, Seyda Öney, Nelusa Pathmanathan, Cristina Morariu, Daniel Weiskopf, and Michael Sedlmair. 2022. Accessibility for Color Vision Deficiencies: Challenges and Findings of a Large Scale Study on Paper Figures. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems(CHI ’22). Association for Computing Machinery, New York, NY, USA, 1–23. https://doi.org/10.1145/3491102.3502133Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2016. Neural Machine Translation by Jointly Learning to Align and Translate. Technical Report arXiv:1409.0473. arXiv. https://doi.org/10.48550/arXiv.1409.0473 arXiv:1409.0473 [cs, stat] type: article.Google ScholarGoogle Scholar
  6. Dávid Bajusz, Anita Rácz, and Károly Héberger. 2015. Why is Tanimoto index an appropriate choice for fingerprint-based similarity calculations?Journal of Cheminformatics 7, 1 (May 2015), 20. https://doi.org/10.1186/s13321-015-0069-3Google ScholarGoogle ScholarCross RefCross Ref
  7. Nick Ballou, Sebastian Deterding, April Tyack, Elisa D Mekler, Rafael A Calvo, Dorian Peters, Gabriela Villalobos-Zúñiga, and Selen Turkay. 2022. Self-Determination Theory in HCI: Shaping a Research Agenda. In Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems(CHI EA ’22). Association for Computing Machinery, New York, NY, USA, 1–6. https://doi.org/10.1145/3491101.3503702Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Edward Bell and Arielle Silverman. 2019. Access to Math and Science Content for Youth Who Are Blind or Visually Impaired. Journal of Blindness Innovation and Research 9, 1 (2019), 1. https://nfb.org/images/nfb/publications/jbir/jbir19/jbir090101.htmlGoogle ScholarGoogle ScholarCross RefCross Ref
  9. Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative Research in Psychology 3, 2 (Jan. 2006), 77–101. https://doi.org/10.1191/1478088706qp063oaGoogle ScholarGoogle ScholarCross RefCross Ref
  10. Emeline Brulé and Gilles Bailly. 2021. ”Beyond 3D printers”: Understanding Long-Term Digital Fabrication Practices for the Education of Visually Impaired or Blind Youth. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems(CHI ’21). Association for Computing Machinery, New York, NY, USA, 1–15. https://doi.org/10.1145/3411764.3445403Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Joseph Chee Chang, Saleema Amershi, and Ece Kamar. 2017. Revolt: Collaborative Crowdsourcing for Labeling Machine Learning Datasets. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, Denver Colorado USA, 2334–2346. https://doi.org/10.1145/3025453.3026044Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Djork-Arné Clevert, Tuan Le, Robin Winter, and Floriane Montanari. 2021. Img2Mol – accurate SMILES recognition from molecular graphical depictions. Chemical Science 12, 42 (2021), 14174–14181. https://doi.org/10.1039/D1SC01839FGoogle ScholarGoogle ScholarCross RefCross Ref
  13. Maitraye Das, Thomas Barlow McHugh, Anne Marie Piper, and Darren Gergle. 2022. Co11ab: Augmenting Accessibility in Synchronous Collaborative Writing for People with Vision Impairments. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems(CHI ’22). Association for Computing Machinery, New York, NY, USA, 1–18. https://doi.org/10.1145/3491102.3501918Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Edward L. Deci and Richard M. Ryan. 1985. Intrinsic motivation and self-determination in human behavior. Springer Science+Business Media, New York.Google ScholarGoogle Scholar
  15. Michael Desmond, Michael Muller, Zahra Ashktorab, Casey Dugan, Evelyn Duesterwald, Kristina Brimijoin, Catherine Finegan-Dollak, Michelle Brachman, Aabhas Sharma, Narendra Nath Joshi, and Qian Pan. 2021. Increasing the Speed and Accuracy of Data Labeling Through an AI Assisted Interface. In 26th International Conference on Intelligent User Interfaces. ACM, College Station TX USA, 392–401. https://doi.org/10.1145/3397481.3450698Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Heather Devine, Andres Gonzalez, and Matthew Hardy. 2011. Making accessible PDF documents. In Proceedings of the 11th ACM symposium on Document engineering(DocEng ’11). Association for Computing Machinery, New York, NY, USA, 275–276. https://doi.org/10.1145/2034691.2034748Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Yancarlos Diaz, Gavin Nishizawa, Behrooz Mansouri, Kenny Davila, and Richard Zanibbi. 2021. The MathDeck Formula Editor: Interactive Formula Entry Combining LaTeX, Structure Editing, and Search. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems. ACM, Yokohama Japan, 1–5. https://doi.org/10.1145/3411763.3451564Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Alfred T. D’Agostino. 2022. Accessible Teaching and Learning in the Undergraduate Chemistry Course and Laboratory for Blind and Low-Vision Students. Journal of Chemical Education 99, 1 (Jan. 2022), 140–147. https://doi.org/10.1021/acs.jchemed.1c00285Google ScholarGoogle ScholarCross RefCross Ref
  19. Henri A. Favre, Warren H. Powell, and International Union of Pure and Applied Chemistry (Eds.). 2014. Nomenclature of organic chemistry: IUPAC recommendations and preferred names 2013. Royal Soc. of Chemistry [u.a.], Cambridge.Google ScholarGoogle Scholar
  20. Ann P. Gulley, Luke A. Smith, Jordan A. Price, Logan C. Prickett, and Matthew F. Ragland. 2017. Process-Driven Math: An Auditory Method of Mathematics Instruction and Assessment for Students who Are Blind or Have Low Vision. Journal of Visual Impairment & Blindness 111, 5 (Sept. 2017), 465–471. https://doi.org/10.1177/0145482X1711100507 Publisher: SAGE Publications Inc.Google ScholarGoogle ScholarCross RefCross Ref
  21. Megan Hofmann, Kelly Mack, Jessica Birchfield, Jerry Cao, Autumn G Hughes, Shriya Kurpad, Kathryn J Lum, Emily Warnock, Anat Caspi, Scott E Hudson, and Jennifer Mankoff. 2022. Maptimizer: Using Optimization to Tailor Tactile Maps to Users Needs. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems(CHI ’22). Association for Computing Machinery, New York, NY, USA, 1–15. https://doi.org/10.1145/3491102.3517436Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Leona Holloway, Kim Marriott, and Matthew Butler. 2018. Accessible Maps for the Blind: Comparing 3D Printed Models with Tactile Graphics. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems(CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3173574.3173772Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Leona M Holloway, Cagatay Goncu, Alon Ilsar, Matthew Butler, and Kim Marriott. 2022. Infosonics: Accessible Infographics for People who are Blind using Sonification and Voice. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems(CHI ’22). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3491102.3517465Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Dorine in’t Veld and Volker Sorge. 2018. The Dutch Best Practice for Teaching Chemistry Diagrams to the Visually Impaired. In Computers Helping People with Special Needs, Klaus Miesenberger and Georgios Kouroupetroglou (Eds.). Vol. 10896. Springer International Publishing, Cham, 644–647. https://doi.org/10.1007/978-3-319-94277-3_99 Series Title: Lecture Notes in Computer Science.Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Chen Jiang, Xi Jin, Ying Dong, and Ming Chen. 2016. Kekule.js: An Open Source JavaScript Chemoinformatics Toolkit. Journal of Chemical Information and Modeling 56, 6 (June 2016), 1132–1138. https://doi.org/10.1021/acs.jcim.6b00167Google ScholarGoogle ScholarCross RefCross Ref
  26. Sunghwan Kim, Jie Chen, Tiejun Cheng, Asta Gindulyte, Jia He, Siqian He, Qingliang Li, Benjamin A Shoemaker, Paul A Thiessen, Bo Yu, Leonid Zaslavsky, Jian Zhang, and Evan E Bolton. 2021. PubChem in 2021: new data content and improved web interfaces. Nucleic Acids Research 49, D1 (Jan. 2021), D1388–D1395. https://doi.org/10.1093/nar/gkaa971Google ScholarGoogle ScholarCross RefCross Ref
  27. Merlin Knaeble, Zihan Chen, Thorsten Schwarz, Gabriel Sailer, Kailun Yang, Rainer Stiefelhagen, and Alexander Maedche. 2022. Accessible Chemical Structural Formulas Through Interactive Document Labeling. In Computers Helping People with Special Needs, Klaus Miesenberger, Georgios Kouroupetroglou, Katerina Mavrou, Roberto Manduchi, Mario Covarrubias Rodriguez, and Petr Penáz (Eds.). Vol. 13341. Springer International Publishing, Cham, 38–46. https://doi.org/10.1007/978-3-031-08648-9_6 Series Title: Lecture Notes in Computer Science.Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Tanner Kohler. 2022. Autonomy, Relatedness, and Competence in UX Design. https://www.nngroup.com/articles/autonomy-relatedness-competence/Google ScholarGoogle Scholar
  29. Nicholas Kong, Marti A. Hearst, and Maneesh Agrawala. 2014. Extracting references between text and charts via crowdsourcing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’14). Association for Computing Machinery, New York, NY, USA, 31–40. https://doi.org/10.1145/2556288.2557241Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Jordan C. Koone, Chad M. Dashnaw, Emily A. Alonzo, Miguel A. Iglesias, Kelly-Shaye Patero, Juan J. Lopez, Ao Yun Zhang, Bernd Zechmann, Noah E. Cook, Mona S. Minkara, Cary A. Supalo, Hoby B. Wedler, Matthew J. Guberman-Pfeffer, and Bryan F. Shaw. 2022. Data for all: Tactile graphics that light up with picture-perfect resolution. Science Advances 8, 33 (Aug. 2022), eabq2640. https://doi.org/10.1126/sciadv.abq2640 Publisher: American Association for the Advancement of Science.Google ScholarGoogle ScholarCross RefCross Ref
  31. Cheuk Yin Phipson Lee, Zhuohao Zhang, Jaylin Herskovitz, JooYoung Seo, and Anhong Guo. 2022. CollabAlly: Accessible Collaboration Awareness in Document Editing. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems(CHI ’22). Association for Computing Machinery, New York, NY, USA, 1–17. https://doi.org/10.1145/3491102.3517635Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Jo-Yu Lo, Da-Yuan Huang, Tzu-Sheng Kuo, Chen-Kuo Sun, Jun Gong, Teddy Seyed, Xing-Dong Yang, and Bing-Yu Chen. 2019. AutoFritz: Autocomplete for Prototyping Virtual Breadboard Circuits. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, Glasgow Scotland Uk, 1–13. https://doi.org/10.1145/3290605.3300633Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Kelly Mack, Emma McDonnell, Dhruv Jain, Lucy Lu Wang, Jon E. Froehlich, and Leah Findlater. 2021. What Do We Mean by “Accessibility Research”? A Literature Survey of Accessibility Papers in CHI and ASSETS from 1994 to 2019. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems(CHI ’21). Association for Computing Machinery, New York, NY, USA, 1–18. https://doi.org/10.1145/3411764.3445412Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Joe R. McDaniel and Jason R. Balmuth. 1992. Kekule: OCR-optical chemical (structure) recognition. Journal of Chemical Information and Computer Sciences 32, 4 (July 1992), 373–378. https://doi.org/10.1021/ci00008a018Google ScholarGoogle ScholarCross RefCross Ref
  35. M.B. McGrath and J.R. Brown. 2005. Visual learning for science and engineering. IEEE Computer Graphics and Applications 25, 5 (Sept. 2005), 56–63. https://doi.org/10.1109/MCG.2005.117 Conference Name: IEEE Computer Graphics and Applications.Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. David Mendez, Anna Gaulton, A Patrícia Bento, Jon Chambers, Marleen De Veij, Eloy Félix, María Paula Magariños, Juan F Mosquera, Prudence Mutowo, Michał Nowotka, María Gordillo-Marañón, Fiona Hunter, Laura Junco, Grace Mugumbate, Milagros Rodriguez-Lopez, Francis Atkinson, Nicolas Bosc, Chris J Radoux, Aldo Segura-Cabrera, Anne Hersey, and Andrew R Leach. 2019. ChEMBL: towards direct deposition of bioassay data. Nucleic Acids Research 47, D1 (Jan. 2019), D930–D940. https://doi.org/10.1093/nar/gky1075Google ScholarGoogle ScholarCross RefCross Ref
  37. Mario Nadj, Merlin Knaeble, Maximilian Xiling Li, and Alexander Maedche. 2020. Power to the Oracle? Design Principles for Interactive Labeling Systems in Machine Learning. KI - Künstliche Intelligenz 34, 2 (June 2020), 131–142. https://doi.org/10.1007/s13218-020-00634-1Google ScholarGoogle ScholarCross RefCross Ref
  38. Rahul Kumar Namdev and Pattie Maes. 2015. An interactive and intuitive stem accessibility system for the blind and visually impaired. In Proceedings of the 8th ACM International Conference on PErvasive Technologies Related to Assistive Environments(PETRA ’15). Association for Computing Machinery, New York, NY, USA, 1–7. https://doi.org/10.1145/2769493.2769502Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Abdulmumin A. Nuhu. 2014. Bioactive Micronutrients in Coffee: Recent Analytical Approaches for Characterization and Quantification. ISRN Nutrition 2014 (Jan. 2014), 1–13. https://doi.org/10.1155/2014/384230Google ScholarGoogle ScholarCross RefCross Ref
  40. Srishti Palani, Zijian Ding, Austin Nguyen, Andrew Chuang, Stephen MacNeil, and Steven P. Dow. 2021. CoNotate: Suggesting Queries Based on Notes Promotes Knowledge Discovery. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. ACM, Yokohama Japan, 1–14. https://doi.org/10.1145/3411764.3445618Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. Jungkap Park, Gus R Rosania, Kerby A Shedden, Mandee Nguyen, Naesung Lyu, and Kazuhiro Saitou. 2009. Automated extraction of chemical structure information from digital raster images. Chemistry Central Journal 3, 1 (Dec. 2009), 4. https://doi.org/10.1186/1752-153X-3-4Google ScholarGoogle ScholarCross RefCross Ref
  42. Dorian Peters, Rafael A. Calvo, and Richard M. Ryan. 2018. Designing for Motivation, Engagement and Wellbeing in Digital Experience. Frontiers in Psychology 9 (2018), 797. https://www.frontiersin.org/articles/10.3389/fpsyg.2018.00797Google ScholarGoogle ScholarCross RefCross Ref
  43. Yujie Qian, Zhengkai Tu, Jiang Guo, Connor W. Coley, and Regina Barzilay. 2022. Robust Molecular Image Recognition: A Graph Generation Approach. Technical Report arXiv:2205.14311. arXiv. https://doi.org/10.48550/arXiv.2205.14311 arXiv:2205.14311 [cs] type: article.Google ScholarGoogle Scholar
  44. André Rodrigues, Hugo Nicolau, André Santos, Diogo Branco, Jay Rainey, David Verweij, Jan David Smeddinck, Kyle Montague, and Tiago Guerreiro. 2022. Investigating the Tradeoffs of Everyday Text-Entry Collection Methods. In CHI Conference on Human Factors in Computing Systems. ACM, New Orleans LA USA, 1–15. https://doi.org/10.1145/3491102.3501908Google ScholarGoogle ScholarDigital LibraryDigital Library
  45. Richard M. Ryan (Ed.). 2019. The Oxford Handbook of Human Motivation (2 ed.). Oxford University Press, New York. https://doi.org/10.1093/oxfordhb/9780190666453.001.0001Google ScholarGoogle ScholarCross RefCross Ref
  46. Richard M. Ryan and Edward L. Deci. 2000. Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. American Psychologist 55 (2000), 68–78. https://doi.org/10.1037/0003-066X.55.1.68 Place: US Publisher: American Psychological Association.Google ScholarGoogle ScholarCross RefCross Ref
  47. Noureddin M. Sadawi, Alan P. Sexton, and Volker Sorge. 2012. Chemical structure recognition: a rule-based approach. In Document Recognition and Retrieval XIX, Vol. 8297. SPIE, Burlingame, CA, 101–109. https://doi.org/10.1117/12.912185 tex.ids= sadawi2012ChemicalStructureRecognition.Google ScholarGoogle ScholarCross RefCross Ref
  48. Volker Sorge, Akashdeep Bansal, Neha M Jadhav, Himanshu Garg, Ayushi Verma, and M Balakrishnan. 2020. Towards generating web-accessible STEM documents from PDF. In Proceedings of the 17th International Web for All Conference(W4A ’20). Association for Computing Machinery, New York, NY, USA, 1–5. https://doi.org/10.1145/3371300.3383351Google ScholarGoogle ScholarDigital LibraryDigital Library
  49. Joshua Staker, Kyle Marshall, Robert Abel, and Carolyn M. McQuaw. 2019. Molecular Structure Extraction from Documents Using Deep Learning. Journal of Chemical Information and Modeling 59, 3 (March 2019), 1017–1029. https://doi.org/10.1021/acs.jcim.8b00669Google ScholarGoogle ScholarCross RefCross Ref
  50. Cary A. Supalo, Mick D. Isaacson, and Michael V. Lombardi. 2014. Making Hands-On Science Learning Accessible for Students Who Are Blind or Have Low Vision. Journal of Chemical Education 91, 2 (Feb. 2014), 195–199. https://doi.org/10.1021/ed3000765 Publisher: American Chemical Society.Google ScholarGoogle ScholarCross RefCross Ref
  51. Mingxing Tan and Quoc V. Le. 2020. EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks. Technical Report arXiv:1905.11946. arXiv. https://doi.org/10.48550/arXiv.1905.11946 arXiv:1905.11946 [cs, stat] type: article.Google ScholarGoogle Scholar
  52. Aniko T. Valko and A. Peter Johnson. 2009. CLiDE Pro: The Latest Generation of CLiDE, a Tool for Optical Chemical Structure Recognition. Journal of Chemical Information and Modeling 49, 4 (April 2009), 780–787. https://doi.org/10.1021/ci800449tGoogle ScholarGoogle ScholarCross RefCross Ref
  53. Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. Attention is All you Need. In Advances in Neural Information Processing Systems, Vol. 30. Curran Associates, Inc., Long Beach, CA, 1. https://papers.nips.cc/paper/2017/hash/3f5ee243547dee91fbd053c1c4a845aa-Abstract.htmlGoogle ScholarGoogle Scholar
  54. Luis von Ahn, Shiry Ginosar, Mihir Kedia, Ruoran Liu, and Manuel Blum. 2006. Improving accessibility of the web with a computer game. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’06). Association for Computing Machinery, New York, NY, USA, 79–82. https://doi.org/10.1145/1124772.1124785Google ScholarGoogle ScholarDigital LibraryDigital Library
  55. Yanan Wang, Ruobin Wang, Crescentia Jung, and Yea-Seul Kim. 2022. What makes web data tables accessible? Insights and a tool for rendering accessible tables for people with visual impairments. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems(CHI ’22). Association for Computing Machinery, New York, NY, USA, 1–20. https://doi.org/10.1145/3491102.3517469Google ScholarGoogle ScholarDigital LibraryDigital Library
  56. David Weininger. 1988. SMILES, a chemical language and information system. Journal of Chemical Information and Computer Sciences 28, 1 (Feb. 1988), 31–36. https://doi.org/10.1021/ci00057a005 Publisher: American Chemical Society.Google ScholarGoogle ScholarDigital LibraryDigital Library
  57. Robin Winter, Floriane Montanari, Frank Noé, and Djork-Arné Clevert. 2019. Learning continuous and data-driven molecular descriptors by translating equivalent chemical representations. Chemical Science 10, 6 (2019), 1692–1701. https://doi.org/10.1039/C8SC04175JGoogle ScholarGoogle ScholarCross RefCross Ref
  58. Sanghyun Yoo, Ohyun Kwon, and Hoshik Lee. 2022. Image-to-Graph Transformers for Chemical Structure Recognition. In ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, Singapore, Singapore, 3393–3397. https://doi.org/10.1109/ICASSP43922.2022.9746088Google ScholarGoogle ScholarCross RefCross Ref
  59. Beste F. Yuksel, Soo Jung Kim, Seung Jung Jin, Joshua Junhee Lee, Pooyan Fazli, Umang Mathur, Vaishali Bisht, Ilmi Yoon, Yue-Ting Siu, and Joshua A. Miele. 2020. Increasing Video Accessibility for Visually Impaired Users with Human-in-the-Loop Machine Learning. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems(CHI EA ’20). Association for Computing Machinery, New York, NY, USA, 1–9. https://doi.org/10.1145/3334480.3382821Google ScholarGoogle ScholarDigital LibraryDigital Library
  60. Lei Zhang, Yan Tong, and Qiang Ji. 2008. Active Image Labeling and Its Application to Facial Action Labeling. In Computer Vision – ECCV 2008(Lecture Notes in Computer Science), David Forsyth, Philip Torr, and Andrew Zisserman (Eds.). Springer, Berlin, Heidelberg, 706–719. https://doi.org/10.1007/978-3-540-88688-4_52Google ScholarGoogle ScholarDigital LibraryDigital Library
  61. Yu Zhang, Yun Wang, Haidong Zhang, Bin Zhu, Siming Chen, and Dongmei Zhang. 2022. OneLabeler: A Flexible System for Building Data Labeling Tools. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems(CHI ’22). Association for Computing Machinery, New York, NY, USA, 1–22. https://doi.org/10.1145/3491102.3517612Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. AutoChemplete - Making Chemical Structural Formulas Accessible

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in
        • Published in

          cover image ACM Other conferences
          W4A '23: Proceedings of the 20th International Web for All Conference
          April 2023
          207 pages
          ISBN:9798400707483
          DOI:10.1145/3587281

          Copyright © 2023 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 30 April 2023

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article
          • Research
          • Refereed limited

          Acceptance Rates

          Overall Acceptance Rate171of371submissions,46%

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        HTML Format

        View this article in HTML Format .

        View HTML Format