skip to main content
10.1145/3584931.3607494acmconferencesArticle/Chapter ViewAbstractPublication PagescscwConference Proceedingsconference-collections
research-article

ReaderQuizzer: Augmenting Research Papers with Just-In-Time Learning Questions to Facilitate Deeper Understanding

Published: 14 October 2023 Publication History

Abstract

Academic reading is a key component of higher education, and serves as a basis for critical thinking, knowledge acquisition and effective communication. Research shows many students struggle with comprehension and analysis tasks with academic texts, despite the central importance of academic reading to success in higher education. Undergraduates and researchers need to internalize dense literature to scaffold their own work upon it. This reading task is time-consuming and difficult to do. Oftentimes, students struggle to actively and critically engage and as a result attain merely a cursory understanding of a paper’s contents, or worse, incorrectly interpret the text. How, then, can we provide a means to more easily digest a text while also facilitating meaningful, critical engagement and understanding? This paper locates itself within the broader field of augmented reading interfaces to implement an augmented reading interface that leverages the power of large language models (LLM) to intelligently generate and co-locate comprehension and analysis questions in an academic paper, thereby making the paper more digestible with the end goal of facilitating deeper understanding, and developing critical reading skills.

References

[1]
Susan A. Ambrose, Michael W. Bridges, Marsha C. Lovett, Michele DiPietro, and Marie K. Norman. 2010. How Learning Works: Seven Research-Based Principles for Smart Teaching. Wiley, San Francisco, CA, 188–216. https://ebookcentral.proquest.com/lib/nyulibrary-ebooks/detail.action?docID=529947#
[2]
Kristien Andrianatos. 2019. Barriers to reading in higher education: Rethinking reading support. Reading & Writing 10, 1 (2019), 9. https://doi.org/10.4102/rw.v10i1.241
[3]
Indry Anwar and Sartika Sailuddin. 2022. Academic Reading Difficulties in Higher Education. Journal of Languages and Language Teaching 10, 2 (2022), 309–314. https://doi.org/10.33394/jollt.v10i2.4849
[4]
Association of American Colleges and Universities (AACU). 2017. VALUE Report 2017. https://www.aacu.org/publication/on-solid-ground-value-report-2017. Accessed: 2023-04-18.
[5]
Ruhil Azmuddin, Nor Fariza, and Afendi Hamat. 2020. Facilitating Online Reading Comprehension in Enhanced Learning Environment Using Digital Annotation Tools. IAFOR Journal of Education 8 (07 2020), 7–27. https://doi.org/10.22492/ije.8.2.01
[6]
Hamiyet Bursali and Rabia Meryem Yilmaz. 2019. Effect of augmented reality applications on secondary school students’ reading comprehension and learning permanency. Computers in Human Behavior 95 (2019), 126–135. https://doi.org/10.1016/j.chb.2019.01.035
[7]
Geoffrey Desa, Pamela J. Howard, Meg Gorzycki, and Diane D. Allen. 2020. Essential but Invisible: Collegiate Academic Reading Explored from the Faculty Perspective. College Teaching 68, 3 (2020), 126–137. https://doi.org/10.1080/87567555.2020.1766406 arXiv:https://doi.org/10.1080/87567555.2020.1766406
[8]
Saman Ebadi and Fateme Ashrafabadi. 2022. An exploration into the impact of augmented reality on EFL learners’ Reading comprehension. Education and Information Technologies 27 (04 2022). https://doi.org/10.1007/s10639-022-11021-8
[9]
Meg Gorzycki, Pamela Howard, Diane Allen, Geoffrey Desa, and Erik Rosegard. 2016. An Exploration of Academic Reading Proficiency at the University Level: A Cross-Sectional Study of 848 Undergraduates. Literacy Research and Instruction 55, 2 (2016), 142–162. https://doi.org/10.1080/19388071.2015.1133738 arXiv:https://doi.org/10.1080/19388071.2015.1133738
[10]
Andrew Head, Kyle Lo, Dongyeop Kang, Raymond Fok, Sam Skjonsberg, Daniel S. Weld, and Marti A. Hearst. 2021. Augmenting Scientific Papers with Just-in-Time, Position-Sensitive Definitions of Terms and Symbols. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 413, 18 pages. https://doi.org/10.1145/3411764.3445648
[11]
Pamela J. Howard, Meg Gorzycki, Geoffrey Desa, and Diane D. Allen. 2018. Academic Reading: Comparing Students’ and Faculty Perceptions of Its Value, Practice, and Pedagogy. Journal of College Reading and Learning 48, 3 (2018), 189–209. https://doi.org/10.1080/10790195.2018.1472942 arXiv:https://doi.org/10.1080/10790195.2018.1472942
[12]
Laura A. Huisinga. 2017. Augmented Reality Reading Support in Higher Education: Exploring Effects on Perceived Motivation and Confidence in Comprehension for Struggling Readers in Higher Education. Ph. D. Dissertation. Iowa State University. https://doi.org/10.31274/etd-180810-5151
[13]
Mary Margaret Kerr and Kristen M. Frese. 2017. Reading to Learn or Learning to Read? Engaging College Students in Course Readings. College Teaching 65, 1 (2017), 28–31. https://doi.org/10.1080/87567555.2016.1222577 arXiv:https://doi.org/10.1080/87567555.2016.1222577
[14]
Simon A. Lei, Patricia J. Rhinehart, Holly A. Howard, and Jonathan K. Cho. 2010. Strategies for improving reading comprehension among college students. Reading Improvement 47, 1 (2010), 30–42.
[15]
Xinyi Lu, Simin Fan, Jessica Houghton, Lu Wang, and Xu Wang. 2023. ReadingQuizMaker: A Human-NLP Collaborative System That Supports Instructors to Design High-Quality Reading Quiz Questions. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI ’23). Association for Computing Machinery, New York, NY, USA, Article 454, 18 pages. https://doi.org/10.1145/3544548.3580957
[16]
Karen Manarin, Miriam Carey, Melanie Rathburn, Glen Ryland, and Pat Hutchings. 2015. Critical Reading for Academic Purposes. Indiana University Press, Bloomington, IN, 47–64. http://www.jstor.org/stable/j.ctt18crz3s.9
[17]
OpenAI. 2023. OpenAI API, Documentation and Overview of Available Models. https://platform.openai.com/docs/models/overview. Accessed: 2023-04-18.
[18]
Dolores Perin. 2013. Literacy Skills Among Academically Underprepared Students. Community College Review 41, 2 (2013), 118–136. https://doi.org/10.1177/0091552113484057 arXiv:https://doi.org/10.1177/0091552113484057
[19]
Aek Phakiti and Lulu Li. 2011. General Academic Difficulties and Reading and Writing Difficulties among Asian ESL Postgraduate Students in TESOL at an Australian University. RELC Journal 42, 3 (2011), 227–264. https://doi.org/10.1177/0033688211421417 arXiv:https://doi.org/10.1177/0033688211421417
[20]
Napol Rachatasumrit, Jonathan Bragg, Amy X. Zhang, and Daniel S Weld. 2022. CiteRead: Integrating Localized Citation Contexts into Scientific Paper Reading. In 27th International Conference on Intelligent User Interfaces (Helsinki, Finland) (IUI ’22). Association for Computing Machinery, New York, NY, USA, 707–719. https://doi.org/10.1145/3490099.3511162

Cited By

View all
  • (2024)Guiding Students in Using LLMs in Supported Learning Environments: Effects on Interaction Dynamics, Learner Performance, Confidence, and TrustProceedings of the ACM on Human-Computer Interaction10.1145/36870388:CSCW2(1-30)Online publication date: 8-Nov-2024

Index Terms

  1. ReaderQuizzer: Augmenting Research Papers with Just-In-Time Learning Questions to Facilitate Deeper Understanding

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CSCW '23 Companion: Companion Publication of the 2023 Conference on Computer Supported Cooperative Work and Social Computing
    October 2023
    596 pages
    ISBN:9798400701290
    DOI:10.1145/3584931
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 14 October 2023

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. academic papers
    2. augmented reading interfaces
    3. reading comprehension

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    CSCW '23
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 2,235 of 8,521 submissions, 26%

    Upcoming Conference

    CSCW '25

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)158
    • Downloads (Last 6 weeks)9
    Reflects downloads up to 17 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Guiding Students in Using LLMs in Supported Learning Environments: Effects on Interaction Dynamics, Learner Performance, Confidence, and TrustProceedings of the ACM on Human-Computer Interaction10.1145/36870388:CSCW2(1-30)Online publication date: 8-Nov-2024

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media