Skip to main content

Interactive Reading Note Generation Utilizing Gaze Information

  • Conference paper
  • First Online:
Human Interface and the Management of Information: Visual and Information Design (HCII 2022)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 13305))

Included in the following conference series:

  • 806 Accesses

Abstract

Reading gives readers intellectual stimuli, elicits their imagination and creativity, and expands their inner world. We introduce the concept to postulate that reading is communication between a reader and a book. An idea is to change a book into a reactive entity and to achieve interactions between a reader and a book. We have introduced a mechanism to feedback a reading note as a response from a book to a reader’s gaze information that the reader generates during reading. Reader’s gaze information generated during reading shows his/her mind about the book. The goal of this study is to build an automatic reading notes creation system that automatically generates reading notes based on gaze information that a reader naturally generates during reading. We conducted experiments to measure a subject’s gaze coordinate data, and to verify whether we could identify eye movements for specific four reading patterns through the analysis of the acquired data. As the result, we have confirmed it possible to identify a reader’s reading patterns from the change of gaze information.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 79.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 99.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Hamada, H., Akita, K., Fujimori, Y., Yagi, Y.: The effects of childhood reading experiences on adult consciousness, motivations and activities. Sci. Read. 58(1), 29–39 (2016)

    Google Scholar 

  2. 54th Summary of Field Survey for Campus Life, National Federation of University Co-operative Associations. https://www.univcoop.or.jp/press/life/report.html

  3. Yoshida, S., Takahara, M., Tanev, I., Shimohara, K.: Automatic reading notes creation: identifying reading patterns by Gaze information during reading. Proc. SICE Annu. Conf. 2020, 1965–1970 (2020)

    Google Scholar 

  4. Yoshida, S., Takahara, M., Tanev, I., Shimohara, K.: Reading notes as media to enrich communications between reader and book. In: 2020 IEEE Asia-Pacific Conference on Computer Science and Data Engineering (CSDE), pp. 1–5 (2020)

    Google Scholar 

  5. Yoshida, S., Takahara, M., Tanev, I., Shimohara, K.: Effect of media functionality by reading note on reading experience over time. Proc. SICE Annu. Conf. 2021, 506–508 (2021)

    Google Scholar 

  6. Yoshida, S., Takahara, M., Tanev, I., Shimohara, K.: Possibility of reading notes as media to enrich communications between reader and book. Human interface and the management of information. Inf. Present. Visual. 12765, 113–124 (2021)

    Google Scholar 

  7. Matsumura, A.: Daijirin, 3rd edn. Sanseido, Tokyo (2006)

    Google Scholar 

  8. Kitahara, Y.: Meikyo Kokugo Dictionary, 2nd edn. Taishukan Publishing, Tokyo (2010)

    Google Scholar 

  9. Shimohara, K.: Artificial Life and Evolving Computer. Kogyo Chosakai Publishing, Tokyo (1998)

    Google Scholar 

  10. Tobii Technology. Tobii Pro Fusion. https://www.tobiipro.com/ja/product-listing/tobii-pro-fusion/

  11. Nakajima, K., Utsumi, Y., Iwamura, M., Hirose, K.: Selection of Gaze-based Characteristics Useful for Detecting Reading Actions. IPSJ SIG Technical Report 2016-CVIM-202(28), pp. 1–6 (2016)

    Google Scholar 

  12. Kunze, K., et al.: Quantifying reading habits: counting how many words you read. In: Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp 2015), pp. 87–96. Association for Computing Machinery, Inc., New York (2015)

    Google Scholar 

  13. Bulling, A., Ward, J.A., Gellersen, H., Tröster, G.: Eye movement analysis for activity recognition using electorooculoraphy. IEEE Trans. Pattern Anal. Mach. Intell. 33(4), 741–753 (2011)

    Article  Google Scholar 

  14. Yoshimura, K., Kawaichi, H., Kunze, K., Kise, K.: Relationship between document understanding and gaze information acquired by eye-tracker. Tech. Rep. IEICE 112(495), 261–266 (2013)

    Google Scholar 

  15. Kunze, K., Ustumi, Y., Shiga, Y., Kise, K., Bulling, A.: I know what you are reading: recognition of document type using mobile eye tracking. In: Proceedings of the 2013 International Symposium on Wearable Computers, pp. 113–116. Association for Computing Machinery, New York (2013)

    Google Scholar 

  16. Nakazono, A., Hamakawa, R.: Reading support system using Gaze movement feature. IPSJ Interact. 2018, 1060–1065 (2018)

    Google Scholar 

  17. Imamura, M., Cho, I.: Research on Reading Support with Eye-tracking – Attempt for Ambient Interface. Undergraduate Research of the Department of Intermedia Art and Science, Waseda University (2016)

    Google Scholar 

  18. Soseki Natsume: I Am a Cat. https://www.aozora.gr.jp/cards/000148/card789.html

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Satoko Yoshida .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Yoshida, S., Takahara, M., Makihara, E., Tanev, I., Shimohara, K. (2022). Interactive Reading Note Generation Utilizing Gaze Information. In: Yamamoto, S., Mori, H. (eds) Human Interface and the Management of Information: Visual and Information Design. HCII 2022. Lecture Notes in Computer Science, vol 13305. Springer, Cham. https://doi.org/10.1007/978-3-031-06424-1_38

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-06424-1_38

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-06423-4

  • Online ISBN: 978-3-031-06424-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics