Skip to main content
SpringerLink
Log in
Book cover

International Conference on Algorithms and Architectures for Parallel Processing

ICA3PP 2020: Algorithms and Architectures for Parallel Processing pp 383–397Cite as

I am Smartglasses, and I Can Assist Your Reading

  • Conference paper
  • First Online:

  • 1859 Accesses

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 12453))

Abstract

Human reading states reflect people’s mental activities and are closely related with learning behaviors. Consequently, it is of great value to identify reading states in many aspects. For example, it can provide timely assistance in learning processes and boost the learning efficiency of learners in a personalized way. Conventionally, researchers usually make use of EEG and fMRI to recognize human reading states. However, these methods have shortcomings of high device cost, low portability and bad user experience. In this paper, we design a real-time reading states detection system named ETist with commodity wearable glasses that can identify four reading states including attention, browsing, mind wandering and drowsiness via tracking eye movement. Through our experiments, we demonstrate that this system can recognize four fine-grained states with an average accuracy of 84.0%, which is applicable in a wide area of applications.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    College English Test Band 6.

References

  1. Smallwood, J., et al.: Subjective experience and the attentional lapse: task engagement and disengagement during sustained attention. Consciousness Cognit. 13(4), 657–690 (2004). https://doi.org/10.1016/j.concog.2004.06.003

  2. Feng, S., D’Mello, S., Graesser, A.C.: Mind wandering while reading easy and difficult texts. Psychon. Bull. Rev. 20(3), 586–592 (2012). https://doi.org/10.3758/s13423-012-0367-y

    Article  Google Scholar 

  3. Smallwood, J., McSpadden, M., Schooler, J.W.: When attention matters: the curious incident of the wandering mind. Memory Cogn. 36(6), 1144–1150 (2008)

    Article  Google Scholar 

  4. Berka, C., et al.: EEG correlates of task engagement and mental workload in vigilance, learning, and memory tasks. Aviat. Space Environ. Med. 78(5), B231–B244 (2007)

    Google Scholar 

  5. Lan, T., Adami, A., Erdogmus, D., Pavel, M.: Estimating cognitive state using EEG signals. In: Signal Processing Conference, 2005 13th European, pp. 1–4. IEEE (2005)

    Google Scholar 

  6. Mather, M., Cacioppo, J.T., Kanwisher, N.: How fMRI can inform cognitive theories. Perspect. Psychol. Sci. 8(1), 108–113 (2013)

    Article  Google Scholar 

  7. Wang, X., Hutchinson, R.A., Mitchell, T.M.: Training fMRI classifiers to discriminate cognitive states across multiple subjects. In: NIPS, pp. 709–716 (2003)

    Google Scholar 

  8. Chen, Y., Fu, S., Iversen, S.D., Smith, S.M., Matthews, P.M.: Testing for dual brain processing routes in reading: a direct contrast of chinese character and pinyin reading using fmri. J. Cogn. Neurosci. 14(7), 1088–1098 (2002)

    Article  Google Scholar 

  9. Rayner, K.: Eye movements and attention in reading, scene perception, and visual search. Quart. J. Exp. Psychol. 62(8), 1457–1506 (2009)

    Article  Google Scholar 

  10. Rayner, K., Chace, K.H., Slattery, T.J., Ashby, J.: Eye movements as reflections of comprehension processes in reading. Sci. Stud. Read. 10(3), 241–255 (2006)

    Article  Google Scholar 

  11. Li, J., Ngai, G., Leong, H.V., Chan, S.C.: Multimodal human attention detection for reading from facial expression, eye gaze, and mouse dynamics. ACM SIGAPP Appl. Comput. Rev. 16(3), 37–49 (2016)

    Article  Google Scholar 

  12. Bixler, R., Blanchard, N., Garrison, L., D’Mello, S.: Automatic detection of mind wandering during reading using gaze and physiology. In: Proceedings of the 2015 ACM on international Conference on Multimodal Interaction, pp. 299–306 (2015)

    Google Scholar 

  13. Brusnighan, S.M., Folk, J.R.: Combining contextual and morphemic cues is beneficial during incidental vocabulary acquisition: semantic transparency in novel compound word processing. Read. Res. Quart. 47(2), 172–190 (2012)

    Article  Google Scholar 

  14. Johnson, C.I., Mayer, R.E.: An eye movement analysis of the spatial contiguity effect in multimedia learning. J. Exp. Psychol. Appl. 18(2), 178 (2012)

    Article  Google Scholar 

  15. Tsai, M.J., Hou, H.T., Lai, M.L., Liu, W.Y., Yang, F.Y.: Visual attention for solving multiple-choice science problem: an eye-tracking analysis. Comput. Educ. 58(1), 375–385 (2012)

    Article  Google Scholar 

  16. Marshall, S.P.: Identifying cognitive state from eye metrics. Aviat. Space Environ. Med. 78(5), B165–B175 (2007)

    Google Scholar 

  17. Liang, Y., Reyes, M.L., Lee, J.D.: Real-time detection of driver cognitive distraction using support vector machines. IEEE Trans. Intell. Transp. Syst. 8(2), 340–350 (2007)

    Article  Google Scholar 

  18. Devi, M.S., Bajaj, P.R.: Driver fatigue detection based on eye tracking. In: First International Conference on Emerging Trends in Engineering and Technology. ICETET 2008, pp. 649–652. IEEE (2008)

    Google Scholar 

  19. Schooler, J.W.: Zoning out while reading: evidence for dissociations between experience and metaconsciousness jonathan w. schooler, erik d. reichle, and david v. halpern. Thinking and seeing: Visual metacognition in adults and children, 203 (2004)

    Google Scholar 

  20. James, W.: The Principles of Psychology, vol. 1. Cosimo Inc. (2007)

    Google Scholar 

  21. Hjørland, B.: Theoretical clarity is not ‘manicheanism’: a reply to Marcia bates. J. Inf. Sci. 37(5), 546–550 (2011)

    Article  Google Scholar 

  22. Shen, J., Barbera, J., Shapiro, C.M.: Distinguishing sleepiness and fatigue: focus on definition and measurement. Sleep Med. Rev. 10(1), 63–76 (2006)

    Article  Google Scholar 

  23. Lai, M.-L., et al.: A review of using eye-tracking technology in exploring learning from2000 to 2012. Educ. Res. Rev. 10, 90–115 (2013)

    Article  Google Scholar 

  24. Bruner, R.F.: Repetition is the first principle of all learning. Available at SSRN 224340 (2001)

    Google Scholar 

  25. Pupil. Pupil eye-tracking glasses. 30 March 2017. https://pupil-labs.com/

  26. Ylias, G., Heaven, P.C.L.: The influence of distraction on reading comprehension: a big five analysis. Personality Individ. Differ. 34(6), 1069–1079 (2003)

    Article  Google Scholar 

  27. Shuyan, H., Zheng, G.: Driver drowsiness detection with eyelid related parameters by support vector machine. Expert Syst. Appl. 36(4), 7651–7658 (2009)

    Article  Google Scholar 

  28. Jodai, H.: Reading rate and comprehension. Online Submission 2011

    Google Scholar 

  29. Hart, S.G.: Nasa-task load index (nasa-tlx); 20 years later. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 50, pp. 904–908. Sage Publications Sage CA: Los Angeles (2006)

    Google Scholar 

Download references

Acknowledgment

This research was supported in part by the China NSFC Grant (61802264, 61872248), Guangdong NSF 2017A030312008, Shenzhen Science and Technology Foundation (No. JCYJ20180305124807337, No. ZDSYS20190902092853047), Guangdong Science and Technology Foundation (2019B111103001, 2019B020209001), GDUPS (2015), and Natural Science Foundation of SZU (No. 860-000002110537).

Author information

Authors and Affiliations

  1. College of Computer Science and Software Engineering, Shenzhen University, Shenzhen, China

    Baojie Yuan, Yetong Han, Jialu Dai, Yongpan Zou, Ye Liu & Kaishun Wu

Authors
  1. Baojie Yuan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yetong Han
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jialu Dai
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yongpan Zou
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Ye Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Kaishun Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yongpan Zou .

Editor information

Editors and Affiliations

  1. Columbia University, New York, NY, USA

    Meikang Qiu

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Yuan, B., Han, Y., Dai, J., Zou, Y., Liu, Y., Wu, K. (2020). I am Smartglasses, and I Can Assist Your Reading. In: Qiu, M. (eds) Algorithms and Architectures for Parallel Processing. ICA3PP 2020. Lecture Notes in Computer Science(), vol 12453. Springer, Cham. https://doi.org/10.1007/978-3-030-60239-0_26

Download citation

Publish with us

Policies and ethics

Search

Navigation