Shoya Ishimaru
Kensuke Hoshika
Kai Kunze
ABSTRACT
Reading in real life occurs in a variety of settings. One may read while commuting to work, waiting in a queue or lying on the sofa relaxing. However, most of current activity recognition work focuses on reading in fully controlled experiments. This paper proposes reading detection algorithms that consider such natural readings. The key idea is to record a large amount of data including natural reading habits in real life (more than 980 hours from 7 participants) with commercial electrooculography (EOG) glasses and to use them for deep learning. Our proposed approaches classified controlled reading vs. not reading with 92.2% accuracy on a user-dependent training. However, the classification accuracy decreases to 73.8% on natural reading vs. not reading. The results indicate that there is a strong gap between controlled reading and natural reading, highlighting the need for more robust reading detection algorithms.
- Oliver Amft, Florian Wahl, Shoya Ishimaru, and Kai Kunze. 2015. Making Regular Eyeglasses Smart. Pervasive Computing, IEEE 14, 3 (2015), 32--43.Google Scholar
Digital Library
- Andreas Bulling and Daniel Roggen. 2011. Recognition of visual memory recall processes using eye movement analysis. In Proceedings of the 13th international conference on Ubiquitous computing. ACM, 455--464. Google ScholarDigital Library
- Andreas Bulling, Jamie A. Ward, and Hans Gellersen. 2012. Multimodal Recognition of Reading Activity in Transit Using Body-Worn Sensors. ACM Trans. on Applied Perception 9, 1 (2012), 2:1--2:21. Google ScholarDigital Library
- Andreas Bulling, Jamie A Ward, Hans Gellersen, and Gerhard Troster. 2011. Eye movement analysis for activity recognition using electrooculography. IEEE transactions on pattern analysis and machine intelligence 33, 4 (2011), 741--753. Google ScholarDigital Library
- A.E. Cunningham and K.E. Stanovich. 2001. What reading does for the mind. Journal of Direct Instruction 1, 2 (2001), 137--149.Google Scholar
- Dima Damen, Teesid Leelasawassuk, Osian Haines, Andrew Calway, and Walterio W Mayol-Cuevas. 2014. You-Do, I-Learn: Discovering Task Relevant Objects and their Modes of Interaction from Multi-User Egocentric Video.. In BMVC.Google Scholar
- Joydeep Ghosh, Yong Jae Lee, and Kristen Grauman. 2012. Discovering important people and objects for egocentric video summarization. In 2012 IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 1346--1353. Google ScholarDigital Library
- Nils Y Hammerla and Thomas Plötz. 2015. Let's (not) stick together: pairwise similarity biases cross-validation in activity recognition. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, 1041--1051. Google ScholarDigital Library
- Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long short-term memory. Neural computation 9, 8 (1997), 1735--1780. Google ScholarDigital Library
- Shoya Ishimaru, Kai Kunze, Koichi Kise, and Andreas Dengel. 2016. The wordometer 2.0: estimating the number of words you read in real life using commercial EOG glasses. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct. ACM, 293--296. Google ScholarDigital Library
- Shoya Ishimaru, Kai Kunze, Koichi Kise, Jens Weppner, Andreas Dengel, Paul Lukowicz, and Andreas Bulling. 2014. In the Blink of an Eye: Combining Head Motion and Eye Blink Frequency for Activity Recognition with Google Glass. In Proceedings of the 5th Augmented Human International Conference. ACM, Article 15, 4 pages. Google ScholarDigital Library
- K. Kunze, A. Bulling, Y. Utsumi, S. Yuki, and K. Kise. 2013a. I know what you are reading - Recognition of document types using mobile eye tracking. In Proceedings of the 2013 ACM International Symposium on Wearable Computers. Google ScholarDigital Library
- Kai Kunze, Hitoshi Kawaichi, Kazuyo Yoshimura, and Koichi Kise. 2013b. The Wordometer-Estimating the Number of Words Read Using Document Image Retrieval and Mobile Eye Tracking. In 2013 12th International Conference on Document Analysis and Recognition. IEEE, 25--29. Google ScholarDigital Library
- Kai Kunze, Katsutoshi Masai, Masahiko Inami, Ömer Sacakli, Marcus Liwicki, Andreas Dengel, Shoya Ishimaru, and Koichi Kise. 2015. Quantifying reading habits: counting how many words you read. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, 87--96. Google ScholarDigital Library
- Susan Michie, Charles Abraham, Craig Whittington, John McAteer, and Sunjai Gupta. 2009. Effective techniques in healthy eating and physical activity interventions: a meta-regression. Health Psychology 28, 6 (2009), 690--701.Google ScholarCross Ref
- Keith Rayner. 1998. Eye movements in reading and information processing: 20 years of research. Psychological bulletin 124, 3 (1998), 372.Google Scholar
- KE Stanovich and AE Cunningham. 1998. What reading does for the mind. American Education Journal (1998).Google Scholar
- Julian Steil and Andreas Bulling. 2015. Discovery of everyday human activities from long-term visual behaviour using topic models. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, 75--85. Google ScholarDigital Library
Index Terms
- Towards reading trackers in the wild: detecting reading activities by EOG glasses and deep neural networks
Recommendations
The wordometer 2.0: estimating the number of words you read in real life using commercial EOG glasses
UbiComp '16: Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: AdjunctOn the basis of the motivation to increase daily reading volumes, this paper introduces an implementation of "Wordometer 2.0," which counts the number of read words in a day. While word count estimation using eye tracking glasses or medical EOG (...
Classification of reading and not reading behavior based on eye movement analysis
UbiComp/ISWC '19 Adjunct: Adjunct Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2019 ACM International Symposium on Wearable ComputersNowadays, many researchers analyze reading behavior with eye trackers. Various traits of reading like engagement, or text difficulty have been observed in laboratory settings. But, their automatic application for daily life is usually prevented by one ...
Skim reading: an adaptive strategy for reading on the web
WebSci '14: Proceedings of the 2014 ACM conference on Web scienceIt has been suggested that readers spend a great deal of time skim reading on the Web and that if readers skim read they reduce their comprehension of what they have read. There have been a number of studies exploring skim reading, but relatively little ...
Comments