ABSTRACT
This paper presents two topics. The first is an overview of our recently started project called "experiential supplement", which is to transfer human experiences by recording and processing them to be acceptable by others. The second is sensing technologies for producing experiential supplements in the context of learning. Because a basic activity of learning is reading, we also deal with sensing of reading. Methods for quantifying the reading in terms of the number of read words, the period of reading, type of read documents, identifying read words are shown with experimental results. As for learning, we propose methods for estimating the English ability, confidence in answers to English questions, and estimating unknown words. The above are sensed by various sensors including eye trackers, EOG, EEG, and the first person vision.
- Olivier Augereau, Hiroki Fujiyoshi, and Koichi Kise. 2016. Towards an Automated Estimation of English Skill via TOEIC Score Based on Reading Analysis. In Proc. International Conference on Pattern Recognition.Google ScholarCross Ref
- Olivier Augereau, Koichi Kise, and Kensuke Hoshika. 2015. A Proposal of a Document Image Reading-life Log Based on Document Image Retrieval and Eyetracking. In Proc. International Conf. on Document Analysis and Recognition (ICDAR2015). 23--26. Google ScholarDigital Library
- Georg Buscher and Andreas Dengel. 2009. Gaze-based filtering of relevant document segments. In Proc. International World Wide Web Conference (WWW). 20--24.Google Scholar
- Shoya Ishimaru, Kai Kunze, Koichi Kise, and Andreas Dengel. 2016. The Wordometer 2.0 - Estimating the Number of Words You Read in Real Life using Commercial EOG Glasses. In Proc. UbiComp2016 Adjunct. 1217--1220. Google ScholarDigital Library
- Kai Kunze, Hitoshi Kawaichi, Koichi Kise, and Kazuyo Yoshimura. 2013. The Wordometer - Estimating the Number of Words Read Using Document Image Retrieval and Mobile Eye Tracking. In Proc. ICDAR2013. 25 -- 29. Google ScholarDigital Library
- Kai Kunze, Katsutoshi Masai, Masahiko Inami, Ömer Sacakli, Marcus Liwicki, Andreas Dengel, Shoya Ishimaru, and Koichi Kise. 2015. Quantifying Reading Habits - Counting How Many Words You Read. In Proc. UbiComp2015. 87--96. Google ScholarDigital Library
- Kai Kunze, Yuki Shiga, Shoya Ishimaru, and Koichi Kise. 2013a. Reading Activity Recognition Using an Off-the-Shelf EEG --- Detecting Reading Activities and Distinguishing Genres of Documents. In Proc. International Conf. on Document Analysis and Recognition (ICDAR2013). 96--100. Google ScholarDigital Library
- Kai Kunze, Yuzuko Utsumi, Yuki Shiga, Koichi Kise, and Andreas Bulling. 2013b. I know what you are reading: recognition of document types using mobile eye tracking. In Proc. International Symposium on Wearable Comuters. 113--116. Google ScholarDigital Library
- Keith Rayner. 1998. Eye movements in reading and information processing: 20 years of research. Psychological bulleti 124, 3 (1998), 372--422.Google Scholar
- Keith Rayner, Alexander Pollatsek, Jane Ashby, and Calrles Clifton Jr. 2012. Psychology of Reading (2nd ed.). Psychology Press.Google Scholar
- Charles Lima Sanches, Olivier Augereau, and Koichi Kise. 2016. Vertical Error Correction of Eye Trackers in Nonrestrictive Reading Condition. IPSJ Trans. on Computer Vision and Applications 8, 7 (2016).Google Scholar
- Yuki Shiga, Yuzuko Utsumi, Masakazu Iwamura, Kai Kunze, and Koichi Kise. 2016. Automatic Document Type Classification Using Eye Movements and Egocentric Images. Trans. IEICE (D) J99-D, 9 (2016), 950--958.Google Scholar
- Christian Szegedy, Wei Liu, Yangqing Jia, Pierre Sermanet, Scott Reed, Dragomir Anguelov, Dumitru Erhan, Vincent Vanhoucke, and Andrew Rabinovich. 2015. Going Deeper with Convolutions. In Proc. CVPR 2015. IEEE.Google ScholarCross Ref
Index Terms
- Quantified reading and learning for sharing experiences
Recommendations
Wordometer Systems for Everyday Life
We present in this paper a detailed comparison of different algorithms and devices to determine the number of words read in everyday life. We call our system the “Wordometer”. We used three kinds of eye tracking systems in our experiment: mobile video-...
Reading detection in real-time
ETRA '19: Proceedings of the 11th ACM Symposium on Eye Tracking Research & ApplicationsObservable reading behavior, the act of moving the eyes over lines of text, is highly stereotyped among the users of a language, and this has led to the development of reading detectors-methods that input windows of sequential fixations and output ...
Detection of Reading Impairment from Eye-Gaze Behaviour using Reinforcement Learning
AbstractExperimental psychology and neuroscience reveal that decision-behavior plays a dominant role in human-selective-attention when it comes to reading, object and scene detection. Difficulties in reading are easily reflected by eye-movement patterns. ...
Comments