Hilal Al Maqbali
Falk Scholer
James A. Thom
ABSTRACT
Using eye tracking in the evaluation of web search interfaces can provide rich information on users' information search behaviour, particularly in the matter of user interaction with different informative components on a search results screen. One of the main issues affecting the use of eye tracking in research is the quality of captured eye movements (calibration), therefore, in this paper, we propose a method that allows us to determine the quality of calibration, since the existing eye tracking system (Tobii Studio) does not provide any criteria for this aspect. Another issue addressed in this paper is the adaptation of gaze direction. We use a black screen displaying for 3 seconds between screens to avoid the effect of the previous screen on user gaze direction on the coming screen. A further issue when employing eye tracking in the evaluation of web search interfaces is the selection of the appropriate filter for the raw gaze-points data. In our studies, we filtered this data by removing noise, identifying gaze points that occur in Area of Interests (AOIs), optimising gaze data and identifying viewed AOIs.
- R. A. Abrams, D. E. Meyer and S. Kornblum. Speed and accuracy of saccadic eye movements: Characteristics of impulse variability in the oculomotor system. Journal of Experimental Psychology: Human Perception and Performance, Volume 15, Number 3, pages 529--543, 1989.Google Scholar
Cross Ref
- H. Ali {Al Maqbali}, F. Scholer, J. A. Thom and M. Wu. User interaction with novel web search interfaces. In Proceedings of the 21st Annual Conference of the Australian Computer-Human Interaction Special Interest Group: Design: Open 24/7, pages 301--304. ACM, 2009. Google ScholarDigital Library
- C. S. Campbell and P. P. Maglio. A robust algorithm for reading detection. In Proceedings of the 2001 workshop on Perceptive user interfaces, pages 1--7. ACM, 2001. Google ScholarDigital Library
- M. S. Castelhano and J. M. Henderson. The influence of color on the perception of scene gist. Journal of Experimental Psychology: Human Perception and Performance, Volume 34, Number 3, pages 660, 2008.Google ScholarCross Ref
- A. Chapanis. Theory and methods for analyzing errors in man-machine systems. Annals of the New York Academy of Sciences, Volume 51, Number 7, pages 1179--1203, 1951.Google ScholarCross Ref
- M. J. Cole, J. Gwizdka, C. Liu and N. J. Belkin. Dynamic assessment of information acquisition effort during interactive search. Proceedings of the American Society for Information Science and Technology, Volume 48, Number 1, pages 1--10, 2011.Google ScholarCross Ref
- H. Drewes. Eye gaze tracking for human computer interaction. Ph.D. thesis, Ludwig-Maximilians-Universität München, 2010.Google Scholar
- A. Duchowski. Eye tracking methodology: Theory and practice, Volume 373. Springer, 2007. Google ScholarDigital Library
- A. Friedman and L. S. Liebelt. On the time course of viewing pictures with a view towards remembering. Eye movements: Cognition and visual perception, pages 137--155, 1981.Google Scholar
- J. H. Goldberg and J. I. Helfman. Scanpath clustering and aggregation. In Proceedings of the 2010 Symposium on Eye-Tracking Research & Applications, pages 227--234. ACM, 2010. Google ScholarDigital Library
- J. H. Goldberg and X. P. Kotval. Computer interface evaluation using eye movements: methods and constructs. International Journal of Industrial Ergonomics, Volume 24, Number 6, pages 631--645, 1999.Google ScholarCross Ref
- R. N. Haber and M. Hershenson. The psychology of visual perception. Holt, Rinehart & Winston, 1973.Google Scholar
- K. Holmqvist, M. Nyström, R. Andersson, R. Dewhurst, H. Jarodzka and J. Van de Weijer. Eye tracking: A comprehensive guide to methods and measures. Oxford University Press, UK, England, 2011.Google Scholar
- A. J. Hornof and T. Halverson. Cleaning up systematic error in eye-tracking data by using required fixation locations. Behavior Research Methods, Volume 34, Number 4, pages 592--604, 2002.Google Scholar
- J. Hyönä, R. F. Lorch Jr and J. K. Kaakinen. Individual differences in reading to summarize expository text: Evidence from eye fixation patterns. Journal of Educational Psychology, Volume 94, Number 1, pages 44, 2002.Google ScholarCross Ref
- A. W. Inhoff and K. Rayner. Parafoveal word processing during eye fixations in reading: Effects of word frequency. Attention, Perception, & Psychophysics, Volume 40, Number 6, pages 431--439, 1986.Google ScholarCross Ref
- R. J. K. Jacob and K. S. Karn. Eye tracking in human-computer interaction and usability research: Ready to deliver the promises. The Mind's Eye: Cognitive and Applied Aspects of Eye Movement Research, pages 573--603, 2003.Google Scholar
- R. Jenkins, J. D. Beaver and A. J. Calder. I thought you were looking at me direction-specific aftereffects in gaze perception. Psychological Science, Volume 17, Number 6, pages 506--513, 2006.Google ScholarCross Ref
- R. Karsh and FW Breitenbach. Looking at looking: The amorphous fixation measure. Eye movements and psychological functions: International views, pages 53--64, 1983.Google Scholar
- D. Kelly and C. Cool. The effects of topic familiarity on information search behavior. In Proceedings of the 2nd ACM/IEEE-CS joint conference on Digital libraries, pages 74--75. ACM, 2002. Google ScholarDigital Library
- E. Kowler. Eye movements and their role in visual and cognitive processes, Volume 4. Elsevier Science Ltd, 1990.Google Scholar
- Hilal Al Maqbali, Falk Scholer, James A. Thom and Mingfang Wu. Do users find looking at text more useful than visual representations? a comparison of three search result interfaces. In Proceedings of the Australasian Document Computing Symposium, pages 35--42, 2009.Google Scholar
- Hilal Al Maqbali, Falk Scholer, James A. Thom and Mingfang Wu. Evaluating the effectiveness of visual summaries for web search. The Fifteen Australasian Document Computing Symposium (ADCS2010), Melbourne, Australia, pages 36--43, 2010.Google Scholar
- Hilal Al Maqbali, Falk Scholer, James A. Thom and Mingfang Wu. Tracking the impact of visual summaries on navigational web search. Manuscript submitted for publication to JASIST (Under revision to address reviewers' comments), 2012.Google Scholar
- A. Palanica and R. J. Itier. Searching for a perceived gaze direction using eye tracking. Journal of Vision, Volume 11, Number 2, 2011.Google ScholarCross Ref
- A. Pollatsek, K. Rayner and J. M. Henderson. Role of spatial location in integration of pictorial information across saccades. Journal of Experimental Psychology: Human Perception and Performance, Volume 16, Number 1, pages 199--210, 1990.Google ScholarCross Ref
- K. Rayner, S. P. Liversedge, S. J. White and D. Vergilino-Perez. Reading disappearing text cognitive control of eye movements. Psychological science, Volume 14, Number 4, pages 385--388, 2003.Google Scholar
- E. D. Reichle, K. Rayner and A. Pollatsek. The E-Z reader model of eye-movement control in reading: Comparisons to other models. Behavioral and brain sciences, Volume 26, Number 4, pages 445--476, 2003.Google Scholar
- Erik D. Reichle, Alexander Pollatsek, Donald L. Fisher and Keith Rayner. Toward a model of eye movement control in reading. Psychological review, Volume 105, Number 1, pages 125--157, 1998.Google Scholar
- Rayner Reichle. Comparing the e-z reader model to other models of eye movement control in reading, 2000.Google Scholar
- D. D. Salvucci and J. H. Goldberg. Identifying fixations and saccades in eye-tracking protocols. In Proceedings of the 2000 symposium on Eye tracking research & applications, pages 71--78. ACM, 2000. Google ScholarDigital Library
- D. Sauter, BJ Martin, N. Di Renzo and C. Vomscheid. Analysis of eye tracking movements using innovations generated by a kalman filter. Medical and biological Engineering and Computing, Volume 29, Number 1, pages 63--69, 1991.Google ScholarCross Ref
- J. B. J. Smeets and I. T. C. Hooge. Nature of variability in saccades. Journal of neurophysiology, Volume 90, Number 1, pages 12--20, 2003.Google Scholar
- R. Williams and R. Morris. Eye movements, word familiarity, and vocabulary acquisition. European Journal of Cognitive Psychology, Volume 16, Number 1--2, pages 312--339, 2004.Google Scholar
- Using eye tracking for evaluating web search interfaces
Recommendations
Pupil vs. Eyelid: Evaluating the Accuracy of Blink Detection in Pupil-based Eye Tracking Devices
AbstractSpontaneous eye blinks as a means to tap into human cognitive and affective processes have been demonstrated to offer valuable insight in various fields of application, such as human-computer-interaction and driver drowsiness detection. ...
Eye&Head: Synergetic Eye and Head Movement for Gaze Pointing and Selection
UIST '19: Proceedings of the 32nd Annual ACM Symposium on User Interface Software and TechnologyEye gaze involves the coordination of eye and head movement to acquire gaze targets, but existing approaches to gaze pointing are based on eye-tracking in abstraction from head motion. We propose to leverage the synergetic movement of eye and head, and ...
4th international workshop on pervasive eye tracking and mobile eye-based interaction
UbiComp '14 Adjunct: Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct PublicationPrevious work on eye tracking and eye-based human-computer interfaces mainly concentrated on making use of the eyes in traditional desktop settings. With the recent growth of interest in smart glass devices and low-cost eye trackers, however, gaze-based ...
Comments