Abstract
In this paper, we discuss our system that estimates user attention to displayed content signals with temporal analysis of their exhibited behavior. Detecting user attention and controlling contents are key issues in our “networked interaction therapy system,” which effectively attracts the attention of memory-impaired people. In our proposed system, user behavior, including facial movements and body motions (“beat actions”), is detected with vision-based methods. User attention to the displayed content is then estimated based on the on/off facial orientation from a display system and body motions synchronous to auditorial signals. This attention monitoring mechanism design is derived from observations of actual patients. Estimated attention level can be used for content control to attract more attention of the viewers to the display system. Experimental results suggest that the content switching mechanism effectively attracts user interest.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Kuwahara, N., Kuwabara, K., Utsumi, A., Yasuda, K., Tetsutani, N.: Networked interaction therapy: Relieving stress in memory-impaired people and their family members. In: Proc. of IEEE Engineering in Medicine and Biology Society (2004)
Utsumi, A., Ohya, J.: Multiple-camera-based human tracking using nonsynchronous observations. In: Proceedings of Fourth Asian Conference on Computer Vision, pp. 1034–1039 (2000)
Gavrila, D.M., Davis, L.S.: 3-d model-based tracking of humans in action: a multi-view approach. In: Proc. of Computer Vision and Pattern Recognition, pp. 73–80 (1996)
Cai, Q., Aggarwal, J.K.: Tracking human motion using multiple cameras. In: Proceedings of 13th International Conference on Pattern Recognition, pp. 68–72 (1996)
Segen, J., Pingali, S.: A camera-based system for tracking people in real time. In: Proceedings of 13th International Conference on Pattern Recognition, pp. 63–67 (1996)
Low, J., Schietecat, T., Kwok, T.F., Lindeboom, L.: Technology applied to address difficulties of alzheimer patients and their partners. In: Proceedings of the conference on Dutch directions in HCI, p. 18. ACM Press, New York (2004)
Yang, J., Stiefelhagen, R., Meier, U., Waibel, A.: A real-time face tracker. In: Proc. 3rd IEEE Workshop on Application of Computer Vision, pp. 142–147 (1996)
Terrillon, J.C., David, M., Akamatsu, S.: Automatic detection of human faces in natural scene image by use of skin color model and invariant moment. In: Proc. of IEEE Int. Conf. on Automatic Face and Gesture Recognition, pp. 112–117 (1998)
Heinzmann, J., Zelinsky, A.: 3-d facial pose and gaze point estimation using a robust real time tracking paradigm. In: Proc. of IEEE Int. Conf. on Automatic Face and Gesture Recognition, pp. 142–147 (1998)
Kawato, S., Tetsutani, N.: Real-time detection of between-the-eyes with a circle frequency filter. In: Proc. of ACCV 2002, pp. 442–447 (2002)
Gorodnichy, D.O.: On importance of nose for face tracking. In: Proc. of IEEE 5th Int. Conf. on Automatic Face and Gesture Recognition, pp. 188–193 (2002)
Scheirer, E.D.: Tempo and beat analysis of acoustic musical signals. Journal of Accoustical Society of America 103 (1), 588–601 (1998)
Goto, M.: An audio-based real-time beat tracking system for music with or without drum-sounds. Journal of New Music Research 30(2), 159–171 (2001)
Shiratori, T., Nakazawa, A., Ikeuchi, K.: Detecting dance motion structure through music analysis. In: Proc. of Sixth International Conference on Automatic Face and Gesture Recognition, pp. 857–862 (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Utsumi, A., Kawato, S., Abe, S. (2005). Attention Monitoring Based on Temporal Signal-Behavior Structures. In: Sebe, N., Lew, M., Huang, T.S. (eds) Computer Vision in Human-Computer Interaction. HCI 2005. Lecture Notes in Computer Science, vol 3766. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11573425_10
Download citation
DOI: https://doi.org/10.1007/11573425_10
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-29620-1
Online ISBN: 978-3-540-32129-3
eBook Packages: Computer ScienceComputer Science (R0)