Abstract
For elderly people healthcare in ambient living environments, recognizing confusion states in an automatic and non-contact manner is essential. In this work we provide a visual approach to confusion recognition consisting of behavior monitoring and movement pattern analysis. To collect data for evaluation, we created a dataset from a search experiment. After extracting and analyzing the movement patterns, we achieved a recognition rate of \(89.6\%\) when cross-validating over different subjects and \(88.9\%\) when testing on a new set of samples. To our knowledge, we are the first to investigate confusion recognition using visual information. Our work shows that the mental confusion can be effectively recognized based on the movement pattern.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
- 2.
The study was conducted according to the ethical guidelines set out in the WMA Declaration of Helsinki (ethical committee approval was granted: 196/10-UBB/bal). The study protocol was approved by the ethics committee of University of Ulm, Germany.
References
Aggarwal, J., Ryoo, M.: Human activity analysis: a review. ACM Comput. Surv. 43(3), 16:1–16:143 (2011). http://doi.acm.org/10.1145/1922649.1922653
Alahi, A., Ortiz, R., Vandergheynst, P.: Freak: fast retina keypoint. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition, pp. 510–517, June 2012
Arthur, D., Vassilvitskii, S.: k-means++: the advantages of careful seeding. In: Proceedings of the Eighteenth Annual ACM-SIAM Symposium on Discrete Algorithms, pp. 1027–1035. Society for Industrial and Applied Mathematics (2007)
Bottesch, T., Bühler, T., Kächele, M.: Speeding up k-means by approximating Euclidean distances via block vectors. In: Proceedings of the 33rd International Conference on Machine Learning, pp. 2578–2586 (2016)
Devernay, F., Mateus, D., Guilbert, M.: Multi-camera scene flow by tracking 3-D points and surfels. In: 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2006), vol. 2, pp. 2203–2212 (2006)
Eccleston, C.: Chronic pain and distraction: an experimental investigation into the role of sustained and shifting attention in the processing of chronic persistent pain. Behav. Res. Ther. 33(4), 391–405 (1995)
Frisch, D., Baron, J.: Ambiguity and rationality. J. Behav. Dec. Mak. 1(3), 149–157 (1988)
Fu, Y., Hospedales, T.M., Xiang, T., Gong, S.: Learning multimodal latent attributes. IEEE Trans. Pattern Anal. Mach. Intell. 36(2), 303–316 (2014)
Horn, B.K., Schunck, B.G.: Determining optical flow. Artif. Intell. 17(1–3), 185–203 (1981)
Laptev, I., Marszalek, M., Schmid, C., Rozenfeld, B.: Learning realistic human actions from movies. In: 2008 IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8, June 2008
Layher, G., Giese, M.A., Neumann, H.: Learning representations of animated motion sequences–a neural model. Top. Cogn. Sci. 6(1), 170–182 (2014)
Mihailidis, A., Carmichael, B., Boger, J.: The use of computer vision in an intelligent environment to support aging-in-place, safety, and independence in the home. IEEE Trans. Inf. Technol. Biomed. 8(3), 238–247 (2004)
Morewedge, C.K., Kahneman, D.: Associative processes in intuitive judgment. Trends Cogn. Sci. 14(10), 435–440 (2010)
Morris, B.T., Trivedi, M.M.: Trajectory learning for activity understanding: unsupervised, multilevel, and long-term adaptive approach. IEEE Trans. Pattern Anal. Mach. Intell. 33(11), 2287–2301 (2011)
Oneata, D., Verbeek, J., Schmid, C.: Action and event recognition with fisher vectors on a compact feature set. In: 2013 IEEE International Conference on Computer Vision, pp. 1817–1824, December 2013
Poppe, R.: A survey on vision-based human action recognition. Image Vis. Comput. 28(6), 976–990 (2010)
Rashidi, P., Mihailidis, A.: A survey on ambient-assisted living tools for older adults. IEEE J. Biomed. Health Inform. 17(3), 579–590 (2013)
Ren, S., He, K., Girshick, R., Sun, J.: Faster R-CNN: towards real-time object detection with region proposal networks. In: Advances in Neural Information Processing Systems, pp. 91–99 (2015)
Rosten, E., Drummond, T.: Machine learning for high-speed corner detection. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3951, pp. 430–443. Springer, Heidelberg (2006). doi:10.1007/11744023_34
Tian, Y., Sukthankar, R., Shah, M.: Spatiotemporal deformable part models for action detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2642–2649 (2013)
Tsai, C.F.: Bag-of-words representation in image annotation: a review. ISRN Artif. Intell. (2012)
Tyagi, A., Potamianos, G., Davis, J.W., Chu, S.M.: Fusion of multiple camera views for kernel-based 3D tracking. In: IEEE Workshop on Motion and Video Computing (WMVC 2007), p. 1, February 2007
Acknowledgments
This study is funded by the SenseEmotion project of German Federal Ministry of Education and Research (BMBF).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Zhang, Y., Layher, G., Walter, S., Kessler, V., Neumann, H. (2017). Visual Confusion Recognition in Movement Patterns from Walking Path and Motion Energy. In: Mokhtari, M., Abdulrazak, B., Aloulou, H. (eds) Enhanced Quality of Life and Smart Living. ICOST 2017. Lecture Notes in Computer Science(), vol 10461. Springer, Cham. https://doi.org/10.1007/978-3-319-66188-9_11
Download citation
DOI: https://doi.org/10.1007/978-3-319-66188-9_11
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-66187-2
Online ISBN: 978-3-319-66188-9
eBook Packages: Computer ScienceComputer Science (R0)