Abstract
What target is focused on by many people? Analysis of the target is a crucial task, especially in a cinema, a stadium, and so on. However, it is very difficult to estimate the gaze of each person in a crowd accurately and simultaneously with existing image-based eye tracking methods, since the image resolution of each person becomes low when we capture the whole crowd with a distant camera. Therefore, we introduce a new approach for localizing the gaze target focused on by a crowd of people. The proposed framework aggregates the individually estimated results of each person’s gaze. It enables us to localize the target being focused on by them even though each person’s gaze localization from a low-resolution image is inaccurate. We analyze the effects of an aggregation method on the localization accuracy using images capturing a crowd of people in a tennis stadium under the assumption that all of the people are focusing on the same target, and also investigate the effect of the number of people involved in the aggregation on the localization accuracy. As a result, the proposed method showed the ability to improve the localization accuracy as it is applied to a larger crowd of people.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
We used Flea3 (FL3-U3-13E4C-C) cameras produced by Point Grey Research.
References
Okamoto, K., et al.: Classification of pedestrian behavior in a shopping mall based on LRF and camera observations. In: Proceedings of the 12th IAPR Conference on Machine Vision Applications, pp. 1–5 (2011)
Fridman, L., Langhans, P., Lee, J., Reimer, B.: Driver gaze region estimation without use of eye movement. IEEE Intell. Syst. 31, 49–56 (2016)
Yonetani, R., Kawashima, H., Hirayama, T., Matsuyama, T.: Gaze probing: event-based estimation of objects being focused on. In: Proceedings of the 20th IAPR International Conference on Pattern Recognition, pp. 101–104 (2010)
Hirayama, T., Sumi, Y., Kawahara, T., Matsuyama, T.: Info-concierge: proactive multi-modal interaction through mind probing. In: Proceedings of the 3rd Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, pp. 1–10 (2011)
Recasens, A., Khosla, A., Vondrick, C., Torralba, A.: Where are they looking? In: Proceedings of the 28th International Conference on Neural Information Processing Systems, pp. 199–207 (2015)
Park, H.S., Jain, E., Sheikh, Y.: 3D gaze concurrences from head-mounted cameras. In: Proceedings of the 25th International Conference on Neural Information Processing Systems, pp. 422–430 (2012)
Park, H.S., Shi, J.: Social saliency prediction. In: Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition, pp. 4777–4785 (2015)
Sugano, Y., Zhang, X., Bulling, A.: Aggregaze: collective estimation of audience attention on public displays. Proceedings of the 29th ACM Symposium on User Interface Software and Technology, pp. 821–831 (2016)
Zhang, X., Sugano, Y., Fritz, M., Bulling, A.: It’s written all over your face: full-face appearance-based gaze estimation. In: Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 2299–2308 (2017)
Krafka, K., et al.: Eye tracking for everyone. In: Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition, pp. 2176–2184 (2016)
Ono, Y., Okabe, T., Sato, Y.: Gaze estimation from low resolution images. In: Chang, L.-W., Lie, W.-N. (eds.) PSIVT 2006. LNCS, vol. 4319, pp. 178–188. Springer, Heidelberg (2006). https://doi.org/10.1007/11949534_18
Vasilescu, M.A.O., Terzopoulos, D.: Multilinear analysis of image ensembles: TensorFaces. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002. LNCS, vol. 2350, pp. 447–460. Springer, Heidelberg (2002). https://doi.org/10.1007/3-540-47969-4_30
Tawari, A., Møgelmose, A., Martin, S., Moeslund, T.B., Trivedi, M.M.: Attention estimation by simultaneous analysis of viewer and view. In: Proceedings of the 17th IEEE International Conference on Intelligent Transportation Systems, pp. 1381–1387 (2014)
Agarwal, S., Furukawa, Y., Snavely, N., Simon, I., Curless, B., Seitz, S.M., Szeliski, R.: Building rome in a day. Comm. ACM 54, 105–112 (2011)
Zhang, K., Zhang, Z., Li, Z., Qiao, Y.: Joint face detection and alignment using multitask cascaded convolutional networks. IEEE Signal Process. Lett. 23, 1499–1503 (2016)
Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. In: Proceedings of the 3rd International Conference on for Learning Representations, pp. 1–15 (2015)
Zhang, X., Sugano, Y., Fritz, M., Bulling, A.: Appearance-based gaze estimation in the wild. In: Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition, pp. 4511–4520 (2015)
Ariz, M., Bengoechea, J., Villanueva, A., Cabeza, R.: A novel 2D/3D database with automatic face annotation for head tracking and pose estimation. Comput. Vis. Image Underst. 148, 201–210 (2016)
He, Q., et al.: OMEG: oulu multi-pose eye gaze dataset. In: Paulsen, R.R., Pedersen, K.S. (eds.) SCIA 2015. LNCS, vol. 9127, pp. 418–427. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-19665-7_35
Funes Mora, K.A., Monay, F., Odobez, J.M.: EYEDIAP database: data description and gaze tracking evaluation benchmarks. In: Proceedings of the 2014 Symposium on Eye Tracking Research and Applications, pp. 255–258 (2014)
Le Cun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based learning applied to document recognition. Proc. IEEE 86, 2278–2324 (1998)
Astola, J., Haavisto, P., Neuvo, Y.: Vector median filters. Proc. IEEE 78, 678–689 (1990)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Kodama, Y. et al. (2019). Localizing the Gaze Target of a Crowd of People. In: Carneiro, G., You, S. (eds) Computer Vision – ACCV 2018 Workshops. ACCV 2018. Lecture Notes in Computer Science(), vol 11367. Springer, Cham. https://doi.org/10.1007/978-3-030-21074-8_2
Download citation
DOI: https://doi.org/10.1007/978-3-030-21074-8_2
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-21073-1
Online ISBN: 978-3-030-21074-8
eBook Packages: Computer ScienceComputer Science (R0)