Skip to main content
SpringerLink
Log in

Who Is in the Crowd? Deep Face Analysis for Crowd Understanding

  • Conference paper
  • First Online:
Pattern Recognition. ICPR International Workshops and Challenges (ICPR 2021)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 12662))

Included in the following conference series:

  • 2186 Accesses

Abstract

Crowd understanding plays a vital role in management processes and continues to receive a growing interest in various public and commercial service sectors. Surveillance, entertainment, marketing, and social sciences are only a few of the fields that can benefit from the development of automatic systems for crowd understanding. Little attention has been paid to the study of who are the subjects that characterize the crowd. In this article, we present a crowd understanding system based on face analysis capable of providing statistics about people in the crowd in terms of demographic (i.e. gender and age group), affective state (i.e. eight emotions, valence and arousal), and fine-grained facial attributes.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Augusto, J.C.: Ambient intelligence: basic concepts and applications. In: Filipe, J., Shishkov, B., Helfert, M. (eds.) Software and Data Technologies, pp. 16–26. Springer, Berlin Heidelberg (2008)

    Chapter  Google Scholar 

  2. Bianco, S., Celona, L., Napoletano, P.: Visual-based sentiment logging in magic smart mirrors. In: ICCE-Berlin, pp. 1–4. IEEE (2018)

    Google Scholar 

  3. Brunelli, R., Lanz, O., Santuari, A., Tobia, F.: Tracking visitors in a museum. PEACH-Intelligent Interfaces for Museum Visits, pp. 205–225. Springer, Berlin Berlin (2007)

    Chapter  Google Scholar 

  4. Celona, L., Bianco, S., Schettini, R.: Fine-grained face annotation using deep multi-task cnn. MDPI Sens. 18(8), 2666 (2018)

    Article  Google Scholar 

  5. Celona, L., Mammana, L., Bianco, S., Schettini, R.: A multi-task cnn framework for driver face monitoring. In: ICCE-Berlin, pp. 1–4. IEEE (2018)

    Google Scholar 

  6. Chris, F.: Revealed: how facial recognition has invaded shops - and your privacy. The Guardian (2016). https://www.theguardian.com/cities/2016/mar/03/revealed-facial-recognition-software-infiltrating-cities-saks-toronto

  7. Hung, P.C.K., Kanev, K., Huang, S.C., Iqbal, F., Fung, B.C.M.: Smart TV face monitoring for children privacy. J. Internet Technol. 19(5), 1577–1583 (2018)

    Google Scholar 

  8. Kasiran, Z., Yahya, S.: Facial expression as an implicit customers’ feedback and the challenges. In: CGIV, pp. 377–381 (2007)

    Google Scholar 

  9. King, D.E.: Dlib-ml: a machine learning toolkit. J. Mach. Learn. Res. 10, 1755–1758 (2009)

    Google Scholar 

  10. Kulshrestha, T., Saxena, D., Niyogi, R., Cao, J.: Real-time crowd monitoring using seamless indoor-outdoor localization. IEEE Trans. Mobile Comput. 19(3), 664–679 (2019)

    Article  Google Scholar 

  11. Liu, W., Salzmann, M., Fua, P.: Context-aware crowd counting. In: CVPR, pp. 5099–5108. IEEE (2019)

    Google Scholar 

  12. Mollahosseini, A., Hasani, B., Mahoor, M.H.: Affectnet: a database for facial expression, valence, and arousal computing in the wild. IEEE Trans. Affect. Comput. 10(1), 18–31 (2017)

    Article  Google Scholar 

  13. Shao, J., Kang, K., Loy, C.C., Wang, X.: Deeply learned attributes for crowded scene understanding. In: CVPR, pp. 4657–4666. IEEE (2015)

    Google Scholar 

  14. Shao, J., Change Loy, C., Wang, X.: Scene-independent group profiling in crowd. In: CVPR, pp. 2219–2226 (2014)

    Google Scholar 

  15. Taha, A.E.M., Ali, A.: Monitoring a crowd’s affective state: status quo and future outlook. IEEE Commun. Mag. 57(4), 26–32 (2019)

    Article  Google Scholar 

  16. Teixeira, T., Wedel, M., Pieters, R.: Emotion-induced engagement in internet video advertisements. J. Market. Res. 49(2), 144–159 (2012)

    Article  Google Scholar 

  17. Yolcu, G., Oztel, I., Kazan, S., Oz, C., Bunyak, F.: Deep learning-based face analysis system for monitoring customer interest. J. Ambient Intell. Humanized Comput. 11(1), 237–248 (2019). https://doi.org/10.1007/s12652-019-01310-5

    Article  Google Scholar 

  18. Zhang, C., Li, H., Wang, X., Yang, X.: Cross-scene crowd counting via deep convolutional neural networks. In: CVPR, pp. 833–841 (2015)

    Google Scholar 

  19. Zhou, B., Tang, X., Wang, X.: Measuring crowd collectiveness. In: CVPR, pp. 3049–3056 (2013)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Informatics, Systems and Communication University of Milano - Bicocca, viale Sarca, 336, 20126, Milan, Italy

    Simone Bianco, Luigi Celona & Raimondo Schettini

Authors
  1. Simone Bianco
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Luigi Celona
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Raimondo Schettini
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Luigi Celona .

Editor information

Editors and Affiliations

  1. Dipartimento di Ingegneria dell’Informazione, University of Firenze, Firenze, Italy

    Alberto Del Bimbo

  2. Dipartimento di Ingegneria “Enzo Ferrari”, Università di Modena e Reggio Emilia, Modena, Italy

    Rita Cucchiara

  3. Department of Computer Science, Boston University, Boston, MA, USA

    Stan Sclaroff

  4. Dipartimento di Matematica e Informatica, University of Catania, Catania, Italy

    Giovanni Maria Farinella

  5. Cloud & AI, JD.COM, Beijing, China

    Tao Mei

  6. Dipartimento di Ingegneria dell’Informazione, Universita di Firenze, Firenze, Italy

    Marco Bertini

  7. Computational Sciences Department, National Institute of Astrophysics, Optics and Electronics (INAOE), Tonantzintla, Puebla, Mexico

    Hugo Jair Escalante

  8. Dipartimento di Ingegneria “Enzo Ferrari”, Università di Modena e Reggio Emilia, Modena, Italy

    Roberto Vezzani

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Bianco, S., Celona, L., Schettini, R. (2021). Who Is in the Crowd? Deep Face Analysis for Crowd Understanding. In: Del Bimbo, A., et al. Pattern Recognition. ICPR International Workshops and Challenges. ICPR 2021. Lecture Notes in Computer Science(), vol 12662. Springer, Cham. https://doi.org/10.1007/978-3-030-68790-8_38

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-68790-8_38

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-68789-2

  • Online ISBN: 978-3-030-68790-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Societies and partnerships

Search

Navigation