Skip to main content

Emblem Recognition: Cultural Coaching Software via Hand Gestures

  • Conference paper
  • First Online:
HCI International 2020 – Late Breaking Posters (HCII 2020)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1293))

Included in the following conference series:

  • 1102 Accesses

Abstract

Negotiations and casual exchanges that involve different cultures may often lead to misunderstandings and eventually adverse outcomes. These conflicts can be easily avoided if both parties are familiarized with each other’s culture. This paper proposes a novel way of tackling this problem by using computer vision and identifying hand gestures that are particular to a culture. Such gestures, also known as emblems, are used frequently during interaction. There is a certain complexity to emblems, and their identification could provide vital information during communication if recognized accurately. An example for this case is the “thumbs up” gesture, where the thumb is extended while the other fingers are curled up. This gesture, while positive in the West, can be insulting in other countries. The implemented computer vision software was able to detect five distinct hand gestures that had one specific meaning in the United States, as well as other connotations in other countries. This helped inform participants with residency in the United States about additional meanings of familiar hand gestures that are commonly used in North America. The main purpose of culturally-sensitive technology is to help a user get acquainted with socio-cultural particularities of another group. Possible applications are discussed further, such as serving as a cultural interpreter during a diplomatic or business exchange or aiding in cultural sensibility training for tourists traveling to a new country.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Littlewood, W.: Cultural awareness and the negotiation of meaning in intercultural communication. Lang. Awareness 2–3, 189–199 (2011)

    Google Scholar 

  2. Archer, D.: Unspoken diversity: cultural differences in gestures. Qual. Sociol. 20(1), 79–105 (1997)

    Article  Google Scholar 

  3. Knapp, M.: Nonverbal Communication in Human Interaction. Holt, Rinehart, and Winston, New York (1972)

    Google Scholar 

  4. Matsumoto, D., Hwang, H.: Cultural similarities and differences in emblematic gestures. J. Nonverbal Behav. 37, 1–27 (2013)

    Article  Google Scholar 

  5. Heimgärtner, R.: Intercultural user interface design – culture-centered hci design – cross-cultural user interface design: different terminology or different approaches? In: Marcus, A. (ed.) DUXU 2013. LNCS, vol. 8013, pp. 62–71. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-39241-2_8

    Chapter  Google Scholar 

  6. Quek, F., Zhao, M.: Inductive learning in hand pose recognition. In: Proceedings of the Second International Conference on Automatic Face and Gesture Recognition, Killington, VT, pp. 78–83. IEEE (1996)

    Google Scholar 

  7. Kanaujia, A., Huang, Y., Metaxas, D.: Emblem detections by tracking facial features. In: 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW’2006), New York, NY, p. 108. IEEE (2006)

    Google Scholar 

  8. Zheng, M., Liu, P.X., Meng, M.Q.-H.: Interpretation of human and robot emblematic gestures: how do they differ? Int. J. Robot. Autom. 34(1), 55–70 (2018)

    Google Scholar 

  9. Cabibihan, J.-J., So, W., Pramanik, S.: Human-recognizable robotic gestures. IEEE Trans. Auton. Ment. Dev. 4(4), 305–314 (2012)

    Article  Google Scholar 

  10. Peña, P., Polceanu, M., Lisetti, C., Visser, U.: eEVA as a real-time multimodal agent human-robot interface. In: Holz, D., Genter, K., Saad, M., von Stryk, O. (eds.) RoboCup 2018. LNCS (LNAI), vol. 11374, pp. 262–274. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-27544-0_22

    Chapter  Google Scholar 

  11. Rehm, M., Bee, N., André, E.: Wave like an Egyptian — accelerometer based gesture recognition for culture specific interactions. People and Computers XXII Culture. Creativity, Interaction, vol. 1, pp. 13–22. Liverpool, UK (2008)

    Google Scholar 

  12. Hasler, B.S., Salomon, O., Tuchman, P., Lev-Tov, A., Friedman, D.: Real-time gesture translation in intercultural communication. AI Soc. 32(1), 25–35 (2014). https://doi.org/10.1007/s00146-014-0573-4

    Article  Google Scholar 

  13. Sadaival.: Hand-Gestures [Software] (2018). https://github.com/Sadaival/Hand-Gestures, Accessed 10 Mar 2020

Download references

Acknowledgements

I would like to thank Roger F. Malina for his invaluable support in the development of the project, as well as the members of the ArtSciLab. Additionally, I am grateful to all the volunteers that were excited to try the software with me and gave me instrumental feedback.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Cris Kubli .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Kubli, C. (2020). Emblem Recognition: Cultural Coaching Software via Hand Gestures. In: Stephanidis, C., Antona, M., Ntoa, S. (eds) HCI International 2020 – Late Breaking Posters. HCII 2020. Communications in Computer and Information Science, vol 1293. Springer, Cham. https://doi.org/10.1007/978-3-030-60700-5_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-60700-5_9

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-60699-2

  • Online ISBN: 978-3-030-60700-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics