Andrey Krekhov
ABSTRACT
We frequently utilize face emojis to express emotions in digital communication. But how wholly and precisely do such pictographs sample the emotional spectrum, and are there gaps to be closed? Our research establishes emoji intensity scales for seven basic emotions: happiness, anger, disgust, sadness, shock, annoyance, and love. In our survey (N = 1195), participants worldwide assigned emotions and intensities to 68 face emojis. According to our results, certain feelings, such as happiness or shock, are visualized by manifold emojis covering a broad spectrum of intensities. Other feelings, such as anger, have limited and only very intense representative visualizations. We further emphasize that the cultural background influences emojis’ perception: for instance, linear-active cultures (e.g., UK, Germany) rate the intensity of such visualizations higher than multi-active (e.g., Brazil, Russia) or reactive cultures (e.g., Indonesia, Singapore). To summarize, our manuscript promotes future research on more expressive, culture-aware emoji design.
Supplemental Material
- 1881. Typographical Art. Puck 212 (Mar 1881), 65.Google Scholar
- Sarah Alismail and Hengwei Zhang. 2018. The Use of Emoji in Electronic User Experience Questionnaire: An Exploratory Case Study. In Proceedings of the 51st Hawaii International Conference on System Sciences. 3366–3375.Google ScholarCross Ref
- Kate Allen, Ruth Marlow, Vanessa Edwards, Claire Parker, Lauren Rodgers, Obioha C Ukoumunne, Edward Chan Seem, Rachel Hayes, Anna Price, and Tamsin Ford. 2018. ‘How I Feel About My School’: The construction and validation of a measure of wellbeing at school for primary school children. Clinical Child Psychology and Psychiatry 23, 1 (2018), 25–41. https://doi.org/10.1177/1359104516687612 arXiv:https://doi.org/10.1177/1359104516687612PMID: 28135832.Google ScholarCross Ref
- Qiyu Bai, Qi Dan, Zhe Mu, and Maokun Yang. 2019. A Systematic Review of Emoji: Current Research and Future Perspectives. Frontiers in Psychology 10 (2019). https://doi.org/10.3389/fpsyg.2019.02221Google Scholar
- Francesco Barbieri, Miguel Ballesteros, Francesco Ronzano, and Horacio Saggion. 2018. Multimodal Emoji Prediction. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers). Association for Computational Linguistics, New Orleans, Louisiana, 679–686. https://doi.org/10.18653/v1/N18-2107Google ScholarCross Ref
- Francesco Barbieri, German Kruszewski, Francesco Ronzano, and Horacio Saggion. 2016. How cosmopolitan are emojis? Exploring emojis usage and meaning over different languages with distributional semantics. In Proceedings of the 24th ACM international conference on Multimedia. 531–535.Google ScholarDigital Library
- Lidia Bielinis. 2019. MY GRANDCHILDREN WOULD KNOW THAT… SENIORS INTERPRETING EMOTICONS. In SOCIETY. INTEGRATION. EDUCATION. Proceedings of the International Scientific Conference, Vol. 5. 26–41.Google Scholar
- M. M. Bradley and P. J. Lang. 1994. Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. Journal of behavior therapy and experimental psychiatry 25, 1(1994), 49–59. https://doi.org/10.1016/0005-7916(94)90063-9Google ScholarCross Ref
- Spencer Cappallo, Thomas Mensink, and Cees G.M. Snoek. 2015. Image2Emoji: Zero-Shot Emoji Prediction for Visual Media. In Proceedings of the 23rd ACM International Conference on Multimedia (Brisbane, Australia) (MM ’15). Association for Computing Machinery, New York, NY, USA, 1311–1314. https://doi.org/10.1145/2733373.2806335Google ScholarDigital Library
- Spencer Cappallo, Thomas Mensink, and Cees G.M. Snoek. 2015. Query-by-Emoji Video Search. In Proceedings of the 23rd ACM International Conference on Multimedia (Brisbane, Australia) (MM ’15). Association for Computing Machinery, New York, NY, USA, 735–736. https://doi.org/10.1145/2733373.2807961Google ScholarDigital Library
- Spencer Cappallo, Stacey Svetlichnaya, Pierre Garrigues, Thomas Mensink, and Cees G. M. Snoek. 2019. New Modality: Emoji Challenges in Prediction, Anticipation, and Retrieval. IEEE Transactions on Multimedia 21, 2 (2019), 402–415. https://doi.org/10.1109/TMM.2018.2862363Google ScholarDigital Library
- Nan-Chen Chen, Daniel Perry, Hidekazu Saegusa, and Cecilia Aragon. 2020. A Cross-Cultural Survey of Emoticon Research Before 2015. Human Centered Design and Engineering Technical Report (2020).Google Scholar
- Zhenpeng Chen, Xuan Lu, Wei Ai, Huoran Li, Qiaozhu Mei, and Xuanzhe Liu. 2018. Through a gender lens: Learning usage patterns of emojis from large-scale android users. In Proceedings of the 2018 World Wide Web Conference. 763–772.Google ScholarDigital Library
- Herbert H Clark. 1996. Using language. Cambridge university press.Google Scholar
- Henriette Cramer, Paloma de Juan, and Joel Tetreault. 2016. Sender-intended functions of emojis in US messaging. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services. 504–509.Google ScholarDigital Library
- Marcel Danesi. 2016. The semiotics of emoji: The rise of visual language in the age of the internet. Bloomsbury Publishing.Google ScholarDigital Library
- Paul Ekman. 1972. Universal and cultural differences in facial expression of emotion. In Nebraska symposium on motivation, Vol. 19. University of Nebraska Press, 207–284.Google Scholar
- Paul Ekman. 1992. Are there basic emotions?(1992).Google Scholar
- Paul Ekman. 1992. Facial expressions of emotion: New findings, new questions.Google Scholar
- Abdallah El Ali, Torben Wallbaum, Merlin Wasmann, Wilko Heuten, and Susanne CJ Boll. 2017. Face2emoji: Using facial emotional expressions to filter emojis. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems. 1577–1584.Google ScholarDigital Library
- Dorothea Erharter and Elka Xharo. 2016. Developer-Guideline Usability von Apps für Seniorinnen und Senioren. Developer-Guideline Usability von Apps für Seniorinnen und Senioren. Entstanden im Rahmen des Projektes ”mobi. senior. A ”. Wien (2016).Google Scholar
- Thorsten M. Erle, Karoline Schmid, Simon H. Goslar, and Jared D. Martin. 2021. Emojis as social information in digital communication. Emotion (2021), Advance online publication. https://doi.org/10.1037/emo0000992Google Scholar
- Vyvyan Evans. 2017. The emoji code: How smiley faces, love hearts and thumbs up are changing the way we communicate. Michael O’Mara Books.Google Scholar
- Jose A Gallud, Habib M Fardoun, Fernando Andres, and Nehme Safa. 2018. A study on how older people use emojis. In Proceedings of the XIX International Conference on Human Computer Interaction. 1–4.Google ScholarDigital Library
- Boting Gao and Doug P. VanderLaan. 2020. Cultural Influences on Perceptions of Emotions Depicted in Emojis. Cyberpsychology, Behavior, and Social Networking 23, 8(2020), 567–570. https://doi.org/10.1089/cyber.2020.0024Google ScholarCross Ref
- Andrzej Grzybowski and Konrad Kupidura-Majewski. 2019. What is color and how it is perceived?Clinics in Dermatology 37, 5 (2019), 392–401. https://doi.org/10.1016/j.clindermatol.2019.07.008 The Color of Skin.Google Scholar
- Sharath Chandra Guntuku, Mingyang Li, Louis Tay, and Lyle H Ungar. 2019. Studying cultural differences in emoji usage across the east and the west. In Proceedings of the International AAAI Conference on Web and Social Media, Vol. 13. 226–235.Google Scholar
- Edward T Hall. 1976. Beyond culture. Garden city. NY: Anchor (1976).Google Scholar
- Tianran Hu, Han Guo, Hao Sun, Thuy-vy Nguyen, and Jiebo Luo. 2017. Spice up your chat: the intentions and sentiment effects of using emojis. In Proceedings of the International AAAI Conference on Web and Social Media, Vol. 11.Google Scholar
- A. Illendula, K. Manohar, and M. Yedulla. 2018. Which Emoji Talks Best for My Picture?. In 2018 IEEE/WIC/ACM International Conference on Web Intelligence (WI). IEEE Computer Society, Los Alamitos, CA, USA, 514–519. https://doi.org/10.1109/WI.2018.00-44Google Scholar
- Anurag Illendula and Amit Sheth. 2019. Multimodal emotion classification. In Companion Proceedings of The 2019 World Wide Web Conference. 439–449.Google ScholarDigital Library
- Rachael E Jack, Oliver GB Garrod, Hui Yu, Roberto Caldara, and Philippe G Schyns. 2012. Facial expressions of emotion are not culturally universal. Proceedings of the National Academy of Sciences 109, 19(2012), 7241–7244.Google ScholarCross Ref
- Ryan Kelly and Leon Watts. 2015. Characterising the inventive appropriation of emoji as relationally meaningful in mediated close personal relationships. Experiences of technology appropriation: Unanticipated users, usage, circumstances, and design 2(2015).Google Scholar
- Sujay Khandekar, Joseph Higg, Yuanzhe Bian, Chae Won Ryu, Jerry O. Talton Iii, and Ranjitha Kumar. 2019. Opico: a study of emoji-first communication in a mobile social app. In Companion Proceedings of The 2019 World Wide Web Conference. 450–458.Google ScholarDigital Library
- Paul R Kleinginna and Anne M Kleinginna. 1981. A categorized list of emotion definitions, with suggestions for a consensual definition. Motivation and emotion 5, 4 (1981), 345–379.Google Scholar
- Petra Kralj Novak, Jasmina Smailović, Borut Sluban, and Igor Mozetič. 2015. Sentiment of emojis. PloS one 10, 12 (2015), e0144296.Google ScholarCross Ref
- Richard Lewis. 2010. When cultures collide. Nicholas Brealey Publishing Boston, MA.Google Scholar
- Mingyang Li, Sharath Guntuku, Vinit Jakhetiya, and Lyle Ungar. 2019. Exploring (Dis-)Similarities in Emoji-Emotion Association on Twitter and Weibo. In Companion Proceedings of The 2019 World Wide Web Conference (San Francisco, USA) (WWW ’19). Association for Computing Machinery, New York, NY, USA, 461–467. https://doi.org/10.1145/3308560.3316546Google ScholarDigital Library
- Nikola Ljubešić and Darja Fišer. 2016. A global analysis of emoji usage. In Proceedings of the 10th Web as Corpus Workshop. 82–89.Google ScholarCross Ref
- Xuan Lu, Wei Ai, Xuanzhe Liu, Qian Li, Ning Wang, Gang Huang, and Qiaozhu Mei. 2016. Learning from the ubiquitous language: an empirical analysis of emoji usage of smartphone users. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing. 770–780.Google ScholarDigital Library
- Gretchen McCulloch and Lauren Gawne. 2018. Emoji grammar as beat gestures. In Proceedings of the 1st International Workshop on Emoji Understanding and Applications in Social Media, Standford [en línea]. Disponible en http://knoesis. org/resources/Emoji2018/Emoji2018_Papers/Paper13_Emoji2018.pdf [Consulta 11/12/2019].Google Scholar
- Wulf-Uwe Meyer, Rainer Reisenzein, and Achim Schützwohl. 2001. Einführung in die Emotionspsychologie. Band I: Die Emotionstheorien von Watson, James und Schachter. Huber, Bern Göttingen, Bd 1, 2 (2001).Google Scholar
- Hannah Miller, Daniel Kluver, Jacob Thebault-Spieker, Loren Terveen, and Brent Hecht. 2017. Understanding Emoji Ambiguity in Context: The Role of Text in Emoji-Related Miscommunication. In Proceedings of the 11th International Conference on Web and Social Media, ICWSM 2017. AAAI Press, 152–161.Google Scholar
- Hannah Miller, Jacob Thebault-Spieker, Shuo Chang, Isaac Johnson, Loren Terveen, and Brent Hecht. 2016. “Blissfully Happy” or “Ready to Fight”: Varying Interpretations of Emoji. In Proceedings of the International AAAI Conference on Web and Social Media, Vol. 10.Google Scholar
- Hannah Miller Hillberg, Zachary Levonian, Daniel Kluver, Loren Terveen, and Brent Hecht. 2018. What I See is What You Don’t Get: The Effects of (Not) Seeing Emoji Rendering Differences across Platforms. Proceedings of the ACM on Human-Computer Interaction 2, CSCW(2018), 1–24.Google ScholarDigital Library
- Svenja Noichl, Nadine Bergner, and Ulrik Schroeder. 2017. Zielgruppengerechte App-Icons für Seniorinnen und Senioren. Bildungsräume 2017(2017).Google Scholar
- Jaram Park, Vladimir Barash, Clay Fink, and Meeyoung Cha. 2013. Emoticon style: Interpreting differences in emoticons across cultures. In Proceedings of the International AAAI Conference on Web and Social Media, Vol. 7.Google Scholar
- Henning Pohl, Christian Domin, and Michael Rohs. 2017. Beyond Just Text: Semantic Emoji Similarity Modeling to Support Expressive Communication 👫📲😃. ACM Trans. Comput.-Hum. Interact. 24, 1, Article 6 (March 2017), 42 pages. https://doi.org/10.1145/3039685Google ScholarDigital Library
- Marília Prada, David L. Rodrigues, Margarida V. Garrido, Diniz Lopes, Bernardo Cavalheiro, and Rui Gaspar. 2018. Motives, frequency and attitudes toward emoji and emoticon use. Telematics and Informatics 35, 7 (2018), 1925–1934. https://doi.org/10.1016/j.tele.2018.06.005Google ScholarCross Ref
- Monica A Riordan. 2017. Emojis as tools for emotion work: Communicating affect in text messages. Journal of Language and Social Psychology 36, 5 (2017), 549–567.Google ScholarCross Ref
- Giuseppe Riva. 2002. The sociocognitive psychology of computer-mediated communication: The present and future of technology-based interactions. Cyberpsychology & behavior 5, 6 (2002), 581–598.Google Scholar
- Jessica Röhner, Astrid Schütz, and Astrid Schütz. 2012. Psychologie der Kommunikation. Springer.Google Scholar
- James P Spradley and David W McCurdy. 2012. Conformity and conflict: Readings in cultural anthropology. Jill Potash.Google Scholar
- Sandeep Suntwal, Sue Brown, and Laura Brandimarte. 2021. Pictographs, Ideograms, and Emojis (PIE): A Framework for Empirical Research Using Non-verbal Cues. In Proceedings of the 54th Hawaii International Conference on System Sciences. 6400–6409. https://doi.org/10.24251/HICSS.2021.771Google ScholarCross Ref
- Kohske Takahashi, Takanori Oishi, and Masaki Shimada. 2017. Is ☺ Smiling? Cross-Cultural Study on Recognition of Emoticon’s Emotion. Journal of Cross-Cultural Psychology 48, 10 (2017), 1578–1586. https://doi.org/10.1177/0022022117734372 arXiv:https://doi.org/10.1177/0022022117734372Google ScholarCross Ref
- Garreth W. Tigwell and David R. Flatla. 2016. Oh That’s What You Meant! Reducing Emoji Misunderstanding. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (Florence, Italy) (MobileHCI ’16). Association for Computing Machinery, New York, NY, USA, 859–866. https://doi.org/10.1145/2957265.2961844Google ScholarDigital Library
- Alexander Toet and Jan B.F. van Erp. 2019. The EmojiGrid as a Tool to Assess Experienced and Perceived Emotions. Psych 1, 1 (2019), 469–481. https://doi.org/10.3390/psych1010036Google ScholarCross Ref
- Sarah Theres Völkel, Daniel Buschek, Jelena Pranjic, and Heinrich Hussmann. 2019. Understanding emoji interpretation through user personality and message context. In Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services. 1–12.Google ScholarDigital Library
- Sanjaya Wijeratne, Lakshika Balasuriya, Amit Sheth, and Derek Doran. 2017. EmojiNet: An Open Service and API for Emoji Sense Discovery. In Proceedings of the 11th International AAAI Conference on Web and Social Media (Montréal, Canada) (ICWSM ’17). AAAI Press, Palo Alto, USA, 437–446. https://aaai.org/ocs/index.php/ICWSM/ICWSM17/paper/view/15551Google Scholar
- Sanjaya Wijeratne, Lakshika Balasuriya, Amit Sheth, and Derek Doran. 2017. A Semantics-Based Measure of Emoji Similarity. In Proceedings of the International Conference on Web Intelligence (Leipzig, Germany) (WI ’17). Association for Computing Machinery, New York, NY, USA, 646–653. https://doi.org/10.1145/3106426.3106490Google ScholarDigital Library
- Sarah Wiseman and Sandy J. J. Gould. 2018. Repurposing Emoji for Personalised Communication: Why 🍕 Means “I Love You”. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–10. https://doi.org/10.1145/3173574.3173726Google ScholarDigital Library
- Ian D. Wood and Sebastian Ruder. 2016. Emoji as Emotion Tags for Tweets. In Proceedings of the Emotion and Sentiment Analysis Workshop LREC 2016 (Portoroz, Slovenia) (LREC 2016). European Language Resources Association, 76–79.Google Scholar
- Rui Zhou, Jasmine Hentschel, and Neha Kumar. 2017. Goodbye text, hello emoji: Mobile communication on WeChat in China. In Proceedings of the 2017 CHI conference on human factors in computing systems. 748–759.Google ScholarDigital Library
Index Terms
- Interpolating Happiness: Understanding the Intensity Gradations of Face Emojis Across Cultures
Recommendations
The communicative role of non-face emojis
Emojis have evolved from imitations of facial expressions meant to communicate affect into pictures of objects, food, and places that are not directly linked to affect. While emojis that resemble facial expressions are well-researched, emojis that ...
The Interplay Between Emojis and Linguistic Text
Chinese Lexical SemanticsAbstractThis paper examines the interplay between emojis and the accompanying linguistic text when the two channels disagree with each other. In general, emojis are typically regarded as an explicit way to convey a specific emotion. However, it is ...
A case for emojis, more or less: An analysis of word and emoji expressivity in text messaging for high and low alexithymia levels
AbstractThe impact of alexithymia on verbal and non-verbal expressivity was investigated in one of the most prevalent mediums for present-day human interacting, smartphone text messaging. The variety of words and emojis used to express ...
Graphical abstractDisplay Omitted
Highlights- Deficits in verbal and non-verbal expressivity not universal in alexithymia.
- ...
Comments