skip to main content
10.1145/3267305.3267562acmconferencesArticle/Chapter ViewAbstractPublication PagesubicompConference Proceedingsconference-collections
poster

Mapping Natural Facial Expressions Using Unsupervised Learning and Optical Sensors on Smart Eyewear

Published: 08 October 2018 Publication History

Abstract

Our communication highly depends on nonverbal clues, especially on facial expressions. This paper presents the mapping of spontaneous facial expressions in daily conversation using the optical sensors on smart eyewear and unsupervised learning method(Self-Organizing Map) to see the potentially detectable expressions. We had the case study of five to ten minutes of the unscripted communications with five users. It showed that our system could map the various facial expressions of the users such as social smile and the smile of enjoyment. The study also demonstrated that the map trained with the datasets of five users could categorize the similar expressions of each user into the shared clusters among the users.

References

[1]
P. Ekman and W. V. Friesen. 1982. Felt, false, and miserable smiles. Journal of Nonverbal Behavior 6, 4 (jun 1982), 238--252.
[2]
B. Fasel and J. Luettin. 2003. Automatic facial expression analysis: A survey. Pattern Recognition 36, 1 (2003), 259--275.
[3]
C. Frith. 2009. Role of facial expressions in social interactions. Philosophical Transactions of the Royal Society of London B: Biological Sciences 364, 1535 (2009), 3453--3458.
[4]
C. D. Frith and U. Frith. 2012. Mechanisms of Social Cognition. Annual Review of Psychology 63, 1 (2012), 287--313.
[5]
T. Kohonen. 1982. Self-organized formation of topologically correct feature maps. Biological Cybernetics 43, 1 (01 Jan 1982), 59--69.
[6]
K. Masai, Y. Sugiura, M. Ogata, K. Kunze, M. Inami, and M. Sugimoto. In Proceedings of the 21st International Conference on Intelligent User Interfaces. New York, NY, USA.
[7]
G. Vettigli. 2018. MiniSom: minimalistic and NumPy-based implementation of the Self Organizing Map. (2018). https://github.com/JustGlowing/minisom

Index Terms

  1. Mapping Natural Facial Expressions Using Unsupervised Learning and Optical Sensors on Smart Eyewear

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    UbiComp '18: Proceedings of the 2018 ACM International Joint Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and Wearable Computers
    October 2018
    1881 pages
    ISBN:9781450359665
    DOI:10.1145/3267305
    Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

    Sponsors

    In-Cooperation

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 08 October 2018

    Check for updates

    Author Tags

    1. Facial Expression
    2. Unsupervised Learning
    3. Wearable Computing

    Qualifiers

    • Poster
    • Research
    • Refereed limited

    Conference

    UbiComp '18
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 764 of 2,912 submissions, 26%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 127
      Total Downloads
    • Downloads (Last 12 months)5
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 22 Feb 2025

    Other Metrics

    Citations

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media