skip to main content
10.1145/2911996.2912038acmconferencesArticle/Chapter ViewAbstractPublication PagesicmrConference Proceedingsconference-collections
short-paper

Vinereactor: Crowdsourced Spontaneous Facial Expression Data

Published:06 June 2016Publication History

ABSTRACT

Although machines are more pervasive in our everyday lives, we are still forced to interact with them through limited communication channels. Our overarching goal is to support new and complex interactions by teaching the computer to interpret the expressions of the user. Towards this goal, we present Vinereactor, a new labeled database for face analysis and affect recognition. Our dataset is one of the first to explore human expression recognition in response to a stimulus video, enabling a new facet of affect analysis research. Furthermore, our dataset is the largest of its kind, nearly a magnitude larger than its closest related work.

References

  1. T. Baltrusaitis, P. Robinson, and L.-P. Morency. Constrained local neural fields for robust facial landmark detection in the wild. In International Conference on Computer Vision Workshops, pages 354--361, 2013. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. T. F. Cootes, G. J. Edwards, and C. J. Taylor. Active appearance models. IEEE Transactions on Pattern Analysis & Machine Intelligence, (6):681--685, 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. H. Dibekliouglu, A. A. Salah, and T. Gevers. Are you really smiling at me? spontaneous versus posed enjoyment smiles. In ECCV, pages 525--538. 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. P. Ekman and E. Rosenberg. What the face reveals: Basic and applied studies of spontaneous expression using the Facial Action Coding System (FACS). Oxford University Press, 1997.Google ScholarGoogle Scholar
  5. R. Gross, I. Matthews, J. Cohn, T. Kanade, and S. Baker. Multi-pie. Image and Vision Computing, 28(5):807--813, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. G. B. Huang, M. Ramesh, T. Berg, and E. Learned-Miller. Labeled faces in the wild: A database for studying face recognition in unconstrained environments. Technical Report 07--49, University of Massachusetts, Amherst, October 2007.Google ScholarGoogle Scholar
  7. Y. Jia, E. Shelhamer, J. Donahue, S. Karayev, J. Long, R. Girshick, S. Guadarrama, and T. Darrell. Caffe: Convolutional architecture for fast feature embedding. In ACM International Conference on Multimedia, pages 675--678, 2014. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. E. Kim and S. Vangala. Deep action unit classification using a binned intensity loss and semantic context model. Technical report, Villanova University, 2016.Google ScholarGoogle Scholar
  9. V. Le, J. Brandt, Z. Lin, L. Bourdev, and T. S. Huang. Interactive facial feature localization. In ECCV, pages 679--692. 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. P. Lucey, J. Cohn, T. Kanade, J. Saragih, Z. Ambadar, and I. Matthews. The extended cohn-kanade dataset (ckGoogle ScholarGoogle Scholar
  11. ): A complete dataset for action unit and emotion-specified expression. In Computer Vision and Pattern Recognition Workshops, pages 94--101, 2010.Google ScholarGoogle Scholar
  12. P. Lucey, J. Cohn, K. Prkachin, P. Solomon, and I. Matthews. Painful data: The unbc-mcmaster shoulder pain expression archive database. In Automatic Face & Gesture Recognition and Workshops, pages 57--64, 2011.Google ScholarGoogle ScholarCross RefCross Ref
  13. D. McDuff, R. Kaliouby, and R. W. Picard. Crowdsourcing facial responses to online videos. Affective Computing, 3(4):456--468, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. L. Wolf, T. Hassner, and I. Maoz. Face recognition in unconstrained videos with matched background similarity. In CVPR, pages 529--534, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. X. Zhang, L. Yin, J. F. Cohn, S. Canavan, M. Reale, A. Horowitz, P. Liu, and J. M. Girard. Bp4d-spontaneous: a high-resolution spontaneous 3d dynamic facial expression database. Image and Vision Computing, 32(10):692--706, 2014.Google ScholarGoogle ScholarCross RefCross Ref
  16. X. Zhu and D. Ramanan. Face detection, pose estimation, and landmark localization in the wild. In CVPR, pages 2879--2886, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Vinereactor: Crowdsourced Spontaneous Facial Expression Data

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      ICMR '16: Proceedings of the 2016 ACM on International Conference on Multimedia Retrieval
      June 2016
      452 pages
      ISBN:9781450343596
      DOI:10.1145/2911996

      Copyright © 2016 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 6 June 2016

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • short-paper

      Acceptance Rates

      ICMR '16 Paper Acceptance Rate20of120submissions,17%Overall Acceptance Rate254of830submissions,31%

      Upcoming Conference

      ICMR '24
      International Conference on Multimedia Retrieval
      June 10 - 14, 2024
      Phuket , Thailand

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader