skip to main content
10.1145/2602299.2602314acmconferencesArticle/Chapter ViewAbstractPublication PagesimxConference Proceedingsconference-collections
research-article

Detection of predictability ratings of live events on TV by use of second screens

Published:25 June 2014Publication History

ABSTRACT

Event predictability, one dimension of human emotion description, indicates to what extent sequences of events in videos are predictable for viewers. This study adopts second screening style of Social TV viewing model, where viewers text about live events on TV via social media app on mobile second screen. 14 instances from different TV content types are presented to 19 viewers on TV-like screen. While texting, custom Twitter application collects touch and inertial sensors' data of which features are extracted to model viewers' physical interaction with mobile screens. Viewers self-reported their predictability ratings via a slider with 9 scales, which later are divided equally into three levels indicating whether viewers describe events in videos as unpredictable, medium or predictable. Bayesian networking classifier is created to recognize the three predictability labels from features described in physical interaction model. The study result shows that the predictability labels are recognized with 85.7% average accuracy.

References

  1. Brody, S. and Diakopoulos, N. Cooooooooooooooollllllllllllll!!!!!!!!!!!!!!: using word lengthening to detect sentiment in microblogs. In Proc. EMNLP '11, ACL(2011), 562--570. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Cesar, P., Bulterman, D.C. a., Jansen, J., Geerts, D., Knoche, H., and Seager, W. Fragment, tag, enrich, and send. ACM TOMCCAP, 5, 3 (2009), 1--27. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Cesar, P. and Geerts, D. Understanding Social TV: a survey. In Proc. NEM Summit 2011, (2011), 94--99.Google ScholarGoogle Scholar
  4. Chittaranjan, G., Blom, J., and Gatica-Perez, D. Who's Who with Big-Five: Analyzing and Classifying Personality Traits with Smartphones. In Proc. ISWC 2011, IEEE (2011), 29--36. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Coutrix, C. and Mandran, N. Identifying emotions expressed by mobile users through 2D surface and 3D motion gestures. In Proc. Ubicomp 2012, ACM Press(2012), 311--320. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Czikszentmihalyi, M. Flow: The Psychology of Optimal Experience. Harper and Row, 1990.Google ScholarGoogle Scholar
  7. Doughty, M., Rowland, D., and Lawson, S. Who is on your sofa?: TV audience communities and second screening social networks. In Proc. EuroITV 2012, ACM (2012), 79--86. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Dourish, P. A History of Interaction. In Where the Action Is: The Foundations of Embodied Interaction. The MIT Press, London, England, 2004, 1--23.Google ScholarGoogle Scholar
  9. Ekman, P. Basic emotions. Handbook of Cognition and Emotion. John Wiley & Sons, Ltd., Sussex, U.K, 2005.Google ScholarGoogle Scholar
  10. Epp, C., Lippold, M., and Mandryk, R.L. Identifying Emotional States using Keystroke Dynamics. In Proc. of CHI 2011, ACM Press (2011), 715--724. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Fontaine, J, Scherer, K.R., Roesch, E.B., and Ellsworth, P.C. The World of Emotions Is Not Two Dimensional. Psychological Science 18, 12 (2007), 1050--1057.Google ScholarGoogle ScholarCross RefCross Ref
  12. Gao, Y., Bianchi-Berthouze, N., and Meng, H. What does touch tell us about emotions in touchscreen-based gameplay? ACM TOCHI, 19, 4 (2012), 31. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Gunes, H., Shan, C., Chen, S., and Tian, Y. Bodily Expression For Automatic Affect Recognition, Advances in Emotion Recognition. Wiley-Blackwell, 2012, 1--31.Google ScholarGoogle Scholar
  14. Hall, M.A. Correlation-based Feature Selection for Machine Learning. 1999.Google ScholarGoogle Scholar
  15. Heo, S. and Lee, G. Forcetap: extending the input vocabulary of mobile touch screens by adding tap gestures. In Proc. Mobile HCI, ACM (2011), 113--122. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Hinckley, K. and Wigdor, D. Input technologies and techniques. The Human-Computer Interaction Handbook CRC Press, USA, 2012, 95--132.Google ScholarGoogle Scholar
  17. Kim, H. and Choi, Y.S. Exploring Emotional Preference for Smartphone. In Proc. IEEE CCNC 2012, IEEE (2012), 245--249.Google ScholarGoogle Scholar
  18. Lee, H., Choi, Y.S., Lee, S., and Park, I.P. Towards Unobtrusive Emotion Recognition for Affective Social Communication. In Proc. IEEE CCNC 2012, IEEE(2012), 276--280.Google ScholarGoogle ScholarCross RefCross Ref
  19. Likamwa, R., Liu, Y., Lane, N.D., and Zhong, L. MoodScope : Building a Mood Sensor from Smartphone Usage Patterns. In Proc. MobiSys'13, (2013). Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Marwick, a. E. and Boyd, D. I tweet honestly, I tweet passionately: Twitter users, context collapse, and the imagined audience. New Media & Society 13, 1 (2010), 114--133.Google ScholarGoogle Scholar
  21. McPherson, K., Huotari, K., Cheng, F.Y.-S., Humphrey, D., Cheshire, C., and Brooks, A.L. Glitter: a mixedmethods study of twitter use during glee broadcasts. In Proc. CSCW 2012, ACM (2012), 167--170. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Miluzzo, E., Varshavsky, A., Balakrishnan, S., and Choudhury, R.R. Tapprints: your finger taps have fingerprints. In Proc. MobiSys 2012, ACM (2012), 323--336. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Nicolau, H. and Jorge, J. Touch typing using thumbs: understanding the effect of mobility and hand posture. In Proc. CHI 2012, ACM(2012), 2683--2686. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Russell, J.A. Core Affect and the Psychological Construction of Emotion. Psychological Review 110, 1 (2003), 145--172.Google ScholarGoogle ScholarCross RefCross Ref
  25. Sahami Shirazi, A., Rohs, M., Schleicher, R., Kratz, S., Müller, A., and Schmidt, A. Real-time nonverbal opinion sharing through mobile phones during sports events. In Proc. CHI 2012, ACM Press (2011), 307--310. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Soleymani, M. and Lichtenauer, J. A multimodal database for affect recognition and implicit tagging. IEEE Transactions on Affective Computing 3, 1 (2012), 42--55. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Spangler, T. TV Viewers Aren't Thrilled with SecondScreen Synchronized Content, Study Finds. 2014. http://variety.com/2014/digital/news/tv-viewers-arentthrilled-with-second-screen-synchronized-content-studyfinds-1201040757/.Google ScholarGoogle Scholar
  28. Spangler, T. Yahoo Is Shutting Down TV App IntoNow - But the Second Screen Isn't Dead Yet. 2014. http://variety.com/2014/digital/news/yahoo-is-shuttingdown-tv-app-intonow-but-the-second-screen-isnt-deadyet-1201075160/.Google ScholarGoogle Scholar
  29. Wallbott, H.G. Bodily expression of emotion. European journal of social psychology 28, (1998), 879--896.Google ScholarGoogle Scholar
  30. Wohn, D.Y. and Na, E.-K. Tweeting about TV: Sharing television viewing experiences via social media message streams. First Monday 16, (2011), 1--13.Google ScholarGoogle ScholarCross RefCross Ref
  31. Yew, J., Arbor, A., Shamma, D.A., and Churchill, E.F. Knowing Funny: Genre Perception and Categorization in Social Video Sharing. In Proc. CHI 2011, ACM Press (2011), 297--306. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Zhao, S., Zhong, L., Wickramasuriya, J., and Vasudevan, V. Analyzing Twitter for Social TV: Sentiment Extraction for Sports. In Proc. EuroITV 2011, (2011), 1--8.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Detection of predictability ratings of live events on TV by use of second screens

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      TVX '14: Proceedings of the ACM International Conference on Interactive Experiences for TV and Online Video
      June 2014
      170 pages
      ISBN:9781450328388
      DOI:10.1145/2602299

      Copyright © 2014 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 25 June 2014

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article

      Acceptance Rates

      TVX '14 Paper Acceptance Rate20of80submissions,25%Overall Acceptance Rate69of245submissions,28%

      Upcoming Conference

      IMX '24
    • Article Metrics

      • Downloads (Last 12 months)2
      • Downloads (Last 6 weeks)0

      Other Metrics

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader