skip to main content
10.1145/2745197.2745207acmconferencesArticle/Chapter ViewAbstractPublication PagesimxConference Proceedingsconference-collections
research-article

Audience Silhouettes: Peripheral Awareness of Synchronous Audience Kinesics for Social Television

Published:03 June 2015Publication History

ABSTRACT

We introduce audience silhouettes for TV, which are visual representations of viewers' body movements displayed in real-time on top of television content. With their minimal visual cues and their ability to convey presence and to leverage interactions via non-verbal kinesics, audience silhouettes are strong candidates for implementing Oehlberg et al.'s theater metaphor of an unobtrusive social TV system [37]. In a user study, we found our participants connecting well to the on-screen silhouettes, while their television watching experience was perceived more enjoyable. We also report viewers' body movement behavior in the presence of on-screen silhouettes, which we characterize numerically with new measures (e.g., average body movement) and we report experimental findings; e.g., we found that the number of silhouettes influences viewers' body movements and the body postures they adopt and that women produce more body movement than men.

References

  1. Analysis Manson Limited. The Connected Consumer Survey 2013: TV and video http://www.analysysmason.com/Research/Content/ Reports/Connected-Consumer-TV-May2013-RDMB0/ samples-TOC/ (last accessed march 2015).Google ScholarGoogle Scholar
  2. Bangor, A., Kortum, P., and Miller, J. Determining what individual SUS scores mean: Adding an adjective rating scale. Journal of Usability Studies 4, 3 (2009), 114--123.Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Bangor, A., Kortum, P. T., and Miller, J. T. An empirical evaluation of the system usability scale. Int. Journal of Human-Computer Interaction 24, 6 (2008), 574--594.Google ScholarGoogle ScholarCross RefCross Ref
  4. Basapur, S., Mandalia, H., Chaysinh, S., Lee, Y., Venkitaraman, N., and Metcalf, C. FANFEEDS: Evaluation of socially generated information feed on second screen as a TV show companion. In Proc. of EuroITV '12, ACM (New York, NY, USA, 2012), 87--96. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Benedek, J., and Miner, T. Measuring desirability: New methods for evaluating desirability in a usability lab setting. In Proc. of the Usability Professionals Assoc. Conf., 2002 http://www.microsoft.com/usability/ uepostings/desirabilitytoolkit.doc.Google ScholarGoogle Scholar
  6. Bianchi-Berthouze, N. Understanding the role of body movement in player engagement. Human Computer Interaction 28, 1 (2013), 40--75.Google ScholarGoogle ScholarCross RefCross Ref
  7. Birdwhistell, R. Introduction to kinesics: An annotation system for analysis of body motion and gesture. Washington, DC: Foreign Service Institute, 1952.Google ScholarGoogle Scholar
  8. Bobick, A. F., and Davis, J. W. The recognition of human movement using temporal templates. IEEE TPAMI 23, 3 (Mar. 2001), 257--267. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Brooke, J. SUS: A quick and dirty usability scale. In Usability evaluation in industry. Taylor & Francis, 1996.Google ScholarGoogle Scholar
  10. Cesar, P., Bulterman, D. C., and Jansen, A. J. Usages of the secondary screen in an interactive television environment: Control, enrich, share, and transfer television content. In Proc. EuroITV'08 (2008), 168--177. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Cesar, P., Chorianopoulos, K., and Jensen, J. F. Social television and user interaction. Computers in Entertainment 6, 1 (May 2008), 4:1--4:10. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Chartrand, T., and Bargh, J. The chameleon effect: The perception-behavior link and social interaction. J. of Personality and Social Psychology 76, 6 (1999), 893--910.Google ScholarGoogle ScholarCross RefCross Ref
  13. Chorianopoulos, K. Content-enriched communication supporting the social uses of TV. The Journal of The Communications Network 6, 1 (2007), 23--30.Google ScholarGoogle Scholar
  14. Coppens, T., Trappeniers, L., and Godon, M. AmigoTV: towards a social TV experience. In EuroITV '04 (2004).Google ScholarGoogle Scholar
  15. Courtois, C., and D'heer, E. Second screen applications and tablet users: Constellation, awareness, experience, and interest. In Proc. of EuroITV '12 (2012), 153--156. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Dezfuli, N., Khalilbeigi, M., Huber, J., Müller, F., and Mühlhäuser, M. PalmRC: Imaginary palm-based remote control for eyes-free television interaction. In Proc. of EuroITV '12, ACM (New York, NY, USA, 2012), 27--34. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Doughty, M., Rowland, D., and Lawson, S. Who is on your sofa?: TV audience communities and second screening social networks. In EuroITV '12 (2012), 79--86. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Feyereisen, P., and de Lannoy, J. Gestures and Speech: Psychological Investigations. Cambridge University Press, New York, 1991.Google ScholarGoogle Scholar
  19. Geerts, D. Comparing voice chat and text chat in a communication tool for interactive television. In Proc. of NordiCHI '06, ACM (New York, USA, 2006), 461--464. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Geerts, D., Cesar, P., and Bulterman, D. The implications of program genres for the design of social television systems. In Proc. of UXTV '08 (2008), 71--80. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Geerts, D., and De Grooff, D. Supporting the social uses of television: Sociability heuristics for social TV. In Proc. of CHI '09, ACM (New York, NY, USA, 2009), 595--604. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Geerts, D., Vaishnavi, I., Mekuria, R., van Deventer, O., and Cesar, P. Are we in sync?: Synchronization requirements for watching online video together. In Proc. of CHI '11, ACM (New York, NY, USA, 2011), 311--314. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Graham, J. A., and Argyle, M. A cross-cultural study of the communication of extra-verbal meaning by gestures. Int. Journal of Psychology 10 (1975), 57--67.Google ScholarGoogle ScholarCross RefCross Ref
  24. Hall, J. A. Nonverbal Sex Differences: Communication Accuracy and Expressive Style Paperback. Johns Hopkins University Press, 1990.Google ScholarGoogle Scholar
  25. Harboe, G., Massey, N., Metcalf, C., Wheatley, D., and Romano, G. The uses of social television. Computers in Entertainment 6, 1 (May 2008), 8:1--8:15. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Harboe, G., Metcalf, C. J., Bentley, F., Tullio, J., Massey, N., and Romano, G. Ambient social TV: Drawing people into a shared experience. In CHI '08 (2008), 1--10. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Hawkins, R. P., Pingree, S., Hitchon, J., Radler, B., Gorham, B. W., Kahlor, L., Gilligan, E., Serlin, R. C., Schmidt, T., Kannaovakun, P., and Kolbeins, G. H. What produces television attention and attention style? Human Communication Research 31, 1 (2005), 162--187.Google ScholarGoogle Scholar
  28. Huang, E. M., Harboe, G., Tullio, J., Novak, A., Massey, N., Metcalf, C. J., and Romano, G. Of social television comes home: A field study of communication choices and practices in TV-based text and voice chat. In Proc. of CHI '09, ACM (New York, NY, USA, 2009), 585--594. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Jones, B., Sodhi, R., Murdock, M., Mehra, R., Benko, H., Wilson, A., Ofek, E., MacIntyre, B., Raghuvanshi, N., and Shapira, L. Roomalive: Magical experiences enabled by scalable, adaptive projector-camera units. In Proc. of UIST '14, ACM (New York, NY, USA, 2014), 637--644. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Jones, B. R., Benko, H., Ofek, E., and Wilson, A. D. Illumiroom: Peripheral projected illusions for interactive experiences. In Proc. of CHI '13 (2013), 869--878. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Kelley, J. F. An iterative design methodology for user-friendly natural language office information applications. ACM Trans. on Inf. Sys. 2, 1 (1984), 26--41. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Kendon, A. Do gestures communicate? A review. Research on Language and Social Interaction 27 (1994), 175--200.Google ScholarGoogle ScholarCross RefCross Ref
  33. Kleinsmith, A., and Bianchi-Berthouze, N. Affective body expression perception and recognition: A survey. IEEE Trans. Affect. Comput. 4, 1 (Jan. 2013), 15--33. Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. McNeill, D. Hand and Mind: What Gesture Reveals about Thought. University Chicago Press, 1992.Google ScholarGoogle Scholar
  35. Morris, M. R. Web on the wall: Insights from a multimodal interaction elicitation study. In Proc. of ITS '12, ACM (New York, NY, USA, 2012), 95--104. Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Nathan, M., Harrison, C., Yarosh, S., Terveen, L., Stead, L., and Amento, B. CollaboraTV: Making television viewing social again. In Proc. UXTV '08 (2008), 85--94. Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. Oehlberg, L., Ducheneaut, N., Thornton, J. D., Moore, R. J., and Nickell, E. Social TV: Designing for distributed, sociable television viewing. In Proc. of EuroITV '06 (2006), 251--259.Google ScholarGoogle Scholar
  38. Ren, G., and O'Neill, E. Freehand gestural text entry for interactive TV. In Proc. of EuroITV '13 (2013), 121--130. Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Schirra, S., Sun, H., and Bentley, F. Together alone: Motivations for live-tweeting a television series. In Proc. of CHI '14, ACM (New York, USA, 2014), 2441--2450. Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Shamma, D. A., Bastea-Forte, M., Joubert, N., and Liu, Y. Enhancing online personal connections through the synchronized sharing of online video. In Proc. of CHI EA '08, ACM (New York, NY, USA, 2008), 2931--2936. Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. Vatavu, R.-D. Nomadic gestures: A technique for reusing gesture commands for frequent ambient interactions. J. Ambient Intell. Smart Environ. 4, 2 (Apr. 2012), 79--93. Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. Vatavu, R.-D. User-defined gestures for free-hand TV control. In Proc. of EuroiTV '12 (2012), 45--48. Google ScholarGoogle ScholarDigital LibraryDigital Library
  43. Vatavu, R.-D. A comparative study of user-defined handheld vs. freehand gestures for home entertainment environments. Journal of Ambient Intelligence and Smart Environments 5, 2 (2013), 187--211. Google ScholarGoogle ScholarDigital LibraryDigital Library
  44. Vatavu, R.-D. There's a world outside your TV: Exploring interactions beyond the physical TV screen. In EuroITV '13, ACM (New York, NY, USA, 2013), 143--152. Google ScholarGoogle ScholarDigital LibraryDigital Library
  45. Vatavu, R.-D., and Mancas, M. Visual attention measures for multi-screen tv. In Proc. of TVX '14, ACM (New York, NY, USA, 2014), 111--118. Google ScholarGoogle ScholarDigital LibraryDigital Library
  46. Vatavu, R.-D., and Zaiti, I.-A. Leap gestures for TV: Insights from an elicitation study. In Proc. of TVX '14, ACM (New York, NY, USA, 2014), 131--138. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Audience Silhouettes: Peripheral Awareness of Synchronous Audience Kinesics for Social Television

          Recommendations

          Comments

          Login options

          Check if you have access through your login credentials or your institution to get full access on this article.

          Sign in

          PDF Format

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader