Radu-Daniel Vatavu
ABSTRACT
We explore interactions in the space surrounding the TV set, and use this space as a canvas to display additional TV content in the form of projected screens and customized controls and widgets. We present implementation details for a prototype that creates a hybrid, physical-projected, augmented TV space with off-the-shelf, low-cost technical equipment. The results of a participatory design study are reported to inform development of interaction techniques for multimedia content that spans the physical-projected TV space. We report a set of commands for twelve frequently-used TV tasks and compile guidelines for designing interactions for augmented TV spaces. With this work, we plan to make TV interface designers aware of the many opportunities offered by the space around the physical TV screen once turned interactive. It is our hope that this very first investigation of the interactive potential of the area surrounding the TV set will encourage new explorations of augmented TV spaces, and will foster the design of new applications and new entertainment experiences for our interactive, smart TV spaces of the future.
- Agarawala, A., Balakrishnan, R. 2006. Keepin' it real: pushing the desktop metaphor with physics, piles and the pen. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '06). ACM, New York, NY, USA, 1283--1292 Google Scholar
Digital Library
- Alfaro, S., Bove, V.M. 2011. Surround vision: a hand-held screen for accessing peripheral content around a main screen. In Proceedings of the 4th international conference on Interactive Digital Storytelling (ICIDS'11). Springer-Verlag, Berlin, Heidelberg, 342--345 Google ScholarDigital Library
- Bailly, G., Vo, D.B., Lecolinet, E., Guiard, Y. 2011. Gesture-aware remote controls: guidelines and interaction technique. In Proceedings of the 13th international conference on multimodal interfaces (ICMI '11). ACM, New York, NY, USA, 263--270 Google ScholarDigital Library
- Basapur, S., Mandalia, H., Chaysinh, S., Lee, Y., Venkitaraman, N., Metcalf, C. 2012. FANFEEDS: evaluation of socially generated information feed on second screen as a TV show companion. In Proceedings of the 10th European conference on Interactive TV and video (EuroiTV '12). ACM, New York, NY, USA, 87--96 Google ScholarDigital Library
- Baudisch, P., Chu, G. 2009. Back-of-device interaction allows creating very small touch devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09). ACM, New York, NY, USA, 1923--1932 Google ScholarDigital Library
- Benko, H., Saponas, T.S., Morris, D., Tan, D. 2009. Enhancing input on and above the interactive surface with muscle sensing. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS '09). ACM, New York, NY, USA, 93--100 Google ScholarDigital Library
- Bernhaupt, R., Obrist, M., Weiss, A., Beck, E., Tscheligi, M. 2008. Trends in the living room and beyond: results from ethnographic studies using creative and playful probing. Comput. Entertain. 6, 1, Article 5 (May 2008), 23 pages. Google ScholarDigital Library
- Bobeth, J., Schmehl, S., Kruijff, E., Deutsch, S., Tscheligi, M. 2012. Evaluating performance and acceptance of older adults using freehand gestures for TV menu control. In Proceedings of the 10th European conference on Interactive TV and video (EuroiTV '12). ACM, New York, USA, 35--44 Google ScholarDigital Library
- Bolt, R.A. 1980. "Put-that-there": Voice and gesture at the graphics interface. In Proceedings of the 7th annual conference on Computer graphics and interactive techniques (SIGGRAPH '80). ACM, New York, NY, USA, 262--270 Google ScholarDigital Library
- Butler, A., Izadi, S., Hodges, S. 2008. SideSight: multi-"touch" interaction around small devices. In Proceedings of the 21st annual ACM symposium on User interface software and technology (UIST '08). ACM, New York, USA, 201--204 Google ScholarDigital Library
- Canizares, A.G. 2006. Fun Rooms: Home Theaters, Music Studios, Game Rooms, and More. Harper DesignGoogle Scholar
- Cao, X., Forlines, C., Balakrishnan, R. 2007. Multi-user interaction using handheld projectors. In Proceedings of the 20th annual ACM symposium on User interface software and technology (UIST '07). ACM, New York, NY, USA, 43--52 Google ScholarDigital Library
- Cesar, P., Chorianopoulos, K. 2009. The Evolution of TV Systems, Content, and Users Toward Interactivity. Foundations and Trends in Human.-Computer Interaction 2 (4), 373--95 Google ScholarDigital Library
- Cesar, P, Bulterman, D.C., Jansen, A.J. 2008. Usages of the Secondary Screen in an Interactive Television Environment: Control, Enrich, Share, and Transfer Television Content. In Proceedings of the 6th European conference on Changing Television Environments (EuroITV '08). Springer-Verlag, Berlin, Heidelberg, 168--177 Google ScholarDigital Library
- Courtois, C., D'heer, E. 2012. Second screen applications and tablet users: constellation, awareness, experience, and interest. In Proceedings of the 10th European conference on Interactive TV and video (EuroITV '12). ACM, New York, NY, USA, 153--156 Google ScholarDigital Library
- Cotting, D., Gross, M. 2006. Interactive environment-aware display bubbles. In Proceedings of the 19th annual ACM symposium on User interface software and technology (UIST '06). ACM, New York, NY, USA, 245--254. Google ScholarDigital Library
- Cruickshank, L., Tsekleves, E., Whitham, R., Hill, A. 2007. Making interactive TV easier to use: interface design for a second screen approach. The Design Journal, 10 (3)Google Scholar
- Freeman, W.T., Weissman, C.D. 1995. Television Control by Hand Gestures. In: Proceedings of the IEEE Int. Workshop on Automatic Face and Gesture Recognition, ZurichGoogle Scholar
- Harboe, G., Metcalf, C.J., Bentley, F., Tullio, J., Massey, N., Romano, G. 2008. Ambient social tv: drawing people into a shared experience. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '08). ACM, New York, NY, USA, 1--10. Google ScholarDigital Library
- Harrison, C., Ramamurthy, S., Hudson, S.E. 2012. On-body interaction: armed and dangerous. In Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction (TEI '12). ACM, NY, USA, 69--76 Google ScholarDigital Library
- Harrison, C., Benko, H., Wilson, A.D. 2011. OmniTouch: wearable multitouch interaction everywhere. In Proceedings of the 24th annual ACM symposium on User interface software and technology (UIST '11). ACM, New York, NY, USA, 441--450 Google ScholarDigital Library
- Hilliges, O., Izadi, S., Wilson, A.D., Hodges, S., Garcia-Mendoza, A., Butz, A. 2009. Interactions in the air: adding further depth to interactive tabletops. In Proceedings of the 22nd annual ACM symposium on User interface software and technology (UIST '09). ACM, New York, USA, 139--148 Google ScholarDigital Library
- Hoffman, M., Varcholik, P., LaViola, J.J. Jr. 2010. Breaking the status quo: Improving 3D gesture recognition with spatially convenient input devices. In Proceedings of the 2010 IEEE Virtual Reality Conference (VR '10). IEEE Computer Society, Washington, DC, USA, 59--66 Google ScholarDigital Library
- Ibrahim, A., Johansson, P. 2002. Multimodal dialogue systems for interactive TV applications. In Proceedings of the 4th IEEE International Conference on Multimodal Interfaces (ICMI'02), Pittsburgh, USA, 117--122 Google ScholarDigital Library
- Jensen, J.F. 2005. Interactive television: new genres, new format, new content. In Proceedings of the second Australasian conference on Interactive Entertainment (IE '05). Creativity & Cognition Studios Press, Sydney, 89--96 Google ScholarDigital Library
- Jones, B., Benko, H., Ofek, E., Wilson, A.D. 2013. IllumiRoom: Peripheral Projected Illusions for Interactive Experiences. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'13) Google ScholarDigital Library
- Kane, S.K., Avrahami, D., Wobbrock, J.O., Harrison, B., Rea, A.D., Philipose, M., LaMarca, A. 2009. Bonfire: a nomadic system for hybrid laptop-tabletop interaction. In Proceedings of the 22nd annual ACM symposium on User interface software and technology (UIST '09). ACM, New York, NY, USA, 129--138 Google ScholarDigital Library
- Kühnel, C., Westermann, T., Hemmert, F., Kratz, S., Müller, A., Möller, S. 2011. I'm home: Defining and evaluating a gesture set for smart-home control. International Journal of Human-Computer Studies, 69 (11), 693--704Google ScholarCross Ref
- Lee, J.C. 2008. Hacking the Nintendo Wii Remote. IEEE Pervasive Computing 7(3), July 2008, 39--45 Google ScholarDigital Library
- Malizia, A., Bellucci, A. 2012. The artificiality of natural user interfaces. Communications of the ACM, 55(3), 36--38 Google ScholarDigital Library
- MacKenzie, R., Hawkey, K., Booth, K.S., Liu, Z., Perswain, P., Dhillon, S.S. 2012. LACOME: a multi-user collaboration system for shared large displays. In Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work Companion (CSCW '12). ACM, New York, USA, 267--268 Google ScholarDigital Library
- Marquardt, N., Jota, R., Greenberg, S., Jorge, J.A. 2011. The continuous interaction space: interaction techniques unifying touch and gesture on and above a digital surface. In Proc. of the 13th IFIP TC 13 international conference on Human-computer interaction (INTERACT'11). Springer, 461--476 Google ScholarDigital Library
- Mistry, P., Maes, P., Chang, L. 2009. WUW - Wear Ur World: a wearable gestural interface. In CHI '09 Extended Abstracts on Human Factors in Computing Systems (CHI EA '09). ACM, New York, NY, USA, 4111--4116 Google ScholarDigital Library
- Natapov, D., Castellucci, S.J., MacKenzie, I.S. 2009. ISO 9241-9 evaluation of video game controllers. In Proceedings of Graphics Interface (GI '09). Canadian Information Processing Society, Toronto, Ont., Canada, Canada, 223--230 Google ScholarDigital Library
- Nielsen Group. 2012. The digital revolution: A look through the marketer's lens (April 2012) http://na.ad-tech.com/sf/wp-content/uploads/DigitalConsumer.pdfGoogle Scholar
- Norman, D.A. 2010. Natural user interfaces are not natural. Interactions 17(3), May 2010, 6--10 Google ScholarDigital Library
- Park, K.L., Park, J.K., Kim, S.D. 2008. An Effective Model and Management Scheme of Personal Space for Ubiquitous Computing Applications. IEEE Transactions on Systems, Man, and Cybernetics. Part A: Systems and Humans, 38(6), November 2008, 1295--1311 Google ScholarDigital Library
- Qin, Q., Rohs, M., Kratz, S. 2011. Dynamic ambient lighting for mobile devices. In Proceedings of the 24th annual ACM symposium adjunct on User interface software and technology (UIST '11 Adjunct). ACM, NY, USA, 51--52 Google ScholarDigital Library
- Rushing, K. 2006. Home Theater Design: Planning and Decorating. Media-Savvy Interiors. Quarry BooksGoogle Scholar
- Schlömer, T., Poppinga, B., Henze, N., Boll, S. 2008. Gesture recognition with a Wii controller. In Proceedings of the 2nd international conference on Tangible and embedded interaction (TEI '08). ACM, New York, NY, USA, 11--14. Google ScholarDigital Library
- Thomas, B.H. 2012. A survey of visual, mixed, and augmented reality gaming. Computers in Entertainment 10 (3), December 2012, 33 pages Google ScholarDigital Library
- Vatavu, R.D. 2010. Creativity in Interactive TV: Personalize, Share, and Invent Interfaces. In A. Marcus, A. Cereijo Roibas, R. Sala (Eds.), Mobile TV: Customizing Content and Experience, Springer Human-Computer Interaction Series, Springer London, pp. 121--139Google Scholar
- Vatavu, R.D. 2012. Point & Click Mediated Interactions for Large Home Entertainment Displays. Multimedia Tools and Applications. 59 (1). Springer Netherlands, 113--128 Google ScholarDigital Library
- Vatavu, R.D. 2012. User-defined gestures for free-hand TV control. In Proceedings of the 10th European conference on Interactive TV and video (EuroITV '12). ACM, New York, NY, USA, 45--48 Google ScholarDigital Library
- Vermeulen, J., Slenders, J., Luyten, K., Coninx, K. 2009. I Bet You Look Good on the Wall: Making the Invisible Computer Visible. In Proc. of the 3rd European Conference on Ambient Intelligence (AmI'09). Springer, 196--205 Google ScholarDigital Library
- Wigdor, D., Leigh, D., Forlines, C., Shipman, S., Barnwell, J., Balakrishnan, R., Shen, C. 2006. Under the table interaction. In Proceedings of the 19th annual ACM symposium on User interface software and technology (UIST '06). ACM, New York, NY, USA, 259--268 Google ScholarDigital Library
- Wilson, A.D. 2005. PlayAnywhere: a compact interactive tabletop projection-vision system. In Proceedings of the 18th annual ACM symposium on User interface software and technology (UIST '05). ACM, New York, NY, USA, 83--92 Google ScholarDigital Library
- Wilson, A.D., Izadi, S., Hilliges, O., Garcia-Mendoza, A., Kirk, D. 2008. Bringing physics to the surface. In Proceedings of the 21st annual ACM symposium on User interface software and technology (UIST '08). ACM, New York, NY, USA, 67--76 Google ScholarDigital Library
- Wilson, A.D., Benko, H. 2010. Combining multiple depth cameras and projectors for interactions on, above and between surfaces. In Proceedings of the 23nd annual ACM symposium on User interface software and technology (UIST '10). ACM, New York, NY, USA, 273--282 Google ScholarDigital Library
- Wilson, A., Benko, H., Izadi, S., Hilliges, O. 2012. Steerable augmented reality with the beamatron. In Proceedings of the 25th annual ACM symposium on User interface software and technology (UIST '12). ACM, New York, USA, 413--422 Google ScholarDigital Library
- Wobbrock, J.O., Morris, M.R., Wilson, A.D. 2009. User-defined gestures for surface computing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09). ACM, New York, NY, USA, 1083--1092. Google ScholarDigital Library
- You, W., Fels, S., Lea, R. 2008. Studying vision-based multiple-user interaction with in-home large displays. In Proceedings of the 3rd ACM international workshop on Human-centered computing (HCC '08). ACM, New York, NY, USA, 19--26 Google ScholarDigital Library
- Ziola, R., Kellar, M., Inkpen, K. 2007. DeskJockey: exploiting passive surfaces to display peripheral information. In Proceedings of the 11th IFIP TC 13 international conference on Human-computer interaction (INTERACT'07). Springer Berlin, Heidelberg, 447--460 Google ScholarDigital Library
Index Terms
- There's a world outside your TV: exploring interactions beyond the physical TV screen
Recommendations
ShapeShifting TV: interactive screen media narratives
This paper presents a paradigm, called ShapeShifting TV, for the realisation of interactive TV narratives or, more generally, of interactive screen-media narratives. These are productions whose narrations respond on the fly (i.e. in real time) to ...
Designing gestural interfaces for the interactive TV
EuroITV '13: Proceedings of the 11th European Conference on Interactive TV and VideoHome entertainment and interactive TV have known fundamental technological advances in the last years by incorporating developments from sensing, processing, and communications technologies. As such systems become more complex and present more options ...
A Model for Interactive TV Storytelling
SBGAMES '09: Proceedings of the 2009 VIII Brazilian Symposium on Games and Digital EntertainmentInteractive storytelling systems are applications to generate and dramatize interactive stories. The main challenge to such systems is the generation of coherent stories while users are watching and interfering with what is happening. In an interactive ...
Comments