skip to main content
research-article
Free access

IllumiRoom: immersive experiences beyond the TV screen

Published: 21 May 2015 Publication History

Abstract

IllumiRoom is a proof-of-concept system that surrounds a television with projected light, bringing video games, and film experiences out of the TV screen and into the real world. IllumiRoom uses 3D scanning and projected light to change the appearance of the room, induce apparent motion, extend the field of view, and enable entirely new gaming experiences. Our system is entirely self-calibrating and is designed to work in any room. We present a detailed exploration of the design space of possible projected visualizations and we demonstrate ways to trigger and drive these visualizations from gaming content. We also contribute specific feedback from two groups of target users (10 gamers and 15 game designers); providing insights for enhancing game and film experiences beyond the TV.

References

[1]
Aides, A., Avraham, T., Schechner, Y. Multiscale ultrawide foveated video extrapolation. In IEEE ICCP, 2011.
[2]
Batlle, J., Mouaddib, E., Salvi, J. Recent progress in coded structured light as a technique to solve the correspondence problem: A survey. Pattern Recognition 31, 7 (1998), 963--982.
[3]
Baudisch, P., Good, N., Stewart, P. Focus plus context screens: Combining display technology with visualization techniques. In ACM UIST, 2001.
[4]
Benko, H., Jota, R., Wilson, A.D. MirageTable: Freehand interaction on a projected augmented reality tabletop. In ACM CHI, 2012.
[5]
Bimber, O., Emmerling, A., Klemmer, T. Embedded entertainment with smart projectors. IEEE Computer 38, 1 (Jan. 2005), 16--26.
[6]
Bimber, O., Iwai, D. Superimposing dynamic range. ACM Trans. Graphic 27, 5 (Dec. 2008), 1.
[7]
Bimber, O., Raskar, R. Spatial Augmented Reality: Merging Real and Virtual Worlds. AK Peters, 2005.
[8]
Cruz-Neira, C., Sandin, D., DeFanti, T. Surround-screen projection-based virtual reality: The design and implementation of the CAVE. In ACM SIGGRAPH, 1993.
[9]
Ghosh, A., Trentacoste, M., Seetzen, H., Heidrich, W. Real illumination from virtual environments. In Eurographics Symposium on Rendering, 2005.
[10]
Gibson, J. The Perception of the Visual World. 1950.
[11]
Jones, B., Sodhi, R., Campbell, R., Garnett, G., Bailey, B., Build your world and play in it: Interacting with surface particles on complex objects. In IEEE ISMAR, 2010.
[12]
Jones, B., Sodhi, R., Karsch, K., Casperson, M. Projection mapping central, 2014. http://projection-mapping.org.
[13]
Milgram, P., Takemura, H., Utsumi, A., Kishino, F. Augmented reality: A class of displays on the reality-virtuality continuum. Proc. SPIE 2351, Telemanipulator Telepresence Technol. 282, (1995).
[14]
Mills, P., Sheikh, A., Thomas, G., Debenham, P. Surround video. In Networked and Electronic Media Summit, 2011.
[15]
Novy, D.E., Bove, V.M. Infinity-by-nine, 2013. http://obm.media.mit.edu.
[16]
Pinhanez, C. The everywhere displays projector: A device to create ubiquitous graphical interfaces. In ACM UbiComp, 2001.
[17]
Quirk, P., Johnson, T., Skarbez, R., Towles, H., Gyarfas, F., Fuchs, H. RANSAC-assisted display model reconstruction for projective display. In IEEE VR, 2006.
[18]
Raskar, R., Welch, G., Cutts, M., Lake, A., Stesin, L., Fuchs, H. The office of the future: A unified approach to image-based modeling and spatially immersive displays. In ACM SIGGRAPH, 1998.
[19]
Raskar, R., Welch, G., Low, K.K., Bandyopadhyay, D. Shader lamps: Animating real objects with image-based illumination. In Eurographics Workshop on Rendering Techniques, 2001.
[20]
Raskar, R., Ziegler, R., Willwacher, T. Cartoon dioramas in motion. In ACM NPAR, 2002.
[21]
Sekular, R., Blake, R. Perception, 2nd edn. 1990.
[22]
Tan, D.S., Gergle, D., Scupelli, P., Pausch, R. With similar visual angles, larger displays improve spatial performance. In ACM CHI, 2003.
[23]
Weffers-Albu, A., de Waele, S., Hoogenstraaten, W., Kwisthout, C. Immersive TV viewing with advanced Ambilight. In IEEE ICCE, Jan. 2011.
[24]
Wilson, A.D., Benko, H., Izadi, S., Hilliges, O. Steerable augmented reality with the Beamatron. In ACM UIST, 2012.

Cited By

View all
  • (2023)Projection Mapping in the City: Co-creating Public Digital Installations for Climate Awareness with Animation and Interaction Design UndergraduatesProceedings of the 5th Annual Symposium on HCI Education10.1145/3587399.3587408(91-95)Online publication date: 28-Apr-2023
  • (2023)Projectoroid:A Mobile Robot-Based SAR Display ApproachAdjunct Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586182.3615793(1-3)Online publication date: 29-Oct-2023
  • (2023)Ability-Centered Examination of People with Motor Impairments’ Interaction with Television Towards More Accessible Smart Home Entertainment EnvironmentsAmbient Intelligence—Software and Applications—13th International Symposium on Ambient Intelligence10.1007/978-3-031-22356-3_4(32-43)Online publication date: 1-Jan-2023
  • Show More Cited By

Index Terms

  1. IllumiRoom: immersive experiences beyond the TV screen

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image Communications of the ACM
    Communications of the ACM  Volume 58, Issue 6
    June 2015
    94 pages
    ISSN:0001-0782
    EISSN:1557-7317
    DOI:10.1145/2783419
    • Editor:
    • Moshe Y. Vardi
    Issue’s Table of Contents
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 21 May 2015
    Published in CACM Volume 58, Issue 6

    Permissions

    Request permissions for this article.

    Check for updates

    Qualifiers

    • Research-article
    • Research
    • Refereed

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)480
    • Downloads (Last 6 weeks)100
    Reflects downloads up to 20 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2023)Projection Mapping in the City: Co-creating Public Digital Installations for Climate Awareness with Animation and Interaction Design UndergraduatesProceedings of the 5th Annual Symposium on HCI Education10.1145/3587399.3587408(91-95)Online publication date: 28-Apr-2023
    • (2023)Projectoroid:A Mobile Robot-Based SAR Display ApproachAdjunct Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586182.3615793(1-3)Online publication date: 29-Oct-2023
    • (2023)Ability-Centered Examination of People with Motor Impairments’ Interaction with Television Towards More Accessible Smart Home Entertainment EnvironmentsAmbient Intelligence—Software and Applications—13th International Symposium on Ambient Intelligence10.1007/978-3-031-22356-3_4(32-43)Online publication date: 1-Jan-2023
    • (2020)Semantic Priming of Colored Signs in the Peripheral Vision during Electronic Text ReadingMultimodal Technologies and Interaction10.3390/mti40200284:2(28)Online publication date: 8-Jun-2020
    • (2020)Recent Multimodal Communication Methodologies in Phonology, Vision, and TouchHuman-Computer Interaction. Multimodal and Natural Interaction10.1007/978-3-030-49062-1_27(392-400)Online publication date: 19-Jul-2020
    • (2019)Viewers’ Visions of the FutureProceedings of the 2019 ACM International Conference on Interactive Experiences for TV and Online Video10.1145/3317697.3323356(59-69)Online publication date: 4-Jun-2019
    • (2018)DeLightPersonal and Ubiquitous Computing10.5555/3268755.326877122:4(787-805)Online publication date: 1-Aug-2018
    • (2018)Depth Perception and Manipulation in Projection-Based Spatial Augmented RealityPRESENCE: Virtual and Augmented Reality10.1162/pres_a_0032927:2(242-256)Online publication date: 1-Feb-2018
    • (2018)DeLight: biofeedback through ambient light for stress intervention and relaxation assistancePersonal and Ubiquitous Computing10.1007/s00779-018-1141-622:4(787-805)Online publication date: 23-May-2018
    • (2017)Moving towards consistent depth perception in stereoscopic projection-based augmented realityProceedings of the 27th International Conference on Artificial Reality and Telexistence and 22nd Eurographics Symposium on Virtual Environments10.5555/3298830.3298860(161-168)Online publication date: 22-Nov-2017
    • Show More Cited By

    View Options

    View options

    PDF

    View or Download as a PDF file.

    PDFChinese translation

    eReader

    View online with eReader.

    eReader

    Digital Edition

    View this article in digital edition.

    Digital Edition

    Magazine Site

    View this article on the magazine site (external)

    Magazine Site

    Login options

    Full Access

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media