Florian Echtler
Vitus Maierhöfer
Nicolai Brodersen Hansen
Raphael Wimmer
ABSTRACT
Real-time online interaction is the norm today. Tabletops and other dedicated interactive surface devices with direct input and tangible interaction can enhance remote collaboration, and open up new interaction scenarios based on mixed physical/virtual components. However, they are only available to a small subset of users, as they usually require identical bespoke hardware for every participant, are complex to setup, and need custom scenario-specific applications. We present SurfaceCast, a software toolkit designed to merge multiple distributed, heterogeneous end-user devices into a single, shared mixed-reality surface. Supported devices include regular desktop and laptop computers, tablets, and mixed-reality headsets, as well as projector-camera setups and dedicated interactive tabletop systems. This device-agnostic approach provides a fundamental building block for exploration of a far wider range of usage scenarios than previously feasible, including future clients using our provided API.
In this paper, we present various example application scenarios which we enhance through the multi-user and multi-device features of the framework. Our results show that the hardware- and content-agnostic architecture of SurfaceCast can run on a wide variety of devices with sufficient performance and fidelity for real-time interaction.
- Pollie Barden, Rob Comber, David Green, Daniel Jackson, Cassim Ladha, Tom Bartindale, Nick Bryan-Kinns, Tony Stockman, and Patrick Olivier. 2012. Telematic Dinner Party: Designing for Togetherness through Play and Performance. In Proceedings of the Designing Interactive Systems Conference (New York, NY, USA) (DIS ’12). ACM, 38–47. https://doi.org/10.1145/2317956.2317964Google Scholar
Digital Library
- Florian Echtler. 2018. SurfaceStreams: A Content-Agnostic Streaming Toolkit for Interactive Surfaces. In The 31st Annual ACM Symposium on User Interface Software and Technology Adjunct Proceedings (New York, NY, USA) (UIST ’18 Adjunct). ACM, 10–12. https://doi.org/10.1145/3266037.3266085Google ScholarDigital Library
- Florian Echtler and Martin Kaltenbrunner. 2016. SUR40 Linux: Reanimating an Obsolete Tangible Interaction Platform. In Proceedings of the 2016 ACM on Interactive Surfaces and Spaces (New York, NY, USA) (ISS ’16). ACM, 343–348. https://doi.org/10.1145/2992154.2996778Google ScholarDigital Library
- Florian Echtler and Raphael Wimmer. 2014. The Interactive Dining Table, or Pass the Weather Widget, Please. In Proceedings of the Ninth ACM International Conference on Interactive Tabletops and Surfaces (New York, NY, USA) (ITS ’14). ACM, 419–422. https://doi.org/10.1145/2669485.2669525Google ScholarDigital Library
- Keita Higuchi, Yinpeng Chen, Philip A. Chou, Zhengyou Zhang, and Zicheng Liu. 2015. ImmerseBoard: Immersive Telepresence Experience Using a Digital Whiteboard. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems(CHI ’15). ACM, New York, NY, USA, 2383–2392. https://doi.org/10.1145/2702123.2702160Google ScholarDigital Library
- Sasa Junuzovic, Kori Inkpen, Tom Blank, and Anoop Gupta. 2012. IllumiShare: Sharing Any Surface. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’12). ACM, New York, NY, USA, 1919–1928. https://doi.org/10.1145/2207676.2208333Google ScholarDigital Library
- Martin Kaltenbrunner and Florian Echtler. 2018. The TUIO 2.0 Protocol: An Abstraction Framework for Tangible Interactive Surfaces. Proceedings of the ACM on Human-Computer Interaction 2, EICS, Article 8 (June 2018), 35 pages. https://doi.org/10.1145/3229090Google ScholarDigital Library
- Chelsea Mills, Denise Y. Geiskkovitch, Carman Neustaedter, William Odom, and Benett Axtell. 2023. Remote Wavelength: Design and Evaluation of a System for Social Connectedness Through Distributed Tabletop Gameplay. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI ’23). Association for Computing Machinery, New York, NY, USA, Article 680, 19 pages. https://doi.org/10.1145/3544548.3581142Google ScholarDigital Library
- Jasmin Odenwald, Sven Bertel, and Florian Echtler. 2020. Tabletop Teleporter: Evaluating the Immersiveness of Remote Board Gaming. In Proceedings of the 9TH ACM International Symposium on Pervasive Displays (Manchester, United Kingdom) (PerDis ’20). Association for Computing Machinery, New York, NY, USA, 79–86. https://doi.org/10.1145/3393712.3395337Google ScholarDigital Library
- David Saffo, Sara Di Bartolomeo, Caglar Yildirim, and Cody Dunne. 2021. Remote and Collaborative Virtual Reality Experiments via Social VR Platforms. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 523, 15 pages. https://doi.org/10.1145/3411764.3445426Google ScholarDigital Library
- Sebastian Stickert, Hagen Hiller, and Florian Echtler. 2018. Companion - A Software Toolkit for Digitally Aided Pen-and-Paper Tabletop Roleplaying. In The 31st Annual ACM Symposium on User Interface Software and Technology Adjunct Proceedings (New York, NY, USA) (UIST ’18 Adjunct). ACM, 48–50. https://doi.org/10.1145/3266037.3266097Google ScholarDigital Library
- Baris Unver, Sarah A. McRoberts, Sabirat Rubya, Haiwei Ma, Zuoyi Zhang, and Svetlana Yarosh. 2016. ShareTable Application for HP Sprout. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems(CHI EA ’16). ACM, New York, NY, USA, 3784–3787. https://doi.org/10.1145/2851581.2890252Google ScholarDigital Library
- Jun Wei, Xuan Wang, Roshan Lalintha Peiris, Yongsoon Choi, Xavier Roman Martinez, Remi Tache, Jeffrey Tzu Kwan Valino Koh, Veronica Halupka, and Adrian David Cheok. 2011. CoDine: An Interactive Multi-sensory System for Remote Dining. In Proceedings of the 13th International Conference on Ubiquitous Computing (New York, NY, USA) (UbiComp ’11). ACM, 21–30. https://doi.org/10.1145/2030112.2030116Google ScholarDigital Library
- Ying Yang, Tim Dwyer, Michael Wybrow, Benjamin Lee, Maxime Cordeil, Mark Billinghurst, and Bruce H. Thomas. 2022. Towards Immersive Collaborative Sensemaking. Proc. ACM Hum.-Comput. Interact. 6, ISS, Article 588 (nov 2022), 25 pages. https://doi.org/10.1145/3567741Google ScholarDigital Library
- Jakob Zillner, Christoph Rhemann, Shahram Izadi, and Michael Haller. 2014. 3D-Board: A Whole-Body Remote Collaborative Whiteboard. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology(UIST ’14). ACM, New York, NY, USA, 471–479. https://doi.org/10.1145/2642918.2647393Google ScholarDigital Library
Index Terms
- Demonstrating SurfaceCast: Ubiquitous, Cross-Device Surface Sharing
Recommendations
SurfaceCast: Ubiquitous, Cross-Device Surface Sharing
Real-time online interaction is the norm today. Tabletops and other dedicated interactive surface devices with direct input and tangible interaction can enhance remote collaboration, and open up new interaction scenarios based on mixed physical/...
Enabling tangible interaction on capacitive touch panels
UIST '10: Adjunct proceedings of the 23nd annual ACM symposium on User interface software and technologyWe propose two approaches to sense tangible objects on capacitive touch screens, which are used in off-the-shelf multi-touch devices such as Apple iPad, iPhone, and 3M's multi-touch displays. We seek for the approaches that do not require modifications ...
Clip-on gadgets: expanding multi-touch interaction area with unpowered tactile controls
UIST '11: Proceedings of the 24th annual ACM symposium on User interface software and technologyVirtual keyboards and controls, commonly used on mobile multi-touch devices, occlude content of interest and do not provide tactile feedback. Clip-on Gadgets solve these issues by extending the interaction area of multi-touch devices with physical ...
Comments