Keita Higuchi
ABSTRACT
ImmerseBoard is a system for remote collaboration through a digital whiteboard that gives participants a 3D immersive experience, enabled only by an RGBD camera (Microsoft Kinect) mounted on the side of a large touch display. Using 3D processing of the depth images, life-sized rendering, and novel visualizations, ImmerseBoard emulates writing side-by-side on a physical whiteboard, or alternatively on a mirror. User studies involving three tasks show that compared to standard video conferencing with a digital whiteboard, ImmerseBoard provides participants with a quantitatively better ability to estimate their remote partners' eye gaze direction, gesture direction, intention, and level of agreement. Moreover, these quantitative capabilities translate qualitatively into a heightened sense of being together and a more enjoyable experience. ImmerseBoard's form factor is suitable for practical and easy installation in homes and offices.
Supplemental Material
- Apperley, M., McLeod, L., Masoodian, M., Paine, L., Phillips, M., Rogers, B., and Thomson, K. Use of video shadow for small group interaction awareness on a large interactive display surface. AUIC '03 (2003), 81--90. Google Scholar
Digital Library
- Birnholtz, J. P., Grossman, T., Mak, C., and Balakrishnan, R. An exploratory study of input configuration and group process in a negotiation task using a large display. CHI '07, 91--100. Google ScholarDigital Library
- Diamant, E. I., Fussell, S. R., and Lo, F.-L. Collaborating across cultural and technological boundaries: team culture and information use in a map navigation task. IWIC '09, 175--184. Google ScholarDigital Library
- Doucette, A., Gutwin, C., Mandryk, R. L., Nacenta, M., and Sharma, S. Sometimes when we touch: how arm embodiments change reaching and collaboration on digital tables. CSCW '13, 193--202. Google ScholarDigital Library
- Elrod, S., Bruce, R., Gold, R., Goldberg, D., Halasz, F., Janssen, W., Lee, D., McCall, K., Pedersen, E., Pier, K., Tang, J., and Welch, B. Liveboard: a large interactive display supporting group meetings, presentations, and remote collaboration. CHI '92, 599--607. Google ScholarDigital Library
- Genest, A. M., Gutwin, C., Tang, A., Kalyn, M., and Ivkovic, Z. Kinectarms: a toolkit for capturing and displaying arm embodiments in distributed tabletop groupware. CSCW '13, 157--166. Google ScholarDigital Library
- Ishii, H., and Kobayashi, M. Clearboard: a seamless medium for shared drawing and conversation with eye contact. CHI '92, 525--532. Google ScholarDigital Library
- Jouppi, N. P., Iyer, S., Thomas, S., and Slayden, A. Bireality: mutually-immersive telepresence. MULTIMEDIA '04, 860--867. Google ScholarDigital Library
- Junuzovic, S., Inkpen, K., Blank, T., and Gupta, A. Illumishare: sharing any surface. CHI '12, 1919--1928. Google ScholarDigital Library
- Kendon, A. Some functions of gaze-direction in social interaction. Acta psychologica 26 (1967), 22--63.Google Scholar
- Khan, A., Matejka, J., Fitzmaurice, G., and Kurtenbach, G. Spotlight: directing users' attention on large displays. CHI '05, 791--798. Google ScholarDigital Library
- Kim, K., Bolton, J., Girouard, A., Cooperstock, J., and Vertegaal, R. Telehuman: effects of 3d perspective on gaze and pose estimation with a life-size cylindrical telepresence pod. CHI '12, 2531--2540. Google ScholarDigital Library
- Liu, S., Chou, P. A., Zhang, C., Zhang, Z., and Chen, C. W. Virtual view reconstruction using temporal information. IEEE ICME 2012, 115--120. Google ScholarDigital Library
- Misawa, K., Ishiguro, Y., and Rekimoto, J. Livemask: a telepresence surrogate system with a face-shaped screen for supporting nonverbal communication. AVI '12, 394--397. Google ScholarDigital Library
- Moezzi, S. Immersive telepresence. MultiMedia, IEEE 4, 1 (1997), 17--17. Google ScholarDigital Library
- Morikawa, O., and Maesako, T. Hypermirror: toward pleasant-to-use video mediated communication system. CSCW '98, 149--158. Google ScholarDigital Library
- Mulligan, J., Zabulis, X., Kelshikar, N., and Daniilidis, K. Stereo-based environment scanning for immersive telepresence. Circuits and Systems for Video Technology, IEEE Transactions on 14, 3 (2004), 304--320. Google ScholarDigital Library
- Nescher, T., and Kunz, A. An interactive whiteboard for immersive telecollaboration. The Visual Computer 27, 4 (2011), 311--320. Google ScholarDigital Library
- Proudlock FA, Shekhar H, G. I. Coordination of eye and head movements during reading. Invest Ophthalmol Vis Sci. 44, 7 (2003), 2991--2998.Google ScholarCross Ref
- Raskar, R., Welch, G., Cutts, M., Lake, A., Stesin, L., and Fuchs, H. The office of the future: a unified approach to image-based modeling and spatially immersive displays. SIGGRAPH '98 (1998), 179--188. Google ScholarDigital Library
- Rekimoto, J. A multiple device approach for supporting whiteboard-based interactions. CHI '98, 344--351. Google ScholarDigital Library
- Roussel, N. Experiences in the design of the well, a group communication device for teleconviviality. MULTIMEDIA '02, 146--152. Google ScholarDigital Library
- Streitz, N. A., Geissler, J., Holmer, T., Konomi, S., Müller-Tomfelde, C., Reischl, W., Rexroth, P., Seitz, P., and Steinmetz, R. i-land: an interactive landscape for creativity and innovation. CHI '99 (1999), 120--127. Google ScholarDigital Library
- Tan, K.-H., Robinson, I., Samadani, R., Lee, B., Gelb, D., Vorbau, A., Culbertson, B., and Apostolopoulos, J. Connectboard: A remote collaboration system that supports gaze-aware interaction and sharing. MMSP '09 (2009), 1--6.Google ScholarCross Ref
- Tang, A., Pahud, M., Inkpen, K., Benko, H., Tang, J. C., and Buxton, B. Three's company: understanding communication channels in three-way distributed collaboration. CSCW '10, ACM (2010), 271--280. Google ScholarDigital Library
- Tang, J. C., and Minneman, S. Videowhiteboard: video shadows to support remote collaboration. CHI '91, 315--322. Google ScholarDigital Library
- Tseng, B. L., Shae, Z.-Y., Leung, W. H., and Chen, T. Immersive whiteboards in a networked collaborative environment. In IEEE Multimedia and Expo (2001).Google Scholar
- Uchihashi, S., and Tanzawa, T. Mixing remote locations using shared screen as virtual stage. MM '11, 1265--1268. Google ScholarDigital Library
- Zhang, C., Cai, Q., Chou, P., Zhang, Z., and Martin-Brualla, R. Viewport: A distributed, immersive teleconferencing system with infrared dot pattern. MultiMedia, IEEE 20, 1 (2013), 17--27. Google ScholarDigital Library
- Zillner, J., Rhemann, C., Izadi, S., and Haller, M. 3d-board: A whole-body remote collaborative whiteboard. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology, UIST '14 (2014), 471--479. Google ScholarDigital Library
Index Terms
- ImmerseBoard: Immersive Telepresence Experience using a Digital Whiteboard
Recommendations
The blue-C (poster session): integrating real humans into a networked immersive environment
CVE '00: Proceedings of the third international conference on Collaborative virtual environmentsIn this paper, we report ongoing work in a new project, The Blue-C. The goal of this project is to build a collaborative, immersive virtual environment which will eventually integrate real humans, captured by a set of video cameras. Two Blue-C.s will be ...
Haptic around: multiple tactile sensations for immersive environment and interaction in virtual reality
VRST '18: Proceedings of the 24th ACM Symposium on Virtual Reality Software and TechnologyIn this paper, we present Haptic Around, a hybrid-haptic feedback system, which utilizes fan, hot air blower, mist creator and heat light to recreate multiple tactile sensations in virtual reality for enhancing the immersive environment and interaction. ...
A Classification of Human-to-Human Communication during the Use of Immersive Teleoperation Interfaces
VRIC '15: Proceedings of the 2015 Virtual Reality International ConferenceWe propose a new classification of the human-to-human communication during the use of immersive teleoperation interfaces based on real-life examples. While a large body of research is concerned with communication in collaborative virtual environments (...
Comments