Article

BiReality: mutually-immersive telepresence

Authors:

Norman P. Jouppi,

April SlaydenAuthors Info & Claims

MULTIMEDIA '04: Proceedings of the 12th annual ACM international conference on Multimedia

Pages 860 - 867

https://doi.org/10.1145/1027527.1027725

Published: 10 October 2004 Publication History

Abstract

BiReality (a.k.a. Mutually-Immersive Telepresence) uses a teleoperated robotic surrogate to provide an immersive telepresence system for face-to-face interactions. Our goal is to recreate to the greatest extent practical, both for the user and the people at the remote location, the sensory experience relevant for face-to-face interactions of the user actually being in the remote location. Our system provides a 360-degree surround immersive audio and visual experience for both the user and remote participants, and streams eight 704x480 MPEG-2 coded videos totaling 20Mb/s. The system preserves gaze and eye contact, presents local and remote participants to each other at life size, and preserves the head height of the user at the remote location. Initial user experiences are presented.

References

[1]

J. Augustine, S. R. Kokrady., N. P. Jouppi, and S. Iyer. Region of Interest Editing of MPEG-2 Video Streams in the Compressed Domain. In Proc. of IEEE International Conference on Multimedia and Expo, 2004.

[2]

H. H. Baker and et. al. Computational and Performance Issues in Coliseum Videoconferencing. In Proc. ACM Multimedia, 2003.

Digital Library

[3]

J. Blauert. Spatial Hearing: The Psychophysics of Human Sound Localization. MIT Press, 2nd edition, 1997.

[4]

W. A. Buxton and T. P. Moran. EuroPARC's Integrated Interactive Intermedia Facility (iiif ): Early Experience. In IFIP WG 8.4 Conference on Multi-User Interfaces and Applications, pages 11--34, 1990.

Digital Library

[5]

W. A. S. Buxton. Telepresence: Integrating Shared Task and Person Spaces. In Graphic Interface 1992, 123--129.

Digital Library

[6]

M. Chen. A Low-Latency Lip-Synchronized Videoconferencing System. In Proc. ACM CHI 2003, 465--471.

Digital Library

[7]

M. Chen. Leveraging the Asymmetric Sensitivity of Eye Contact for Videoconference. In Proc. ACM CHI 2002, 49--56.

Digital Library

[8]

E. T. Hall. The Hidden Dimension. Anchor Press, 1990.

[9]

N. P. Jouppi. First Steps Towards Mutually-Immersive Mobile Telepresence. In Proc. of the ACM Conference on Computer Supported Cooperative Work, pages 354--363, 2002.

Digital Library

[10]

N. P. Jouppi and S. Iyer. A Headphone-free Head-tracked Audio System for Advanced Audio Telepresence. In Proc. the 117th Audio Engineering Society Convention, October 2004.

[11]

M. W. Matlin and H. J. Foley. Sensation and Perception. Allyn and Bacon, 4th edition, 1997.

[12]

H. Nakanishi, C. Yoshida, T. Nishimura, and T. Ishida. FreeWalk: A 3D Virtual Space for Casual Meetings. IEEE Multimedia, 6(2):20--28, April 1999.

Digital Library

[13]

B. O'Conaill, S. Whittaker, and S. Wilbur. Conversations Over Video Conferences: An Evaluation of the Spoken Aspects of Video-Mediated Communication. Human-Computer Interaction, 8:389--428, 1993.

Digital Library

[14]

K. I. Okada, F. Maeda, Y. Ichikawaa, and Y. Matsushita. Multiparty Videoconferencing at Virtual Social Distance: MAJIC Design. In Proc. ACM CSCW 1994, 385--393.

Digital Library

[15]

E. Paulos and J. Canny. PRoP: Personal Roving Presence. In ACM CHI 1998, 296--303.

Digital Library

[16]

A. Prussog, L. Mühlbach, and M. Böcker. Telepresence in Videocommunications. In Proc. the Human Factors and Ergonomics Society 38th Annual Meeting, pages 180--184, 1994.

[17]

A. Sellen. Remote conversations: The effect of mediating talk with technology. Human-Computer Interaction, 10:401--444, 1995.

Digital Library

[18]

A. Sellen, B. Buxton, and J. Arnott. Using Spatial Cues to Improve Videoconferencing. In Proc. ACM CHI 1992, 651--652.

Digital Library

[19]

R. Vertegaal. The GAZE Groupware System: Mediating Joint Attention in Multiparty Communication and Collaboration. In Proc. ACM CHI 1999, 294--301.

Digital Library

[20]

R. Vertegaal, I. Weevers, C. Sohn, and C. Cheung. GAZE-2: Conveying Eye Contact in Group Video Videoconferencing Using Eye-Controlled Camera Direction. In Proc. ACM CHI 2003, 521--528.

Digital Library

Cited By

Kobayashi KKomuro TKagawa KKawahito S(2020)Transmission of correct gaze direction in video conferencing using screen-embedded camerasMultimedia Tools and Applications10.1007/s11042-020-09758-wOnline publication date: 19-Sep-2020
https://doi.org/10.1007/s11042-020-09758-w
Ishak CNeustaedter CHawkins DProcyk JMassimi MKaye JDruin ALampe CMorris DHourcade J(2016)Human Proxies for Remote University Classroom AttendanceProceedings of the 2016 CHI Conference on Human Factors in Computing Systems10.1145/2858036.2858184(931-943)Online publication date: 7-May-2016
https://dl.acm.org/doi/10.1145/2858036.2858184
Higuchi KChen YChou PZhang ZLiu ZBegole BKim JInkpen KWoo W(2015)ImmerseBoardProceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems10.1145/2702123.2702160(2383-2392)Online publication date: 18-Apr-2015
https://dl.acm.org/doi/10.1145/2702123.2702160
Show More Cited By

Index Terms

BiReality: mutually-immersive telepresence

Recommendations

First steps towards mutually-immersive mobile telepresence
CSCW '02: Proceedings of the 2002 ACM conference on Computer supported cooperative work

Mutually-Immersive Mobile Telepresence uses a teleoperated robotic surrogate to visit remote locations as a substitute for physical travel. Our goal is to recreate to the greatest extent possible, both for the user and the people at the remote location, ...
Gestural communication over video stream: supporting multimodal interaction for remote collaborative physical tasks
ICMI '03: Proceedings of the 5th international conference on Multimodal interfaces

We present a system integrating gesture and live video to support collaboration on physical tasks. The architecture combines network IP cameras, desktop PCs, and tablet PCs to allow a remote helper to draw on a video feed of a workspace as he/she ...
Coordination of communication: effects of shared visual context on collaborative work
CSCW '00: Proceedings of the 2000 ACM conference on Computer supported cooperative work

We outline some of the benefits of shared visual information for collaborative repair tasks and report on a study comparing collaborative performance on a manual task by workers and helpers who are located side-by-side or connected via audio-video or ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MULTIMEDIA '04: Proceedings of the 12th annual ACM international conference on Multimedia

October 2004

1028 pages

ISBN:1581138938

DOI:10.1145/1027527

General Chairs:
Henning Schulzrinne
Columbia University
,
Nevenka Dimitrova
Philips Research
,
Program Chairs:
Angela Sasse
UCL
,
Sue Moon
KAIST
,
Rainer Lienhart
U Augsburg

Copyright © 2004 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 October 2004

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

MM04

Sponsor:

MM04: 2004 12th Annual ACM International Conference on Multimedia

October 10 - 16, 2004

NY, New York, USA

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

16
Total Citations
View Citations
535
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)0

Reflects downloads up to 03 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Kobayashi KKomuro TKagawa KKawahito S(2020)Transmission of correct gaze direction in video conferencing using screen-embedded camerasMultimedia Tools and Applications10.1007/s11042-020-09758-wOnline publication date: 19-Sep-2020
https://doi.org/10.1007/s11042-020-09758-w
Ishak CNeustaedter CHawkins DProcyk JMassimi MKaye JDruin ALampe CMorris DHourcade J(2016)Human Proxies for Remote University Classroom AttendanceProceedings of the 2016 CHI Conference on Human Factors in Computing Systems10.1145/2858036.2858184(931-943)Online publication date: 7-May-2016
https://dl.acm.org/doi/10.1145/2858036.2858184
Higuchi KChen YChou PZhang ZLiu ZBegole BKim JInkpen KWoo W(2015)ImmerseBoardProceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems10.1145/2702123.2702160(2383-2392)Online publication date: 18-Apr-2015
https://dl.acm.org/doi/10.1145/2702123.2702160
Takayama LHarris HKuzuoka HEvers VImai MForlizzi J(2013)Presentation of (telepresent) selfProceedings of the 8th ACM/IEEE international conference on Human-robot interaction10.5555/2447556.2447684(381-388)Online publication date: 3-Mar-2013
https://dl.acm.org/doi/10.5555/2447556.2447684
Kristoffersson ACoradeschi SLoutfi A(2013)A review of mobile robotic telepresenceAdvances in Human-Computer Interaction10.1155/2013/9023162013(3-3)Online publication date: 1-Jan-2013
https://dl.acm.org/doi/10.1155/2013/902316
MacCormick JBruckman ACounts SLampe CTerveen L(2013)Video chat with multiple camerasProceedings of the 2013 conference on Computer supported cooperative work companion10.1145/2441955.2442004(195-198)Online publication date: 23-Feb-2013
https://dl.acm.org/doi/10.1145/2441955.2442004
Takayama LHarris H(2013)Presentation of (telepresent) self: On the double-edged effects of mirrors2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI)10.1109/HRI.2013.6483613(381-388)Online publication date: Mar-2013
https://doi.org/10.1109/HRI.2013.6483613
Rae ITakayama LMutlu BKonstan JChi EHöök K(2012)One of the gangProceedings of the SIGCHI Conference on Human Factors in Computing Systems10.1145/2207676.2208723(3091-3100)Online publication date: 5-May-2012
https://dl.acm.org/doi/10.1145/2207676.2208723
Kim KBolton JGirouard ACooperstock JVertegaal RKonstan JChi EHöök K(2012)TeleHumanProceedings of the SIGCHI Conference on Human Factors in Computing Systems10.1145/2207676.2208640(2531-2540)Online publication date: 5-May-2012
https://dl.acm.org/doi/10.1145/2207676.2208640
Takayama LGo JPoltrock SSimone CGrudin JMark GRiedl J(2012)Mixing metaphors in mobile remote presenceProceedings of the ACM 2012 conference on Computer Supported Cooperative Work10.1145/2145204.2145281(495-504)Online publication date: 11-Feb-2012
https://dl.acm.org/doi/10.1145/2145204.2145281
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten