skip to main content
10.1145/2470654.2466173acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

Panoinserts: mobile spatial teleconferencing

Published: 27 April 2013 Publication History

Abstract

We present PanoInserts: a novel teleconferencing system that uses smartphone cameras to create a surround representation of meeting places. We take a static panoramic image of a location into which we insert live videos from smartphones. We use a combination of marker- and image-based tracking to position the video inserts within the panorama, and transmit this representation to a remote viewer. We conduct a user study comparing our system with fully-panoramic video and conventional webcam video conferencing for two spatial reasoning tasks. Results indicate that our system performs comparably with fully-panoramic video, and better than webcam video conferencing in tasks that require an accurate surrounding representation of the remote space. We discuss the representational properties and usability of varying video presentations, exploring how they are perceived and how they influence users when performing spatial reasoning tasks.

References

[1]
Agarwala, A., Zheng, K. C., Pal, C., Agrawala, M., Cohen, M., Curless, B., Salesin, D., and Szeliski, R. Panoramic video textures. ACM Transactions on Graphics 24, 3 (July 2005), 821--827.
[2]
Benford, S., Brown, C., Reynard, G., and Greenhalgh, C. Shared spaces: transportation, artificiality, and spatiality. In Proceedings of the 1996 ACM conference on Computer supported cooperative work, ACM (1996), 77--86.
[3]
Benford, S., Greenhalgh, C., Reynard, G., Brown, C., and Koleva, B. Understanding and constructing shared spaces with mixed-reality boundaries. ACM Transaction on Computer-Human Interaction 5, 3 (Sept. 1998), 185--223.
[4]
Billinghurst, M., Poupyrev, I., Kato, H., and May, R. Mixing realities in shared space: An augmented reality interface for collaborative computing. In Multimedia and Expo, 2000. ICME 2000. 2000 IEEE International Conference on, vol. 3, IEEE (2000), 1641--1644.
[5]
Brooke, J. SUS: A quick and dirty usability scale. In Usability evaluation in industry, P. W. Jordan, B. Weerdmeester, A. Thomas, and I. L. Mclelland, Eds. Taylor and Francis, London, 1996.
[6]
Brown, M., and Lowe, D. G. Recognising panoramas. In Proceedings of the IEEE International Conference on Computer Vision, vol. 2, IEEE Computer Society (2003), 1218--1226.
[7]
Chen, M. Leveraging the asymmetric sensitivity of eye contact for videoconference. In Proceedings of the SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves, ACM (2002), 49--56.
[8]
Cutler, R., Rui, Y., Gupta, A., Cadiz, J., Tashev, I., He, L.-w., Colburn, A., Zhang, Z., Liu, Z., and Silverberg, S. Distributed meetings: a meeting capture and broadcasting system. In Proceedings of the ACM International Conference on Multimedia (2002), 503--512.
[9]
Diverdi, S., Withert, J., and Hllerert, T. Envisor: Online environment map construction for mixed reality. In Proceedings of IEEE VR Conference (2008).
[10]
Fiala, M., Green, D., and Roth, G. A panoramic video and acoustic beamforming sensor for videoconferencing. In Haptic, Audio and Visual Environments and Their Applications (October 2004), 47--52.
[11]
Fischler, M. A., and Bolles, R. C. Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24, 6 (1981), 381--395.
[12]
Hauber, J., Regenbrecht, H., Billinghurst, M., and Cockburn, A. Spatiality in videoconferencing: trade-offs between efficiency and social presence. In Conference on Computer Supported Co-operative work, ACM (2006), 413--422.
[13]
Kauff, P., and Schreer, O. An immersive 3d video-conferencing system using shared virtual team user environments. In Proceedings of the 4th international conference on Collaborative virtual environments, ACM (2002), 105--112.
[14]
Lewis, J., and Sauro, J. The factor structure of the system usability scale. Human Centered Design (2009), 94--103.
[15]
Li, Y., Wang, Y., Huang, W., and Zhang, Z. Automatic image stitching using SIFT. International Conference on Audio Language and Image Processing (2008), 568--571.
[16]
Lowe, D. Distinctive image features from scale-invariant keypoints. International Journal of Computer Visiono 60, 2 (2004), 91--110.
[17]
Majumder, A., Seales, W. B., Gopi, M., and Fuchs, H. Immersive teleconferencing: a new algorithm to generate seamless panoramic video imagery. In Proceedings of the International Conference on Multimedia, ACM (1999), 169--178.
[18]
Mikolajczyk, K., and Schmid, C. Scale and affine invariant interest point detectors. International Journal of Computer Vision 60, 1 (2004), 63--86.
[19]
Mulloni, A., Seichter, H., Düunser, A., Baudisch, P., and Schmalstieg, D. 360 degrees: panoramic overviews for location-based services. In Proceedings of the Annual Conference on Human Factors in Computing Systems, ACM (2012), 2565--2568.
[20]
Rousseeuw, P. J. Least median of squares regression. Journal of the American Statistics Association 79, 388 (1984), 871--880.
[21]
Rui, Y., Gupta, A., and Cadiz, J. Viewing meeting captured by an omni-directional camera. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM (2001), 450--457.
[22]
Schaffalitzky, F., and Zisserman, A. Multi-view matching for unordered image sets, or "how do i organize my holiday snaps?". In Proceedings of the European Conference on Computer Vision, Springer-Verlag (2002), 414--431.
[23]
Steedly, D., Pal, C., and Szeliski, R. Efficiently registering video into panoramic mosaics. In Proceedings of the International Conference on Computer Vision, vol. 2 (2005), 1300--1307.
[24]
Steptoe, W., Normand, J.-M., Oyekoya, O., Pece, F., Giannopoulos, E., Tecchia, F., Steed, A., and Slater, M. Acting rehearsal in collaborative multimodal mixed reality environments. Presence: Teleoperators & Virtual Environments 21, 4 (2012), 406--422.
[25]
Suen, S. T., Lam, E. Y., and Wong, K. K. Photographic stitching with optimized object and color matching based on image derivatives. Optics Express 15, 12 (2007), 7689--7696.
[26]
Szeliski, R. Image mosaicing for tele-reality applications. In Proceedings of the IEEE Workshop on Applications of Computer Vision (1994), 44--53.
[27]
Szeliski, R. Image alignment and stitching: a tutorial. Foundations and Trends in Computer Graphics and Computer Vision 2 (2006), 1--104.
[28]
Szeliski, R., and Shum, H.-Y. Creating full view panoramic image mosaics and environment maps. In Proceedings of the Annual Conference on Computer Graphics and Interactive Techniques, ACM Press/Addison-Wesley Publishing Co. (1997), 251--258.
[29]
Vertegaal, R., Weevers, I., Sohn, C., and Cheung, C. GAZE-2: conveying eye contact in group video conferencing using eye-controlled camera direction. Proceedings of the conference on Human factors in computing systems (2003), 521--528.
[30]
Wagner, D., Mulloni, A., Langlotz, T., and Schmalstieg, D. Real-time panoramic mapping and tracking on mobile phones. In Proceedings of the IEEE VR Conference, IEEE Computer Society (2010), 211--218.
[31]
Wu, C. SiftGPU: A GPU implementation of scale invariant feature transform (SIFT). http://cs.unc.edu/~ccwu/siftgpu, 2007.

Cited By

View all
  • (2025)Visual Expansion and Real‐Time Calibration for Pan‐Tilt‐Zoom Cameras Assisted by Panoramic ModelsComputer Animation and Virtual Worlds10.1002/cav.7001536:1Online publication date: 28-Jan-2025
  • (2023)A Survey on 360° Images and Videos in Mixed Reality: Algorithms and ApplicationsJournal of Computer Science and Technology10.1007/s11390-023-3210-138:3(473-491)Online publication date: 30-May-2023
  • (2022)Content format and quality of experience in virtual realityMultimedia Tools and Applications10.1007/s11042-022-12176-983:15(46481-46506)Online publication date: 9-Mar-2022
  • Show More Cited By

Index Terms

  1. Panoinserts: mobile spatial teleconferencing

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CHI '13: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
    April 2013
    3550 pages
    ISBN:9781450318990
    DOI:10.1145/2470654
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 27 April 2013

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. camera tracking
    2. mixed reality
    3. mobile phones
    4. panoramas
    5. remote collaboration
    6. teleconferencing
    7. telepresence

    Qualifiers

    • Research-article

    Conference

    CHI '13
    Sponsor:

    Acceptance Rates

    CHI '13 Paper Acceptance Rate 392 of 1,963 submissions, 20%;
    Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

    Upcoming Conference

    CHI 2025
    ACM CHI Conference on Human Factors in Computing Systems
    April 26 - May 1, 2025
    Yokohama , Japan

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)12
    • Downloads (Last 6 weeks)2
    Reflects downloads up to 19 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2025)Visual Expansion and Real‐Time Calibration for Pan‐Tilt‐Zoom Cameras Assisted by Panoramic ModelsComputer Animation and Virtual Worlds10.1002/cav.7001536:1Online publication date: 28-Jan-2025
    • (2023)A Survey on 360° Images and Videos in Mixed Reality: Algorithms and ApplicationsJournal of Computer Science and Technology10.1007/s11390-023-3210-138:3(473-491)Online publication date: 30-May-2023
    • (2022)Content format and quality of experience in virtual realityMultimedia Tools and Applications10.1007/s11042-022-12176-983:15(46481-46506)Online publication date: 9-Mar-2022
    • (2021)ML Tools for the Web: A Way for Rapid Prototyping and HCI ResearchArtificial Intelligence for Human Computer Interaction: A Modern Approach10.1007/978-3-030-82681-9_10(315-343)Online publication date: 5-Nov-2021
    • (2020)MobileportationProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/33973314:2(1-16)Online publication date: 15-Jun-2020
    • (2019)Immersive Telepresence and Remote Collaboration using Mobile and Wearable DevicesIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2019.289873725:5(1908-1918)Online publication date: May-2019
    • (2017)Recurring MeetingsProceedings of the ACM on Human-Computer Interaction10.1145/31347191:CSCW(1-17)Online publication date: 6-Dec-2017
    • (2017)Write for LifeProceedings of the ACM on Human-Computer Interaction10.1145/31347081:CSCW(1-24)Online publication date: 6-Dec-2017
    • (2017)Digital Privacy Challenges with Shared Mobile Phone Use in BangladeshProceedings of the ACM on Human-Computer Interaction10.1145/31346521:CSCW(1-20)Online publication date: 6-Dec-2017
    • (2017)Static stages for heterogeneous programmingProceedings of the ACM on Programming Languages10.1145/31338951:OOPSLA(1-27)Online publication date: 12-Oct-2017
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media