skip to main content
10.1145/3131542.3131560acmotherconferencesArticle/Chapter ViewAbstractPublication PagesiotConference Proceedingsconference-collections
research-article

Inteach: enhanced personal e-learning with tabletop telepresence and real-world objects

Published: 22 October 2017 Publication History

Abstract

We present InTeach, which integrates e-learning with real-world objects (e.g., books and notebooks) using a compact telepresence. There are many software applications of e-learning that work on PCs and mobile devices. Specifically, video streaming-based e-learning provides face-to-face communication between remote teachers and local students. However, conventional e-learning systems do not take real-world objects enough into account. We use textbooks provided by e-learning software and a text editor on PCs as a notebook. Therefore, we developed InTeach, a compact telepresence system to enhance e-learning. Our telepresence system implements a robotic arm attached to a tablet device. As the tablet contains both a camera and display, the device works for face-to-face communication. As the tablet is attached to a robotic arm, the telepresence can see both a student and real-world objects on the desk by changing direction. Moreover, to realize natural interactions, we integrate our telepresence with a wearable device to sense a remote teacher's head motion, so the teacher's head motion is directly reflected to the telepresence system.

References

[1]
William Buxton. Telepresence: Integrating Shared Task and Person Spaces. In Proceedings of Graphics Interface'92, pp. 123--129, 1992.
[2]
Gina Venolia, John Tang, Ruy Cervantes, Sara Bly, George Robertson, Bongshin Lee, and Kori Inkpen. Embodied Social Proxy: Mediating Interpersonal Connection in Hub- and-Satellite Teams. In Proceedings of ACM CHI '10, pp. 1049--1058, 2010.
[3]
Abigail Sellen, Bill Buxton, and John Arnott. Using spatial cues to improve videoconferencing. In Proceedings of AM CHI '92, pp. 651--652, 1992.
[4]
Nicole Yankelovich, Nigel Simpson, Jonathan Kaplan, and Joe Provino. Porta-person: Telepresence for the connected conference room. In Proceedings of ACM CHI (Extend Abstracts), pp. 2789--2794, 2007.
[5]
Hiroshi Ishii, and Minoru Kobayashi. ClearBoard: A Seamless Media for Shared Drawing and Conversation with Eye-Contact. In Proceedings of ACM CHI '92, pp. 525--532, 1992.
[6]
Daniel Leithinger, Sean Follmer, Alex Olwal, and Hiroshi Ishii. Physical Telepresence: Shape Capture and Display for Embodied, Computer-mediated Remote Collaboration, In Proceedings of ACM UIST '14, pp. 461--470, 2014.
[7]
Talking Heads https://www.suitabletech.com/
[8]
Christian Becker-Asano and Hiroshi Ishiguro. Evaluating facial displays of emotion for the android robot Geminoid F. In Proceedings of IEEE WACI '11, pp. 22--29, 2011.
[9]
Hiroaki Tobita, Shigaaki Maruyama, and Takuya Kuzi. Floating avatar: tele-presence system using blimps for communication and entertainment. In Proceedings of CHI '11 (Extended Abstracts), pp. 541--550, 2011.
[10]
Samratul Fuady, Masato Orishige, Li Haoyan, Hironori Mitake, and ShoichiHasegawa. Natural Interaction in Asymmetric Teleconference using Stuffed-toy Avatar Robot, In Proceedings of EuroGrahics '16, pp. 93--98, 2016.
[11]
Tadakazu Kashiwabara, Hirotaka Osawa, Kazuhiko Shinozawa, and Michita Imai. TEROOS: A Wearable Avatar to Enhance Joint Activities, In Proceedings of ACM CHI '12, pp. 2001--2004, 2012.
[12]
Sven Kratz, Don Kimber, Weiqing Su, Gwen Gordon, and Don Severns. Polly: "Being There" through the Parrot and a Guide, In Proceedings of MobileHCI '04 (Extended Abstract), pp. 625--630, 2004.
[13]
Yuichi Tsumaki, Fumiaki Ono, Taisuke Tsukuda, The 20-DOF Miniature Humanoid MH-2 for a Wearable Communication System, In Proceedings of IEEE ICRA '12, 2012, pp. 3930--3935, 2012.
[14]
Rosalia G. Schneider and Manuel M. Oliveira. Panoramic e-Learning Videos for non-Linear Navigation, In Proceedings of ACM SA '14, 2014.
[15]
Christian Corsten. DragonFly: spatial navigation for lecture videos, In Proceedings of ACM CHI (Extend Abstracts), pp. 4387--4392, 2010.
[16]
Hideki Koike, Yoichi Sato, Yoshinori Kobayashi, Hiroaki Tobita, and Motoki Kobayashi. Interactive textbook and interactive Venn diagram: natural and intuitive interfaces on augmented desk system, In Proceedings of ACM CHI '00, pp. 121--128, 2000.
[17]
Brygg Ullmer and Hiroshi Ishii. The metaDESK: models and prototypes for tangible user interfaces, In Proceedings of ACM UIST '97, pp. 223--23, 1997.
[18]
Kazuhiro Otsuka. MMSpace: Kinetically-augmented telepresence for small group-to-group conversations, In Proceedings of IEEE VR '16, pp. 19--28, 2016
[19]
Christian Becker-Asano, Severin Gustorff, Kai Oliver Arras, Kohei Ogawa, Shuichi Nishio, Hiroshi Ishiguro, and Bernhard Nebel. Robot Embodiment, Operato Modality, and Social Interaction in Tele-Existence: A Project Outline, In Proceedings of IEEE HRI '13, pp. 79--80, 2013.
[20]
William Cain, John Bell, and Cui Cheng. Implementing Robotic Telepresence in a Synchronous Hybrid Course, In Proceedings of IEEE ICALT '16, pp. 171--175, 2016.
[21]
Hiroaki Tobita. Gutsy-Avatar: Computational Assimilation for Advanced Communication and Collaboration. In Proceedings of IEEE ICRC '17, pp. 8--13, 2017.
[22]
Hiroaki Tobita. Ghost-Hack AR: human augmentation using multiple telepresence systems for network communication. In Proceedings of ACM PerDis '17, 2017.
[23]
Aaron M. Genest, Carl Gutwin, Anthony Tang, Michael Kalyn, and Zenja Ivkovic. KinectArms: a toolkit for capturing and displaying arm embodiments in distributed tabletop groupware. In Proceedings of ACM CWCW '13, pp. 157--166, 2013.
[24]
Claudio S. Pinhanez, Frank Nielsen, and Kim Binsted. Projecting computer graphics on moving surface: s simple calibration and tracking method. In Proceedings of ACM Siggraph '99 (Abstracts and Applications), pp. 266, 1999.
[25]
Facerig https://facerig.com
[26]
Natan Linder and Rattie Maes. LuminAR: portable robotic augmented reality interface design and prototype. In Proceedings of ACM UIST '10 (Adjunct proceedings), pp. 395--396, 2010.
[27]
Nobuchika Sasaki, Takeshi Kurata, Takekazu Kato, Masakatsu Kourogi, and Hideaki Kuzuoka. WACL: Supporting Telecommunications Using Wearable Active Camera with Laser Pointer. In Proceedings of IEEE ISWC '03, pp. 53--56, 2003.

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
IoT '17: Proceedings of the Seventh International Conference on the Internet of Things
October 2017
211 pages
ISBN:9781450353182
DOI:10.1145/3131542
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 October 2017

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. computational assimilation
  2. computer-mediated learning
  3. enhanced appearance
  4. telepresence
  5. wearable controller

Qualifiers

  • Research-article

Conference

IoT '17

Acceptance Rates

Overall Acceptance Rate 28 of 84 submissions, 33%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 111
    Total Downloads
  • Downloads (Last 12 months)4
  • Downloads (Last 6 weeks)1
Reflects downloads up to 13 Jan 2025

Other Metrics

Citations

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media