skip to main content
10.1145/2493988.2494330acmconferencesArticle/Chapter ViewAbstractPublication PagesubicompConference Proceedingsconference-collections
research-article

Eyeglass-based hands-free videophone

Published: 08 September 2013 Publication History

Abstract

We propose an eyeglass-based videophone that enables the wearer to make a video call without holding a phone (that is to say hands-free) in the mobile environment. The glasses have 4 (or 6) fish-eye cameras to widely capture the face of the wearer and the images are fused to yield 1 frontal face image. The face image is also combined with the background image captured by a rear-mounted camera; the result is a self-portrait image without holding any camera device at arm's length. Simulations confirm that 4 fish-eye cameras with 250-degree field of view (or 6 cameras with 180-degree field of view) can cover 83% of the frontal face. We fabricate a 6 camera prototype, and confirm the possibility of generating the self-portrait image. This system suits not only hands-free videophones but also other applications like visual life logging and augmented reality use.

References

[1]
Kodama, M., Tsunoji, T. and Motegi, N. FOMA videophone multipoint platform. NTT Review, 15, 2 (2003), 17--21.
[2]
Apple Inc. FaceTime. http://www.apple.com/ios/facetime/
[3]
Deloitte Touche Tohmatsu Limited. Video calling: the base goes mainstream, but usage remains niche. Technology, Media & Telecommunications Predictions (2011), 41--42.
[4]
Google Inc. Project Glass. http://www.google.com/glass/
[5]
Seiko Epson Corporation. Enjoying Visual Content Anytime, Anywhere: The Moverio BT-100 Mobile Viewer. http://global.epson.com/newsroom/2011/news_20111219.html
[6]
Kanade, T. and Hebert, M. First-Person Vision. Proc. IEEE, 100, 8 (2012), 2442--2453.
[7]
Manabe, H. and Fukumoto, M. Full-time wearable headphone-type gaze detector. Proc. CHI '06 Extended Abstracts on Human Factors in Computing Systems, ACM Press (2006), 1073--1078
[8]
Kidd, C. D., Orr, R., Abowd, G. D., Atkeson, C. G., Essa, I. A., MacIntyre, B., Mynatt, E. D., Starner, T. and Newstetter, W. The Aware Home: A Living Laboratory for Ubiquitous Computing Research. Proc. the Second International Workshop on Cooperative Buildings, Integrating Information, Organization, and Architecture (1999), 191--198.
[9]
Higuchi, K., Ishiguro, Y. and Rekimoto, J. Flying eyes: free-space content creation using autonomous aerial vehicles. Proc. CHI '11 Extended Abstracts on Human Factors in Computing Systems, ACM Press (2011), 561--570.
[10]
Ye, Z., Li, Y., Fathi, A., Han, Y., Rozga, A., Abowd, G. D. and Rehg, J. M.Detecting eye contact using wearable eye-tracking glasses. Proc. the 2012 ACM Conference on Ubiquitous Computing, ACM Press (2012), 699--704.
[11]
Jones, A., Fyffe, G., Xueming, Y., Wan-Chun, M., Busch, J., Ichikari, R., Bolas, M. and Debevec, P. Head-Mounted Photometric Stereo for Performance Capture. Proc. ACM SIGGRAPH 2010 Emerging Technologies, 14 (2010).
[12]
Reddy, C. K., Stockman, G. C., Rolland, J. P. and Biocca, F. A. Mobile Face Capture for Virtual Face Videos. Proc. the 2004 Conference on Computer Vision and Pattern Recognition Workshop, 5 (2004), 77.
[13]
Spitzer, M. B., Rensing, N. M., McClelland, R. and Aquilino, P. Eyeglass-based systems for wearable computing. Proc. the 1st IEEE International Symposium on Wearable Computer (1997), 48.
[14]
Shimizu, S., Kawai, J. and Yamada, H. Wraparound View System for Motor Vehicles. Fujitsu scientific and technical journal, 46, 1 (2010), 95--102.
[15]
Digital Human Research Center, AIST. AIST anthropometric database. http://riodb.ibase.aist.go.jp/dhb-odydb
[16]
Maejima, A., Yarimizu, H., Kubo, H. and Morishima, S. Automatic generation of head models and facial animations considering personal characteristics. Proc. of the 17th ACM Symposium on Virtual Reality Software and Technology, ACM Press (2010), 71--78.

Cited By

View all
  • (2020)Eye-based Interaction Using Embedded Optical Sensors on an Eyewear Device for Facial Expression RecognitionProceedings of the Augmented Humans International Conference10.1145/3384657.3384787(1-10)Online publication date: 16-Mar-2020
  • (2018)Behind-the-maskProceedings of the 2018 International Conference on Advanced Visual Interfaces10.1145/3206505.3206544(1-5)Online publication date: 29-May-2018
  • (2017)Evaluation of Facial Expression Recognition by a Smart Eyewear for Facial Direction Changes, Repeatability, and Positional DriftACM Transactions on Interactive Intelligent Systems10.1145/30129417:4(1-23)Online publication date: 13-Dec-2017
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
ISWC '13: Proceedings of the 2013 International Symposium on Wearable Computers
September 2013
160 pages
ISBN:9781450321273
DOI:10.1145/2493988
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 September 2013

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. eyeglass based system
  2. hands-free
  3. videophone

Qualifiers

  • Research-article

Conference

UbiComp '13
Sponsor:

Acceptance Rates

ISWC '13 Paper Acceptance Rate 20 of 101 submissions, 20%;
Overall Acceptance Rate 38 of 196 submissions, 19%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)12
  • Downloads (Last 6 weeks)0
Reflects downloads up to 17 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2020)Eye-based Interaction Using Embedded Optical Sensors on an Eyewear Device for Facial Expression RecognitionProceedings of the Augmented Humans International Conference10.1145/3384657.3384787(1-10)Online publication date: 16-Mar-2020
  • (2018)Behind-the-maskProceedings of the 2018 International Conference on Advanced Visual Interfaces10.1145/3206505.3206544(1-5)Online publication date: 29-May-2018
  • (2017)Evaluation of Facial Expression Recognition by a Smart Eyewear for Facial Direction Changes, Repeatability, and Positional DriftACM Transactions on Interactive Intelligent Systems10.1145/30129417:4(1-23)Online publication date: 13-Dec-2017
  • (2016)Facial Expression Recognition in Daily Life by Embedded Photo Reflective Sensors on Smart EyewearProceedings of the 21st International Conference on Intelligent User Interfaces10.1145/2856767.2856770(317-326)Online publication date: 7-Mar-2016
  • (2016)Face-Off: A Face Reconstruction Technique for Virtual Reality (VR) ScenariosComputer Vision – ECCV 2016 Workshops10.1007/978-3-319-46604-0_35(490-503)Online publication date: 18-Sep-2016
  • (2014)Exploring the use of hand-to-face input for interacting with head-worn displaysProceedings of the SIGCHI Conference on Human Factors in Computing Systems10.1145/2556288.2556984(3181-3190)Online publication date: 26-Apr-2014

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media