poster

Augmented object selection through smart glasses

Authors:

Jéssica Franco,

Diogo CabralAuthors Info & Claims

MUM '19: Proceedings of the 18th International Conference on Mobile and Ubiquitous Multimedia

Article No.: 47, Pages 1 - 5

https://doi.org/10.1145/3365610.3368416

Published: 26 November 2019 Publication History

Abstract

Several interaction methods for smart glasses have been studied, but it is not clear which method could be the best to interact with augmented objects. In this study, an Augmented Reality (AR) marker-based application for smart glasses was developed, implementing three different interaction methods for marker selection: one using mid-air hand gestures, other using head movements and double-tap in the glasses, and the last one using a handheld controller. We studied the users' interaction times, preferences, and their willingness to perform the interaction method in public. We find that users' felt more comfortable using a familiar handheld controller. However, the solution with the smart glass's tap function and head movement got results close to the results of smart glass's controller.

References

[1]

Ronald T. Azuma, Yohan Baillot, Reinhold Behringer, Steven Feiner, Simon Julier, and Blair MacIntyre, 'Recent advances in augmented reality', IEEE Computer Graphics and Applications, vol. 21, no. 6, pp. 34--47, Dec. 2001.

Digital Library

[2]

Gilles Bailly, Jörg Müller, Michael Rohs, Daniel Wigdor, and Sven Kratz, 'ShoeSense: a new perspective on gestural interaction and wearable applications', in Proceedings of the 2012 ACM annual conference on Human Factors in Computing Systems - CHI '12, Austin, Texas, USA, 2012, p. 1239.

[3]

David Dobbelstein, Philipp Hock, and Enrico Rukzio, 'Belt: An Unobtrusive Touch Input Device for Head-worn Displays', in Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems - CHI '15, Seoul, Republic of Korea, 2015, pp. 2135--2138.

[4]

Tovi Grossman, Xiang Anthony Chen, and George Fitzmaurice, 'Typing on Glasses: Adapting Text Entry to Smart Eyewear', in Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services - MobileHCI '15, Copenhagen, Denmark, 2015, pp. 144--152.

Digital Library

[5]

Yi-Ta Hsieh, Antti Jylhä, Valeria Orso, Luciano Gamberini, and Giulio Jacucci, 'Designing a Willing-to-Use-in-Public Hand Gestural Interaction Technique for Smart Glasses', in Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems - CHI '16, Santa Clara, California, USA, 2016, pp. 4203--4215.

Digital Library

[6]

Yi-Ta Hsieh, Valeria Orso, Salvatore Andolina, Manuela Canaveras, Diogo Cabral, Anna Spagnolli, Luciano Gamberini, and Giulio Jacucci, 'Interweaving Visual and Audio-Haptic Augmented Reality for Urban Exploration', in Proceedings of the 2018 on Designing Interactive Systems Conference 2018 - DIS '18, Hong Kong, China, 2018, pp. 215--226.

Digital Library

[7]

Da-Yuan Huang, Liwei Chan, Shuo Yang, Fan Wang, Rong-Hao Liang, De-Nian Yang, Yi-Ping Hung, and Bing-Yu Chen, 'DigitSpace: Designing Thumb-to-Fingers Touch Interfaces for One-Handed and Eyes-Free Interactions', in Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems - CHI '16, Santa Clara, California, USA, 2016, pp. 1526--1537.

Digital Library

[8]

Wolf Kienzle and Ken Hinckley, 'LightRing: always-available 2D input on any surface', in Proceedings of the 27th annual ACM symposium on User interface software and technology - UIST '14, Honolulu, Hawaii, USA, 2014, pp. 157--160.

[9]

Marion Koelle, Abdallah El Ali, Vanessa Cobus, Wilko Heuten, and Susanne CJ Boll, 'All about Acceptability?: Identifying Factors for the Adoption of Data Glasses', in Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems - CHI '17, Denver, Colorado, USA, 2017, pp. 295--300.

Digital Library

[10]

Marion Koelle, Matthias Kranz, and Andreas Möller, 'Don't look at me that way!: Understanding User Attitudes Towards Data Glasses Usage', in Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services - MobileHCI '15, Copenhagen, Denmark, 2015, pp. 362--372.

Digital Library

[11]

Lik-Hang Lee and Pan Hui, 'Interaction Methods for Smart Glasses: A Survey', IEEE Access, vol. 6, pp. 28712--28732, 2018.

[12]

Roman Lissermann, Jochen Huber, Aristotelis Hadjakos, and Max Mühlhäuser, 'EarPut: augmenting behind-the-ear devices for ear-based interaction', in CHI '13 Extended Abstracts on Human Factors in Computing Systems on - CHI EA '13, Paris, France, 2013, p. 1323.

Digital Library

[13]

Rufat Rzayev, Paweł W. Woźniak, Tilman Dingler, and Niels Henze, 'Reading on Smart Glasses: The Effect of Text Position, Presentation Type and Walking', in Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI '18, Montreal QC, Canada, 2018, pp. 1--9.

[14]

Ying-Chao Tung, Chun-Yen Hsu, Han-Yu Wang, Silvia Chyou, Jhe-Wei Lin, Pei-Jung Wu, Andries Valstar, and Mike Y. Chen, 'User-Defined Game Input for Smart Glasses in Public Space', in Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems - CHI '15, Seoul, Republic of Korea, 2015, pp. 3327--3336.

Digital Library

[15]

Cheng-Yao Wang, Wei-Chen Chu, Po-Tsung Chiu, Min-Chieh Hsiu, Yih-Harn Chiang, and Mike Y. Chen, 'PalmType: Using Palms as Keyboards for Smart Glasses', in Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services - MobileHCI '15, Copenhagen, Denmark, 2015, pp. 153--160.

Digital Library

[16]

Shanhe Yi, Zhengrui Qin, Ed Novak, Yafeng Yin, and Qun Li, 'GlassGesture: Exploring head gesture interface of smart glasses', in IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications, San Francisco, CA, USA, 2016, pp. 1--9.

[17]

Chun Yu, Ke Sun, Mingyuan Zhong, Xincheng Li, Peijun Zhao, and Yuanchun Shi, 'One-Dimensional Handwriting: Inputting Letters and Words on Smart Glasses', in Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems - CHI '16, Santa Clara, California, USA, 2016, pp. 71--82.

Digital Library

Cited By

Räthel FSchmidt SGabel JPosniak LSteinicke F(2024)An Evaluation of Targeting Methods in Spatial Computing Interfaces with Visual DistractionsProceedings of the 30th ACM Symposium on Virtual Reality Software and Technology10.1145/3641825.3687712(1-11)Online publication date: 9-Oct-2024
https://dl.acm.org/doi/10.1145/3641825.3687712
Zhang HLi LXue CWei XZhou Y(2024)HSM:Hand Surface Menu Solution for Interaction in VR2024 10th International Conference on Virtual Reality (ICVR)10.1109/ICVR62393.2024.10869121(167-176)Online publication date: 24-Jul-2024
https://doi.org/10.1109/ICVR62393.2024.10869121
Spittle BFrutos-Pascual MCreed CWilliams I(2023)A Review of Interaction Techniques for Immersive EnvironmentsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.317480529:9(3900-3921)Online publication date: 1-Sep-2023
https://doi.org/10.1109/TVCG.2022.3174805
Show More Cited By

Index Terms

Augmented object selection through smart glasses
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Mixed / augmented reality

Recommendations

User-Defined Game Input for Smart Glasses in Public Space
CHI '15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems

Smart glasses, such as Google Glass, provide always-available displays not offered by console and mobile gaming devices, and could potentially offer a pervasive gaming experience. However, research on input for games on smart glasses has been ...
Haptic feedback of gaze gestures with glasses: localization accuracy and effectiveness
UbiComp/ISWC'15 Adjunct: Adjunct Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2015 ACM International Symposium on Wearable Computers

Wearable devices including smart eyewear require new interaction methods between the device and the user. In this paper, we describe our work on the combined use of eye tracking for input and haptic (touch) stimulation for output with eyewear. Input ...
Eye Blink Detection for Smart Glasses
ISM '13: Proceedings of the 2013 IEEE International Symposium on Multimedia

Eye blink is a quick action of closing and opening of the eyelids. Eye blink detection has a wide range of applications in human computer interaction and human vision health care research. Existing approaches to eye blink detection often cannot suit ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

MUM '19: Proceedings of the 18th International Conference on Mobile and Ubiquitous Multimedia

November 2019

462 pages

ISBN:9781450376242

DOI:10.1145/3365610

General Chair:
Fabio Paternò
CNR-ISTI, Italy
,
Program Chairs:
Giulio Jacucci
University of Helsinki, Finland
,
Michael Rohs
University of Hannover, Germany
,
Carmen Santoro
CNR-ISTI, Italy

Copyright © 2019 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 November 2019

Check for updates

Author Tags

Qualifiers

Poster

Funding Sources

Fundação para a Ciência e Tecnologia

Conference

MUM 2019

MUM 2019: 18th International Conference on Mobile and Ubiquitous Multimedia

November 26 - 29, 2019

Pisa, Italy

Acceptance Rates

Overall Acceptance Rate 190 of 465 submissions, 41%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
360
Total Downloads

Downloads (Last 12 months)35
Downloads (Last 6 weeks)0

Reflects downloads up to 07 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Räthel FSchmidt SGabel JPosniak LSteinicke F(2024)An Evaluation of Targeting Methods in Spatial Computing Interfaces with Visual DistractionsProceedings of the 30th ACM Symposium on Virtual Reality Software and Technology10.1145/3641825.3687712(1-11)Online publication date: 9-Oct-2024
https://dl.acm.org/doi/10.1145/3641825.3687712
Zhang HLi LXue CWei XZhou Y(2024)HSM:Hand Surface Menu Solution for Interaction in VR2024 10th International Conference on Virtual Reality (ICVR)10.1109/ICVR62393.2024.10869121(167-176)Online publication date: 24-Jul-2024
https://doi.org/10.1109/ICVR62393.2024.10869121
Spittle BFrutos-Pascual MCreed CWilliams I(2023)A Review of Interaction Techniques for Immersive EnvironmentsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.317480529:9(3900-3921)Online publication date: 1-Sep-2023
https://doi.org/10.1109/TVCG.2022.3174805
Grafström AHolmgren MLinge SLagerberg TObaid M(2022)A Speculative Design Approach to Investigate Interactions for an Assistant Robot Cleaner in Food PlantsAdjunct Proceedings of the 2022 Nordic Human-Computer Interaction Conference10.1145/3547522.3547682(1-5)Online publication date: 8-Oct-2022
https://dl.acm.org/doi/10.1145/3547522.3547682
Papadopoulos TEvangelidis KKaskalis TEvangelidis GSylaiou S(2021)Interactions in Augmented and Mixed Reality: An OverviewApplied Sciences10.3390/app1118875211:18(8752)Online publication date: 20-Sep-2021
https://doi.org/10.3390/app11188752
Lee LBraud THosio SHui P(2021)Towards Augmented Reality Driven Human-City Interaction: Current Research on Mobile Headsets and Future ChallengesACM Computing Surveys10.1145/346796354:8(1-38)Online publication date: 4-Oct-2021
https://dl.acm.org/doi/10.1145/3467963
Faleel SGammon MFan KHuang DLi WIrani P(2021)HPUI: Hand Proximate User Interfaces for One-Handed Interactions on Head Mounted DisplaysIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2021.310649327:11(4215-4225)Online publication date: Nov-2021
https://doi.org/10.1109/TVCG.2021.3106493
Faleel SGammon MSakamoto YMenon CIrani PChoukou MTaiar RIrani PSeigneur J(2020)User gesture elicitation of common smartphone tasks for hand proximate user interfacesProceedings of the 11th Augmented Human International Conference10.1145/3396339.3396363(1-8)Online publication date: 27-May-2020
https://dl.acm.org/doi/10.1145/3396339.3396363

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten