research-article

Eye-Wearable Technology for Machine Maintenance: Effects of Display Position and Hands-free Operation

Authors:

Xianjun Sam Zheng,

Cedric Foucault,

Patrik Matos da Silva,

Siddharth Dasari,

Stuart GooseAuthors Info & Claims

CHI '15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems

Pages 2125 - 2134

https://doi.org/10.1145/2702123.2702305

Published: 18 April 2015 Publication History

Abstract

Exciting developments in eye-wearable technology and its potential industrial applications warrant a thorough understanding of its advantages and drawbacks through empirical evidence. We conducted an experiment to investigate what characteristics of eye-wearable technology impact user performance in machine maintenance, which included a representative set of car maintenance tasks involving Locate, Manipulate, and Compare actions. Participants were asked to follow instructions displayed on one of four technologies: a peripheral eye-wearable display, a central eye-wearable display, a tablet, or a paper manual. We found a significant effect of display position: the peripheral eye-wearable display resulted in longer completion time than the central display; but no effect for hands-free operation. The technology effects were also modulated by different Tasks and Action types. We discuss the human factors implications for designing more effective eye-wearable technology, including display position, issues of monocular display, and how the physical proximity of the technology affects users' reliance level.

Supplementary Material

MP4 File (p2125-zheng.mp4)

Download
140.30 MB

References

[1]

Aleksy, M., Rissanen, M. J., Maczey, S., & Dix. M. Wearable computing in industrial service applications. Procedia Computer Science, 5:394--400, 2011.

[2]

Billinghurst, M., Bowskill, J., Jessop, M., & Morphett, J. A wearable spatial conferencing space. In Proc. 2nd International Symposium on Wearable Computers, 76--83. IEEE, 1998.

Digital Library

[3]

Caudell, T.P., & Mizell, D.W. Augmented reality: an application of heads-up display technology to manual manufacturing processes. In Proc. 25th Hawaii International Conf. on System Sciences, 659--669, 1992.

[4]

Dey, A. K., Salber, D., Abowd, G. D., & Futakawa, M. The conference assistant: Combining context-awareness with wearable computing. In Proc. 3rd International Symposium on Wearable Computers, 21--28. IEEE, 1999.

Digital Library

[5]

Friedrich, W. ARVIKA-augmented reality for development, production and service, In Proc. ISMAR, 34, 2002.

Digital Library

[6]

Gartner Says Smartglasses Will Bring Innovation to Workplace Efficiency. http://gtnr.it/1qqbXce.

[7]

Goose, S., Sudarsky, S., Zhang, X.& Navab, N. Speechenabled augmented reality supporting mobile industrial maintenance, Pervasive Computing, IEEE, 2(1): 65--70, 2003.

Digital Library

[8]

Henderson, S. & Feiner, S. Augmented Reality in the Psychomotor Phase of a Procedural Task, In Proc. of IEEE International Symposium on Mixed and Augmented Reality, 191--200, (2011).

Digital Library

[9]

Hung, G. K., & Ciuffreda, K. J. Models of the Visual System. Springer Science, 2002.

[10]

Kraut, R. E., Fussell, S. R., & Siegel, J. Visual information as a conversational resource in collaborative physical tasks. HCI, 18, 13--49, 2003.

Digital Library

[11]

Lee, J. D., & See, K. A. Trust in automation: Designing for appropriate reliance. Human Factors, 46(1):50--80, 2004.

[12]

Machinery Maintenance & Heavy Equipment Repair Services Market Research Report, 2014. http://bit.ly/1kVmv6N.

[13]

Mackay, W. E. Users and customizable software: A coadaptive phenomenon. PhD thesis, 1990.

[14]

Mann, S. Wearable computing. The Encyclopedia of HCI, 2nd Ed., 2013.

[15]

Mann, S., Lo, R. C., Ovtcharov, K., Gu, S., Dai, D., Ngan, C., & Ai, T. Realtime high dynamic range video for eyetap wearable computers, fpga- based seeing aids, and glasseye. In Proc. 25th CCECE, 1--6, 2012.

[16]

Neumann, U., & Majoros, A. E. Cognitive, performance, and systems issues for augmented reality applications in manufacturing and maintenance. In Proc. VRAIS, p4--12, 1998.

Digital Library

[17]

Ockerman, J. J., & Pritchett, A. R. Preliminary investigation of wearable computers for task guidance in aircraft inspection. In Proc. 2nd International Symposium on Wearable Computers 33--40. IEEE, 1998.

Digital Library

[18]

Parasuraman, R., & Riley, V. Humans and automation: Use, misuse, disuse, abuse. Human Factors, 39(2):230253, 1997.

[19]

Pineles, S. L., Velez, F. G., Isenberg, S. J., Fenoglio, Z., Birch, E., Nusinowitz, S., & Demer, J. L. Functional burden of strabismus: Decreased binocular summation and binocular inhibition. JAMA ophthalmology, 131(11):1413--1419, 2013.

[20]

Reiss, M., & Reiss, G. Ocular dominance: some family data. Laterality: Asymmetries of Body, Brain and Cognition, 2(1):7--16, 1997.

[21]

Richardson, M., Jones, G. & Torrance, M. Identifying the task variables that influence perceived object assembly complexity, Ergonomics, 47(9), 945--64, 2004.

[22]

Rhodes, B. J. The wearable remembrance agent: A system for augmented memory. Personal Technologies, 1(4):218--224, 1997.

[23]

Siegel, J., & Bauer, M. A field usability evaluation of a wearable system. In Proc. 1st International Symposium on Wearable Computers 18--22. IEEE, 1997.

Digital Library

[24]

Siewiorek, D., Smailagic, A., Bass, L., Siegel, J., Martin, R., & Bennington, B. Adtranz: a mobile computing system for maintenance and collaboration. In Proc. 16th International Symposium on Wearable Computers, 25--25, IEEE, 1998.

Digital Library

[25]

Smailagic, A., & Siewiorek, D. Application design for wearable and context-aware computers. Pervasive Computing, IEEE, 1(4):20--29, 2002.

Digital Library

[26]

Smart Glass Market by Technology -- 2020. http://bit.ly/1thCiOK.

[27]

Starner, T. The challenges of wearable computing: Part 1. IEEE Micro, 21(4):44--52, 2001.

Digital Library

[28]

Starner, T., Mann, S., Rhodes, B., Levine, J., Healey, J., Kirsch, D., Picard, R. W., & Pentland, A. Augmented reality through wearable computing. Presence: Teleoperators and Virtual Environments, 6(4):386--398, 1997.

Digital Library

[29]

Stidwill, D., & Fletcher, R. Normal Binocular Vision: Theory, Investigation and Practical Aspects. John Wiley & Sons, 2010.

[30]

Thompson, C., Najjar, L. J., & Ockerman, J. J. Wearable computer based training and performance support systems. In Proc. the Interservice/Industry Training, Simulation & Education Conf., 1997.

[31]

Träskbäack, M. & Haller, M. Mixed reality training application for an oil refinery: user requirements. In Proc. of VRCAI, 324--327, 2004.

Digital Library

[32]

Trope, Y., & Liberman, N. Construal-level theory of psychological distance. Psychological review, 117(2):440, 2010.

[33]

Weaver, K. A., Baumann, H., Starner, T., Iben, H., & Lawo, M. An empirical task analysis of warehouse order picking using head-mounted displays. In Proc. of the SIGCHI, 1695--1704, 2010.

Digital Library

[34]

Wickens, C. D. Processing resources in attention. (Parasuraman R, Davies R), editors. Varieties of attention, 1984.

[35]

Williams, L. E. & Bargh, J. A. Keeping one's distance the influence of spatial distance cues on aect and evaluation. Psychological Science, 19(3):302--308, 200.

[36]

World Vehicle Population Tops 1 Billion Units WardsAuto. http://bit.ly/1jugNFm.

Cited By

Rettinger MSteinhaus JHackenberg ALehr LMüller NSchöffel MPandit SMayer JHolzmann-Littig CRigoll GSchmaderer C(2025)Potential of digital technologies in counteracting long-standing deficits in hemodialysis machine trainingScientific Reports10.1038/s41598-025-89435-w15:1Online publication date: 14-Feb-2025
https://doi.org/10.1038/s41598-025-89435-w
Arora PSong YSingh RVaradharajan SKimmel EHuang KHaynes MStarner TKostakos VKay JHoang T(2024)Comfortably Going Blank: Optimizing the Position of Optical Combiners for Monocular Head-Worn Displays During InactivityProceedings of the 2024 ACM International Symposium on Wearable Computers10.1145/3675095.3676628(148-151)Online publication date: 5-Oct-2024
https://dl.acm.org/doi/10.1145/3675095.3676628
Mosur PKimmel EArora PSingh RMadiwale AKang JStarner TKostakos VKay JHoang T(2024)Stepping into AR: Exploring Optimal Positioning for Monocular Head-Worn Displays for Reading on the GoCompanion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/3675094.3678383(844-850)Online publication date: 5-Oct-2024
https://dl.acm.org/doi/10.1145/3675094.3678383
Show More Cited By

Index Terms

Eye-Wearable Technology for Machine Maintenance: Effects of Display Position and Hands-free Operation
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms

Recommendations

Natural group binding and cross-display object movement methods for wearable devices
MobileHCI '16: Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services

As wearable devices become more popular, situations where there are multiple persons present with such devices will become commonplace. In these situations, wearable devices could support collaborative tasks and experiences between co-located persons ...
PressTact: Side Pressure-Based Input for Smartwatch Interaction
CHI EA '16: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems

Smartwatches have gained a lot of public interest as one of the most popular wearable devices in recent times, but their diminutive touch screens mar the user experiences. The small screen of watch suffers from visual occlusion and the fat finger ...
Wearable remote control of a mobile device: comparing one- and two-handed interaction
MobileHCI '14: Proceedings of the 16th international conference on Human-computer interaction with mobile devices & services

While wearable technologies are suitable for remotely controlling mobile devices, few studies have examined user preferences for one- or two-handed touch interaction with these wearables, especially when worn on the wrist and hand area. As these ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems

April 2015

4290 pages

ISBN:9781450331456

DOI:10.1145/2702123

General Chairs:
Bo Begole
Huawei, USA
,
Jinwoo Kim
Yonsei University, Korea
,
Program Chairs:
Kori Inkpen
Microsoft Research, USA
,
Woontack Woo
KAIST, Korea

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 April 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '15

Sponsor:

SIGCHI

CHI '15: CHI Conference on Human Factors in Computing Systems

April 18 - 23, 2015

Seoul, Republic of Korea

Acceptance Rates

CHI '15 Paper Acceptance Rate 486 of 2,120 submissions, 23%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

74
Total Citations
View Citations
1,543
Total Downloads

Downloads (Last 12 months)67
Downloads (Last 6 weeks)7

Reflects downloads up to 07 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Rettinger MSteinhaus JHackenberg ALehr LMüller NSchöffel MPandit SMayer JHolzmann-Littig CRigoll GSchmaderer C(2025)Potential of digital technologies in counteracting long-standing deficits in hemodialysis machine trainingScientific Reports10.1038/s41598-025-89435-w15:1Online publication date: 14-Feb-2025
https://doi.org/10.1038/s41598-025-89435-w
Arora PSong YSingh RVaradharajan SKimmel EHuang KHaynes MStarner TKostakos VKay JHoang T(2024)Comfortably Going Blank: Optimizing the Position of Optical Combiners for Monocular Head-Worn Displays During InactivityProceedings of the 2024 ACM International Symposium on Wearable Computers10.1145/3675095.3676628(148-151)Online publication date: 5-Oct-2024
https://dl.acm.org/doi/10.1145/3675095.3676628
Mosur PKimmel EArora PSingh RMadiwale AKang JStarner TKostakos VKay JHoang T(2024)Stepping into AR: Exploring Optimal Positioning for Monocular Head-Worn Displays for Reading on the GoCompanion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/3675094.3678383(844-850)Online publication date: 5-Oct-2024
https://dl.acm.org/doi/10.1145/3675094.3678383
Song YArora PVaradharajan SSingh RHaynes MStarner T(2024)Looking From a Different Angle: Placing Head-Worn Displays Near the NoseProceedings of the Augmented Humans International Conference 202410.1145/3652920.3652946(28-45)Online publication date: 4-Apr-2024
https://dl.acm.org/doi/10.1145/3652920.3652946
Alhakamy A(2024)Extended Reality (XR) Toward Building Immersive Solutions: The Key to Unlocking Industry 4.0ACM Computing Surveys10.1145/365259556:9(1-38)Online publication date: 25-Apr-2024
https://dl.acm.org/doi/10.1145/3652595
Wu GQian JCastelo Quispe SChen SRulff JSilva C(2024)ARTiST: Automated Text Simplification for Task Guidance in Augmented RealityProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642772(1-24)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642772
Bahnsen KTiemann LPlabst LGrundgeiger T(2024)Augmented Reality Cues Facilitate Task Resumption after Interruptions in Computer-Based and Physical TasksProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642666(1-16)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642666
Bohus DAndrist SSaw NParadiso AChakraborty IRad M(2024)SIGMA: An Open-Source Interactive System for Mixed-Reality Task Assistance Research – Extended Abstract2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)10.1109/VRW62533.2024.00241(889-890)Online publication date: 16-Mar-2024
https://doi.org/10.1109/VRW62533.2024.00241
Song YArora PSingh RVaradharajan SHaynes MStarner T(2023)Going Blank Comfortably: Positioning Monocular Head-Worn Displays When They are InactiveProceedings of the 2023 ACM International Symposium on Wearable Computers10.1145/3594738.3611375(114-118)Online publication date: 8-Oct-2023
https://dl.acm.org/doi/10.1145/3594738.3611375
Lin GLi JFazly APavlovic VTruong K(2023)Identifying Multimodal Context Awareness Requirements for Supporting User Interaction with Procedural VideosProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581006(1-17)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581006
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten