skip to main content
10.1145/3050385.3050387acmotherconferencesArticle/Chapter ViewAbstractPublication Pagesergo-iaConference Proceedingsconference-collections
research-article

User evaluation of an augmented reality prototype for expert/field operator remote assistance in aeronautics

Published: 06 July 2016 Publication History

Abstract

The field of aeronautic maintenance is more and more demanding and complex. There is a rising demand for systems to help operators in their activities. Augmented reality is a recurring solution, allowing to display virtual content (e.g. documentation) over a real scene. We conceived the TAC system (Collaborative Remote Assistance), which uses augmented reality to improve the collaboration between an operator and a remote expert. In this article, we present an end-user evaluation of the TAC prototype, validating the use of augmented reality as a support for operator-expert communication.

References

[1]
Anderson, J.R. Acquisition of cognitive skill. Psychological Review (1982), 89(4), 369--406.
[2]
Azuma, R. & al. Recent advances in augmented reality. IEEE Comput. Graph. Appl. (2001), 21(6):34--47.
[3]
Bauer,M., Heiber, T., Kortuem, G. & Segall, Z. A collaborative wearable system with remote sensing. In ISWC '98: Proceedings of the 2nd IEEE International Symposium on Wearable Computers, (1998). page 10, Washington, DC, USA, 1998. IEEE Computer Society
[4]
Bottecchia, S. Le système TAC: Téléassistance Collaborative. Réalité augmentée et NTIC au service des experts et des opérateurs dans le cadre d'une tâche de maintenance industrielle supervisée. Thèse de Doctorat, Université Paul Sabatier (2010), Toulouse, France.
[5]
Brangier, E. & Barcenilla, J. Concevoir un produit facile à utiliser : Adapter les technologies à l'homme. (2003) Edition d'organisation, Paris.
[6]
Caverni, J.P. Psychologie de l'expertise : éléments d'introduction. Psychologie Française, n° spécial, Psychologie de l'expertise, (1988) 33(3), 114--125.
[7]
Caverni, J.P. La verbalisation comme source d'observables pour l'étude du fonctionnement cognitif. In Psychologie cognitive : modéles et méthodes. J.P Caverni, C. Bastien, P. Mendelsohn & G. Tiberghien (Eds.) Grenoble, P.U.G., (1991) 253--273.
[8]
Chase, W.G., & Ericsson, K.A. Skill and working memory. In G.H. Bower (Ed.), the psychology of learning and motivation. New-York: Academic Press. (1982) 16, 1--58.
[9]
Chase, W.G., & Simon, H.A. Perception in chess. Cognitive Psychology, (1973) 4, 55--81.
[10]
Clark, H.H. & Brennan, S.E. Perspectives on socially shared cognition. In American Psychological Association, ch. Grounding in Communication, L. Resnick, J. Levine, and S. Teasley, editors, Washington. (1991) 127--149
[11]
Clay, A., Wolff, M., & Mollard, R. User-designed movement interactions: an exploratory study for natural interactions. European Journal of Automation (EJA), (2014) 4-5-6, 453--472.
[12]
De Bonnefoy, N. Système Informationnel Mixte, Ubiquitaire et Intuitif - Support aux opérateurs nomades de maintenance aéronautique. Thèse de doctorat, (2009). Université Paul Sabatier, Toulouse, France.
[13]
Doherty-Sneddon, G., Anderson, A., O'Malley, C., Langton, S., Garrod, S. & Bruce, V. Face-to-face and video mediated communication: A comparison of dialogue structure and task performance. In Journal of Experimental Psychology, (1997) 3, 105--125.
[14]
Dupont, G. The dirty dozen errors in maintenance. In Human Factors Issues in Aircraft Maintenance and Inspection Meeting 11 Proceedings, Washington, DC: FAA (1997).
[15]
EASA. Règlement (CE) No 2042/2003. (2003). Consulté le 19 septembre 2015 sur http://eurlex.europa.eu/LexUriServ/LexUriServ.do?uri=CONSLEG:2003R2042:20060510:FR:PDF
[16]
Falzon, P. Ergonomie cognitive du dialogue. Grenoble, PUG (1989)
[17]
Grusenmeyer, C. Les activités de maintenance: exploitation d'une enquête et analyse ergonomique dans une entreprise. Note Scientifique et technique NS 311 de l'Institut National de Recherche et de Sécurité (INRS). (2013). Consulté le 19 septembre 2015 sur http://lara.inist.fr/handle/2332/2585
[18]
Henderson, S., and Feiner, S. Exploring the benefits of augmented reality documentation for maintenance and repair. Visualization and Computer Graphics, IEEE Transactions on, (2011) 17(10), 1355--1368.
[19]
Hoc, J.M. L'extraction des connaissances et l'aide à l'activité humaine. Intellectica, 12, (1991), 33--64.
[20]
Karsenty, L. Communication, Incompréhension et Gestion des Risques. Cours du diplôme universitaire Bases Facteurs Humains pour la Conception de Systèmes Homme Machine en Aéronautique. (2014). Université Paris Descartes.
[21]
Leplat, J. The elicitation of expert knowledge. In E. Hollnagel, G.Mancini & D.D. Woods (Eds.), Intelligent decision support in process environments. Berlin, Springer-Verlag, (1986) 107--122.
[22]
Louis, A., & Wolff, M. Analyse du développement de l'expertise dans le domaine del'industrie automobile : réflexions et perspectives. In L'humain au cœur des systèmes et de leur développement. D. Galarreta, P. Girard, J.-C. Tucoulou, & M. Wolff (Eds.). Ergo'IA 2008. Biarritz, France. (2008) 259--260
[23]
Morel, C., et Dos Santos Pereira, G. Psychologie de l'expertise et modélisation des connaissances pour des opérations de maintenance en aéronautique. Rapport de stage Master 1<sup>ère</sup> année en ergonomie, (2015). Université Paris Descartes.
[24]
Neumann, U., and Majoros, A. Cognitive, performance, and systems issues for augmented reality applications in manufacturing and maintenance. In VRAIS'98 Proceedings of the Virtual Reality Annual International Symposium, Washington, DC, USA. (1998). IEEE Computer Society, p4.
[25]
Patankar, M. Root cause analysis of rule violations by aviation maintenance technicians. Technical Report Grant No. 2001-G-001 FAA Office of Aviation Medicine, (2002) Washington, DC.
[26]
Rasmussen, J. Information processing and human-machine interaction. Amsterdam, (1986) North Holland Publisher.
[27]
Reason, J. L'erreur humaine. (1993) Presses Universitaires de France
[28]
Reason, J. & Hobbs, A. Managing Maintenance Error : a practical guide. Hampshire (UK), Ashgate publishing company, (2003) 183p.
[29]
Sakata, S., Kurata, T., Kato, T., Kourogi, M., and Kuzuoka, H. WACL: Supporting telecommunications using wearable active camera with laser pointer. In Proceedings of the 7th IEEE International Symposium on Wearable Computers (ISWC'03), Washington, DC, USA. (2003) IEEE Computer Society; P53
[30]
Shelton, B.E., and Hedley, N.R. Using augmented reality for teaching earth-sun relationships to undergraduate geography students. In First IEEE International Augmented Reality Toolkit Workshop, (2002) Darmstadt, Germany.
[31]
Stedmon, A.W., and Stone, R.J. Re-viewing reality: human factors of synthetic training environments. In International Journal of Human-Computer Studies, (2001). 55(4) :675--698.
[32]
Tang, A., Owen, C., Biocca, F. & Mou, W. Comparative effectiveness of augmented reality in object assembly. In CHI'03: Proceedings of the SIGCHI conference on Human factors in computing systems, 73--80, (2003). New York, NY, USA. ACM.
[33]
UKCAA Aircraft maintenance incident analysis. Reference: CAA paper 2007/04, (United Kingdom Civil Aviation Authority) (2009).
[34]
Wolff, M., Rouanet, H., & Grosgeorge, B. Analyse d'une expertise professionnelle : l'évaluation des jeunes talents au basket-ball de haut niveau. Le Travail Humain, (1998) 61, 3, 281--303
[35]
Zafiharimalala, H. Étude ergonomique pour la consultation sur écran de petite taille de la documentation de maintenance aéronautique Thèse de doctorat, Université Toulouse le Mirail-Toulouse II (2011).
[36]
Zhu, J. & al. An authorable context-aware augmented reality system to assist the maintenance technicians. The International Journal of Advanced Manufacturing Technology. (2013) 66--9, 1699--1714.
[37]
Kubicki, S., Wolff, M., Lepreux, S., & Kolski, C. RFID interactive tabletop application with tangible objects: exploratory study to observe young children' behaviors. Personal and Ubiquitous Computer. (2015)
[38]
Department of Transport, Air Accident Investigation Branch. Report on the accident to BAC one-eleven, G-BJRT over Didcot, Oxfordshire on 10 june 1990. 1992. ISBN 011 551099 0

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
Ergo'IA '16: Proceedings of the 15th Ergo'IA "Ergonomie Et Informatique Avancée" Conference
July 2016
163 pages
ISBN:9781450347853
DOI:10.1145/3050385
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 July 2016

Permissions

Request permissions for this article.

Check for updates

Qualifiers

  • Research-article

Conference

ERGO'IA
ERGO'IA: Ergo'IA 2016
July 6 - 8, 2016
Bidart, France

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 59
    Total Downloads
  • Downloads (Last 12 months)3
  • Downloads (Last 6 weeks)0
Reflects downloads up to 16 Jan 2025

Other Metrics

Citations

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media