Skip to main content

Advertisement

Springer Nature Link
Log in

Impact of monitor-based augmented reality for on-site industrial manual operations

  • Original Article
  • Published:
Cognition, Technology & Work Aims and scope Submit manuscript

Abstract

This work evaluates the impact of augmented reality (AR) technology to support operators during manual industrial tasks. The work focuses specifically on monitor-based augmented reality as a solution to provide instructions to the operator. Instructions are superimposed directly onto a video representation of the physical workspace and are displayed on a standard monitor. In contrast to previous AR solutions proposed to support manual tasks, the current work is more industrially acceptable because it meets most of the industrial requirements and it is cost effective for a deployment in an industrial environment. The developed prototype is described and evaluated by means of a user study to compare the monitor-based augmented reality solution to provide instructions and the traditional method. The test shows that AR can be a valid substitute to support the operators during manual tasks because it allows them to be more time efficient and it reduces their mental workload compared to traditional instructional manuals.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

Explore related subjects

Discover the latest articles and news from researchers in related subjects, suggested using machine learning.

References

  • Agrawala M, Phan D, Heiser J, Haymaker J, Klingner J, Hanrahan P, Tversky B (2003) Designing effective step-by-step assembly instructions. In: ACM SIGGRAPH 2003, New York, USA, ACM Press, pp 828–837

  • Alvarez H, Aguinaga I, Borro D (2011) Providing guidance for maintenance operations using automatic markerless augmented reality system. In: IEEE international symposium on mixed and augmented reality, pp 181–190

  • Azuma RT (1997) A survey of augmented reality. Presence 6(4):355–385

    Article  Google Scholar 

  • Bach C, Scapin DL (2004) Obstacles and perspectives for evaluating mixed reality systems usability. In: Acte du Workshop MIXER, IUI-CADUI, vol 4

  • Bai Z, Blackwell AF (2012) Analiytic review of usability evaluation in ISMAR. Interact Comput 24:450–460

    Article  Google Scholar 

  • Baird KM, Barfield W (1999) Evaluating the effectiveness of augmented reality displays for a manual assembly task. Virtual Real 4(4):250–259

    Article  Google Scholar 

  • Billinghurst M, Hakkarainen M, Woodward C (2008) Augmented assembly using a mobile phone. In: Proceedings of the 7th international conference on mobile and ubiquitous multimedia (MUM), IEEE, pp 84–87

  • Caudell TP, Mizell DW (1992) Augmented reality: an application of heads-up display technology to manual manufacturing processes. In: Proceedings of the twenty-fifth Hawaii international conference on system sciences, pp 659–669

  • De Crescenzio F, Fantini M, Persiani F, Di Stefano L, Azzari P, Salti S (2011) Augmented reality for aircraft maintenance training and operations support. IEEE Comput Graph Appl 31(1):96–101

    Article  Google Scholar 

  • Didier J-Y, Roussel D, Mallem M, Otmane S, Naudet S et al (2005) AMRA: augmented reality assistance in train maintenance tasks. In: 4th ACM/IEEE international symposium on mixed and augmented reality (ISMAR)—workshop industrial augmented reality, pp 1–10

  • Dünser A, Grassert R, Seichter H, Billinghurst M (2007) Applying HCI principles to AR systems design. In: Proceedings of MRUI’07: 2nd international workshop at the IEEE virtual reality conference

  • Dünser A, Grasset R, Billinghurst M (2008) A survey of evaluation techniques used in augmented reality studies. Human Interface Technology Laboratory New Zealand, pp 1–27

  • Feiner S, Macintyre B, Seligmann D (1993) Knowledge-based augmented reality. Commun ACM 36(7):53–62

    Article  Google Scholar 

  • Fite-Georgel P (2011) Is there a reality in Industrial Augmented Reality? In: 10th IEEE international symposium on mixed and augmented reality, IEEE, pp 201–210

  • Gharsellaoui A, Oliver J, Garbaya S (2011) Benchtop augmented reality interface for enhanced manual assembly. In: IEEE aerospace and electronic system society (AESS)—France chapter technical event, pp 1–6

  • Hart SG, Staveland LE (1988) Development of NASA-TLX (task load index): results of empirical and theoretical research. In: Human mental workload, vol 1, pp 139–183

  • Henderson SJ, Feiner S (2011a) Exploring the benefits of augmented reality documentation for maintenance and repair. IEEE Trans Vis Comput Graph 17(10):1355–1368

    Article  Google Scholar 

  • Henderson SJ, Feiner S (2011b) Augmented reality in the psychomotor phase of a procedural task. In: 10th IEEE international symposium on mixed and augmented reality, IEEE, pp 191–200

  • Klinker G, Creighton O, Dutoit A H, Kobylinski R, Vilsmeier C, Brugge B (2001) Augmented maintenance of powerplants: a prototyping case study of a mobile AR system. In: Proceedings IEEE and ACM international symposium on augmented reality, pp 124–133

  • Liu C, Huot S, Diehl J, Mackay W, Beaudouin-Lafon M (2012) Evaluating the benefits of real-time feedback in mobile augmented reality with hand-held devices. In: Proceedings of the 2012 ACM annual conference on human factors in computing systems—CHI ’12, pp 2973–2976

  • Livingston MA (2005) Evaluating human factors in augmented reality systems. Comput Graph Appl IEEE 25(6):6–9

    Article  Google Scholar 

  • Livingston MA (2006) Quantification of visual capabilities using augmented reality displays. In: IEEE/ACM international symposium on mixed and augmented reality, ISMAR, pp 3–12

  • Markov-Vetter D, Staadt O (2013) A pilot study for augmented reality supported procedure guidance to operate payload racks on-board the international space station. In: IEEE international symposium on mixed and augmented reality (ISMAR), pp 1–6

  • Milgram P, Takemura H, Utsumi A, Kishino F (1994) Augmented reality: a class of displays on the reality–virtuality continuum. In: Proceedings of telemanipulator and telepresence technologies, SPIE, vol 2351, pp 282–292

  • Mulloni A, Seichter H, Schmalstieg D (2011) Handheld augmented reality indoor navigation with activity-based instructions. In: Proceedings of the 13th international conference on human computer interaction with mobile devices and services, ACM, pp 211–220

  • Nakanishi M, Sato T (2012) Application of digital manuals with a retinal imaging display in manufacturing: behavioral, physiological, and psychological effects on workers. Human Factors and Ergonomics in Manufacturing and Service Industries

  • Navab N (2004) Developing killer apps for industrial augmented reality. IEEE Comput Graph Appl 24(3):16–20

    Article  Google Scholar 

  • Nee AYC, Ong SK, Chryssolouris G, Mourtzis D (2012) Augmented reality applications in design and manufacturing. CIRP Ann Manuf Technol 61(2):657–679

    Article  Google Scholar 

  • Neumann U, Majoros A (1998) Cognitive, performance, and systems issues for augmented reality applications in manufacturing and maintenance. In: Virtual reality annual international symposium, IEEE, pp 4–11

  • Ong SK, Yuan ML, Nee AYC (2008) Augmented reality applications in manufacturing: a survey. Int J Prod Res 46(10):2707–2742

    Article  MATH  Google Scholar 

  • Ozuysal M, Calonder M, Lepetit V, Fua P (2010) Fast keypoint recognition using random ferns. IEEE Trans Pattern Anal Mach Intell 32(3):448–461

    Article  Google Scholar 

  • Radkowski R, Oliver J (2013) Natural feature tracking augmented reality for on-site assembly assistance systems. In: Virtual, augmented and mixed reality. Systems and applications, pp 281–290

  • Radkowski R, Herrema J, Oliver J (2015) Augmented reality-based manual assembly support with visual features for different degrees of difficulty. Int J Hum Comput Interact 31(5):337–349

    Article  Google Scholar 

  • Re GM, Bordegoni M (2014) An augmented reality framework for supporting and monitoring operators during maintenance tasks. Human–Computer Interaction, Part II, HCII 2014, LNCS 8526, Springer, pp 443–454

  • Reiners D, Stricker D, Klinker G, Stefan M (1998) Augmented reality for construction tasks: doorlock assembly. In: IEEE and ACM international workshop on augmented reality (IWAR), pp 31–46

  • Richardson M, Jones G, Torrance M (2004) Identifying the task variables that influence perceived object assembly complexity. Ergonomics 47(9):945–964

    Article  Google Scholar 

  • Sausman J, Samoylov A, Regli SH, Hopps M (2012) Effect of eye and body movement on augmented reality in the manufacturing domain. In: IEEE international symposium on mixed and augmented reality (ISMAR), pp 315–316

  • Shepard RN, Metzel J (1971) Mental rotation of three-dimensional objects. Science 171(3972):701–703

    Article  Google Scholar 

  • Tang A, Owen C, Biocca F, Mou W (2003) Comparative effectiveness of augmented reality in object assembly. In: Proceedings of the conference on human factors in computing systems (CHI), New York, ACM Press, pp 73–80

  • VanWaardhuizen M, Oliver J, Gimeno J (2011) Table top augmented reality system for conceptual design and prototyping. In: ASME world conference on innovative virtual reality (WINVR), pp 1–11

  • Wiedenmaier S, Oehme O, Schmidt L, Luczak H (2003) Augmented reality (AR) for assembly processes design and experimental evaluation. Int J Hum Comput Interact 16(3):497–514

    Article  Google Scholar 

  • Yuan ML, Ong SK, Nee AYC (2005) Assembly guidance in augmented reality environments using a virtual interactive tool. In: Singapore-MIT alliance symposium, pp 1–9

Download references

Author information

Authors and Affiliations

  1. Mechanical Department, Politecnico di Milano, Via La Masa 1, 20156, Milan, Italy

    Guido Maria Re & Monica Bordegoni

  2. Virtual Reality Application Center, Iowa State University, 1620 Howe Hall, Ames, IA, 50011, USA

    James Oliver

Authors
  1. Guido Maria Re
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. James Oliver
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Monica Bordegoni
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Guido Maria Re.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Re, G.M., Oliver, J. & Bordegoni, M. Impact of monitor-based augmented reality for on-site industrial manual operations. Cogn Tech Work 18, 379–392 (2016). https://doi.org/10.1007/s10111-016-0365-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10111-016-0365-3

Keywords