Skip to main content
SpringerLink
Log in

Performance in computer-mediated work: the moderating role of level of automation

  • Original Article
  • Published:
Cognition, Technology & Work Aims and scope Submit manuscript

Abstract

Organizations require good performance from individuals to achieve their objectives. In view of the growing presence of technology, it becomes necessary to understand performance in the context of information systems. Previous research shows that knowledge and perceived usefulness factors have direct effects on performance. However, the literature also recognizes that there may be different man–machine arrangements to carry out the tasks (level of automation). This study, using a multi-disciplinary approach, evaluates empirically whether the level of intervention moderates the effects of knowledge and perceived usefulness on performance. A questionnaire was used to collect data from 201 users in different organizations and different functional areas. The structural equations model was used for analysis. The results show that the degree of automation moderates the direct relationships. Thus, in structured and proceduralized environments, at high levels of automation, the relevance of knowledge of the task may decrease, and at low levels of intervention, the relevance of perceived usefulness may fall.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2

Similar content being viewed by others

References

  • Alter S (1999) A general, yet useful theory of information systems. Commun Assoc Inf Syst 1:1–69

    Google Scholar 

  • Amalberti R (1998) Automation in aviation: a human factors perspective. In: Garland DJ, Wise J, Hopkin D (eds) Handbook of aviation human factors. Lawrence Erlbaum Associates, Hillsdale, pp 173–192

    Google Scholar 

  • Anderson JR (1989) A theory of the origins of human knowledge. Artif Intell 40(1–3):313–351

    Article  Google Scholar 

  • Axelsen M (2012) Continued use of intelligent decision aids and auditor knowledge: qualitative evidence. Paper presented at the AMCIS 2012 Proceedings

  • Bacharach SB, Bamberger P (1995) Beyond situational constraints: job resources inadequacy and individual performance at work. Hum Resour Manag Rev 5(2):79–102

    Article  Google Scholar 

  • Beattie BR, Taylor CR, Watts MJ (1985) The economics of production, 2nd edn. Wiley, New York

    Google Scholar 

  • Borman WC, White LA, Pulakos ED, Oppler SH (1991) Models of supervisory job performance ratings. J Appl Psychol 76(6):863–872

    Article  Google Scholar 

  • Braverman H (1998) Labor and monopoly capital: the degradation of work in the twentieth century, 25th edn. Monthly Review Press, New York

    Google Scholar 

  • Bravo ER, Santana M, Rodón J (2015) Information systems and performance: the role of technology, the task and the individual. Behav Inf Technol 34(3):247–260

    Article  Google Scholar 

  • Brislin RW, Freimanis C (1995) Back-translation: a tool for cross-cultural research. In: Sin-wai C, Pollar DE (eds) An encyclopaedia of translation: Chinese–English, English–Chinese, vol 1. The Chinese University Press, Hong Kong, pp 22–40

    Google Scholar 

  • Brynjolfsson E, Hitt L (1995) Information technology as a factor of production: the role of differences among firms. Econ Innov New Technol 3(3–4):183–200

    Article  Google Scholar 

  • Burke RJ, Cooper CL (2006) The new world of work and organizations: implications for human resource management. Hum Resour Manag Rev 16(2):83–85

    Article  Google Scholar 

  • Burke RJ, Ng E (2006) The changing nature of work and organizations: implications for human resource management. Hum Resour Manag Rev 16(2):86–94

    Article  Google Scholar 

  • Cacciabue PC, Carsten O, Vanderhaegen F (2014) Is there still a need for CTW? Cogn Technol Work 16(3):311–317

    Article  Google Scholar 

  • Dekker SW, Woods D (2002) MABA–MABA or abracadabra? Progress on human–automation co-ordination. Cogn Technol Work 4(4):240–244

    Article  Google Scholar 

  • Deng X, Doll WJ, Hendrickson AR, Scazzero JA (2005) A multi-group analysis of structural invariance: an illustration using the technology acceptance model. Inf Manag 42(5):745–759

    Article  Google Scholar 

  • Dewan S, Min C-K (1997) The substitution of information technology for other factors of production: a firm level analysis. Manag Sci 43(12):1660–1675

    Article  MATH  Google Scholar 

  • DeWinter JCF, Dodou D (2011) Why the Fitts list has persisted throughout the history of function allocation. Cogn Technol Work 16:1–11

    Article  Google Scholar 

  • Dinev T, McConnell AR, Smith HJ (2015) Research commentary—informing privacy research through information systems, psychology, and behavioral economics: thinking outside the “APCO” box. Inf Syst Res 26(4):639–655

    Article  Google Scholar 

  • Elias SM, Smith WL, Barney CE (2012) Age as a moderator of attitude towards technology in the workplace: work motivation and overall job satisfaction. Behav Inf Technol 31(5):453–467

    Article  Google Scholar 

  • Endsley MR (1995) Toward a theory of situation awareness in dynamic systems. Hum Factors J Hum Factors Ergon Soc 37(1):32–64

    Article  Google Scholar 

  • Endsley MR, Kaber DB (1999) Level of automation effects on performance, situation awareness and workload in a dynamic control task. Theor Issues Ergon Sci 42(3):462–492

    Google Scholar 

  • Fallon EF (2006) Allocation of functions: past, present, and future perspectives. In: Karwowski W (ed) International encyclopedia of ergonomics and human factors, 2nd edn. CRC Press, New York

    Google Scholar 

  • Frohm J, Lindström V, Stahre J, Winroth M (2008) Levels of automation in manufacturing. Ergon Int J Ergon Hum Factors 30(3)

  • Gefen D, Straub DW, Boudreau M-C (2000) Structural equation modeling and regression: guidelines for research practice. Commun Assoc Inf Syst 4:1–76

    Google Scholar 

  • Gefen D, Karahanna E, Straub DW (2003) Trust and TAM in online shopping: an integrated model. MIS Q 27(1):51–90

    Google Scholar 

  • Ghazizadeh M, Lee JD, Boyle LN (2012) Extending the technology acceptance model to assess automation. Cogn Technol Work 14(1):39–49

    Article  Google Scholar 

  • Goodhue D, Thompson RL (1995) Task-technology fit and individual performance. MIS Q 19(2):213–236

    Article  Google Scholar 

  • Hair JF, Black WC, Babin BJ, Anderson RE, Tatham RL (2006) Multivariate data analysis, 6th edn. Prentice-Hall, New Jersey

    Google Scholar 

  • Hesketh B, Neal A (1999) Technology and performance. In: Ilgen DR, Pulakos ED (eds) The changing nature of work performance: implications for staffing, motivation, and development. Jossey-Bass Inc, San Francisco, pp 1–18

    Google Scholar 

  • Hicks J (1963) The theory of wages, 2nd edn. Macmillan and Company, London

    Book  Google Scholar 

  • Hoc J-M, Lemoine M-P (1998) Cognitive evaluation of human–human and human–machine cooperation modes in air traffic control. Int J Aviat Psychol 8(1):1–32

    Article  Google Scholar 

  • Hoffman RR, Feltovich PJ, Ford KM, Woods DD, Klein G, Feltovich A (2002) A rose by any other name… would probably be given an acronym. Intell Syst IEEE 17(4):72–80

    Article  Google Scholar 

  • Ilgen DR, Pulakos ED (1999) Employee performance in today’s organizations. In: Ilgen DR, Pulakos ED (eds) The changing nature of work performance: implications for staffing, motivation, and development. Jossey-Bass Inc, San Francisco, pp 1–18

    Google Scholar 

  • Inagaki T, Sheridan TB (2012) Authority and responsibility in human–machine systems: probability theoretic validation of machine-initiated trading of authority. Cogn Technol Work 14(1):29–37. doi:10.1007/s10111-011-0193-4

    Article  Google Scholar 

  • Kaber DB, Draper JV (2004) Human–machine system design and information processing. In: Zandin KB (ed) Maynard’s industrial engineering handbook, 5th edn. McGraw-Hill, New York, pp 111–137

    Google Scholar 

  • Kaber DB, Omal E, Endsley M (1999) Level of automation effects on telerobot performance and human operator situation awareness and subjective workload. In: Scerbo MW, Mouloua M (eds) Automation technology and human performance: current research and trends. Lawrence Erlbaum Associates, Mahwah, pp 165–170

    Google Scholar 

  • Kallinikos J (2010) The “age of smart machine”: a 21st century view. Encycl Softw Eng 1(1):1–7

    Google Scholar 

  • Kozlowski SW, Toney RJ, Mullins ME, Weissbein DA, Brown KG, Bell BS (2001) 2. Developing adaptability: a theory for the design of integrated-embedded training systems. Adv Hum Perform Cogn Eng Res 1:59–123

    Article  Google Scholar 

  • Lintern G (2012) Work-focused analysis and design. Cogn Technol Work 14(1):71–81

    Article  Google Scholar 

  • Markus M, Tanis C (2000) The enterprise systems experience—from adoption to success. In: Zmud RW (ed) Framing the domains of IT management: projecting the future through the past. Pinnaflex Educational Resources Inc, Cincinnatti, pp 173–207

    Google Scholar 

  • Marler JH, Liang X (2012) Information technology change, work complexity and service jobs: a contingent perspective. New Technol Work Employ 27(2):133–146

    Article  Google Scholar 

  • Mascha MF, Smedley G (2007) Can computerized decision aids do “damage”? A case for tailoring feedback and task complexity based on task experience. Int J Acc Inf Syst 8(2):73–91

    Article  Google Scholar 

  • McCloy RA, Campbell JP, Cudeck R (1994) A confirmatory test of a model of performance determinants. J Appl Psychol 79(4):493–505

    Article  Google Scholar 

  • Millot P, Pacaux-Lemoine M-P (2013) A common work space for a mutual enrichment of human–machine cooperation and team-situation awareness. IFAC Proc Volumes 46(15):387–394

    Article  Google Scholar 

  • Muhammed S (2007) Antecedents and impacts of knowledge management practices supported by information technology: An empirical study in manufacturing context. Doctoral dissertation, The University of Toledo, Toledo, US

  • Muhammed S, Doll WJ, Deng X (2009) A model of interrelationships among individual level knowledge management success measures. Int J Knowl Manag 5(1):1–16

    Article  Google Scholar 

  • Mukhopadhyay T, Lerch FJ, Mangal V (1997) Assessing the impact of information technology on labor productivity: a field study. Decis Support Syst 19(2):109–122

    Article  Google Scholar 

  • Napoleon K, Gaimon C (2004) The creation of output and quality in services: a framework to analyze information technology-worker systems. Prod Op Manag 13(3):245–259

    Article  Google Scholar 

  • Nicholson W, Snyder CM (2011) Microeconomic theory: basic principles and extensions, 11th edn. The Dryden Press, Mason

    Google Scholar 

  • Pacaux-Lemoine M-P, Trentesaux D, Zambrano Rey G (2016) Human–machine cooperation to design Intelligent Manufacturing Systems. Paper presented at the Industrial Electronics Society, IECON 2016-42nd Annual Conference of the IEEE, Florence, Italy

  • Parasuraman R, Sheridan TB, Wickens CD (2000) A model for types and levels of human interaction with automation. IEEE Trans Syst Man Cybern Part A Syst Hum 30(3):286–297

    Article  Google Scholar 

  • Parkes A (2012) The effect of task-individual-technology fit on user attitude and performance: an experimental investigation. Decis Support Syst 54(3):997–1009

    Google Scholar 

  • Peterson T, Arnn R (2005) Self-efficacy: the foundation of human performance. Perform Improvement Q 18(2):5–18

    Article  Google Scholar 

  • Price HE (1985) The allocation of functions in systems. Hum Factors J Hum Factors Ergon Soc 27(1):33–45

    Article  Google Scholar 

  • Quinn JB, Anderson P, Finkelstein S (1996) Managing professional intellect: making the most of the best. Harvard Bus Rev 74(2):71–80

    Google Scholar 

  • Sarter N (2008) Investigating mode errors on automated flight decks: illustrating the problem-driven, cumulative, and interdisciplinary nature of human factors research. Hum Factors J Hum Factors Ergon Soc 50(3):506–510

    Article  Google Scholar 

  • Sarter NB, Woods DD, Billings CE (1997) Automation surprises. Handb Hum Factors Ergon 2:1926–1943

    Google Scholar 

  • Schmidt FL, Hunter JE (1998) The validity and utility of selection methods in personnel psychology: practical and theoretical implications of 85 years of research findings. Psychol Bull 124(2):262–274

    Article  Google Scholar 

  • Schmitt N, Cortina JM, Ingerick MJ, Wiechmann D (2003) Personnel selection and employee performance. In: Borman WC, Ilgen D, Klimoski R (eds) Handbook of psychology, vol 12. Wiley, New Jersey, pp 77–105

    Google Scholar 

  • Schotter A (2008) Microeconomics: a modern approach, 1st edn. South-Western Cengage Learning, Mason

    Google Scholar 

  • Seddon PB (1997) A respecification and extension of the DeLone and McLean model of IS success. Inf Syst Res 8(3):240–253

    Article  Google Scholar 

  • Seddon PB, Kiew M-Y (1997) A partial test and development of DeLone and McLean’s model of IS success. Australas J Inf Syst 4(1):90–109

    Google Scholar 

  • Sircar S, Choi J (2009) A study of the impact of information technology on firm performance: a flexible production function approach. Inf Syst J 19(3):313–339

    Article  Google Scholar 

  • Soh C, Kien Sia S, Fong Boh W, Tang MT (2003) Misalignments in ERP implementation: a dialectic perspective. Int J Hum Comput Interact 16(1):81–100

    Article  Google Scholar 

  • Sonnentag S, Frese M (2005) Performance concepts and performance theory. In: Sonnentag S (ed) Psychological management of individual performance. Wiley, Chichester, pp 1–25

    Google Scholar 

  • Stone RW, Good DJ, Baker-Eveleth L (2007) The impact of information technology on individual and firm marketing performance. Behav Inf Technol 26(6):465–482

    Article  Google Scholar 

  • Sun Y, Bhattacherjee A, Ma Q (2009) Extending technology usage to work settings: the role of perceived work compatibility in ERP implementation. Inf Manag 46(6):351–356

    Article  Google Scholar 

  • Sun H, Fang Y, Hsieh JPA (2014) Consuming information systems: an economic model of user satisfaction. Decis Support Syst 57:188–199

    Article  Google Scholar 

  • Torkzadeh G, Chang JC-J, Hardin AM (2011) Usage and impact of technology enabled job learning. Eur J Inf Syst 20(1):69–86

    Article  Google Scholar 

  • Varian HR (2010) Intermediate microeconomics: a modern approach, 8th edn. W. W. Norton & Company, New York

    Google Scholar 

  • Viswesvaran C (2001) Assessment of individual job performance: a review of the past century and a look ahead. In: Anderson N, Ones D, Sinangil H, Viswesvaran C (eds) Handbook of industrial, work and organizational psychology: personnel psychology, vol 1. SAGE Publications, London, pp 110–126

    Chapter  Google Scholar 

  • Viswesvaran C, Ones DS (2000) Perspectives on models of job performance. Int J Selection Assess 8(4):216–226

    Article  Google Scholar 

  • Wagner H-T, Weitzel T (2007) Towards an IT production function: understanding routines as fundamental for IT value creation. J Enterp Inf Manag 20(4):380–395

    Article  Google Scholar 

  • Wei Z-G, Macwan AP, Wieringa PA (1998) A quantitative measure for degree of automation and its relation to system performance and mental load. Hum Factors J Hum Factors Ergon Soc 40(2):277–295

    Article  Google Scholar 

  • Zacher H, Heusner S, Schmitz M, Zwierzanska MM, Frese M (2010) Focus on opportunities as a mediator of the relationships between age, job complexity, and work performance. J Vocat Behav 76(3):374–386

    Article  Google Scholar 

  • Zieba S, Polet P, Vanderhaegen F, Debernard S (2010) Principles of adjustable autonomy: a framework for resilient human–machine cooperation. Cogn Technol Work 12(3):193–203

    Article  Google Scholar 

  • Zuboff S (1985) Automate/informate: the two faces of intelligent technology. Org Dyn 14(2):5–18

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Engineering, Universidad del Pacífico-Perú, Av. Salaverry 2020, Lima, Peru

    Edgardo R. Bravo

  2. Faculty of Economics and Administrative Sciences at Universidad Esan, Lima, Peru

    Jhony Ostos

Authors
  1. Edgardo R. Bravo
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jhony Ostos
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Edgardo R. Bravo.

Appendix 1

Appendix 1

See Table 6.

Table 6 Scales of measurement
Full size table

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Bravo, E.R., Ostos, J. Performance in computer-mediated work: the moderating role of level of automation. Cogn Tech Work 19, 529–541 (2017). https://doi.org/10.1007/s10111-017-0429-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10111-017-0429-z

Keywords

Search

Navigation