Skip to main content
Log in

An exploratory study into whether to or not to include users in the development of industrial hypermedia applications

  • Original Article
  • Published:
Requirements Engineering Aims and scope Submit manuscript

Abstract

While there is agreement among both information system (IS) practitioners and IS researchers as to the value of user participation in IS development, the correlation between user participation and actual use or user satisfaction (surrogate measures of IS success) has been equivocal. A possible reason for the contradictory findings could be that user participation is being utilised, regardless of the levels of complexity of either the system or the task. This paper describes two exploratory case studies to test this hypothesis. Industrial hypermedia applications (IHA) were developed and qualitative data collected, through usability trials, to see the effect of user participation on user perception (extrinsic motivations of use) of the system, rather than IS success. The findings show that users should participate in the development when both the IS and the task are complex. On the other hand, when both the system and the task are not complex, user participation can be kept to a minimum. Furthermore, it is recommended that user participation should not be evaluated against IS success, but against system features.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1.

Similar content being viewed by others

Notes

  1. Multiple regression is a means of establishing the relative importance of the independent variable to the dependent variable. Standard multiple regression implies that the researcher completely specifies the set of independent variables to be included in the model [27].

  2. Cronbach’s alpha (0  ≤  alpha ≤ 1) is a measure of the extent to which item responses obtained at the same time correlate highly with each other.

References

  1. Igbaria M, Guimarães T (1994) Empirically testing the outcomes of user involvement in DSS development. OMEGA: Int J Manage Sci 22(2):157–172

  2. Jackson CM, Chow S, Leitch RA (1997) Toward an understanding of the behavioural intention to use an information system. Decision Sci 28(2):357–389

    Google Scholar 

  3. McKeen JD, Guimarães T, Wetherbe JC (1994) The relationship between user participation, user satisfaction: an investigation of four contingency factors. MIS Q 18(4):427–451

    Google Scholar 

  4. Baroudi JJ, Olson MH, Ives B (1986) An empirical study of the impact of user involvement on system usage and information satisfaction. Commun ACM 29(3):232–238

    Article  Google Scholar 

  5. Hartwick J, Barki H (1994) Explaining the role of user participation in information system use. Manage Sci 40(4):440–465

    Google Scholar 

  6. Ives B, Olson MH (1984) User involvement and MIS success: a review of research. Manage Sci 30(5):586–603

    Google Scholar 

  7. Hwang MI, Thorn RG (1999) The effect of user engagement on system success: a meta-analytical integration of research findings. Inf Manage 35(4):229–236

    Article  Google Scholar 

  8. McKeen JD, Guimarães T (1997) Successful strategies for user participation in systems development. J Manage Inf Syst 14(2):133–150

    Google Scholar 

  9. Hunton JE, Beeler JD (1997) Effects of user participation in systems development: a longitudinal field experiment. MIS Q 21(4):359–388

    Google Scholar 

  10. Lowe D, Hall W (1999) Hypermedia and the web: an engineering approach. Wiley, Chichester

    Google Scholar 

  11. Smith PA, Newman IA, Parks LM (1997) Virtual hierarchies and virtual networks: some lessons from hypermedia usability research applied to the world wide web. Int J Hum Comput Stud 47:67–95

    Article  Google Scholar 

  12. Shneiderman B (1997) Designing information abundant web sites: issues and recommendations. Int J Hum Comput Stud 47:5–29

    Article  Google Scholar 

  13. Smith PA (1996) Toward a practical measure of hypertext usability. Interact Comput 8(4):365–381

    Article  Google Scholar 

  14. Koshy TT, Gramopadhye AK, Kennedy WJ, Ramu NV (1996) Application of hypertext technology to assist maintenance on the shop floor. Comput Ind Eng 30(2):283–295

    Article  Google Scholar 

  15. Eason KD (1991) Ergonomic perspectives on advances in human-computer interaction. Ergonomics 34(6):721–741

    Google Scholar 

  16. Dillon A, McKnight C (1995) Never mind the theory, feel the data: observations on the design of hypertext-based user interfaces. In: Schuler W, Hannemann J, Streitz JN (eds) Designing user interfaces for hypermedia. Research reports ESPRIT project 6532 HIFI, vol 1. Springer, Berlin Heidelberg New York, pp 117–125

  17. Nanard J, Nanard M (1995) Hypertext design environments and the hypertext design process. Commun ACM 38(8):49–56

    Article  Google Scholar 

  18. Kasvi JJJ, Nieminen M, Pulkkis A, Vartiainen M (1998) Knowledge management on the shop-floor, In: Karwowski W, Goonetilleke R (eds) Manufacturing agility and hybrid automation – II. IEA Press, Santa Monica, pp 168–171

  19. Garzotto F, Mainetti L, Paolini P (1995) Hypermedia design, analysis and evaluation issues. Commun ACM 38(8):74–85

    Article  Google Scholar 

  20. Isakowitz T, Stohr EA, Balasupramanian P (1995) RMM: a methodology for structured hypermedia design. Commun ACM 38(8):34–44

    Article  Google Scholar 

  21. Schwabe D, Rossi G (1995) The object-oriented hypermedia model. Commun ACM 38(8):45–46

    Article  Google Scholar 

  22. Wood RE (1986) Task complexity: definition of the construct. Organ Behav Hum Decision Process 37(1):60–82

    Google Scholar 

  23. Davis FD, Bagozzi RP, Warshaw PR (1989) User acceptance of computer technology: a comparison of two theoretical models. Manage Sci 35(8):982–1003

    Google Scholar 

  24. Davis FD, Venkatesh V (1996) A critical assessment of potential biases in the technology acceptance model: 3 experiments. Int J Man Mach Stud 45:19–45

    Article  Google Scholar 

  25. Davis FD (1993) User acceptance of information technology: system characteristics, user perceptions and behavioural impacts. Int J Man Mach Stud 38:475–487

    Article  Google Scholar 

  26. Venkatesh V, Davis FD (1996) A model of the antecedents of perceived ease of use: a development and test. Decision Sci 27(3):451–481

    Google Scholar 

  27. Hair JF Jr, Anderson RE, Tatham RL, Black WC (1998) Multivariate data analysis, 5th edn. Prentice Hall, Upper Saddle River, NJ

  28. Morris MG, Dillon A (1997) How user perceptions influence software use. IEEE Softw 14(4):58–65

    Article  Google Scholar 

  29. Torkzadeh G, Dwyer DJ (1994) A path analytic study of determinants of information system usage. OMEGA: Int J Manage Sci 22(4):339–348

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Devendra Fakun.

Appendix: The post-usability questionnaire

Appendix: The post-usability questionnaire

Please circle the number that best reflects your feelings.

Table 6

Rights and permissions

Reprints and permissions

About this article

Cite this article

Fakun, D., Greenough, R.M. An exploratory study into whether to or not to include users in the development of industrial hypermedia applications. Requirements Eng 9, 57–66 (2004). https://doi.org/10.1007/s00766-003-0180-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00766-003-0180-2

Keywords

Navigation