User acceptance of software as a service: Evidence from customers of China's leading e-commerce company, Alibaba

https://doi.org/10.1016/j.jss.2013.03.012Get rights and content

Highlights

  • A systematic model with which to analyze the user acceptance of SaaS is proposed.

  • A SaaSQual of operationalizing perceived e-service quality of SaaS is developed.

  • Ease of use, security, reliability and responsiveness are 4 dimensions of SaaSQual.

  • E-service quality, usefulness and social influence are 3 factors in accepting SaaS.

  • Direct and indirect influences in promoting user acceptance of SaaS are tested.

Abstract

This paper proposes a model with which to analyze the user acceptance of Software as a Service (SaaS). To develop this model, empirical surveys were conducted through four rounds of questionnaires obtained from customers of China's leading e-commerce company, Alibaba. Firstly, based on the data from the first three rounds (1399 respondents), a SaaSQual of operationalizing perceived e-service quality of SaaS was developed, and its four dimensions (ease of use, security, reliability and responsiveness) were identified. Secondly, based on the data from the fourth round (1532 respondents), it was found that the level of three user perceptions (e-service quality, usefulness, and social influence) were predictive of the users’ behavioral intention to use SaaS, and their direct and indirect influences were tested. This study recommends engineering improvements to SaaS based upon a better understanding of the level of user acceptance of this service.

Introduction

With the rapid advance in the availability of computer services and the widespread use of standard and open Internet technology, Software as a Service (SaaS) has become a focus for new product development within many IT, Internet and software companies. As defined by Carraro and Chong (2006) of Microsoft Corporation, SaaS is “software deployed as a hosted service and accessed over the Internet.” As a process, SaaS is characterized by the use of servers to host applications that customers access over the Internet. This technology has led to a proliferation of services and applications, almost beyond imagination.

In recent years, there is a growing concern regarding the acceptance of SaaS by users (Benlian et al., 2011, Wu, 2011b, Wu et al., 2011). Researchers have tried to measure customer satisfaction as it relates to the use of SaaS. Much attention has been focused upon trying to objectively measure e-service quality in system and software performance (Benlian et al., 2011). In addition to this objective approach, others have examined social and personal factors within the user population as a determinant of the level of user acceptance of SaaS. This latter approach is evident in the technology acceptance model 2 (TAM2). The underlying objective of this research is to construct a systemic model to analyze user acceptance of SaaS. To do so, this paper employs the classic technology acceptance model (TAM) and its modified versions.

Besides identifying the factors that may influence user acceptance of SaaS, we also pay heed to the mechanisms behind these effects. Few studies have explored these mechanisms in depth. TAM has not been used for determining the mechanisms of user acceptance of SaaS. In particular, how e-service quality and social and personal factors interact with each other is oftentimes neglected by SaaS researchers and the practitioners.

Simply stated, the managers of SaaS service providers need to know how to measure e-service quality of SaaS, what aspects of SaaS service best define its quality, and whether users actually intend to use SaaS service from firms that have the highest level of perceived e-service quality or based upon other social and personal factors.

By examining user acceptance of SaaS systemically, this paper proposes an analytical framework by which to expose the significant factors and their mechanisms of action. The remainder of this paper is organized as follows. In Section 2, issues related to user acceptance of SaaS are discussed. In Section 3, a proposed analytical framework is developed. In Section 4, an empirical methodology is described for the development of SaaSQual and the measurement variables. In Section 5, the results of the empirical study from customers of China's leading e-commerce company, Alibaba, are presented and analyzed. In Section 6, the theoretical and practical implications are discussed, and the limitation and future direction are also given. In section 7, conclusions to be drawn from this research are presented.

Section snippets

SaaS and its characteristics

SaaS is a new software application extending the idea of the ASP (Application Service Provider). As a software delivery model providing online service, SaaS has the advantage of reducing costs, improving efficiency, lowering risk, and increasing flexibility compared to the traditional software-as-product model. It is widely considered to have a very promising future.

Although not all SaaS applications share the same traits, there are three basic characteristics common to most SaaS applications:

Perceived usefulness

Perceived usefulness, for the purpose of this paper, is defined as the extent to which an individual believes that using SaaS would improve his/her job performance. On the operation side, the fees paid by customers vary from application to application, depending on the type of subscription. The application architecture of SaaS is a single-instance, multi-tenant model, with service provider hosting applications and deploying software. Additionally, customers can access SaaS over the Internet

Research setting

This paper proposes a model with which to analyze the user acceptance of SaaS. The factors impacting the user acceptance of SaaS are illustrated theoretically. We tested our hypotheses in the context of China's booming SaaS engineering market. The user acceptance of SaaS business will largely determine the future competitive position of SaaS providers. These companies are using a variety of ways to attract users to accept the SaaS. This provides us with an excellent research setting in which to

Reliability and validity

The analysis of reliability and validity of variables in this study is confirmed by the data from the 1532 respondents in the fourth round. The reliability of all instruments assessed by the Cronbach's α coefficients are above 0.7 as shown in Table 6. Confirmatory factor analysis (CFA) demonstrated the unidimensionality, convergent and discriminant validity of the multi-item measures of each construct as displayed in Table 6 (Netemeyer et al., 1990).

Tests of hypotheses

The model proposed in the study was tested

Theoretical implications

This paper proposes a model to analyze the user acceptance of SaaS. Firstly, this paper puts forward a SaaSQual of operationalizing perceived e-service quality of SaaS. SaaS engineering has developed in recent years. A well-developed and effective SaaSQual is valuable to help the SaaS practitioner understand the essence of e-service quality of SaaS. In our SaaSQual, four key dimensions are identified which are ease of use, security, reliability and responsiveness. This study deepens the insight

Conclusions

The present research proposes a model with which to analyze the user acceptance of Software as a Service (SaaS). Firstly, a SaaSQual of operationalizing perceived e-service quality of SaaS was developed, and its four dimensions (ease of use, security, reliability and responsiveness) were identified; secondly, it was found that the level of three user perceptions (e-service quality, usefulness, and social influence) were predictive of the user's behavioral intention to use SaaS, and their direct

Acknowledgments

The authors gratefully acknowledge support for this research from the National Natural Science Foundation of China (Grant nos. 70902059, 71232013), China Postdoctoral Science Foundation (Grant no. 2012M511896) and the IDRC (Grant no. 106341-001).

Jian Du is an associate professor at School of Management, Zhejiang University, China. She is a core member of National Institute for Innovation Management (NIIM) in Zhejiang University. She received her PhD degree in management from Zhejiang University. Her research interests are information management and global manufacturing network.

References (45)

  • S.J. Barnes et al.

    An integrative approach to the assessment of e-commerce quality

    Journal of Electronic Commerce Research

    (2002)
  • A. Benlian et al.

    Service quality in Software-As-A-Service: developing the SaaS-QUAL measure and examining its role in usage continuance

    Journal of Management Information Systems

    (2011)
  • G. Carraro et al.

    Software as a Service (SaaS): An Enterprise Perspective

    (2006)
  • P.Y.K. Chau et al.

    Information technology acceptance by individual professionals: a model comparison approach

    Decision Sciences

    (2001)
  • F. Chong

    Application Marketplaces and the Money Trail

    (2008)
  • F. Chong et al.

    Architecture Strategies for Catching the Long Tail

    (2006)
  • J.J. Cronin et al.

    Measuring service quality: a reexamination and extension

    Journal of Marketing

    (1992)
  • J.J. Cronin et al.

    SERVPERF versus SERVQUAL: reconciling performance-based and perceptions-minus-expectations measurement of service quality

    Journal of Marketing

    (1994)
  • F.D. Davis

    A technology acceptance model for empirically testing new end-user information systems: theory and results

    (1985)
  • F.D. Davis

    Perceived usefulness, perceived ease of use, and user acceptance of information technology

    MIS Quarterly

    (1989)
  • F.D. Davis et al.

    User acceptance of computer technology: a comparison of two theoretical models

    Management Science

    (1989)
  • M. Fishbein et al.

    Belief, Attitude, Intention and Behavior: An Introduction to Theory and Research

    (1975)
  • Cited by (29)

    • Rethinking the role of security in client satisfaction with Software-as-a-Service (SaaS) providers

      2015, Decision Support Systems
      Citation Excerpt :

      Heart [39] surveyed 143 SaaS clients, and found no significant relationship between the perceived risk of data insecurity, and intention to adopt SaaS services. Du et al. [20,21] surveyed 1399 SaaS end-customers and found no significant relationship between security perceptions and intention to adopt SaaS. The enduring gap between the conceptual importance of security and the absence of empirical validation in prior work means that it is critical to understand how security ought to contribute to client satisfaction with SaaS providers.

    • Factors affecting the adoption of cloud-based CRM in small and medium enterprises

      2022, International Journal of Services, Technology and Management
    View all citing articles on Scopus

    Jian Du is an associate professor at School of Management, Zhejiang University, China. She is a core member of National Institute for Innovation Management (NIIM) in Zhejiang University. She received her PhD degree in management from Zhejiang University. Her research interests are information management and global manufacturing network.

    Jing Lu is a Master student in Department of Management Science and Engineering, School of Management, Zhejiang University, China. She received her bachelor degree in Information Management and Information Systems from Shanghai Finance University, China. Her main research interests are information management, software engineering and behavior analysis.

    Dong Wu is a Post-Doctoral Fellow at School of Management, Zhejiang University, China. He received his PhD degree in management from Zhejiang University. His research areas are technological management and technological strategy.

    Huiping Li is an associate professor at Anisfield School of Business, Ramapo College of New Jersey, USA. She received her PhD in Global Business and Management from Rutgers, The State University of New Jersey, USA. Her research interests are technology management, subsidiary management, joint ventures in China, and corporate social responsibility.

    Jie Li is a senior manager in Alibaba Group, China. He received his Master degree in Management Science and Engineering from Zhejiang University, China. His main research areas are software engineering, software architecture, software testing and database system.

    View full text