What translates big data into business value? A meta-analysis of the impacts of business analytics on firm performance

https://doi.org/10.1016/j.im.2022.103685Get rights and content

Highlights

  • A meta-analysis is conducted to examine the impact of BA on firm performance.

  • BA resources, capabilities, and organizational culture strongly impact firm performance.

  • External factors have only a weak influence on the business value created from BA.

  • Performance dimension, economic area, and year show no significant moderating effects.

  • Six propositions and ten future research directions are derived based on the findings.

Abstract

The main purpose of this study is to examine the factors that are critical to create business value from business analytics (BA). Therefore, we conduct a meta-analysis of 125 firm-level studies spanning ten years of research from across 26 countries. We found evidence that the social factors of BA, such as human resources, management capabilities, and organizational culture show a greater impact on business value, whereas technical aspects play a minor role in enhancing firm performance. Through these findings, we contribute to the ongoing debate concerning BA business value by synthesizing and validating the findings of the body of knowledge.

Introduction

The disruptive impact of big data on various businesses and industries has been referred to as a “management revolution” [1] or “the next frontier” [2]. Others have even opined that “big data is possibly the most significant ‘tech’ disruption in business and academic ecosystems since the meteoric rise of the Internet and the digital economy” [3]. The advanced techniques and technologies necessary to handle big data are commonly referred to by the terms business intelligence (BI), business analytics (BA), or big data analytics (BDA) [4]. Given the enormous potential of BA to create value for business and society, an increasing number of studies from diverse research disciplines have attempted to examine the value creation mechanism of BA [5,6]. In the BA literature, technical and human resources, as well as management capabilities, are considered essential antecedents to business value creation [7.], [8.], [9.]. Moreover, a data-driven culture [6,10,11] and contextual factors such as the competitive intensity [12] and industry dynamism [13] were found to have a major impact on the value created from BA. Some studies have noted that firms can only create value from BA when they manage to combine their resources and capabilities to gain benefits [14].

Overall, numerous studies with inconsistent results have been published on the business value of BA over the past decades [7,15,16]. Although most studies report a positive relationship between BA and firm performance, for example, by demonstrating the strong impact of data analytics competency on improving firm decision-making [14] or illustrating the major role that BDA use plays in enhancing asset productivity and business growth [17], some studies present a more nuanced picture of the conditions under which BA can create value for firms. In an attempt to explain the mixed results of prior studies, IS scholars have pointed to the essential role of contextual factors, such as a firm's structural readiness, and psychological readiness factors, which are needed to create value from BA [16]. In addition, whether BA is beneficial for firms depends on the fit between different factors, such as BA tools, data, people, and tasks [18]. Some IS scholars have similarly suggested that several factors, such as the inability to capture the indirect benefits of BA use, methodological issues, and inadequate consideration of environmental factors and time lags, are the main reasons for these mixed results [15].

Although the wealth of studies on the business value of BA has undoubtedly contributed to the body of knowledge by providing valuable insights into specific aspects of the value creation mechanism, recent work has highlighted the need for a more consistent picture, especially with regard to the question on how contextual factors influence the performance outcomes due to BA [5]. To date, few research efforts, whether in IS or in other disciplines, have attempted to provide a more integrated and consistent picture on the business value of BA based on empirical findings from prior studies. We address this gap by synthesizing quantitative evidence on this research topic from the rich body of knowledge. Thus, our main research objective is to provide a comprehensive and consistent picture of the main factors that contribute to enhance the business value of BA, resolve the inconsistencies across studies, and achieve an enhanced understanding of the conditions under which BA's has varying impacts on firm performance. In doing so, we aim not only to synthesize qualitative findings from the body of knowledge but also to strive for a more valid picture of these findings based on the quantitative results of former studies. In particular, we aim to answer the following research questions (RQs):

  • RQ1: What are the main BA resources and capabilities as well as contextual factors that are critical to create business value from business analytics?

  • RQ2: To what extent do these factors contribute to enhancing firm performance and what conditions may cause business analytics to have varying impacts on firm performance?

To answer the RQs, we conduct a meta-analysis of 125 firm-level studies reported in 123 articles spanning ten years of research from across 26 countries and four continents. We consider meta-analysis to be an appropriate method for synthesizing the results of conflicting studies to resolve the inconsistencies [19] and increase the statistical power of these results [20]. The findings are expected to be of high importance for research and practice because answering the questions of how, when, and why it can create value is essential for companies to gain a competitive advantage [6,21]. For researchers, developing an enhanced understanding of the main determinants of the business value of IT would help to advance the development of theory in IS research. In business practice, such an enhanced understanding would help managers to increase the value of IT [22].

The remainder of this paper is structured as follows. In Sections 2 and 3, we explain the theoretical background concerning the business value of BA, describe the scope of our research, and develop the research framework, including identifying the dependent and independent variables of interest. In Section 4, we describe the relevant phases and activities of our meta-analysis research approach. The results of the meta-analysis are presented in Section 5. Implications for research and practice as well as the limitations of this study are described in Section 6. Finally, the concluding Section 7 presents a brief summary of this research.

Section snippets

Business value of business analytics

In the literature, the term big data is often used to describe extremely large and complex data sets drawn from various sources that require advanced techniques, such as BI, BA, or BDA, for storage, management, analysis, and visualization [4]. In this context, the “three Vs” framework is often used to highlight volume (magnitude of data), velocity (speed of data creation), and variety (structural heterogeneity of data sources) as the main characteristics of big data. Additional Vs were later

Research model

We combine the broad view of the business value term of BA proposed by Grover et al. [6] with the well-established IS business value framework [32] to examine the impact of BA on firm performance at the organizational level for several reasons. First, the IS business value framework [32] provides a sociotechnical conceptualization of IS as investments in important IS resources and capabilities such as technical assets, human resources and management capabilities, and non-IS investments (such as

Meta-analysis

We chose to conduct a meta-analysis because such a research approach facilitates the achievement of our primary goals—integrating, synthesizing, and analyzing the quantitative results of multiple individual studies to draw new conclusions from past knowledge [72]. Moreover, meta-analysis is a useful means by which to increase the statistical power of results [20]. Since being introduced in the 1970s, meta-analysis has become an important research method in multiple research disciplines of the

Results

The results of the meta-analysis of the 125 studies and 358 effect sizes are summarized in Table 6. We conducted six separate meta-analyses, each examining the relationship between an independent variable and firm performance. Each of the studies was assigned a relative weight, which is the inverse of the sum of the sampling error and the between-study variance. The relative weight for each study provides the basis for calculating the weighted mean reflected by the summary effect size [73].2

Discussion

The main research objective of our study was to integrate the empirical evidence of previous studies regarding the business value of BA to achieve a consistent and enhanced understanding of the impact of BA on firm performance. Moreover, we were interested in answering the question of under what conditions BA can create value. We found evidence that BA has an overall positive impact on organizational performance in terms of operational, financial, and market performance. In addition, we gained

Conclusion

With the primary purpose of providing a comprehensive and consistent picture of the main factors that contribute to enhancing the business value of BA, we conducted a meta-analysis of 125 studies from 123 articles to answer the questions of whether and when BA can create business value for organizations. More specifically, we examined the impact of BA resources, capabilities, and contextual factors on firm performance, as well as potential moderating effects that might account for the

CRediT authorship contribution statement

Thuy Duong Oesterreich: Conceptualization, Methodology, Investigation, Data curation, Validation, Writing – original draft, Visualization, Project administration. Eduard Anton: Investigation, Formal analysis, Validation, Writing – original draft, Visualization. Frank Teuteberg: Writing – review & editing, Supervision.

Thuy Duong Oesterreich: Thuy Duong Oesterreich is a post-doctoral researcher at the Department of Accounting and Information Systems, which is part of the Institute of Information Management and Information Systems Engineering at the Osnabrück University. She received her PhD in Information Systems at the Osnabrück University in 2019. In her research, she focusses on investigating the sociotechnical and socioeconomic issues of information technology and information systems, including big data

References (225)

  • SF Wamba et al.

    Big data analytics and firm performance: effects of dynamic capabilities

    J. Bus. Res.

    (2017)
  • S Krishnamoorthi et al.

    Business analytics and business value: a comparative case study

    Inf. Manage.

    (2018)
  • V-H Trieu

    Getting value from Business Intelligence systems: a review and research agenda

    Decis. Support Syst.

    (2017)
  • WA Günther et al.

    Debating big data: a literature review on realizing value from big data

    J. Strateg. Inf. Syst.

    (2017)
  • K Božič et al.

    Business intelligence and analytics for value creation: the role of absorptive capacity

    Int. J. Inf. Manag.

    (2019)
  • R Torres et al.

    Enabling firm performance through business intelligence and analytics: a dynamic capabilities perspective

    Inf. Manage.

    (2018)
  • N Côrte-Real et al.

    Leveraging internet of things and big data analytics initiatives in European and American firms: is data quality a way to extract business value?

    Inf. Manage.

    (2020)
  • SF Wamba et al.

    The performance effects of big data analytics and supply chain ambidexterity: the moderating effect of environmental dynamism

    Int. J. Prod. Econ.

    (2020)
  • MD Peters et al.

    Business intelligence systems use in performance measurement capabilities: Implications for enhanced competitive advantage

    Int. J. Account. Inf. Syst.

    (2016)
  • S Wang et al.

    Harnessing business analytics value through organizational absorptive capacity

    Inf. Manage.

    (2019)
  • R Eidizadeh et al.

    Analysing the role of business intelligence, knowledge sharing and organisational innovation on gaining competitive advantage

    J. Workplace Learn.

    (2017)
  • A Ashrafi et al.

    The role of business analytics capabilities in bolstering firms’ agility and performance

    Int. J. Inf. Manag.

    (2019)
  • K Lepenioti et al.

    Prescriptive analytics: literature review and research challenges

    Int. J. Inf. Manag.

    (2020)
  • R Rosenthal

    The file drawer problem and tolerance for null results

    Psychol. Bull.

    (1979)
  • A McAfee et al.

    Big data: the management revolution

    Harv. Bus. Rev.

    (2012)
  • J Manyika et al.

    Big data: The next Frontier For innovation, Competition

    (2011)
  • R Agarwal et al.

    Editorial—big data, data science, and analytics: the opportunity and challenge for is research

    Inf. Syst. Res.

    (2014)
  • H Chen et al.

    Business intelligence and analytics: from big data to big impact

    Manag. Inf. Syst. Q

    (2012)
  • P Mikalef et al.

    Big data and business analytics: a research agenda for realizing business value

    Inf. Manage.

    (2020)
  • V Grover et al.

    Creating strategic business value from big data analytics: a research framework

    J. Manag. Inf. Syst.

    (2018)
  • A Ferraris et al.

    Big data analytics capabilities and knowledge management: impact on firm performance

    Manag. Decis.

    (2019)
  • Mikalef P, Boura M, Lekakos G, Krogstie J (2018) Complementarities between information governance and big data...
  • R Dubey et al.

    Big data analytics capability in supply chain agility: the moderating effect of organizational flexibility

    Manag. Decis.

    (2019)
  • M Ghasemaghaei

    Are firms ready to use big data analytics to create value? The role of structural and psychological readiness

    Enterp. Inf. Syst.

    (2019)
  • DQ Chen et al.

    How the use of big data analytics affects value creation in supply chain management

    J. Manag. Inf. Syst.

    (2015)
  • MI Hwang

    The use of meta-analysis in mis research: promises and problems

    Data Base Adv. Inf. Syst.

    (1996)
  • JE Hunter et al.

    Methods of Meta-Analysis: Correcting Error and Bias in Research Findings

    (2004)
  • R Kohli et al.

    Business value of IT: an essay on expanding research directions to keep up with the times

    J. Assoc. Inf. Syst.

    (2008)
  • S Tonidandel et al.

    Big data methods: leveraging modern data analytic techniques to build organizational science

    Organ. Res. Methods

    (2018)
  • G Phillips-Wren et al.

    Business analytics in the context of big data: a roadmap for research

    Commun. Assoc. Inf. Syst.

    (2015)
  • T Davenport et al.

    Competing On Analytics: Updated, With a New Introduction: The New Science of Winning

    (2017)
  • I Someh et al.

    Reconceptualizing synergy to explain the value of business analytics systems

    J. Inf. Technol.

    (2019)
  • JS Walker

    Big data: A revolution That Will Transform How We live, work, and Think

    (2014)
  • B Marr

    Evidence-based decision making: Using business intelligence to drive value

    CMA Mag.

    (2009)
  • E Brynjolfsson et al.

    Data in Action: Data-Driven Decision Making in U.S. Manufacturing

    (2016)
  • R Sabherwal et al.

    Information technology impacts on firm performance: an extension of Kohli and Devaraj (2003)

    MIS Q.

    (2015)
  • N Melville et al.

    Information technology and organizational performance: an integrative model of IT business value

    MIS Q.

    (2004)
  • G Schryen

    Revisiting IS business value research: what we already know, what we still need to know, and how we can get there

    Eur. J. Inf. Syst.

    (2013)
  • K Zhu et al.

    Post-adoption variations in usage and value of e-business by organizations: cross-country evidence from the retail industry

    Inf. Syst. Res.

    (2005)
  • S Ji-fan Ren et al.

    Modelling quality dynamics, business value and firm performance in a big data analytics environment

    Int. J. Prod. Res

    (2017)
  • Cited by (24)

    • A csQCA study of value creation in logistics collaboration by big data: A perspective from companies in China

      2022, Technology in Society
      Citation Excerpt :

      This will only expand the scope of big data applications, rather than deepen collaboration. This is in line with the literature that only a few companies have fully exploited the potential of their big data, and few have applied it to collaboration [4,17,50]. The results show that the integration or synergy elements appear separately or simultaneously in the three paths.

    View all citing articles on Scopus

    Thuy Duong Oesterreich: Thuy Duong Oesterreich is a post-doctoral researcher at the Department of Accounting and Information Systems, which is part of the Institute of Information Management and Information Systems Engineering at the Osnabrück University. She received her PhD in Information Systems at the Osnabrück University in 2019. In her research, she focusses on investigating the sociotechnical and socioeconomic issues of information technology and information systems, including big data and business analytics. She has several years of industry experience in the area of management accounting and IT project management prior to her academic career. Her research was published in numerous peer-reviewed journals and conferences, including Information & Management, Technological Forecasting and Social Change, Journal of Accounting & Organizational Change, International Journal of Accounting Information Systems, Information Systems and e-Business Management, and International Conference on Information Systems (ICIS).

    Eduard Anton: Eduard Anton is a research associate at the Department of Accounting and Information Systems, which is part of the Institute of Information Management and Information Systems Engineering at the Osnabrück University. He completed his master's degree in Information Systems in 2015 and subsequently worked as an IT project manager and IT consultant for several years. Currently, he is pursuing his dissertation, with a particular focus on the socioeconomic implications of business analytics and artificial intelligence. He has published journal articles and conference papers in Information & Management, International Journal of Innovation and Technology Management, and International Conference on Information Systems (ICIS).

    Frank Teuteberg: Frank Teuteberg is full professor at the Osnabrück University in Germany. Since 2007 Frank Teuteberg has been head of the Department of Accounting and Information Systems, which is part of the Institute of Information Management and Information Systems Engineering at the Osnabrück University. Frank Teuteberg is spokesman of the profile line Digital Society – Innovation – Regulation and leader of several research projects (e.g., www.dorfgemeinschaft20.de). Furthermore, he is author of more than 400 papers in the field of cloud computing, industrial Internet of things, e-health, blockchain, and human–computer interaction.

    View full text