skip to main content
article

Information technology and economic performance: A critical review of the empirical evidence

Published:01 March 2003Publication History
Skip Abstract Section

Abstract

For many years, there has been considerable debate about whether the IT revolution was paying off in higher productivity. Studies in the 1980s found no connection between IT investment and productivity in the U.S. economy, a situation referred to as the productivity paradox. Since then, a decade of studies at the firm and country level has consistently shown that the impact of IT investment on labor productivity and economic growth is significant and positive. This article critically reviews the published research, more than 50 articles, on computers and productivity. It develops a general framework for classifying the research, which facilitates identifying what we know, how well we know it, and what we do not know. The framework enables us to systematically organize, synthesize, and evaluate the empirical evidence and to identify both limitations in existing research and data and substantive areas for future research.The review concludes that the productivity paradox as first formulated has been effectively refuted. At both the firm and the country level, greater investment in IT is associated with greater productivity growth. At the firm level, the review further concludes that the wide range of performance of IT investments among different organizations can be explained by complementary investments in organizational capital such as decentralized decision-making systems, job training, and business process redesign. IT is not simply a tool for automating existing processes, but is more importantly an enabler of organizational changes that can lead to additional productivity gains.In mid-2000, IT capital investment began to fall sharply due to slowing economic growth, the collapse of many Internet-related firms, and reductions in IT spending by other firms facing fewer competitive pressures from Internet firms. This reduction in IT investment has had devastating effects on the IT-producing sector, and may lead to slower economic and productivity growth in the U.S. economy. While the turmoil in the technology sector has been unsettling to investors and executives alike, this review shows that it should not overshadow the fundamental changes that have occurred as a result of firms' investments in IT. Notwithstanding the demise of many Internet-related companies, the returns to IT investment are real, and innovative companies continue to lead the way.

References

  1. Alpar, P. and Kim, M. 1991. A microeconomic approach to the measurement of information technology value. J. Manage. Inform. Syst. 7, 2, 55--69. Google ScholarGoogle Scholar
  2. Autor, D., Katz, L., and Krueger, A. 1998. Computing inequality: Have computers changed the labor market? Quart. J. Econ. 113, 4 (Nov.), 1169--1213.Google ScholarGoogle Scholar
  3. Baily, M. N. and Gordon, R. 1988. The productivity slowdown, measurement issues, and the explosion of computer power. Brookings Pap. Econ. Act. 19, 2, 347--420.Google ScholarGoogle Scholar
  4. Baily, M. N. and Lawrence, R. Z. 2001. Do we have a new e-conomy? American Econ. Rev. 91, 2, 308--312.Google ScholarGoogle Scholar
  5. Banker, R., Kauffman, R., and Morey, R. 1990. Measuring gains in operational efficiency from information technology: A study of the positran deployment at Hardee's Inc. J. Manage. Inform. Syst. 7, 2, 29--54. Google ScholarGoogle Scholar
  6. Barua, A., Kriebel, C. H., and Mukhopadhyay, T. 1995. Information technologies and business value: An analytic and empirical investigation. Inform. Syst. Res. 6, 1, 3--23.Google ScholarGoogle Scholar
  7. Black, S. and Lynch, L. 1997. How to compete: The impact of workplace practices and information technology on productivity. Working paper National Bureau of Economic Research, Cambridge, MA.Google ScholarGoogle Scholar
  8. Bosworth, B. P. and Triplett, J. E. 2000. What's new about the new economy? IT, economic growth and productivity. Working paper. Brookings Institution, Washington, D.C.Google ScholarGoogle Scholar
  9. Bresnahan, T. F. 1986. Measuring the spillovers from technical advance: Mainframe computers in financial services. American Econ. Rev. 76, Sept. 34.Google ScholarGoogle Scholar
  10. Bresnahan, T. F. 1997. Computerization and wage dispersion: An analytical reinterpretation. Economic J.: J. Royal Econ. Soc. 109, 456, F390--F415.Google ScholarGoogle Scholar
  11. Bresnahan, T. F. 1999. Computerization and wage dispersion: An analytical reinterpretation. J. Royal Econ. Soc. 109, 456, F390--F415.Google ScholarGoogle Scholar
  12. Bresnahan, T. F., Brynjolfsson, E., and Hitt, L. M. 2002. Information technology, workplace organization and the demand for skilled labor: Firm-level evidence. Quart. J. Econ. 117, 1 (Feb.), 339--376.Google ScholarGoogle Scholar
  13. Brynjolfsson, E. 1993. The productivity paradox of information technology. Commun. ACM 36, 12, 66--77. Google ScholarGoogle Scholar
  14. Brynjolfsson, E. 1996. The contribution of information technology to consumer welfare. Inform. Syst. Res. 7, 3, 281--300.Google ScholarGoogle Scholar
  15. Brynjolfsson, E. and Hitt, L. M.1995. Information technology as a factor of production: The role of differences among firms. Econ. Innov. New Techn. 3, 3, 183--199.Google ScholarGoogle Scholar
  16. Brynjolfsson, E. and Hitt, L. M. 1996. Paradox lost? Firm-level evidence on the returns to information systems spending. Manage. Sci. 42, 4, 541--558. Google ScholarGoogle Scholar
  17. Brynjolfsson, E. and Hitt, L. M. 1998. Beyond the productivity paradox: Computers are the catalyst for bigger changes. Commun. ACM 41, 8 (Aug), 49--55. Google ScholarGoogle Scholar
  18. Brynjolfsson, E. and Hitt, L. M. 2000. Beyond computation: Information technology, organization transformation and business performance. J. Econ. Perspect. 14, 4, 23--48.Google ScholarGoogle Scholar
  19. Brynjolfsson, E., Hitt, L. M., and Yang, S. 1998. Intangible assets: How the interaction of information systems and organizational structure affects stock market valuation. In Proceedings of the International Conference on Information Systems (Helsinki, Finland, Aug.). Google ScholarGoogle Scholar
  20. Brynjolfsson, E., Hitt, L. M., and Yang, S. 2000. Beyond computation: Information technology, organizational transformation and business performance. J. Econ. Perspect. 14, 4, 23--48.Google ScholarGoogle Scholar
  21. Brynjolfsson, E. and Yang, S. 1996. Information technology and productivity: A review of the literature. Advanc. Comput. 43, 179--214.Google ScholarGoogle Scholar
  22. Brynjolfsson, E. and Yang, S. 1997. The intangible benefits and costs of computer investments: Evidence from financial markets. In Proceedings of the International Conference on Information Systems (Atlanta, GA.) Google ScholarGoogle Scholar
  23. Chennells, L. and Van Reenen, J. 1999. Has technology hurt less skilled workers? An econometric survey of the effects of technical change on the structure of pay and jobs. Working Paper Series No. W99/27. The Institute for Fiscal Studies, London, U.K.Google ScholarGoogle Scholar
  24. Cole, R., Chen, Y. C., Barquin-Stolleman, J. A., Dulberger, E. R., Helvacian, N., and Hodge, J. H. 1986. Quality-adjusted price indexes for computer-processors and selected peripheral equipment. Survey Curr. Bus. 66, 1, 41--50.Google ScholarGoogle Scholar
  25. Council of Economic Advisors. 2001. The annual report of the council of economic advisors. In The Economics of the President. U.S. Government Printing Office, Washington, D.C.Google ScholarGoogle Scholar
  26. Daveri, F. 2000. Is growth an information technology story in Europe too? Working paper. Universita di Parma, Parma, Italy.Google ScholarGoogle Scholar
  27. David, P. 1990. The dynamo and the computer: An historical perspective on the modern productivity paradox. American Econ. Rev. 80, 2 (May), 35--61.Google ScholarGoogle Scholar
  28. Dewan, S. and Kraemer, K. L. 1998. International dimensions of the productivity paradox. Commun. ACM 41, 8 (Aug.), 56--62. Google ScholarGoogle Scholar
  29. Dewan, S. and Kraemer, K. L. 2000. Information technology and productivity: Preliminary evidence from country-level data. Manage. Sci. 46, 4 (April), 548--562. Google ScholarGoogle Scholar
  30. Devaraj, S. and Kohli, R. 2002. Information technology payoff in the health care industry: A longitudinal study. J. Manage. Inform. Syst. 16, 4 (Spring), 41--68. Google ScholarGoogle Scholar
  31. Dewan, S. and Min, C. K. 1997. Substitution of information technology for other factors of production: A firm level analysis. Manage. Sci. 43, 12, 1660--1675. Google ScholarGoogle Scholar
  32. Dinardo, J. E. and Pischke, J. S. 1997. The returns to computer use revisited: Have pencils changed the wage structure too? Quart. J. Econ. 112, 1, 291--303.Google ScholarGoogle Scholar
  33. Dulberger, E. R. 1989. The application of an hedonic model to a quality adjusted price index for computer processors. In Technology and Capital Formation, D. W. Jorgenson and R. Landau, Eds. The MIT Press, Cambridge, MA, 37--75.Google ScholarGoogle Scholar
  34. Francalanci, C. and Galal, H. 1998. Information technology and worker composition: Determinants of productivity in the life insurance industry. MIS Quart. 22, 2, 227--241. Google ScholarGoogle Scholar
  35. Franke, R. H. 1987. Technological revolution and productivity decline: Computer introduction in the financial industry. Techn. Forecasting Soc. Change 31, 2, 143--154.Google ScholarGoogle Scholar
  36. Gilchrist, S., Gurbaxani, V., and Town, R. 2001. PCs and the productivity revolution. Working paper. Center for Research on Information Technology and Organizations, University of California, Irvine, Irvine, CA.Google ScholarGoogle Scholar
  37. Gordon, R. 1999. Has the "new economy" rendered the productivity slowdown obsolete? Working paper. Northwestern University, Evanston, IL.Google ScholarGoogle Scholar
  38. Gordon, R. 2000. Does the "new economy" measure up to the great inventions of the past? J. Econ. Perspect. 14, 4, 49--76.Google ScholarGoogle Scholar
  39. Gordon, R. 2001. Technology and economic performance in the American economy. Working Paper. National Bureau of Economic Research, Cambridge, MA. Version of paper prepared for the Council on Foreign Relations, Washington, D.C., and New York, NY.Google ScholarGoogle Scholar
  40. Greenan, N., Mairesse, J., and Topiol-Bensaid, A. 2001. Information technology and research and development impacts on productivity and skills: Looking for correlations on French firm-level data. In Information Technology, Productivity, and Economic Growth: International Evidence and Implications for Economic Development, M. POHJOLA, Ed. Oxford University Press, Cambridge, U.K., 119--148.Google ScholarGoogle Scholar
  41. Gurbaxani, V. and Whang, S. 1991. The impact of information systems on organizations and markets. Commun. ACM 34, 1, 59--73. Google ScholarGoogle Scholar
  42. Harris, S .E. and Katz, J. L. 1991. Organizational performance and information technology investment intensity in the insurance industry. Organizational Sci. 2, 3, 263--296.Google ScholarGoogle Scholar
  43. Hitt L. M. and Brynjolfsson, E. 1996. Productivity, business profitability, and consumer surplus: Three different measures of information technology value. MIS Quart. 20, 2, 121--142. Google ScholarGoogle Scholar
  44. Jorgenson, D. W. 2001. Information technology and the U.S. economy (Presidential address to the American Economic Association). American Econ. Rev. 91, 1, 1--32.Google ScholarGoogle Scholar
  45. Jorgenson, D. W., Ho, M. S., and Stiroh, K. J. 2002. Projecting productivity growth: Lessons from the U.S. growth resurgence. Paper prepared for the Conference on Technology, Growth and the Labor Market, Federal Reserve Bank of Atlanta, Atlanta, GA.Google ScholarGoogle Scholar
  46. Jorgenson, D. W. and Stiroh, K. J. 1995. Computers and growth. Econ. Innov. New Techn. 3, 4, 295--316.Google ScholarGoogle Scholar
  47. Jorgenson, D. W. and Stiroh, K. J. 1999. Information technology and growth. American Econ. Rev. 89, 2 (May), 109--115.Google ScholarGoogle Scholar
  48. Jorgenson, D. W. and Stiroh, K. J. 2000. Raising the speed limit: U.S. economic growth in the information age. Brookings Pap. Econ. Act. 1, 1, 125--211.Google ScholarGoogle Scholar
  49. King, J. L. 1996. Where are the payoffs from computerization? Technology, learning, and organizational change. In Computerization and Controversy, R. Kling, Ed. Academic Press, San Diego, CA, 239--260. Google ScholarGoogle Scholar
  50. Kraemer, K. L. and Dedrick, J. 1994. Payoffs from investment in information technology: Lessons from Asia-Pacific region. World Develop. 22, 12, 19--21.Google ScholarGoogle Scholar
  51. Kraemer, K. L. and Dedrick, J. 2001. Information technology and productivity: Results and implications of cross-country studies. In Information Technology and Economic Development, M. Pohjola, Ed. Oxford University Press, Cambridge, U.K. 257--279.Google ScholarGoogle Scholar
  52. Krueger, A. 1993. How computers have changed the wage structure: Evidence from micro data, 1984--1989. Quart. J. Econ. 108, 1, 33--60.Google ScholarGoogle Scholar
  53. Lal, K. 2001. The determinants of the adoption of information technology: A case study of the Indian garments industry. In Information Technology, Productivity, and Economic Growth: International Evidence and Implications for Economic Development. M. Pohjola, Ed. Oxford University Press, Cambridge, U.K., 149--174.Google ScholarGoogle Scholar
  54. Laudon, K. C. and Marr, K. L. 1994. Productivity and the enactment of a macro culture. NYU Center for Research on Information Systems, Department of Information Systems, New York University, New York, NY.Google ScholarGoogle Scholar
  55. Lichtenberg, F. R. 1995. The output contributions of computer equipment and personnel: A firm level analysis. Econ. Innov. New Techn. 3, 3-4, 201--217.Google ScholarGoogle Scholar
  56. Litan, R. E. and Rivlin, A. M. 2001. Projecting the economic impact of the Internet. Papers and Proceedings of the One Hundred Thirteenth Annual Meeting of the American Economic Association. American Econ. Rev. 91, 2 (May), 313--322.Google ScholarGoogle Scholar
  57. Loveman, G. W. 1994. An assessment of the productivity impact of information technologies. In Information Technology and the Corporation of the 1990s: Research Studies, T. J. Allen and M. S. Scott Morton, Eds. Oxford University Press, Cambridge, U.K., 84--110.Google ScholarGoogle Scholar
  58. Malone, T. W., Yates, J., and Benjamin, R. I. 1989. The logic of electronic markets. Harvard Bus. Rev. 67, 3 (May-June), 166--172. Google ScholarGoogle Scholar
  59. Mckinsey Global Institute. 2001. U.S. Productivity Growth 1995--2000: Understanding the Contribution of Information Technology Relative to Other Factors. McKinsey Global Institute, Washington. D.C.Google ScholarGoogle Scholar
  60. Melville, N. 2001. Information technology investment impact and industry structure: Evidence from firms and industries. Ph. D. dissertation. University of California, Irvine, Irvine, CA.Google ScholarGoogle Scholar
  61. Mukhopadhyay, T., Kekre, S., and Kalathur, S. 1995. Business value of information technology: A study of electronic data interchange. MIS Quart. 19, 2, 137--156. Google ScholarGoogle Scholar
  62. Nordhaus, W. D. 2001. Productivity growth and the new economy. NBER Working Paper No. 8096. National Bureau of Economic Research, Cambridge, MA.Google ScholarGoogle Scholar
  63. Oliner, S. D. and Sichel, D. E. 1994. Computers and output growth revisited: How big is the puzzle? Brookings Pap. Econ. Act. 2, 2, 273--317.Google ScholarGoogle Scholar
  64. Oliner, S. D. and Sichel, D. E. 2000. The resurgence of growth in the late 1990s: Is information technology the story? J. Econ. Perspect. 14, 4, 3--22.Google ScholarGoogle Scholar
  65. Oliner, S. D. and Sichel, D. E. 2002. Information technology and productivity: Where are we now and where are we going? Econ. Rev. 3, 3, 15--41.Google ScholarGoogle Scholar
  66. Pohjola, M. 2001. Information technology and economic growth: A cross-country analysis. In Information Technology and Economic Development. M. POHJOLA, Ed. Oxford University Press, Cambridge, U.K., 242--256.Google ScholarGoogle Scholar
  67. Ramirez, R., Kraemer, K. L., and Lawler, E. 2001. The contribution of information technology investments to firm performance: Influence of management practices. Working paper. Center for Research on Information Technology and Organizations, University of California, Irvine, Irvine, CA.Google ScholarGoogle Scholar
  68. Roach, S. S. 1987. America's technology dilemma: A profile of the information economy. Morgan Stanley Special Economic Study (April).Google ScholarGoogle Scholar
  69. Roach, S. S. 1989. Pitfalls of the new assembly line: Can service learn from manufacturing? Morgan Stanley Special Economic Study (June 22).Google ScholarGoogle Scholar
  70. Roach, S. S. 1991. Services under siege: The restructuring imperative. Harvard Bus. Rev. 39, 2 (Sept-Oct.), 82--92.Google ScholarGoogle Scholar
  71. Romer, P. M. 1986. Increasing returns and long-run growth. J. Polit. Econ. 94, 5, 1002--1037.Google ScholarGoogle Scholar
  72. Schreyer, P. 1999. The contribution of information and communication technology to output growth. Statistical Working Paper No. 99:4. OECD, Paris, France.Google ScholarGoogle Scholar
  73. Sichel, D. E. 1997. The Computer Revolution: An Economic Perspective. Brookings Institution Press, Washington, D.C. Google ScholarGoogle Scholar
  74. Solow, R. 1987. We'd better watch out. New York Times Book Review (July 12).Google ScholarGoogle Scholar
  75. Srinivasan, X., Kekre, S., and Mukhopadhyay, T. 1994. Impact of electronic data interchange technology on JIT shipments. Manage. Sci. 40, 10, 1291--1304. Google ScholarGoogle Scholar
  76. Stiglitz, J. 2002. The roaring nineties. Atlantic Month. 290, 3 (Oct.), 76--89.Google ScholarGoogle Scholar
  77. Stiroh, K. J. 2001a. Information technology and the U.S. productivity revival: What does the industry data say? Unpublished paper. Federal Reserve Bank of New York.Google ScholarGoogle Scholar
  78. Stiroh, K. J. 2001b. What drives productivity growth? Econ. Policy Rev. 7, 1 (March), 37--59.Google ScholarGoogle Scholar
  79. Strassmann, P. A. 1990. The Business Value of Computers: An Executive's Guide. Information Economics Press, New Canaan, CT. Google ScholarGoogle Scholar
  80. Tallon, P., Kraemer, K. L., and Gurbaxani, V. 2000. Executives perspectives on the business value of information technology. J. Manage. Inform. Syst. 16, 4, 145--173. Google ScholarGoogle Scholar
  81. Triplett, J. E. and Bosworth, B. P. 2002. "Baumol's disease" has been cured: IT and multifactor productivity in U.S. services industries. Unpublished paper. The Brookings Institution, Washington, D.C.Google ScholarGoogle Scholar
  82. Weill, P. 1992. The relationship between information technology and firm performance: A study of the valve-manufacturing sector. Inform. Syst. Res. 3, 4, 307--333.Google ScholarGoogle Scholar
  83. Whelan, K. 2000. Computers, obsolescence, and productivity. Finance and Economic Discussions Services, 2000-06, Board of Governors of the Federal Reserve System.Google ScholarGoogle Scholar
  84. Zuboff, S. 1988. In the age of the Smart Machine: The Future of Work and Power. Basic Books, New York, NY. Google ScholarGoogle Scholar

Recommendations

Reviews

Barrett Hazeltine

According to this paper, investment in information technology (IT) does in fact have a significant and positive influence on labor productivity and economic growth, despite earlier studies to the contrary. More than 50 research papers were reviewed for this study, relating, primarily, the amount of capital invested in IT (the input) and the resulting change in labor productivity (the output). A formal framework is used to consider productivity at the firm, industry, and country levels. Increase in productivity from an IT investment may result from either capital deepening (giving workers better tools), or from so-called multifactor productivity (related to enabling organizational change). While it is clear that productivity generally increases with increased IT investment, the gains are not equal for all firms or in all industries, and may not exist for developing countries. Decentralized decision making and related management practices increase the gains created by IT investment. Gains are particularly high in IT-producing industries. It was once believed that service industries did not share the gains in productivity from IT investments, but it appears now that they do. IT investments have actually been increasing productivity for over 30 years, despite the only recent attention to these improvements. This study suggests that major further research in measurements of inputs and, especially, outputs is needed. The paper concludes with a warning that the recent decrease in IT investment has not only devastated the IT producing industry, but may lead to slower economic growth in the US overall. Online Computing Reviews Service

Access critical reviews of Computing literature here

Become a reviewer for Computing Reviews.

Comments

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Sign in

Full Access

PDF Format

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader