skip to main content
10.1145/1985793.1985952acmconferencesArticle/Chapter ViewAbstractPublication PagesicseConference Proceedingsconference-collections
research-article

Data analytics for game development (NIER track)

Published:21 May 2011Publication History

ABSTRACT

The software engineering community has had seminal papers on data analysis for software productivity, quality, reliability, performance etc. Analyses have involved software systems ranging from desktop software to telecommunication switching systems. Little work has been done on the emerging digital game industry. In this paper we explore how data can drive game design and production decisions in game development. We define a mixture of qualitative and quantitative data sources, broken down into three broad categories: internal testing, external testing, and subjective evaluations. We present preliminary results of a case study of how data collected from users of a released game can inform subsequent development.

References

  1. Adent, D. Forza Motorsport 3 And Predictable Development. Gamasutra.com. http://www.gamasutra.com/view/feature/6182/forza_motorsport_3_and_predictable_.phpGoogle ScholarGoogle Scholar
  2. Blow, J. 2004. Game Development: Harder Than You Think. Queue 1, 10 (February 2004), 28--37. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Bungie.net. Global Heatmaps. http://www.bungie.net/online/heatmaps.aspxGoogle ScholarGoogle Scholar
  4. GameFAQs.com. http://www.gamefaqs.com/Google ScholarGoogle Scholar
  5. Kim, J., Gunn, D., Schuh, E., Phillips, B., Pagulayan, R., and Wixon, D. 2008. Tracking real-time user experience (TRUE): a comprehensive instrumentation solution for complex systems. In Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems (CHI '08). ACM, New York, NY, USA, 443--452. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Lewis, C. and Wardrip-Fruin, N. 2010. Mining game statistics from web services: a World of Warcraft armory case study. In Proceedings of the Fifth International Conference on the Foundations of Digital Games (FDG '10). ACM, New York, NY, USA, 100--107. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Nutt, C. Halo: Reach - The Beta Story. Gamasutra.com http://www.gamasutra.com/view/feature/5875/halo_reach__the_beta_story.phpGoogle ScholarGoogle Scholar
  8. Priyesh N. Dixit and G. Michael Youngblood. 2007. Optimal information placement in an interactive 3D environment. In Proceedings of the 2007 ACM SIGGRAPH symposium on Video games (Sandbox '07). ACM, New York, NY, USA, 141--147. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Priyesh N. Dixit and G. Michael Youngblood. 2008. Understanding information observation in interactive 3D environments. In Proceedings of the 2008 ACM SIGGRAPH symposium on Video games (Sandbox '08). ACM, New York, NY, USA, 163--170. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Russell, B. A Deeper Look Into The Combat Design Of Uncharted 2. Gamasutra.com. http://www.gamasutra.com/view/feature/5883/a_deeper_look_into_the_combat_.phpGoogle ScholarGoogle Scholar
  11. Russell, B. Designing Combat Encounters In Uncharted 2. Gamasutra.com http://www.gamasutra.com/view/feature/5945/designing_combat_encounters_in_.phpGoogle ScholarGoogle Scholar
  12. Scanlon, J. The Video Game Industry Outlook: $31.6 Billion and Growing. BusinessWeek.com. http://www.businessweek.com/innovate/content/aug2007/id20070813_120384.htmGoogle ScholarGoogle Scholar
  13. Sofge, E. How Halo: Reach Was Created: Insider's Guide. PopularMechanics.com. http://www.popularmechanics.com/technology/gadgets/video-games/how-halo-reach-was-created-insiders-guideGoogle ScholarGoogle Scholar
  14. Thompson, C. Halo 3: How Microsoft Labs Invented a New Science of Play. Wired.com. http://www.wired.com/gaming/virtualworlds/magazine/15-09/ff_haloGoogle ScholarGoogle Scholar
  15. Van der Heijden, J. Successful Playtesting In Swords & Soldiers. Gamasutra.com http://www.gamasutra.com/view/feature/5939/successful_playtesting_in_swords_.phpGoogle ScholarGoogle Scholar
  16. Weber, B., Mateas, M. A data mining approach to strategy prediction. In Computational Intelligence and Games, 2009. CIG 2009. IEEE Symposium on, vol., no., pp.140--147, 7-10 Sept. 2009 Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Data analytics for game development (NIER track)

          Recommendations

          Reviews

          John M. Artz

          When video game developers design and develop a video game, how do they know that the game meets its objectives for performance, functionality, and game experience__?__ The simple answer is that the game needs to be tested and the gathered data needs to be analyzed. In fact, it needs to be tested just like any other piece of software. The authors lay out a testing framework for video games that includes internal testing, external testing, and subjective evaluations. Internal testing is largely quality assurance; external testing is user acceptance; and subjective testing attempts to measure user experience. The authors then apply this framework to a case study involving an Xbox racing game. The proposed framework looks like a first step, and I would hope that video game developers are further along than this. However, if they are not, this paper provides a good start, a useful framework, and a case study of the ideas. Online Computing Reviews Service

          Access critical reviews of Computing literature here

          Become a reviewer for Computing Reviews.

          Comments

          Login options

          Check if you have access through your login credentials or your institution to get full access on this article.

          Sign in
          • Published in

            cover image ACM Conferences
            ICSE '11: Proceedings of the 33rd International Conference on Software Engineering
            May 2011
            1258 pages
            ISBN:9781450304450
            DOI:10.1145/1985793

            Copyright © 2011 ACM

            Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

            Publisher

            Association for Computing Machinery

            New York, NY, United States

            Publication History

            • Published: 21 May 2011

            Permissions

            Request permissions about this article.

            Request Permissions

            Check for updates

            Qualifiers

            • research-article

            Acceptance Rates

            Overall Acceptance Rate276of1,856submissions,15%

            Upcoming Conference

            ICSE 2025

          PDF Format

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader