Skip to main content
SpringerLink
Log in

Design Principles for a Crowd-Based Prototype Validation Platform

  • Conference paper
  • First Online:
Software Business (ICSOB 2021)

Part of the book series: Lecture Notes in Business Information Processing ((LNBIP,volume 434))

Included in the following conference series:

Abstract

One of the most critical aspects of developing successful products is the early feedback of potential customers. Here, customers can provide feedback iteratively on prototypes before the actual development of the product to save development resources on dissatisfying features. This feedback, in turn, could be collected using crowdsourcing. To gain knowledge about the design of software to support the iterative prototype development based on crowd feedback, this paper develops design principles for a crowd-based prototype validation platform. On this platform, developers can present their software prototypes in different forms and receive iterative feedback from a selected crowd of potential customers. The feedback is presented to the developer in an aggregated form to support his decision-making in further development. We conduct a design science study that builds the design principles based on an analysis of literature and software tools. We instantiate the design principles as a platform and evaluate them within an expert workshop. Our results show that the identified design principles support developing such software support for crowd-based prototype validation.

This work was partially supported by the German Research Foundation (DFG) within the CRC “On-The-Fly Computing” (CRC 901, Project Number: 160364472SFB901) and the German Federal Ministry of Education and Research (BMBF) through Software Campus grant (Project Number: 01IS17046).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 54.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 69.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Figma Tool: https://www.figma.com/.

  2. 2.

    Adobe XD Tool: https://www.adobe.com/products/xd.html.

  3. 3.

    Kickstarter Platform: https://www.kickstarter.com/.

  4. 4.

    Amazon Mechanical Turk Platform: https://www.mturk.com/.

  5. 5.

    Innocentive Platform: https://www.innocentive.com/.

  6. 6.

    UIGiants Platform: https://www.uigiants.com/.

  7. 7.

    YouTube Platform: https://www.youtube.com/.

References

  1. Alvarez, S.A., Barney, J.B., Anderson, P.: Forming and exploiting opportunities: the implications of discovery and creation processes for entrepreneurial and organizational research. Organ. Sci. 24(1), 301–317 (2013)

    Article  Google Scholar 

  2. Blank, S.: Why the lean start-up changes everything. Harv. Bus. Rev. 91, 63–72 (2013)

    Google Scholar 

  3. Blank, S.G., Dorf, B.: The Startup Owner’s Manual: The Step-By-Step Guide for Building a Great Company, 1st edn. K&S Ranch Press, Pescadero (2012)

    Google Scholar 

  4. Burmeister, K., Schade, C.: Are entrepreneurs’ decisions more biased? An experimental investigation of the susceptibility to status quo bias. J. Bus. Ventur. 22(3), 340–362 (2007)

    Article  Google Scholar 

  5. Ceccagnoli, M., Forman, C., Huang, P., Wu, D.J.: Cocreation of value in a platform ecosystem! The case of enterprise software. MIS Q. 36(1), 263 (2012)

    Article  Google Scholar 

  6. Chen, K.T., Chu, W.T., Larson, M., Ooi, W.T. (eds.): Proceedings of CrowdMM 2012. ACM (2012)

    Google Scholar 

  7. Dellermann, D., Lipusch, N., Ebel, P.: Developing design principles for a crowd-based business model validation system. In: Maedche, A., vom Brocke, J., Hevner, A. (eds.) DESRIST 2017. LNCS, vol. 10243, pp. 163–178. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-59144-5_10

    Chapter  Google Scholar 

  8. Durward, D., Blohm, I., Leimeister, J.M.: Crowd work. Bus. Inf. Syst. Eng. 58(4), 281–286 (2016)

    Article  Google Scholar 

  9. Evans, D.S., Schmalensee, R.: Matchmakers: The New Economics of Multisided Platforms. Harvard Business Review Press, Boston (2016)

    Google Scholar 

  10. Fagerholm, F., Sanchez Guinea, A., Mäenpää, H., Münch, J.: The RIGHT model for continuous experimentation. J. Syst. Softw. 123, 292–305 (2017)

    Article  Google Scholar 

  11. Geiger, D., Seedorf, S., Schulze, T., Nickerson, R.C., Schader, M.: Managing the crowd: towards a taxonomy of crowdsourcing processes. In: AMCIS 2011 Proceedings - All Submissions. AIS (2011)

    Google Scholar 

  12. Gregor, S., Hevner, A.R.: Positioning and presenting design science research for maximum impact. MIS Q. 37(2), 337–355 (2013)

    Article  Google Scholar 

  13. Gregor, S., Kruse, L., Seidel, S.: Research perspectives: the anatomy of a design principle. J. Assoc. Inf. Syst. 21, 1622–1652 (2020)

    Google Scholar 

  14. Hammon, L., Hippner, H.: Crowdsourcing. Bus. Inf. Syst. Eng. 4(3), 163–166 (2012)

    Article  Google Scholar 

  15. Hevner, A.R., March, S.T., Park, J., Ram, S.: Design science in information systems research. MIS Q. 28, 75–105 (2004)

    Article  Google Scholar 

  16. Kittur, A., Chi, E.H., Suh, B.: Crowdsourcing user studies with mechanical turk. In: Czerwinski, M., Lund, A., Tan, D. (eds.) Proceeding of CHI 2008, p. 453. ACM (2008)

    Google Scholar 

  17. Kuechler, B., Vaishnavi, V.: On theory development in design science research: anatomy of a research project. Eur. J. Inf. Syst. 17(5), 489–504 (2008)

    Article  Google Scholar 

  18. Leimeister, J.M.: Crowdsourcing. Control. Manag. 56(6), 388–392 (2012)

    Article  Google Scholar 

  19. Lindgren, E., Münch, J.: Raising the odds of success: the current state of experimentation in product development. Inf. Softw. Technol. 77, 80–91 (2016)

    Article  Google Scholar 

  20. Linsey, J.S., Clauss, E.F., Kurtoglu, T., Murphy, J.T., Wood, K.L., Markman, A.B.: An experimental study of group idea generation techniques: understanding the roles of idea representation and viewing methods. J. Mech. Des. 133(3), 031008 (2011)

    Article  Google Scholar 

  21. Luther, K., et al.: Structuring, aggregating, and evaluating crowdsourced design critique. In: Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work and Social Computing, pp. 473–485. ACM (2015)

    Google Scholar 

  22. Maalej, W., Nayebi, M., Johann, T., Ruhe, G.: Toward data-driven requirements engineering. IEEE Softw. 33(1), 48–54 (2016)

    Article  Google Scholar 

  23. Mao, K., Yang, Y., Wang, Q., Jia, Y., Harman, M.: Developer recommendation for crowdsourced software development tasks. In: 2015 IEEE Symposium on Service-Oriented System Engineering, pp. 347–356. IEEE (2015)

    Google Scholar 

  24. McGrath, R.G.: Business models: a discovery driven approach. Long Range Plan. 43, 247–261 (2010)

    Article  Google Scholar 

  25. Möller, F., Guggenberger, T.M., Otto, B.: Towards a method for design principle development in information systems. In: Hofmann, S., Müller, O., Rossi, M. (eds.) DESRIST 2020. LNCS, vol. 12388, pp. 208–220. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-64823-7_20

    Chapter  Google Scholar 

  26. Münch, J., Trieflinger, S., Heisler, B.: Product discovery - building the right things: insights from a grey literature review. In: Proceedings of ICE/ITMC, pp. 1–8. IEEE (2020)

    Google Scholar 

  27. Nambisan, S.: Digital entrepreneurship: toward a digital technology perspective of entrepreneurship. Entrep. Theory Pract. 41(6), 1029–1055 (2017)

    Article  Google Scholar 

  28. Nebeling, M., Speicher, M., Norrie, M.C.: CrowdStudy. In: Proceedings EICS, p. 255. ACM (2013)

    Google Scholar 

  29. Olsson, H.H., Bosch, J.: The HYPEX model: from opinions to data-driven software development. In: Bosch, J. (ed.) Continuous Software Engineering, pp. 155–164. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-11283-1_13

    Chapter  Google Scholar 

  30. Olsson, H.H., Bosch, J.: Towards continuous customer validation: a conceptual model for combining qualitative customer feedback with quantitative customer observation. In: Fernandes, J.M., Machado, R.J., Wnuk, K. (eds.) ICSOB 2015. LNBIP, vol. 210, pp. 154–166. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-19593-3_13

    Chapter  Google Scholar 

  31. Parker, G., van Alstyne, M., Choudary, S.P.: Platform Revolution: How Networked Markets Are Transforming the Economy and How to Make Them Work for You. W.W. Norton & Company, New York (2016)

    Google Scholar 

  32. Quoc Viet Hung, N., Chi Thang, D., Weidlich, M., Aberer, K.: ERICA. In: Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 1037–1038. ACM (2015)

    Google Scholar 

  33. Reibenspiess, V., Drechsler, K., Eckhardt, A., Wagner, H.T.: Tapping into the wealth of employees’ ideas: design principles for a digital intrapreneurship platform. Inf. Manag. 103287 (2020)

    Google Scholar 

  34. Ries, E.: The Lean Startup: How Today’s Entrepreneurs Use Continuous Innovation to Create Radically Successful Businesses. Crown Business, New York (2014)

    Google Scholar 

  35. Srivastava, A., Thomson, S.B.: Framework analysis: a qualitative methodology for applied policy research. J. Admin. Gov. 4, 72–79 (2009)

    Google Scholar 

  36. Tavanapour, N., Bittner, E.A.C.: Towards supportive mechanisms for crowd collaboration – design guidelines for platform developers. In: Zaphiris, P., Ioannou, A. (eds.) HCII 2019. LNCS, vol. 11591, pp. 353–372. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-21817-1_27

    Chapter  Google Scholar 

  37. Teece, D.J.: Business models, business strategy and innovation. Long Range Plan. 43(2–3), 172–194 (2010)

    Article  Google Scholar 

  38. Tran, A., Hasan, S.U., Park, J.Y.: Crowd participation pattern in the phases of a product development process that utilizes crowdsourcing. Ind. Eng. Manag. Syst. 11(3), 266–275 (2012)

    Google Scholar 

  39. Vogel, P.: From venture idea to venture opportunity. Entrep. Theory Pract. 41(6), 943–971 (2017)

    Article  Google Scholar 

  40. Xu, A., Huang, S.W., Bailey, B.: Voyant: generating structured feedback on visual designs using a crowd of non-experts. In: ACM Conference on Computer Supported Cooperative Work & Social Computing, pp. 1433–1444. ACM (2014)

    Google Scholar 

  41. Yin, R.K.: Case Study Research: Design and Methods. Applied Social Research Methods Series, vol. 5, 4th edn. Sage, Los Angeles (2009)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Software Innovation Lab, Paderborn University, Paderborn, Germany

    Sebastian Gottschalk, Muhammad Suffyan Aziz, Enes Yigitbas & Gregor Engels

Authors
  1. Sebastian Gottschalk
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Muhammad Suffyan Aziz
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Enes Yigitbas
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Gregor Engels
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Sebastian Gottschalk .

Editor information

Editors and Affiliations

  1. Free University of Bozen-Bolzano, Bolzano, Italy

    Xiaofeng Wang

  2. University of Oslo, Oslo, Norway

    Antonio Martini

  3. University of South Eastern Norway, Bø, Norway

    Anh Nguyen-Duc

  4. University of Oslo and SINTEF, Oslo, Norway

    Viktoria Stray

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Gottschalk, S., Aziz, M.S., Yigitbas, E., Engels, G. (2021). Design Principles for a Crowd-Based Prototype Validation Platform. In: Wang, X., Martini, A., Nguyen-Duc, A., Stray, V. (eds) Software Business. ICSOB 2021. Lecture Notes in Business Information Processing, vol 434. Springer, Cham. https://doi.org/10.1007/978-3-030-91983-2_16

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-91983-2_16

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-91982-5

  • Online ISBN: 978-3-030-91983-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation