Skip to main content

Exploring Requirements for Multipurpose Crowd Computing Framework

  • Conference paper
  • First Online:
Advances in Service-Oriented and Cloud Computing (ESOCC 2015)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 567))

Included in the following conference series:

  • 1994 Accesses

Abstract

Crowd computing is a common name for variety of methods to solve problems with a help of large, undefined groups of people communicating via Internet. It is becoming widely used nowadays, but there still are many questions about how to effectively program distributed scalable systems, employing human information processing abilities. Crowd computing frameworks described in the literature often focus only on several unique features leaving other almost without attention, making it hard to render a systematic view of all the aspects of the design. The goal of this paper is to collect and analyze all the requirements for crowd computing frameworks that drove the development of these frameworks recently. The united and unified set of requirements is meant to provide a basis for further development of crowd computing frameworks and applications and, at the same time, it can serve as a basis for comparison of that kind of products.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Institutional subscriptions

References

  1. Bernstein, A., Klein, M., Malone, T.W.: Programming the global brain. Commun. ACM 55, 41 (2012)

    Article  Google Scholar 

  2. Ra, M., Liu, B., Porta, T. La, Govindan, R.: Medusa: a programming framework for crowd-sensing applications categories and subject descriptors. In: Proceedings of the 10th International Conference on Mobile Systems, Applications, and Services, MobiSys 2012, pp. 337–350 (2012)

    Google Scholar 

  3. Ahmad, S., Battle, A., Malkani, Z., Kamvar, S.: The jabberwocky programming environment for structured social computing. In: Proceedings of the 24th Annual ACM Symposium User interface Software Technology, UIST 2011, pp. 53–64 (2011)

    Google Scholar 

  4. Van Pelt, C., Sorokin, A.: Designing a scalable crowdsourcing platform. In: Proceedings of the 2012 International Conference on Management Data, SIGMOD 2012, p. 765 (2012)

    Google Scholar 

  5. Kucherbaev, P., Tranquillini, S., Daniel, F., Casati, F., Marchese, M., Brambilla, M., Fraternali, P.: Business processes for the crowd computer. In: Rosa, M., Soffer, P. (eds.) BPM Workshops 2012. LNBIP, vol. 132, pp. 256–267. Springer, Heidelberg (2013)

    Chapter  Google Scholar 

  6. Dai, P., Mausam, Weld, D.S.: Artificial intelligence for artificial artificial intelligence. In: The 25th AAAI Conference on Artificial Intelligence, pp. 1153–1159 (2011)

    Google Scholar 

  7. Morishima, A., Shinagawa, N., Mitsuishi, T.: CyLog/Crowd4U: a declarative platform for complex data-centric crowdsourcing. Proc. VLDB Endow. 5, 1918–1921 (2012)

    Article  Google Scholar 

  8. Franklin, M., Kossmann, D., Kraska, T., Ramesh, S., Xin, R.: CrowdDB: answering queries with crowdsourcing. In: Proceedings of the 2011 ACM SIGMOD International Conference on Management of Data, SIGMOD 2011, pp. 1–12 (2011)

    Google Scholar 

  9. Kittur, A., Smus, B., Khamkar, S., Kraut, R.E.: CrowdForge: crowdsourcing complex work. In: Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology, UIST 2011 (2011)

    Google Scholar 

  10. Horowitz, D., Kamvar, S.D.: The anatomy of a large-scale social search engine. In: Proceedings of the 19th International Conference on World Wide Web, WWW 2010, p. 431 (2010)

    Google Scholar 

  11. Phuttharak, J., Loke, S.W.: LogicCrowd: A declarative programming platform for mobile crowdsourcing. In: Proceedings of the 12th IEEE International Conference on Trust, Security and Privacy in Computing and Communications, TrustCom 2013, pp. 1323–1330 (2013)

    Google Scholar 

  12. Phuttharak, J., Loke, S.W.: Towards declarative programming for mobile crowdsourcing: P2P aspects. In: 1st International Workshop on Mobile Collaborative Crowdsourcing and Sensing (M-CROS) in conjunction with the 15th IEEE International Conference on Mobile Data Management (2014)

    Google Scholar 

  13. Dai, P., Lin, C.H., Weld, D.S.: POMDP-based control of workflows for crowdsourcing. Artif. Intell. 202, 52–85 (2013)

    Article  MathSciNet  MATH  Google Scholar 

  14. Kulkarni, A., Can, M., Hartmann, B.: Collaboratively crowdsourcing workflows with turkomatic. In: Proceedings of the ACM 2012 Conference on Computer Supported Cooperative Work, CSCW 2012, p. 1003. ACM Press, New York (2012)

    Google Scholar 

  15. Ra, M., Liu, B., La Porta, T., Govindan, R.: Demo – medusa: a Programming Framework for Crowd-Sensing Applications. In: Proceedings of the 10th International Conference on Mobile Systems, Applications, and Services, MobiSys 2012, pp. 481–482 (2012)

    Google Scholar 

  16. Scekic, O., Truong, H.-L., Dustdar, S.: Incentives and rewarding in social computing. Commun. ACM 56, 72 (2013)

    Article  Google Scholar 

  17. Hirth, M., Hoßfeld, T., Tran-Gia, P.: Analyzing costs and accuracy of validation mechanisms for crowdsourcing platforms. Math. Comput. Model. 57, 2918–2932 (2013)

    Article  Google Scholar 

  18. Kazai, G., Kamps, J., Milic-Frayling, N.: Worker types and personality traits in crowdsourcing relevance labels. In: Proceedings of the 20th ACM International Conference on Information and Knowledge Management, CIKM 2011, pp. 1941–1944 (2011)

    Google Scholar 

  19. Okubo, Y., Kitasuka, T., Aritsugi, M.: A preliminary study of the number of votes under majority rule in crowdsourcing. Procedia Comput. Sci. 22, 537–543 (2013)

    Article  Google Scholar 

  20. Zhang, H.: Computational Environment Design (2012)

    Google Scholar 

  21. Barowy, D., Curtsinger, C., Berger, E., McGregor, A.: AutoMan: a platform for integrating human-based and digital computation. In: Proceedings of the ACM International Conference on Object Oriented Programming Systems Languages and Applications, OOPSLA 2012, pp. 639–654 (2012)

    Google Scholar 

  22. Tarasov, A., Delany, S.J., Mac Namee, B.: Dynamic estimation of worker reliability in crowdsourcing for regression tasks: making it work. Expert Syst. Appl. 41, 6190–6210 (2014)

    Article  Google Scholar 

  23. Tran-Thanh, L., Stein, S., Rogers, A., Jennings, N.R.: Efficient crowdsourcing of unknown experts using bounded multi-armed bandits. Artif. Intell. 214, 89–111 (2014)

    Article  MathSciNet  MATH  Google Scholar 

  24. Yang, Y., Zhu, B.B., Guo, R., Yang, L., Li, S., Yu, N.: A comprehensive human computation framework – with application to image labeling. In: Proceedings of the 16th ACM International Conference on Multimedia Pages, pp. 479–488 (2008)

    Google Scholar 

  25. Little, G., Chilton, L.B., Goldman, M., Miller, R.C.: TurKit: human computation algorithms on mechanical turk. In: Proceedings of the 23rd Annual ACM Symposium on User Interface Software and Technology, pp. 57–66. ACM, New York (2010)

    Google Scholar 

Download references

Acknowledgements

The research was partially supported by projects funded by grants # 13-07-00271, # 14-07-00345, # 14-07-00363 of the Russian Foundation for Basic Research, project 213 (program 8) of the Presidium of the Russian Academy of Sciences, project # 2.2 of the basic research program “Intelligent information technologies, system analysis and automation” of the Nanotechnology and Information Technology Department of the Russian Academy of Sciences, and Grant 074-U01 of the Government of the Russian Federation.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Alexander Smirnov .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this paper

Cite this paper

Smirnov, A., Ponomarev, A. (2016). Exploring Requirements for Multipurpose Crowd Computing Framework. In: Celesti, A., Leitner, P. (eds) Advances in Service-Oriented and Cloud Computing. ESOCC 2015. Communications in Computer and Information Science, vol 567. Springer, Cham. https://doi.org/10.1007/978-3-319-33313-7_23

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-33313-7_23

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-33312-0

  • Online ISBN: 978-3-319-33313-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics