skip to main content
research-article

A Multi-Institutional Perspective on H/FOSS Projects in the Computing Curriculum

Published:11 July 2018Publication History
Skip Abstract Section

Abstract

Many computer science programs have capstone experiences or project courses that allow students to integrate knowledge from the full breadth of their major. Such capstone projects may be student-designed, instructor-designed, designed in conjunction with outside companies, or integrated with ongoing free and open source (FOSS) projects. The literature shows that the FOSS approach has attracted a great deal of interest, in particular when implemented with projects that have humanitarian goals (HFOSS). In this article, we describe five unique models from five distinct types of institutions for incorporating sustained FOSS or HFOSS (alternatively H/FOSS) project work into capstone experiences or courses. The goal is to provide instructors wishing to integrate open source experiences into their curriculum with additional perspectives and resources to help in adapting this approach to the specific needs and goals of their institution and students. All of the models presented are based on sustained engagement with H/FOSS projects that last at least one semester and often more. Each model is described in terms of its characteristics and how it fits the needs of the institution using the model. Assessment of each model is also presented. We then discuss the themes that are common across the models, such as project selection, team formation, mentoring, and student assessment. We examine the choices made by each model, as well as the challenges faced. We end with a discussion how the models have leveraged institutional initiatives and collaborations with outside organizations to address some of the challenges associated with these projects.

References

  1. James Bowring and Quinn Burke. 2016. Shaping software engineering curricula using open source communities. J. Interact. Learn. Res. 27, 1 (2016), 5--26.Google ScholarGoogle Scholar
  2. Frederick Brooks. 1995. The Mythical Man-Month. Addison-Wesley. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Kevin Buffardi. 2016. Localized open source software projects: Exploring realism and motivation. In Proceedings of the 2016 11th International Conference on Computer Science 8 Education (ICCSE’16). IEEE, 382--387.Google ScholarGoogle ScholarCross RefCross Ref
  4. Kevin Buffardi, Colleen Robb, and David Rahn. 2017. Tech startups: Realistic software engineering projects with interdisciplinary collaboration. J. Comput. Sci. Coll. 32, 4 (April 2017), 93--98. http://dl.acm.org/citation.cfm?id=3055338.3055355 Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. David Carrington and S-K Kim. 2003. Teaching software design with open source software. In Proceedings of the FIE 2003 33rd Annual Frontiers in Education, 2003, Vol. 3. IEEE, S1C--9.Google ScholarGoogle ScholarCross RefCross Ref
  6. Marcelo Cataldo, Audris Mockus, Jeffrey Roberts, and James Herbsleb. 2009. Software dependencies, work dependencies, and their impact on failures. IEEE Trans. Softw. Eng. 35 (2009), 864--878. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Christina Chavez, Antonio Terceiro, Paulo Meirelles, Carlos Santos Jr., and Fabio Kon. 2011. Free/libre/open source software development in software engineering education: Opportunities and experiences. In Proceedings of the Fórum de Educação em Engenharia de Software (CBSoft’11-SBES-FEES). http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.636.9969.Google ScholarGoogle Scholar
  8. Cristóbal Costa-Soria and Jennifer Pérez. 2009. Teaching software architectures and aspect-oriented software development using open-source projects. In Proceedings of the 14th Annual ACM SIGCSE Conference on Innovation and Technology in Computer Science Education (ITiCSE’09). ACM, New York, NY, 385--385. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Steven P. Crain. 2017. Open source security assessment as a class project. J. Comput. Sci. Coll. 32, 6 (June 2017), 41--53. http://dl.acm.org/citation.cfm?id=3069658.3069669 Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. G. DeKoenigsberg, C. Tyler, K. Wade, M. Spevack, M. Chua, and J. Sheltren. 2010. Teaching Open Source. Retrieved September 18, 2017 from https://quaid.fedorapeople.org/TOS/Practical_Open_Source_Software_Exploration/html/index.html.Google ScholarGoogle Scholar
  11. M. Bernardine Dias and Eric Brewer. 2009. How computer science serves the developing world. Commun. ACM 52, 6 (June 2009), 74--80. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Huiling Ding. 2007. Open source: Platform for virtual service learning and user-initiated research. In Proceedings of the IEEE International Professional Communication Conference, 2007 (IPCC’07). IEEE, 1--5.Google ScholarGoogle ScholarCross RefCross Ref
  13. Mohsen Dorodchi and Nasrin Dehbozorgi. 2016. Utilizing open source software in teaching practice-based software engineering courses. In Proceedings of the 2016 IEEE Frontiers in Education Conference (FIE’16). IEEE, 1--5.Google ScholarGoogle ScholarCross RefCross Ref
  14. Heidi J.C. Ellis, Mel Chua, Gregory W. Hislop, Michelle Purcell, and Sebastian Dziallas. 2013. Towards a model of faculty development for FOSS in education. In Proceedings of the 2013 IEEE 26th Conference on Software Engineering Education and Training (CSEE#x38;T’13). IEEE, 269--273.Google ScholarGoogle ScholarCross RefCross Ref
  15. H. J. C. Ellis, G. W. Hislop, S. M. Pulimood, B. Morgan, and B. Coleman. 2015. Software engineering learning in HFOSS: A multi-institutional study. In 2015 ASEE Annual Conference and Exposition. Seattle, Washington, 26.1379.1--26.1379.12.Google ScholarGoogle Scholar
  16. Heidi J.C. Ellis, Gregory W. Hislop, Josephine Sears Rodriguez, and Ralph Morelli. 2012. Student software engineering learning via participation in humanitarian FOSS projects. In Proceedings of the 2012 ASEE Annual Conference 8; Exposition. ASEE Conferences, San Antonio, Texas. https://peer.asee.org/21949.Google ScholarGoogle Scholar
  17. Heidi J.C. Ellis, Stoney Jackson, Darci Burdge, Lori Postner, Gregory W. Hislop, and Joanie Diggs. 2014. Learning within a professional environment: Shared ownership of an HFOSS project. In Proceedings of the 15th Annual Conference on Information Technology Education (SIGITE’14). ACM, New York, NY, 95--100. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Heidi J.C. Ellis, Michelle Purcell, and Gregory W. Hislop. 2012. An approach for evaluating FOSS projects for student participation. In Proceedings of the 43rd ACM Technical Symposium on Computer Science Education (SIGCSE’12). ACM, New York, NY, 415--420. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Heidi J. C. Ellis, Gregory W. Hislop, Mel Chua, and Sebastian Dziallas. 2011. How to involve students in FOSS projects. In Proceedings of the 2011 Frontiers in Education Conference (FIE’11). IEEE Computer Society, Washington, DC, T1H--1--1--T1H--6. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Heidi J.C. Ellis, Gregory W. Hislop, Stoney Jackson, and Lori Postner. 2015. Team project experiences in humanitarian free and open source software (HFOSS). Trans. Comput. Educ. 15, 4, Article 18 (Dec. 2015), 23 pages. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Heidi J.C. Ellis, Ralph A. Morelli, Trishan R. de Lanerolle, Jonathan Damon, and Jonathan Raye. 2007. Can humanitarian open-source software development draw new students to CS? In Proceedings of the 38th SIGCSE Technical Symposium on Computer Science Education (SIGCSE’07). ACM, New York, NY, 551--555. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Robert J. Fornaro, Margaret R. Heil, and Alan L. Tharp. 2007. Reflections on 10 years of sponsored senior design projects: Students win—clients win!J. Syst. Softw. 80, 8 (Aug. 2007), 1209--1216. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. foss2serve. 2017. foss2serve. Retrieved March 30, 2017 from http://foss2serve.org.Google ScholarGoogle Scholar
  24. foss2serve. 2017. HFOSS Communities. Retrieved March 14, 2017 from http://www.foss2serve.org/index.php/HFOSS_Communities.Google ScholarGoogle Scholar
  25. foss2serve. 2017. HFOSS Evaluation Instruments. Retrieved March 27, 2017 from http://foss2serve.org/index.php/Evaluation_Instruments.Google ScholarGoogle Scholar
  26. foss2serve. 2017. HFOSS Projects. Retrieved March 14, 2017 from http://www.foss2serve.org/index.php/HFOSS_Projects.Google ScholarGoogle Scholar
  27. foss2serve. 2017. Learning Activities. Retrieved March 14, 2017 from http://foss2serve.org/index.php/Category:Learning_Activity.Google ScholarGoogle Scholar
  28. foss2serve. 2017. Professor’s Open Source Software Experience (POSSE). Retrieved March 30, 2017 from http://foss2serve.org/index.php/POSSE.Google ScholarGoogle Scholar
  29. Edward F Gehringer. 2011. From the manager’s perspective: Classroom contributions to open-source projects. In Proceedings of the Frontiers in Education Conference (FIE’11), 2011. IEEE, F1E--1. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Swapna S. Gokhale, Thérèse Smith, and Robert McCartney. 2012. Integrating open source software into software engineering curriculum: Challenges in selecting projects. In Proceedings of the 1st International Workshop on Software Engineering Education Based on Real-World Experiences. IEEE Press, 9--12. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Jane Huffman Hayes. 2002. Energizing software engineering education through real-world projects as experimental studies. In Proceedings 15th Conference on Software Engineering Education and Training (CSEE8T'02). Covington, KY, 192--206. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Gregory W. Hislop, Heidi J.C. Ellis, and Ralph A. Morelli. 2009. Evaluating student experiences in developing software for humanity. In Proceedings of the 14th Annual ACM SIGCSE Conference on Innovation and Technology in Computer Science Education (ITiCSE’09). ACM, New York, NY, 263--267. Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Gregory W. Hislop, Heidi J.C. Ellis, S. Monisha Pulimood, Becka Morgan, Suzanne Mello-Stark, Ben Coleman, and Cam Macdonell. 2015. A multi-institutional study of learning via student involvement in humanitarian free and open source software projects. In Proceedings of the 11th Annual International Conference on International Computing Education Research (ICER’15). ACM, New York, NY, 199--206. Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Christopher K. Hobbs and Herbert H. Tsang. 2014. Industry in the classroom: Equipping students with real-world experience a reflection on the effects of industry partnered projects on computing education. In Proceedings of the Western Canadian Conference on Computing Education (WCCCE’14). ACM, New York, NY, Article 7, 5 pages. Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. James M. Hogan, Glenn Smith, and Richard Thomas. 2005. Tight spirals and industry clients: The modern SE education experience. In Proceedings of the 7th Australasian Conference on Computing Education (ACE’05), Vol. 42. Australian Computer Society, Inc., Darlinghurst, Australia, Australia, 217--222. http://dl.acm.org/citation.cfm?id=1082424.1082452 Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Letizia Jaccheri and Thomas Osterlie. 2007. Open source software: A source of possibilities for software engineering education and empirical software engineering. In Proceedings of the 1st International Workshop on Emerging Trends in FLOSS Research and Development, 2007 (FLOSS’07). IEEE, 5--5. Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. Stephen Jacobs. 2010. Building an education ecology on serious game design and development for the one laptop per child and sugar platforms: A service learning course builds a base for peer mentoring, cooperative education internships and sponsored research. In Proceedings of the 2010 International IEEE Consumer Electronics Society’s Games Innovations Conference (ICE-GIC’10). IEEE, 1--6.Google ScholarGoogle Scholar
  38. Association for Computing Machinery (ACM) Joint Task Force on Computing Curricula and IEEE Computer Society. 2013. Computer Science Curricula 2013: Curriculum Guidelines for Undergraduate Degree Programs in Computer Science. ACM, New York, NY. 999133. Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Birgit Krogstie and Bendik Bygstad. 2007. Cross-community collaboration and learning in customer-driven software engineering student projects. In Proceedings of the 20th Conference on Software Engineering Education 8 Training (CSEET’07). IEEE Computer Society, Washington, DC, 336--343. Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Birgit R Krogstie. 2008. Power through brokering: Open source community participation in software engineering student projects. In Proceedings of the 30th International Conference on Software Engineering. ACM, 791--800. Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. Clifton Kussmaul. 2009. Software projects using free and open source software: Opportunities, challenges, 8 lessons learned. In American Society for Engineering Education. American Society for Engineering Education.Google ScholarGoogle Scholar
  42. Clifton Kussmaul. 2016. Experience report: Guiding faculty 8 students to participate in humanitarian FOSS communities. In Proceedings of the 2016 IEEE Eighth International Conference on Technology for Education (T4E). IEEE, 224--227.Google ScholarGoogle ScholarCross RefCross Ref
  43. Trishan R. De Lanerolle, Norman Danner, Gary Parker, Ralph Morelli, Danny Krizanc, and Ozgur Izmirli. 2008. Creating an academic community to build H-FOSS creating an academic community to build humanitarian FOSS: A progress report. In Proceedings of the 5th International ISCRAM Conference, F. Fiedrich and B. Van de Walle (Eds.). Washington, DC, USA, 337--341.Google ScholarGoogle Scholar
  44. Chang Liu. 2005. Enriching software engineering courses with service-learning projects and the open-source approach. In Proceedings of the 27th International Conference on Software Engineering. ACM, 613--614. Google ScholarGoogle ScholarDigital LibraryDigital Library
  45. Cameron Macdonell. 2013. Teaching software engineering with an open-source humanitarian software project (abstract only). In Proceeding of the 44th ACM Technical Symposium on Computer Science Education (SIGCSE’13). ACM, New York, NY, 733--733. Google ScholarGoogle ScholarDigital LibraryDigital Library
  46. Cam Macdonell. 2015. Ushahidi: A crisis mapping system. SIGCAS Comput. Soc. 45, 2 (July 2015), 38--38. Google ScholarGoogle ScholarDigital LibraryDigital Library
  47. Bonnie MacKellar, Mihaela Sabin, and Allen Tucker. 2014. Bridging the academia-industry gap in software engineering: A client-oriented open source software projects course. In Overcoming Challenges in Software Engineering Education: Delivering Non-Technical Knowledge and Skills, Liguo Yu (Ed.). IGI Global, Chap. 19, 373--396.Google ScholarGoogle Scholar
  48. Bonnie K. MacKellar. 2011. A software engineering course with a large-scale project and diverse roles for students. J. Computi. Sci. Coll. 26, 6 (2011), 93--100. Google ScholarGoogle ScholarDigital LibraryDigital Library
  49. Bonnie K. MacKellar. 2013. Analyzing coordination among students in a software engineering project course. In Proceedings of the 26th International Conference on Software Engineering Education and Training (CSEE8T'13), San Francisco, CA, 279--283.Google ScholarGoogle ScholarCross RefCross Ref
  50. Bonnie K. MacKellar, Mihaela Sabin, and Allen Tucker. 2013. Scaling a framework for client-driven open source software projects: A report from three schools. J. Comput. Sci. Colle.ges 28, 6 (2013), 140--147. Google ScholarGoogle ScholarDigital LibraryDigital Library
  51. Robert Marmorstein. 2011. Open source contribution as an effective software engineering class project. In Proceedings of the 16th Annual Joint Conference on Innovation and Technology in Computer Science Education (ITiCSE’11). ACM, New York, NY, 268--272. Google ScholarGoogle ScholarDigital LibraryDigital Library
  52. Andrew Meneely, Laurie Williams, and Edward F. Gehringer. 2008. ROSE: A repository of education-friendly open-source projects. In Proceedings of the 13th Annual Conference on Innovation and Technology in Computer Science Education (ITiCSE’08). ACM, New York, NY, 7--11. Google ScholarGoogle ScholarDigital LibraryDigital Library
  53. Ralph Morelli and Trishan de Lanerolle. 2009. Foss 101: Engaging introductory students in the open source movement. In Proceedings of the 40th ACM Technical Symposium on Computer Science Education (SIGCSE’09). ACM, New York, NY, 311--315. Google ScholarGoogle ScholarDigital LibraryDigital Library
  54. Ralph Morelli, Allen Tucker, Norman Danner, Trishan R. De Lanerolle, Heidi J. C. Ellis, Ozgur Izmirli, Danny Krizanc, and Gary Parker. 2009. Revitalizing computing education through free and open source software for humanity. Commun. ACM 52, 8 (Aug. 2009), 67--75. Google ScholarGoogle ScholarDigital LibraryDigital Library
  55. Becka Morgan and Carlos Jensen. 2014. Lessons learned from teaching open source software development. In Proceedings of the IFIP International Conference on Open Source Systems. Springer, 133--142.Google ScholarGoogle ScholarCross RefCross Ref
  56. Christian Murphy, Swapneel Sheth, and Sydney Morton. 2017. A two-course sequence of real projects for real customers. In Proceedings of the 2017 ACM SIGCSE Technical Symposium on Computer Science Education (SIGCSE’17). ACM, New York, NY, 417--422. Google ScholarGoogle ScholarDigital LibraryDigital Library
  57. Jagadeesh Nandigam, Venkat N. Gudivada, and Abdelwahab Hamou-Lhadj. 2008. Learning software engineering principles using open source software. In 2008 38th Annual Frontiers in Education Conference. IEEE, S3H--18.Google ScholarGoogle ScholarCross RefCross Ref
  58. Debora Maria Nascimento, Kenia Cox, Thiago Almeida, Wendell Sampaio, Roberto Almeida Bittencourt, Rodrigo Souza, and Christina Chavez. 2013. Using open source projects in software engineering education: A systematic mapping study. In Proceedings of the 2013 IEEE Frontiers in Education Conference. IEEE, 1837--1843.Google ScholarGoogle ScholarCross RefCross Ref
  59. Joint Task Force on Computing Curricula. 2015. Curriculum Guidelines for Undergraduate Degree Programs in Software Engineering. Technical Report. New York, NY. Google ScholarGoogle Scholar
  60. Dragutin Petkovic, Gary Thompson, and Rainer Todtenhoefer. 2006. Teaching practical software engineering and global software engineering: Evaluation and comparison. In Proceedings of the 11th Annual SIGCSE Conference on Innovation and Technology in Computer Science Education (ITICSE’06). ACM, New York, NY, 294--298. Google ScholarGoogle ScholarDigital LibraryDigital Library
  61. The Humanitarian FOSS Project. 2017. The Humanitarian FOSS Project. (2017). Retrieved March 14, 2017 from http://www.hfoss.org.Google ScholarGoogle Scholar
  62. The Humanitarian FOSS Project. 2017. Project Gallery. Retrieved March 14, 2017 from http://www.hfoss.org/index.php/project_gallery.Google ScholarGoogle Scholar
  63. Rajendra K. Raj and Fereydoun Kazemian. 2006. Using open source software in computer science courses. In Proceedings of the 36th Annual Frontiers in Education Conference. IEEE, 21--26.Google ScholarGoogle Scholar
  64. Thomas J. Reichlmay. 2006. Collaborating with industry: Strategies for an undergraduate software engineering program. In Proceedings of the 2006 International Workshop on Summit on Software Engineering Education (SSEE’06). ACM, New York, NY, 13--16. Google ScholarGoogle ScholarDigital LibraryDigital Library
  65. Colleen Robb, David Rahn, and Kevin Buffardi. 2017. Tech startups: A model for realistic entrepreneurship 8 software engineering project collaboration. In United States Association for Small Business and Entrepreneurship Conference Proceedings. United States Association for Small Business and Entrepreneurship 1280.Google ScholarGoogle Scholar
  66. Adrian Rusu, Amalia Rusu, Rebecca Docimo, Confesor Santiago, and Mike Paglione. 2009. Academia-academia-industry collaborations on software engineering projects using local-remote teams. In Proceedings of the 40th ACM Technical Symposium on Computer Science Education (SIGCSE’09). ACM, New York, NY, 301--305. Google ScholarGoogle ScholarDigital LibraryDigital Library
  67. Kevin Shockey and PJ Cabrera. 2005. Using open source to enhance learning. In 2005 6th International Conference on Information Technology Based Higher Education and Training. IEEE, F2A--7.Google ScholarGoogle ScholarCross RefCross Ref
  68. Therese Mary Smith, Robert McCartney, Swapna S. Gokhale, and Lisa C. Kaczmarczyk. 2014. Selecting open source software projects to teach software engineering. In Proceedings of the 45th ACM Technical Symposium on Computer Science Education (SIGCSE’14). ACM, New York, NY, 397--402. Google ScholarGoogle ScholarDigital LibraryDigital Library
  69. Ian Sommerville. 2015. Software Engineering (10th ed.). Pearson. Google ScholarGoogle ScholarDigital LibraryDigital Library
  70. Sulayman K. Sowe and Ioannis G. Stamelos. 2007. Involving software engineering students in open source software projects: Experiences from a pilot study. J. Inform. Syst. Edu. 18, 4 (2007), 425.Google ScholarGoogle Scholar
  71. Eleni Stroulia, Ken Bauer, Michelle Craig, Karen Reid, and Greg Wilson. 2011. Teaching distributed software engineering with UCOSP: The undergraduate capstone open-source project. In Proceedings of the 2011 Community Building Workshop on Collaborative Teaching of Globally Distributed Software Development (CTGDSD’11). ACM, New York, NY, 20--25. Google ScholarGoogle ScholarDigital LibraryDigital Library
  72. Claudia Szabo. 2014. Student projects are not throwaways: Teaching practical software maintenance in a software engineering course. In Proceedings of the 45th ACM Technical Symposium on Computer Science Education (SIGCSE’14). ACM, New York, NY, 55--60. Google ScholarGoogle ScholarDigital LibraryDigital Library
  73. Nasser Tadayon. 2004. Software engineering based on the team software process with a real world project. J. Comput. Sci. Coll. 19, 4 (April 2004), 133--142. http://dl.acm.org/citation.cfm?id=1050231.1050248 Google ScholarGoogle ScholarDigital LibraryDigital Library
  74. Allen Tucker, Ralph Morelli, and Trishan de Lanerolle. 2011. The humanitarian FOSS project: Goals, activities, and outcomes. In Proceedings of the 2011 IEEEGlobal Humanitarian Technology Conference (GHTC’11). IEEE, 98--101. Google ScholarGoogle ScholarDigital LibraryDigital Library
  75. A. Tucker, R. Morelli, and C. de Silva. 2011. Software Development: An Open Source Approach. CRC Press, 9781439812907. Google ScholarGoogle ScholarDigital LibraryDigital Library
  76. Linda D. Webster and Edward J. Mirielli. 2007. Student reflections on an academic service learning experience in a computer science classroom. In Proceedings of the 8th ACM SIGITE Conference on Information Technology Education (SIGITE’07). ACM, New York, NY, 207--212. Google ScholarGoogle ScholarDigital LibraryDigital Library
  77. Guangming Xing. 2010. Teaching software engineering using open source software. In Proceedings of the 48th Annual Southeast Regional Conference (ACM SE’10). ACM, New York, NY, Article 57, 3 pages. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. A Multi-Institutional Perspective on H/FOSS Projects in the Computing Curriculum

          Recommendations

          Comments

          Login options

          Check if you have access through your login credentials or your institution to get full access on this article.

          Sign in

          Full Access

          • Published in

            cover image ACM Transactions on Computing Education
            ACM Transactions on Computing Education  Volume 18, Issue 2
            Special Issue on Capstone Projects
            June 2018
            116 pages
            EISSN:1946-6226
            DOI:10.1145/3239167
            Issue’s Table of Contents

            Copyright © 2018 ACM

            Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

            Publisher

            Association for Computing Machinery

            New York, NY, United States

            Publication History

            • Published: 11 July 2018
            • Accepted: 1 August 2017
            • Received: 1 April 2017
            Published in toce Volume 18, Issue 2

            Permissions

            Request permissions about this article.

            Request Permissions

            Check for updates

            Qualifiers

            • research-article
            • Research
            • Refereed

          PDF Format

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader