research-article

To enhance Effectiveness of Crowdsource Software Testing by applying Personality Types

Authors:

Zainab Umair Kamangar,

Umair Ayaz Kamangar,

Shahzad Nizamani,

Tauha Hussain AliAuthors Info & Claims

ICSIE '19: Proceedings of the 8th International Conference on Software and Information Engineering

Pages 15 - 19

https://doi.org/10.1145/3328833.3328838

Published: 09 April 2019 Publication History

Abstract

Crowdsource testing is an evolving trend in software testing, which incorporate benefits of crowd sourcing in software testing. Testers used to perform testing at various places and they are given the tasks involving different types of techniques through open call format. It means software is tested under multiple testers using different platforms, which makes it more reliable and error free. Appropriate task selection in a crowdsourced testing from a large number of tasks required different types of testing that is a complex job for the testers in crowd testing environment. In addition, platform has to involve in an arduous work to evaluate a lot of testing tasks submitted by testers involved in a crowd sourcing environment. Assigning task require testing technique that is improper for a crowdsourced tester does not only reduce the software product's quality, but also overload the platform which assign task to the testers. The core purpose of this paper is to make crowdsourced testing more efficient by finding what personality types are suitable for which type of testing techniques used in crowd sourcing environment. Moreover, this research has conducted a practical experiment to realize which personality type is more suitable for which type of testing in a crowd sourced environment. In total 92 students from Mehran university of engineering and technology has participated in this research. The Myers-Briggs type indicator was used to measure the personality types of students.

References

[1]

Ke Mao, Licia Capra, Mark Harman, and Yue Jia, "A Survey of the Use of Crowdsourcing in Software Engineering," in Journal of Systems and Software, January 8, 2016.

[2]

Kaner, Cem., "Exploratory Testing," in Quality Assurance Institute Worldwide Annual Software Testing Conference, Orlando, FL, November 17, 2006.

[3]

Leicht, N.; Knop, N.; Blohm, I.; Müller-Bloch, C. & Leimeister, J. M., "When is Crowdsourcing Advantageous? The Case of Crowdsourced Software Testing," in European Conference on Information Systems (ECIS 2016), Istanbul, Turkey, pp. 13.

[4]

Leicht, N.; Blohm, I. & Leimeister, J. M., "Leveraging the Power of the Crowd for Software Testing," in IEEE Software, Ausgabe/Nummer: 2, Vol. 34, Erscheinungsjahr/Year: 2017, pp. 62--69.

Digital Library

[5]

Leicht, N.; Rhyn M.; Hansbauer G., "Can laymen outperform experts? The effects of user expertise and task design in crowdsourced Software Testing," in Twenty-Fourth European Conference on Information Systems (ECIS 2016), Istanbul, Turkey, pp. 8.

[6]

S. Zhao, B. Shen, Y. Chen, and H. Zhong, "Towards effective developer recommendation in software crowdsourcing," in Proc. SEKE, 2015, pp. 326--329.

[7]

A.Brew, D.Greene, and P.Cunningham, "Using crowdsourcing and active learning to track sentiment in online media," in Proc. 19th Eur. Conf. Artif. Intell. (ECAI), vol. 215. Amsterdam, The Netherlands, Aug. 2010, pp. 145--150.

Digital Library

[8]

I. Boutsis and V. Kalogeraki, "Crowdsourcing under real-time constraints," in Proc. IEEE 27th Int. Symp. Parallel Distrib. Process, Boston, MA, USA, May 2013, pp. 753--764.

Digital Library

[9]

D. E. Difallah, G. Demartini, and P. Cudré-Mauroux, "Pick-a-crowd: Tell me what you like, and I'll tell you what to do," in Proc. WWW, Rio de Janeiro, Brazil, 2013, pp. 367--374.

[10]

E. Simpson and S. Roberts, "Bayesian methods for intelligent task assignment in crowdsourcing systems," in Decision Making: Uncertainty, Imperfection, Deliberation and Scalability. Basel, Switzerland: Springer, 2015, pp. 132.

[11]

D. Geiger and M. Schader, "Personalized task recommendation in crowdsourcing information systems_Current state of the art," in Decision Support Syst., vol. 65, pp. 316, Sep. 2014.

Digital Library

[12]

K. Mao, L. Capra, M. Harman, and Y. Jia, "A survey of the use of crowdsourcing in software engineering," in J. Syst. Softw., vol. 126, pp. 5784, Apr. 2017.

[13]

V. Ambati, S. Vogel, and J. G. Carbonell, "Towards task recommendation in micro-task markets," in Proc. Hum. Comput., 2011, pp. 80--83.

Digital Library

[14]

A. Brew, D. Greene, and P. Cunningham, "Using crowdsourcing and active learning to track sentiment in online media," in Proc. 19th Eur. Conf. Artif. Intell. (ECAI), vol. 215. Amsterdam, The Netherlands, Aug. 2010, pp. 145--150.

Digital Library

[15]

L. F. Capretz and F. Ahmed, "Making sense of software development and personality types," in IT Prof., vol. 12, no. 1, pp. 613, 2010.

Digital Library

[16]

G. Kazai, J. Kamps, and N. Milic-Frayling, "Worker types and personality traits in crowdsourcing relevance labels," in Proc. CIKM, Scotland, U.K., Oct. 2011, pp. 1941--1944.

[17]

L. F. Capretz, D. Varona, and A. Raza, "Influence of personality types in software tasks choices," in Comput. Hum. Behavior, vol. 52, pp. 373--378, Nov. 2015.

Digital Library

[18]

Muhammad Zahid Tunio, Haiyong Luo, Cong Wang, Fang Zhao, Abdul Rehman Gilal, Wenhua Shao, "Task Assignment Model for Crowdsourcing Software Development: TAM," in Journal of Information Processing Systems, March, 2018.

[19]

Muhammad Zahid Tunio, Haiyong Luo, Cong Wang, Fang Zhao, Abdul Rehman Gilal, Wenhua Shao, "Impact of Personality on Task Selection in Crowdsourcing Software Development: A Sorting Approach" in IEEE Access, Vol. 5, 2017.

Cited By

Xiao LWu YChen RShi H(2024)Optimizing Prioritization of Crowdsourced Test Reports of Web Applications through Image-to-Text ConversionSymmetry10.3390/sym1601008016:1(80)Online publication date: 8-Jan-2024
https://doi.org/10.3390/sym16010080
Zhang YTowey DPike MQiu RJaya AHuey SZhang XWu YLiu HAleti AArrieta A(2024)Metamorphic Testing of a Steer-by-Wire System: An Intercultural Students-as-Partners Collaboration ExperienceProceedings of the 9th ACM International Workshop on Metamorphic Testing10.1145/3679006.3685069(18-25)Online publication date: 13-Sep-2024
https://dl.acm.org/doi/10.1145/3679006.3685069
Di Martino SFasolino AStarace LTramontana P(2023)GUI testing of Android applications: Investigating the impact of the number of testers on different exploratory testing strategiesJournal of Software: Evolution and Process10.1002/smr.2640Online publication date: 11-Dec-2023
https://doi.org/10.1002/smr.2640
Show More Cited By

Index Terms

To enhance Effectiveness of Crowdsource Software Testing by applying Personality Types
1. Information systems
  1. World Wide Web
    1. Web applications
      1. Crowdsourcing

Recommendations

Evolution of software engineers' personality profile

The Myers-Briggs Type Indicator (MBTI) has been applied to several studies that explore various dimensions of human factors in software engineering. Accordingly, this work reviews the results of these studies to explore existing trends. In order to ...
Making Sense of Software Development and Personality Types

It's common sense to state that the production of any software product involves a human element, at least to some extent. We all have different personality traits, and the way we perceive, plan, and execute any activity is influenced by these ...
Applying “Functional Scenario-Based” Test Case Generation Method in Unit Testing and Integration Testing
Structured Object-Oriented Formal Language and Method
Abstract
Specification-based testing enables us to detect errors in the implementation of functions defined in given specifications. Its effectiveness in achieving high path coverage and efficiency in generating test cases are always major concerns of ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

ICSIE '19: Proceedings of the 8th International Conference on Software and Information Engineering

April 2019

276 pages

ISBN:9781450361057

DOI:10.1145/3328833

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 April 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

Higher Education Commision, Pakistan

Conference

ICSIE '19

ICSIE '19: 2019 8th International Conference on Software and Information Engineering

April 9 - 12, 2019

Cairo, Egypt

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
193
Total Downloads

Downloads (Last 12 months)10
Downloads (Last 6 weeks)0

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Xiao LWu YChen RShi H(2024)Optimizing Prioritization of Crowdsourced Test Reports of Web Applications through Image-to-Text ConversionSymmetry10.3390/sym1601008016:1(80)Online publication date: 8-Jan-2024
https://doi.org/10.3390/sym16010080
Zhang YTowey DPike MQiu RJaya AHuey SZhang XWu YLiu HAleti AArrieta A(2024)Metamorphic Testing of a Steer-by-Wire System: An Intercultural Students-as-Partners Collaboration ExperienceProceedings of the 9th ACM International Workshop on Metamorphic Testing10.1145/3679006.3685069(18-25)Online publication date: 13-Sep-2024
https://dl.acm.org/doi/10.1145/3679006.3685069
Di Martino SFasolino AStarace LTramontana P(2023)GUI testing of Android applications: Investigating the impact of the number of testers on different exploratory testing strategiesJournal of Software: Evolution and Process10.1002/smr.2640Online publication date: 11-Dec-2023
https://doi.org/10.1002/smr.2640
Zhao YMiao DCai Z(2022)Reading Personality Preferences From Motion Patterns in Computer Mouse OperationsIEEE Transactions on Affective Computing10.1109/TAFFC.2020.302329613:3(1619-1636)Online publication date: 1-Jul-2022
https://doi.org/10.1109/TAFFC.2020.3023296
Qamar NMalik A(2022)A Quantitative Assessment of the Impact of Homogeneity in Personality Traits on Software Quality and Team ProductivityIEEE Access10.1109/ACCESS.2022.322284510(122092-122111)Online publication date: 2022
https://doi.org/10.1109/ACCESS.2022.3222845
Shahid EArain Q(2021)Indoor positioning: “an image-based crowdsource machine learning approach”Multimedia Tools and Applications10.1007/s11042-021-10906-z80:17(26213-26235)Online publication date: 1-Jul-2021
https://dl.acm.org/doi/10.1007/s11042-021-10906-z
Dodevska ZKovacevic AVukicevic MDelibašić B(2020)Two Sides of Collective Decision Making - Votes from Crowd and Knowledge from ExpertsDecision Support Systems X: Cognitive Decision Support Systems and Technologies10.1007/978-3-030-46224-6_1(3-14)Online publication date: 18-May-2020
https://doi.org/10.1007/978-3-030-46224-6_1

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten