short-paper

Impact of Similarity on Repairing Small Programs: A Case Study on QuixBugs Benchmark

Authors:

Moumita Asad,

Kishan Kumar Ganguly,

Kazi SakibAuthors Info & Claims

ICSEW'20: Proceedings of the IEEE/ACM 42nd International Conference on Software Engineering Workshops

Pages 21 - 22

https://doi.org/10.1145/3387940.3392182

Published: 25 September 2020 Publication History

Get Access

Abstract

Similarity analysis plays an important role in automated program repair by finding the correct solution earlier. However, the effectiveness of similarity is mostly validated using common benchmark Defects4J which consists of 6 large projects. To mitigate the threat of generalizability, this study examines the performance of similarity in repairing small programs. For this purpose, existing syntactic and semantic similarity based approaches, as well as a new technique of combining both similarities, are used. These approaches are evaluated using QuixBugs, a dataset of diverse type bugs from 40 small programs. These techniques fix bugs faster by validating fewer patches than random patch selection based approach. Thus, it proves the effectiveness of similarity in repairing small programs.

References

[1]

Moumita Asad, Kishan Kumar Ganguly, and Kazi Sakib. 2019. Impact Analysis of Syntactic and Semantic Similarities on Patch Prioritization in Automated Program Repair. In ICSME'2019. IEEE, 328--332.

Google Scholar

[2]

Thomas Durieux, Fernanda Madeiral, Matias Martinez, and Rui Abreu. 2019. Empirical review of Java program repair tools: a large-scale experiment on 2,141 bugs and 23,551 repair attempts. In FSE'2019. 302--313.

Digital Library

Google Scholar

[3]

Yuhua Qi, Xiaoguang Mao, Yan Lei, Ziying Dai, and Chengsong Wang. 2014. The strength of random search on automated program repair. In ICSE'2014. ACM, 254--265.

Digital Library

Google Scholar

[4]

Ripon K Saha, Yingjun Lyu, Hiroaki Yoshida, and Mukul R Prasad. 2017. Elixir: Effective object-oriented program repair. In ASE'2017. IEEE, 648--659.

Crossref

Google Scholar

[5]

Ming Wen, Junjie Chen, Rongxin Wu, Dan Hao, and Shing-Chi Cheung. 2018. Context-aware patch generation for better automated program repair. In ICSE'2018. ACM, 1--11.

Digital Library

Google Scholar

[6]

He Ye, Matias Martinez, Thomas Durieux, and Martin Monperrus. 2019. A comprehensive study of automatic program repair on the QuixBugs benchmark. In IBF'2019. IEEE, 1--10.

Crossref

Google Scholar

Cited By

View all

Szalontai BVadász AMárton TPintér BGregorics T(2024)Fine-Tuning CodeLlama to Fix BugsProceedings of International Conference on Recent Innovations in Computing10.1007/978-981-97-3442-9_34(497-509)Online publication date: 23-Oct-2024
https://doi.org/10.1007/978-981-97-3442-9_34
Ufuktepe ETuglular TPalaniappan K(2022)Tracking Code Bug Fix Ripple Effects Based on Change Patterns Using Markov Chain ModelsIEEE Transactions on Reliability10.1109/TR.2022.316794371:2(1141-1156)Online publication date: Jun-2022
https://doi.org/10.1109/TR.2022.3167943
Bian ZBlot APetke J(2021)Refining Fitness Functions for Search-Based Program Repair2021 IEEE/ACM International Workshop on Automated Program Repair (APR)10.1109/APR52552.2021.00008(1-8)Online publication date: Jun-2021
https://doi.org/10.1109/APR52552.2021.00008
Show More Cited By

Index Terms

Impact of Similarity on Repairing Small Programs: A Case Study on QuixBugs Benchmark
1. Software and its engineering
  1. Software creation and management
    1. Software verification and validation
      1. Software defect analysis
        Software testing and debugging
2. Theory of computation

Index terms have been assigned to the content through auto-classification.

Recommendations

Evaluating semantic similarity and relatedness over the semantic grouping of clinical term pairs

Display Omitted Objective: develop a method to quantify the similarity and relatedness of biomedical and clinical term pairs.Semantic similarity and relatedness measures exploit information extrapolated from the Unified Medical Language System.Evaluates ...
A review on semantic similarity measures for ontology

Ontologies are the extensively used structural and semantic knowledge representation to describe any entities with non-ambiguous meaning and relations. A large number of general and domain specific semantic similarity measures are available in the ...
Research on Ontology-Based Measuring Semantic Similarity
ICICSE '08: Proceedings of the 2008 International Conference on Internet Computing in Science and Engineering

Ontology is an explicit specification of a conceptualization on semantic and knowledge. This paper presents a formal definition on ontology and gives an example. Then, a method to measuring semantic similarity is presented. Semantic similarity is ...

Comments

Information & Contributors

Information

Published In

ICSEW'20: Proceedings of the IEEE/ACM 42nd International Conference on Software Engineering Workshops

June 2020

831 pages

ISBN:9781450379632

DOI:10.1145/3387940

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 September 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper
Research
Refereed limited

Conference

ICSE '20

Sponsor:

SIGSOFT
KIISE

ICSE '20: 42nd International Conference on Software Engineering

June 27 - July 19, 2020

Seoul, Republic of Korea

Upcoming Conference

ICSE 2025

2025 IEEE/ACM 46th International Conference on Software Engineering

April 26 - May 3, 2025

Ottawa , ON , Canada

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
135
Total Downloads

Downloads (Last 12 months)9
Downloads (Last 6 weeks)2

Reflects downloads up to 25 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Szalontai BVadász AMárton TPintér BGregorics T(2024)Fine-Tuning CodeLlama to Fix BugsProceedings of International Conference on Recent Innovations in Computing10.1007/978-981-97-3442-9_34(497-509)Online publication date: 23-Oct-2024
https://doi.org/10.1007/978-981-97-3442-9_34
Ufuktepe ETuglular TPalaniappan K(2022)Tracking Code Bug Fix Ripple Effects Based on Change Patterns Using Markov Chain ModelsIEEE Transactions on Reliability10.1109/TR.2022.316794371:2(1141-1156)Online publication date: Jun-2022
https://doi.org/10.1109/TR.2022.3167943
Bian ZBlot APetke J(2021)Refining Fitness Functions for Search-Based Program Repair2021 IEEE/ACM International Workshop on Automated Program Repair (APR)10.1109/APR52552.2021.00008(1-8)Online publication date: Jun-2021
https://doi.org/10.1109/APR52552.2021.00008
Asad MGanguly KSakib K(2021)Combined Similarity Based Automated Program Repair Approaches for Expression Level BugsEvaluation of Novel Approaches to Software Engineering10.1007/978-3-030-70006-5_13(311-335)Online publication date: 27-Feb-2021
https://doi.org/10.1007/978-3-030-70006-5_13

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Evaluating semantic similarity and relatedness over the semantic grouping of clinical term pairs

A review on semantic similarity measures for ontology

Research on Ontology-Based Measuring Semantic Similarity

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Upcoming Conference

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations