research-article

Search-enhanced testing (NIER track)

Authors:

Colin Atkinson,

Oliver Hummel,

Werner JanjicAuthors Info & Claims

ICSE '11: Proceedings of the 33rd International Conference on Software Engineering

Pages 880 - 883

https://doi.org/10.1145/1985793.1985932

Published: 21 May 2011 Publication History

Get Access

Abstract

The prime obstacle to automated defect testing has always been the generation of "correct" results against which to judge the behavior of the system under test - the "oracle problem". So called "back-to-back" testing techniques that exploit the availability of multiple versions of a system to solve the oracle problem have mainly been restricted to very special, safety critical domains such as military and space applications since it is so expensive to manually develop the additional versions. However, a new generation of software search engines that can find multiple copies of software components at virtually zero cost promise to change this situation. They make it economically feasible to use the knowledge locked in reusable software components to dramatically improve the efficiency of the software testing process. In this paper we outline the basic ingredients of such an approach.

References

[1]

P. Ammann and J. Offutt. Introduction to Software Testing. Cambridge University Press, 2008.

Digital Library

Google Scholar

[2]

A. Avizienis. The Methodology of n-version Programming. Software Fault Tolerance, 1995.

Google Scholar

[3]

O. Hummel and C. Atkinson. Automated Creation and Assessment of Component Adapters with Test Cases. Component-Based Software Engineering, pages 166--181, 2010.

Digital Library

Google Scholar

[4]

O. Hummel, W. Janjic, and C. Atkinson. Code Conjurer: Pulling Reusable Software out of Thin Air. IEEE software, 2008.

Digital Library

Google Scholar

[5]

J. Knight and N. Leveson. An Experimental Evaluation of the Assumption of Independence in Multi-Version Programming. In IEEE Transactions on Software Engineering, 1986.

Digital Library

Google Scholar

[6]

S. Reiss. Semantics-Based Code Search. In IEEE 31st International Conference on Software Engineering, 2009. ICSE 2009. IEEE, 2009.

Digital Library

Google Scholar

[7]

I. Sommerville. Software Engineering (9th Edition). Addison Wesley, 9 edition, 3 2010.

Digital Library

Google Scholar

[8]

M. Vouk. Back-to-Back Testing. Information and Software Technology, 32(1):34--45, 1990.

Digital Library

Google Scholar

[9]

E. Weyuker. The Oracle Assumption of Program Testing. In 13th International Conference on System Sciences, pages 44--49.

Google Scholar

Cited By

View all

Janjic WAtkinson CZhu HMuccini HChen Z(2013)Utilizing software reuse experience for automated test recommendationProceedings of the 8th International Workshop on Automation of Software Test10.5555/2662413.2662436(100-106)Online publication date: 18-May-2013
https://dl.acm.org/doi/10.5555/2662413.2662436
Janjic WAtkinson C(2013)Utilizing software reuse experience for automated test recommendation2013 8th International Workshop on Automation of Software Test (AST)10.1109/IWAST.2013.6595799(100-106)Online publication date: May-2013
https://doi.org/10.1109/IWAST.2013.6595799
Janjic WHummel OAtkinson C(2013)Reuse-Oriented Code Recommendation SystemsRecommendation Systems in Software Engineering10.1007/978-3-642-45135-5_14(359-386)Online publication date: 20-Dec-2013
https://doi.org/10.1007/978-3-642-45135-5_14
Show More Cited By

Index Terms

Search-enhanced testing (NIER track)
1. Software and its engineering
  1. Software creation and management
    1. Software development techniques
      1. Reusability
    2. Software verification and validation
      1. Software defect analysis
        Software testing and debugging
2. Theory of computation
  1. Semantics and reasoning
    1. Program reasoning
      1. Program verification

Recommendations

Discrepancy discovery in search-enhanced testing
SUITE '11: Proceedings of the 3rd International Workshop on Search-Driven Development: Users, Infrastructure, Tools, and Evaluation

Automating software testing can significantly reduce the time and effort required to assure the quality of software systems, and over recent years significant strides have been made in test automation techniques. However, one aspect of software testing ...
The Study on an Intelligent General-Purpose Automated Software Testing Suite
ICICTA '10: Proceedings of the 2010 International Conference on Intelligent Computation Technology and Automation - Volume 03

To make the labor intensive manual software testing automated, we present the design and implementation of an intelligent general-purpose automated software testing suite. With the two main tools in the suite: an automated software testing scheduler, ...
Better testing through oracle selection (NIER track)
ICSE '11: Proceedings of the 33rd International Conference on Software Engineering

In software testing, the test oracle determines if the application under test has performed an execution correctly. In current testing practice and research, significant effort and thought is placed on selecting test inputs, with the selection of test ...

Comments

Information & Contributors

Information

Published In

ICSE '11: Proceedings of the 33rd International Conference on Software Engineering

May 2011

1258 pages

ISBN:9781450304450

DOI:10.1145/1985793

General Chair:
Richard N. Taylor
UC Irvine, USA
,
Program Chairs:
Harald Gall
University of Zurich, Switzerland
,
Nenad Medvidović
University of Southern California, USA

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 May 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ICSE11

Sponsor:

SIGSOFT

ICSE11: International Conference on Software Engineering

May 21 - 28, 2011

HI, Waikiki, Honolulu, USA

Acceptance Rates

Overall Acceptance Rate 220 of 1,486 submissions, 15%

Upcoming Conference

ICSE 2025

2025 IEEE/ACM 46th International Conference on Software Engineering

April 26 - May 3, 2025

Ottawa , ON , Canada

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
170
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)0

Reflects downloads up to 08 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Janjic WAtkinson CZhu HMuccini HChen Z(2013)Utilizing software reuse experience for automated test recommendationProceedings of the 8th International Workshop on Automation of Software Test10.5555/2662413.2662436(100-106)Online publication date: 18-May-2013
https://dl.acm.org/doi/10.5555/2662413.2662436
Janjic WAtkinson C(2013)Utilizing software reuse experience for automated test recommendation2013 8th International Workshop on Automation of Software Test (AST)10.1109/IWAST.2013.6595799(100-106)Online publication date: May-2013
https://doi.org/10.1109/IWAST.2013.6595799
Janjic WHummel OAtkinson C(2013)Reuse-Oriented Code Recommendation SystemsRecommendation Systems in Software Engineering10.1007/978-3-642-45135-5_14(359-386)Online publication date: 20-Dec-2013
https://doi.org/10.1007/978-3-642-45135-5_14
Janjic WBarth FHummel OAtkinson CBajracharya SKuhn AYe Y(2011)Discrepancy discovery in search-enhanced testingProceedings of the 3rd International Workshop on Search-Driven Development: Users, Infrastructure, Tools, and Evaluation10.1145/1985429.1985435(21-24)Online publication date: 28-May-2011
https://dl.acm.org/doi/10.1145/1985429.1985435

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Discrepancy discovery in search-enhanced testing

The Study on an Intelligent General-Purpose Automated Software Testing Suite

Better testing through oracle selection (NIER track)

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Upcoming Conference

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations