skip to main content
10.1145/3128473.3128484acmotherconferencesArticle/Chapter ViewAbstractPublication PagessastConference Proceedingsconference-collections
research-article

Feature-Based Test Oracles to Categorize Synthetic 3D and 2D Images of Blood Vessels

Published: 18 September 2017 Publication History

Abstract

Automated testing activities contribute significantly to reduce the cost and to increase the productivity during the software development process. Programs with complex outputs limit the application of automated testing strategies. A possible solution is the use of feature-based oracles. In this study, we use the framework O-FIm/CO (Oracle for Images and Complex Outputs), which uses CBIR (Content-based Image Retrieval) concepts to evaluate the similarity of synthetic images of blood vessels through the "feature-based test oracle" approach. In order to demonstrate the effectiveness of the approach, we evaluated the ability and accuracy of the test oracle in automated the process of categorization of synthetic images of blood vessels in 3D and 2D models through the similarity between features. Furthermore, we compared the accuracy of the categorization of the test oracle relative to random classifiers. The results obtained in two empirical studies revealed an AVG (average) of precision, recall, and specificity of, respectively, 77%, 100%, and 88% in the categorization performed by the test oracle for 3D images and 71%, 81%, and 93% in the categorization performed by the test oracle for 2D images.

References

[1]
E. Barr, M. Harman, P. McMinn, M. Shahbaz, and S. I. Yoo. 2015. The oracle problem in software testing: A survey. IEEE Transactions on Software Engineering (TSE) (2015), 507--525.
[2]
M. E. Delamaro, Fátima L. S. Nunes, and R. A. P. Oliveira. 2013. Using concepts of content-based image retrieval to implement graphical testing oracles. Software Testing, Verification and Reliability (STVR) (2013), 171--198.
[3]
W. E. Howden. 1978. Theoretical and empirical studies of program testing. IEEE Transactions on Software Engineering (TSE) (1978), 293--298.
[4]
R. A. P. Oliveira, M. E. Delamaro, and F. L. S. Nunes. 2009. O-FIm -- Oracle for Images. In Proceedings of the 23th Brazilian Symposium on Software Engineering (SBES) - XVI Tools Session of the SBES. 1--6.
[5]
R. A. P. Oliveira, U. Kanewala, and P. A. Nardi. 2015. Automated Test Oracles: State of the Art, Taxonomies, and Trends. Advances in Computers (2015), 113--199.
[6]
R. A. P. Oliveira, A. M. Memon, V. N. Gil, F. L. S. Nunes, and M. E. Delamaro. 2014. An Extensible Framework to Implement Test Oracles for Non-Testable Programs. In Proceedings of the 26th International Conference on Software Engineering and Knowledge Engineering (SEKE). 199--204.
[7]
M. A. G. Valverde, M. M. Macedo, C. Mekkaoui, and M. P. Jackowski. 2013. Three-dimensional synthetic blood vessel generation using stochastic L-systems. In Proceedings of the Medical Imaging: Image Processing. 86691I-86691I-6.

Cited By

View all
  • (2024)Keeper: Automated Testing and Fixing of Machine Learning SoftwareACM Transactions on Software Engineering and Methodology10.1145/367245133:7(1-33)Online publication date: 13-Jun-2024
  • (2022)A method and experiment to evaluate deep neural networks as test oracles for scientific softwareProceedings of the 3rd ACM/IEEE International Conference on Automation of Software Test10.1145/3524481.3527232(40-51)Online publication date: 17-May-2022
  • (2018)Testing Environmental Models supported by Machine LearningProceedings of the III Brazilian Symposium on Systematic and Automated Software Testing10.1145/3266003.3266004(3-12)Online publication date: 17-Sep-2018

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
SAST '17: Proceedings of the 2nd Brazilian Symposium on Systematic and Automated Software Testing
September 2017
100 pages
ISBN:9781450353021
DOI:10.1145/3128473
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

  • SBC: Sociedade Brasileira de Computação

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 September 2017

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Angiography
  2. Software Testing
  3. Test oracles
  4. Three-Dimensional Synthetic Vascular Networks

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Funding Sources

Conference

SAST '17

Acceptance Rates

SAST '17 Paper Acceptance Rate 11 of 16 submissions, 69%;
Overall Acceptance Rate 45 of 92 submissions, 49%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)1
  • Downloads (Last 6 weeks)0
Reflects downloads up to 02 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Keeper: Automated Testing and Fixing of Machine Learning SoftwareACM Transactions on Software Engineering and Methodology10.1145/367245133:7(1-33)Online publication date: 13-Jun-2024
  • (2022)A method and experiment to evaluate deep neural networks as test oracles for scientific softwareProceedings of the 3rd ACM/IEEE International Conference on Automation of Software Test10.1145/3524481.3527232(40-51)Online publication date: 17-May-2022
  • (2018)Testing Environmental Models supported by Machine LearningProceedings of the III Brazilian Symposium on Systematic and Automated Software Testing10.1145/3266003.3266004(3-12)Online publication date: 17-Sep-2018

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media