article

Fuzzing vs SBST: Intersections & Differences

Authors:

Giovani Guizzo,

Sebastiano PanichellaAuthors Info & Claims

ACM SIGSOFT Software Engineering Notes, Volume 48, Issue 1

Pages 105 - 107

https://doi.org/10.1145/3573074.3573102

Published: 17 January 2023 Publication History

Get Access

Abstract

Search-Based Software Testing (SBST) is the application of SBSE for solving hard software testing problems. SBST has been the subject of discussion of our International SBST Workshop, colocated with the International Conference on Software Engineering (ICSE). In 2022 we hosted the 15th edition of our SBSTWorkshop, which brought together researchers and industrial practitioners to encourage the use of search-based and fuzz testing techniques and tools for addressing software engineering-specific challenges. In this 2022 edition, SBST held, among other exciting events, a discussion panel on the similarities and differences between SBST and Fuzzing. As it implies, the goal of the panel was to have a common ground for discussion on the main similarities and differences between the Fuzzing and SBST fields, focusing on how both communities can collaborate to advance the stateof- the-art on automated testing. This strong panel composed of researchers from both academia and industry was the highlight of SBST'22 and allowed the chairs of the workshop to make substantial changes for 2023. In this paper, we present the main take away messages from that seminal panel and highlight exciting new challenges in the field.

References

[1]

Raja Ben Abdessalem, Annibale Panichella, Shiva Nejati, Lionel C. Briand, and Thomas Stifter. Testing autonomous cars for feature interaction failures using many-objective search. In ASE, pages 143--154, 2018.

Digital Library

Google Scholar

[2]

Valentin Jean Marie Man'es, HyungSeok Han, Choongwoo Han, Sang Kil Cha, Manuel Egele, Edward J Schwartz, and Maverick Woo. The art, science, and engineering of fuzzing: A survey. Transactions on Software Engineering, 2019.

Google Scholar

[3]

Philip McMinn. Search-based software test data generation: A survey. Software Testing, Verification and Reliability, 14(2):105--156, June 2004.

Crossref

Google Scholar

[4]

Jonathan Metzman, L´aszl´o Szekeres, Laurent Maurice Romain Simon, Read Trevelin Sprabery, and Abhishek Arya. FuzzBench: An Open Fuzzer Benchmarking Platform and Service. In Proceedings of the 29th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering, ESEC/FSE 2021, page 1393--1403, New York, NY, USA, 2021. Association for Computing Machinery.

Google Scholar

[5]

Andreea-Ina Radu and Flavio D. Garcia. Grey-box analysis and fuzzing of automotive electronic components via control-flow graph extraction. In Bj¨orn Br¨ucher, Oliver Wasenm¨uller, Mario Fritz, Hans-Joachim Hof, and Christoph Krauß, editors, CSCS '20: Computer Science in Cars Symposium, Feldkirchen, Germany, December 2, 2020, pages 9:1--9:11. ACM, 2020.

Google Scholar

[6]

Andreas Zeller, Rahul Gopinath, Marcel B¨ohme, Gordon Fraser, and Christian Holler. The Fuzzing Book. CISPA Helmholtz Center for Information Security, 2021. Retrieved 2021--10--26 15:30:20+02:00.

Google Scholar

Cited By

View all

Klooster TTurkmen FBroenink GHove RBöhme M(2023)Continuous Fuzzing: A Study of the Effectiveness and Scalability of Fuzzing in CI/CD Pipelines2023 IEEE/ACM International Workshop on Search-Based and Fuzz Testing (SBFT)10.1109/SBFT59156.2023.00015(25-32)Online publication date: May-2023
https://doi.org/10.1109/SBFT59156.2023.00015

Recommendations

8th international workshop on search-based software testing (SBST 2015)
ICSE '15: Proceedings of the 37th International Conference on Software Engineering - Volume 2

This paper is a report on the 8th International Workshop on Search-Based Software Testing at the 37th International Conference on Sofrware Engineering (ICSE). Search-Based Software Testing (SBST) is a form of Search-Based Software Engineering (SBSE) ...
JavaScript SBST Heuristics to Enable Effective Fuzzing of NodeJS Web APIs
JavaScript is one of the most popular programming languages. However, its dynamic nature poses several challenges to automated testing techniques. In this paper, we propose an approach and open-source tool support to enable white-box testing of JavaScript ...
Hybrid-SBST Methodology for Efficient Testing of Processor Cores

Software-based self-test (SBST) has recently emerged as an effective methodology for the manufacturing test of embedded processors in SoCs. SBST is a nonintrusive approach that has the potential to provide high-quality at-speed testing at virtually zero ...

Comments

Information & Contributors

Information

Published In

cover image ACM SIGSOFT Software Engineering Notes

ACM SIGSOFT Software Engineering Notes Volume 48, Issue 1

January 2023

113 pages

ISSN:0163-5948

DOI:10.1145/3573074

Editor:
Jacopo Soldani
University of Pisa, Italy

Issue’s Table of Contents

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 January 2023

Published in SIGSOFT Volume 48, Issue 1

Check for updates

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
186
Total Downloads

Downloads (Last 12 months)36
Downloads (Last 6 weeks)2

Reflects downloads up to 02 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Klooster TTurkmen FBroenink GHove RBöhme M(2023)Continuous Fuzzing: A Study of the Effectiveness and Scalability of Fuzzing in CI/CD Pipelines2023 IEEE/ACM International Workshop on Search-Based and Fuzz Testing (SBFT)10.1109/SBFT59156.2023.00015(25-32)Online publication date: May-2023
https://doi.org/10.1109/SBFT59156.2023.00015

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Recommendations

8th international workshop on search-based software testing (SBST 2015)

JavaScript SBST Heuristics to Enable Effective Fuzzing of NodeJS Web APIs

Hybrid-SBST Methodology for Efficient Testing of Processor Cores

Comments

Information

Published In

Publisher

Publication History

Check for updates

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations