Abstract
In this paper we present a technique for comparing multiple tests and workloads. We show how to automatically determine what each test does uniquely and how to present the information as succinctly as possible. This technology has a number of uses, including in understanding the contribution of tests in regression buckets, especially of legacy systems, and in evaluating what is missing in tests compared to customer usage. We also show that the technology used in the analysis is superior to previous technology in that it can automatically find holes that were previously only found manually.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Adler, Y., Blue, D., Conti, T., Prewitt, R., Ur, S.: Evaluating Workloads Using Comparative Functional Coverage. In: Chockler, H., Hu, A.J. (eds.) HVC 2008. LNCS, vol. 5394, pp. 84–98. Springer, Heidelberg (2009)
Adler, Y., Farchi, E., Klausner, M., Pelleg, D., Raz, O., Shochat, M., Ur, S., Zlotnick, A.: Automated substring hole analysis. In: ICSE 2009, pp. 203–206 (2009)
Adler, Y., Farchi, E., Klausner, M., Pelleg, D., Raz, O., Shochat, M., Ur, S., Zlotnick, A.: Advanced Code Coverage Analysis Using Substring Holes. In: ISSTA 2009 (2009)
Azatchi, H., Fournier, L., Marcus, E., Ur, S., Zohar, K.: Advanced Analysis Techniques for Cross-Product Coverage. IEEE Trans. Comput. 55( 11), 1367–1379 (2006)
Beizer, B.: Software Testing Techniques. Van Nostrand Reinhold, New York (1990)
Bryce, R.C., Colbourn, C.J.: Test prioritization for pairwise interaction coverage. In: Proceedings of the 1st International Workshop on Advances in Model-Based Testing (May 2005)
Buchnik, E., Ur, S.: Compacting regression-suites on-the-fly. In: Proceedings of the 4th Asia Pacific Software Engineering Conference, pp. 385–394 (December 1997)
Grinwald, R., Harel, E., Orgad, M., Ur, S., Ziv, A.: User Defined Coverage—a Tool-Supported Methodology for Design Verification. In: Proceedings of the 35th Annual Conference on Design Automation (1998)
Lachish, O., Marcus, E., Ur, S., Ziv, A.: Hole Analysis for Functional Coverage Data. In: Proceedings of the 39th Conference on Design Automation (2002)
Marick, B.: The Craft of Software Testing: Subsystem Testing Including Object-based and Object-oriented Testing. Prentice-Hall, Englewood Cliffs (1995) ISBN 0131774115
Piziali, A.: Functional Verification Coverage Measurement and Analysis. Springer, Heidelberg (2004)
Yang, Q., Li, J.J., Weiss, D.: A survey of coverage based testing tools. In: Proceedings of the 2006 International Workshop on Automation of Software Test, AST 2006 (2006)
Coverage-Driven Functional Verification: Using Coverage to Speed Verification and Ensure Completeness. Verisity Design, Inc. (2001), http://www.verisity.com/resources/whitepaper/coverage_driven.html (retrieved)
Specman tool, http://www.verisity.com/products/specman.html (retrieved)
FoCuS tool, http://www.alphaworks.ibm.com/tech/focus (retrieved)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Adler, Y., Ur, S., Blue, D. (2011). Evaluating Workloads Using Multi-comparative Functional Coverage. In: Namjoshi, K., Zeller, A., Ziv, A. (eds) Hardware and Software: Verification and Testing. HVC 2009. Lecture Notes in Computer Science, vol 6405. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-19237-1_9
Download citation
DOI: https://doi.org/10.1007/978-3-642-19237-1_9
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-19236-4
Online ISBN: 978-3-642-19237-1
eBook Packages: Computer ScienceComputer Science (R0)