Abstract
We propose an approach to testing that combines formal methods with practical criteria, close to the testing engineer’s experience. It can be seen as a framework to evaluate and select test suites using formal methods, assisted by informal heuristics. This proposal is illustrated with a practical case study: the testing of a protocol for mobile auctions in a distributed, wireless environment.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Alilovic-Curgus, J., Vuong, S.T.: A Metric Based Theory of Test Selection and Coverage. Protocol Specification, Testing and VerificationXIII. Elsevier Science Publishers B.V. IFIP, 1993.
Bertsekas, D., Gallagher, R.: Data Networks, Prentice-Hall International Ed., 1992.
Brookes, S.D., Hoare, C.A.R., Roscoe, A.W.: A Theory of Communicating Sequential Processes. Journal of the ACM 31, 1984
Brinksma, E.: A Theory for the Derivation of Tests. Protocol Specification, Testing and Verification VIII, 63–74. 1988.
Brinksma, E., Tretmans J., Verhaard, L.: A Framework for Test Selection. Protocol Specification, Testing and Verification, XI. Elsevier Science Publishers B.V. 233–248, 1991.
Burguillo-Rial, J.C.: Contribución a la Fase de Prueba de Sistemas Concurrentes y Distribuidos mediante Técnicas de Descripción Formal. Ph. D. Dissertation (in Spanish), Universidad de Vigo, Spain, 2001.
ETSI: “Digital cellular telecommunications system (phase 2+); Multiplexing and multiple access on the radio path (GSM 05.02 version 5.4.1)”. ETSI technical report ETR 300 908, 1997.
Fernández-Iglesias, M. J., Llamas-Nistal, M.: Algebraic Specification through Expression Transformation, in: Mizuno, T., Shiratori, N., Higashino, T., Togashi, A., (Eds.), Procs. of the Joint Conference FORTE/PSTV’97, Chapman & Hall, 1997, 355–366.
Fernández-Iglesias, M. J., González-Castaño, F. J., Pousada-Carballo, J. M., Llamas-Nistal, M., and Romero-Feijoo, A.: From Complex Specifications to a Working Prototype. A Protocol Engineering Case Study. Procs. of FME 2001. Lecture Notes on Computer Science 2021, 436–448.
Heerink, L., Tretmans, J.: Formal Methods in Conformance Testing: a Probabilistic Refinement. In B. Baumgarten, H.J. Burkhardt, and A. Giessler, editors, Int. Workshop on Testing of Communicating Systems IX, Chapman & Hall, 1996, 261–276.
Holzmann, G.: Design and Validation of Computer Protocols, Prentice Hall, 1991.
Huecas, G.: Contribución a la Formalización de la Fase de Ejecución de Pruebas. Ph. D. Dissertation (in Spanish), Universidad Politécnica de Madrid, Spain, 1995.
Information Processing Systems-Open Systems Interconnections: LOTOS: A Formal Description Technique Based on the Temporal Ordering of Observational Behaviour. IS 8807, ISO, 1989.
Information Processing Systems-Open Systems Interconnections: Conformance Testing Methodology and Framework. IS 9646, ISO, 1991.
Information Processing Systems-Open Systems Interconnections: ESTELLE: A formal description technique based on the extended state transition model. IS 9074, ISO, 1989.
ITU-T: Recommendation Recommendation Z.500. Framework on Formal Methods in Conformance Testing. ISO ITU-T, Mayo 1997.
ITU-T: SDL: Specification and Description Language, CCITT Recommendation Z.100, International Telecommunication Union, 1993.
Koenig, H., Ulrich, A., Heiner, M.: Design for Testability: a Step-Wise Approach to Protocol Testing. Testing of Communicating Systems. Volume 10. 1997
Leduc, G.: Failure-based Congruences, Unfair Divergences and New Testing Theory. Proceedings of PSTV XIV, Vancouver, Canadá, Junio 1994. Chapman & Hall, 252–267, 1995.
Mañas, J. A., de Miguel, T.: From LOTOS to C, in: K. J. Turner, (Ed), Procs. of FORTE’88, North Holland, 1988, 79–84.
Mañas, J. A., de Miguel, T., Salvachúa, J., Azcorra, A.: Tool support to implement LOTOS specifications, Computer Networks and ISDN Systems, 25 (1993) 79–84.
Miller, G. H: Microcomputer Engineering, Prentice Hall, 1993.
Milner, R.: Communication and Concurrency. Prentice-Hall International, London, 1989
Musa, J.D., Ackerman, A.F.: Quantifying Software Validation: When to Stop Testing?. IEEE Trans. Soft. Eng., 19–26, 1989.
Myers, G.L.: The Art of Software Testing. John Wiley & Sons Inc., 1979.
Quemada, J., Pavón, S., Fernández, A.: Transforming LOTOS specification with LOLA, in: Turner, K. J., (Ed), Procs. of FORTE’88, North Holland, 1988.
Robles, T.: Contribución al Tratamiento Formal de la Fase de Pruebas del Ciclo Software en Ingeniería de Protocolos. Ph. D. Dissertation (in Spanish), Universidad Politécnica de Madrid, Spain, 1991.
Robles, T., Mañas, J. A., Huecas, G.: Specification and Derivation of OSI Conformance Test Suites. Protocol Test Systems, V. Elsevier Science Publishers. 177–188. IFIP, 1993.
Rodríguez-Hernández, P. S., González-Castaño, F. J., Pousada-Carballo, J. M., Fernández-Iglesias, M. J., García-Reinoso, J.: Cellular Network for Real-Time Mobile Auction. Wireless Personal Communications (Submitted).
Tretmans, J.: A Formal Approach to Conformance Testing. Ph. D. Dissertation, University of Twente, Enschede, The Netherlands, 1992.
Tretmans, J.: Conformance Testing with Labelled Transition Systems: Implementation Relations and Test Generation. Computer Networks and ISDN Systems, 29: 49–79, 1996.
Ulrich, A., Koenig, H.: Test Derivation from LOTOS using Structure Information. Protocol Test Systems VI. 1994.
Velthuys, R.J., Schneider, J.M., Zoerntlein, G.: A Test Derivation Method Based on Exploiting Structure Information. Protocol Specification, Testing and Verification XII, 1992.
Williams, T.W., Parker, K.P.: Design for Testability-A Survey. IEEE Trans. on Computers C-31,1, 2–15. 1982.
Zju, J., Vuong, S.T.: Generalized Metric Based Test Selection and Coverage Measure for Communication protocols. Formal Description Techniques and Protocol Specification, Testing and Verification. FORTE X/PSTV XVII. IFIP 1997.
Zju, J., Vuong, S.T., Chanson, S.T.: Evaluation of Test Coverage for Embedded System Testing. 11th International Workshop on Testing of Communicating Systems. 1998.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Burguillo-Rial, J.C., Fernández-Iglesias, M.J., González-Castaño, F.J., Llamas-Nistal, M. (2002). Heuristic-Driven Test Case Selection from Formal Specifications. A Case Study. In: Eriksson, LH., Lindsay, P.A. (eds) FME 2002:Formal Methods—Getting IT Right. FME 2002. Lecture Notes in Computer Science, vol 2391. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45614-7_4
Download citation
DOI: https://doi.org/10.1007/3-540-45614-7_4
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-43928-8
Online ISBN: 978-3-540-45614-8
eBook Packages: Springer Book Archive