Skip to main content

libfsmtest An Open Source Library for FSM-Based Testing

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 13045))

Abstract

In this paper, the open source library libfsmtest is presented. It has been developed to support model-based testing with finite state machine (FSM) models. The library is provided as a collection of \(\mathtt{C}^{++}\) classes, each class supporting specific aspects of FSM creation and transformation, and test generation from FSM models. Additionally, the library provides main programs for test generation with the methods realised in the library and for testing ‘implementation FSMs’ with suites generated from ‘reference FSMs’. Moreover, a generic test harness is provided for running test suites against \(\mathtt{C}^{++}\) libraries. We explain the unique selling points of this library and compare it to competing approaches.

Funded by the Deutsche Forschungsgemeinschaft (DFG) – project number 407708394.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   79.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   99.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    Licensed according to MIT license https://opensource.org/licenses/MIT. Source code available under https://bitbucket.org/JanPeleska/libfsmtest.

  2. 2.

    https://github.com/agbs-uni-bremen/fsmlib-cpp.git.

  3. 3.

    States \(q,q'\) that are distinguishable in \(\alpha (A)\) are by construction also distinguishable in A, but not every pair of states distinguishable in A is distinguishable in \(\alpha (A)\).

  4. 4.

    http://fsmtestonline.ru.

References

  1. Ambrosio, A.M., Pinheiro, A.C., Simão, A.: FSM-based test case generation methods applied to test the communication software on board the ITASAT University satellite: a case study. J. Aerospace Technol. Manage. 6(4), 447–461 (2014). https://doi.org/10.5028/jatm.v6i4.369

    Article  Google Scholar 

  2. Chen, W., Tang, C.Y., Vuong, S.T.: Improving the UIOV-method for protocol conformance testing. Comput. Commun. 18(9), 609–619 (1995). https://doi.org/10.1016/0140-3664(95)99804-L

    Article  Google Scholar 

  3. Chow, T.S.: Testing software design modeled by finite-state machines. IEEE Trans. Softw. Eng. SE 4(3), 178–186 (1978)

    Article  Google Scholar 

  4. Clarke, E.M., Grumberg, O., Peled, D.A.: Model Checking. The MIT Press, Cambridge (1999)

    MATH  Google Scholar 

  5. Dorofeeva, R., El-Fakih, K., Yevtushenko, N.: An improved conformance testing method. In: Wang, F. (ed.) FORTE 2005. LNCS, vol. 3731, pp. 204–218. Springer, Heidelberg (2005). https://doi.org/10.1007/11562436_16

    Chapter  Google Scholar 

  6. Hierons, R.M.: Testing from a nondeterministic finite state machine using adaptive state counting. IEEE Trans. Comput. 53(10), 1330–1342 (2004). https://doi.org/10.1109/TC.2004.85, http://doi.ieeecomputersociety.org/10.1109/TC.2004.85

  7. Hierons, R.M.: FSM quasi-equivalence testing via reduction and observing absences. Sci. Comput. Program. 177, 1–18 (2019). https://doi.org/10.1016/j.scico.2019.03.004

    Article  Google Scholar 

  8. Huang, W., Özoguz, S., Peleska, J.: Safety-complete test suites. Softw. Qual. J. 27(2), 589–613 (2018). https://doi.org/10.1007/s11219-018-9421-y

    Article  Google Scholar 

  9. Huang, W., Peleska, J.: Complete model-based equivalence class testing for nondeterministic systems. Formal Aspects Comput. 29(2), 335–364 (2016). https://doi.org/10.1007/s00165-016-0402-2

    Article  MathSciNet  MATH  Google Scholar 

  10. Huang, W., Peleska, J.: Complete requirements-based testing with finite state machines. CoRR abs/2105.11786 (2021). https://arxiv.org/abs/2105.11786

  11. Hübner, F., Huang, W., Peleska, J.: Experimental evaluation of a novel equivalence class partition testing strategy. Softw. Syst. Modeling 18(1), 423–443 (2017). https://doi.org/10.1007/s10270-017-0595-8

    Article  Google Scholar 

  12. Jorgensen, P.C.: The Craft of Model-Based Testing. CRC Press, Boca Raton (2017)

    Book  Google Scholar 

  13. Luo, G., von Bochmann, G., Petrenko, A.: Test selection based on communicating nondeterministic finite-state machines using a generalized WP-method. IEEE Trans. Softw. Eng. 20(2), 149–162 (1994). https://doi.org/10.1109/32.265636

    Article  Google Scholar 

  14. Machado, P.D.L., Silva, D.A., Mota, A.C.: Towards property oriented testing. Electron. Notes Theoret. Comput. Sci. 184(Suppl. C), 3–19 (2007). https://doi.org/10.1016/j.entcs.2007.06.001, http://www.sciencedirect.com/science/article/pii/S157106610700432X

  15. Naito, S., Tsunoyama, M.: Fault detection for sequential machines by transition tours. In: Proceedings of IEEE Fault Tolerant Computing Conference, pp. 162–178 (1981)

    Google Scholar 

  16. Peleska, J.: Model-based avionic systems testing for the airbus family. In: 23rd IEEE European Test Symposium, ETS 2018, Bremen, Germany, May 28–June 1, 2018, pp. 1–10. IEEE (2018). https://doi.org/10.1109/ETS.2018.8400703, http://ieeexplore.ieee.org/xpl/mostRecentIssue.jsp?punumber=8392663

  17. Petrenko, A., Simao, A., Maldonado, J.C.: Model-based testing of software and systems: recent advances and challenges. Int. J. Softw. Tools Technol. Transf. 14(4), 383–386 (2012). https://doi.org/10.1007/s10009-012-0240-3

    Article  Google Scholar 

  18. Petrenko, A., Yevtushenko, N., Lebedev, A., Das, A.: Nondeterministic state machines in protocol conformance testing. In: Rafiq, O. (ed.) Protocol Test Systems, VI, Proceedings of the IFIP TC6/WG6.1 Sixth International Workshop on Protocol Test systems, Pau, France, 28–30 September 1993. IFIP Transactions, vol. C-19, pp. 363–378. North-Holland (1993)

    Google Scholar 

  19. van de Pol, J., Meijer, J.: Synchronous or alternating? In: Margaria, T., Graf, S., Larsen, K.G. (eds.) Models, Mindsets, Meta: The What, the How, and the Why Not? LNCS, vol. 11200, pp. 417–430. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-22348-9_24

    Chapter  Google Scholar 

  20. Sachtleben, R., Peleska, J.: Effective grey-box testing with partial FSM models. CoRR abs/2106.14284 (2021). https://arxiv.org/abs/2106.14284

  21. Shabaldina, N., Gromov, M.: Fsmtest-1.0: a manual for researches. In: 2015 IEEE East-West Design Test Symposium (EWDTS), pp. 1–4 (2015). https://doi.org/10.1109/EWDTS.2015.7493141

  22. da Silva Simão, A.: Jplavisfsm (2021). https://github.com/adenilso/jplavisfsm. Accessed 27 Aug 2021

  23. Soucha, M.: Fsmlib (2018). https://github.com/Soucha/FSMlib. Accessed 30 May 2021

  24. Soucha, M., Bogdanov, K.: Spyh-method: An improvement in testing of finite-state machines. In: 2018 IEEE International Conference on Software Testing, Verification and Validation Workshops, ICST Workshops, Västerås, Sweden, 9–13 April 2018, pp. 194–203. IEEE Computer Society (2018). https://doi.org/10.1109/ICSTW.2018.00050

  25. Soucha, M., Bogdanov, K.: Observation tree approach: active learning relying on testing. Comput. J. 63(9), 1298–1310 (2020). https://doi.org/10.1093/comjnl/bxz056

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jan Peleska .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 IFIP International Federation for Information Processing

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Bergenthal, M., Krafczyk, N., Peleska, J., Sachtleben, R. (2022). libfsmtest An Open Source Library for FSM-Based Testing. In: Clark, D., Menendez, H., Cavalli, A.R. (eds) Testing Software and Systems. ICTSS 2021. Lecture Notes in Computer Science, vol 13045. Springer, Cham. https://doi.org/10.1007/978-3-031-04673-5_1

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-04673-5_1

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-04672-8

  • Online ISBN: 978-3-031-04673-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics