skip to main content
10.1145/2744769.2747935acmconferencesArticle/Chapter ViewAbstractPublication PagesdacConference Proceedingsconference-collections
research-article

Model-based testing of automotive software: some challenges and solutions

Published: 07 June 2015 Publication History

Abstract

Automotive software has been growing in size, criticality and complexity with each new generation of vehicles. Testing at the model and code level is an important step in validating the software against various types of defects that may be introduced in the development process. Model based testing (MBT) methodology, paves a road towards automation of testing activities. Test generation is a computationally complex task, which requires efficient constraint solving techniques and some guidance from the test engineer when this task cannot be solved by a tool. At the same time, automatic tools can hardly substitute domain testing experts which can develop more effective tests or at least test fragments than any tool. This is why we believe that future test generation tools should support "tester-in-the-loop" MBT approaches. In this paper, we provide a brief report on our results in this direction.

References

[1]
Alur, R., Dang, T., Esposito, J. M., Fierro, R. B., Hur, Y., Ivancic, F., Kumar, V., Lee, I., Mishra, P., Pappas, G. J. and Sokolsky, O. 2001. Hierarchical hybrid modeling of embedded systems. In Proceedings of the 1st International Workshop on Embedded Software (Tahoe City, USA, October 8--10, 2001), 14--31.
[2]
Alur, R. and Yannakakis, M. 2001. Model checking of hierarchical state machines. ACM Transactions on Programming Languages and Systems, vol. 23, no. 3 (May 2001), 273--303.
[3]
Behrmann, G., David, A., Larsen, K. G., Håkansson, J., Pettersson, P., Yi, W. and Hendriks, M. 2006. UPPAAL 4.0. In Proceedings of 3rd International Conference on the Quantitative Evaluation of Systems (Riverside, CA, Sept. 11--14, 2006), 125--126.
[4]
Clarke, E. M., Kroening, D. and Lerda, F. 2004. A tool for checking ANSI-C programs. In Proceedings of the 10th Tools and Algorithms for the Construction and Analysis of Systems (Barcelona, Spain, March 29 -- April 2, 2004), LNCS, vol. 2988, 168--176.
[5]
Cousot, P. and Halbwachs, N. 1978. Automatic discovery of linear restraints among variables of a program. In Proceedings of the Fifth Annual ACM Symposium on Principles of Programming Languages (Tucson, USA, January 1978), 84--96.
[6]
Devroey, X., Perrouin, G., Cordy, M., Legay, A., Schobbens, P.-Y. and Heymans, P. 2014. State machine flattening: mapping study and assessment. CoRR (March 2014), vol. abs/1403.5398.
[7]
Dijkstra, E. W. 1959. A note on two problems in connexion with graphs. Numerische mathematic, vol. 1, no. 1 (1959), 269--271.
[8]
Dutertre, B., De Moura, L. 2006. A fast linear-arithmetic solver for DPLL(T). In Proceedings of 18th International Conference on Computer Aided Verification, (Seattle, USA, August 17--20, 2006), LNCS, vol. 4144, 81--94.
[9]
Frieze, A. M., Galbiati, G. and Maffioli, F. 1982. On the worst-case performance of some algorithms for the asymmetric traveling salesman problem. Networks, vol. 12, no. 1 (Spring 1982), 23--39.
[10]
Harel, D. 1987. Statecharts: a visual formalism for complex systems. Sci. Comput. Program., vol. 8, no. 3 (June 1987), 231--274.
[11]
Halbwachs, N., Caspi, P., Raymond, P. and Pilaud, D. 1991. The synchronous dataflow programming language LUSTRE. In Proceedings of IEEE, vol. 79, no. 9 (September 1991), 1305--1320.
[12]
Helsgaun, K. 2009. General k-opt submoves for the Lin-Kernighan TSP heuristic. Math. Program. Comput., vol. 1, no. 2--3 (October 2009), 119--163.
[13]
Jeannet, B. 2003. Dynamic partitioning in linear relation analysis: application to the verification of reactive systems. Formal Methods in System Design, vol. 23, no. 1 (July 2003), 5--37.
[14]
Leveson, N. G., Heimdahl, M. P. E., Hildreth, H. and Reese, J. D. 1994. Requirements specification for process-control systems. IEEE Trans. Software Eng., vol. 20, no. 9 (September 1994), 684--707.
[15]
Mealy, G. H. 1955. A method for synthesizing sequential circuits. Bell System Technical Journal, vol. 34, no. 5 (September 1955), 1045--1079.
[16]
Mohalik, S.; Gadkari, A. A.; Yeolekar, A.; Shashidhar, K. and Ramesh, S. 2014. Automatic test case generation from Simulink/Stateflow models using model checking. Softw. Test. Verif. Rel. (March 2014), vol. 24, 155--180.
[17]
Nguena Timo, O., Petrenko, A., Dury, A. and S. Ramesh. 2014. Reachability in hierarchical machines. In Proceedings of the 2014 IEEE 15th International Conference on Information Reuse and Integration (San Francisco, USA, August 13--15, 2014), 475--482.
[18]
Petrenko, A., Boroday, S., and Groz, R. 2004. Confirming configurations in EFSM testing. IEEE Trans. Software Eng., vol. 30, no. 1 (January 2004), 29--42.
[19]
Petrenko, A., Dury, A., S. Ramesh and Mohalik, S. 2013. A method and tool for test optimization for automotive controllers. In Proceeding of 6th International Conference on Software Testing, Verification and Validation Workshops (Luxembourg, March 18-22, 2013).
[20]
Schrammel, P.; Melham, T. and Kroening, D. 2013. Chaining test cases for reactive system testing. In Proceedings of 25th International Conference on Testing Software and Systems (Istanbul, Turkey, November 13-15, 2013), LNCS, vol. 8254, 133--148.

Cited By

View all
  • (2024)Software Validation Techniques in the Automotive SectorDevelopment and Testing of Vehicle Software and its Influence on Sustainable Transport10.1007/978-3-031-47630-3_2(31-118)Online publication date: 11-Jan-2024
  • (2023)Verification and validation of embedded software in an automotive context: a systematic literature reviewRevista Científica Multidisciplinar Núcleo do Conhecimento10.32749/nucleodoconhecimento.com.br/computer-science/embedded-software(207-250)Online publication date: 3-Oct-2023
  • (2023)HYASM: A Tool to Verify Hierarchical Systems2023 IEEE International Conference on Enabling Technologies: Infrastructure for Collaborative Enterprises (WETICE)10.1109/WETICE57085.2023.10477788(1-6)Online publication date: 14-Dec-2023
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
DAC '15: Proceedings of the 52nd Annual Design Automation Conference
June 2015
1204 pages
ISBN:9781450335201
DOI:10.1145/2744769
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 June 2015

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. extended state machines
  2. finite state machines
  3. model-based testing
  4. statecharts
  5. test chaining
  6. test generation
  7. test models
  8. test optimization
  9. tester-in-the-loop

Qualifiers

  • Research-article

Conference

DAC '15
Sponsor:
DAC '15: The 52nd Annual Design Automation Conference 2015
June 7 - 11, 2015
California, San Francisco

Acceptance Rates

Overall Acceptance Rate 1,770 of 5,499 submissions, 32%

Upcoming Conference

DAC '25
62nd ACM/IEEE Design Automation Conference
June 22 - 26, 2025
San Francisco , CA , USA

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)29
  • Downloads (Last 6 weeks)8
Reflects downloads up to 13 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Software Validation Techniques in the Automotive SectorDevelopment and Testing of Vehicle Software and its Influence on Sustainable Transport10.1007/978-3-031-47630-3_2(31-118)Online publication date: 11-Jan-2024
  • (2023)Verification and validation of embedded software in an automotive context: a systematic literature reviewRevista Científica Multidisciplinar Núcleo do Conhecimento10.32749/nucleodoconhecimento.com.br/computer-science/embedded-software(207-250)Online publication date: 3-Oct-2023
  • (2023)HYASM: A Tool to Verify Hierarchical Systems2023 IEEE International Conference on Enabling Technologies: Infrastructure for Collaborative Enterprises (WETICE)10.1109/WETICE57085.2023.10477788(1-6)Online publication date: 14-Dec-2023
  • (2023)Survey of Model-Based Security Testing Approaches in the Automotive DomainIEEE Access10.1109/ACCESS.2023.328217611(55474-55514)Online publication date: 2023
  • (2023)Arduino practice judgment system based on function execution log in virtual execution environmentComputer Applications in Engineering Education10.1002/cae.2269532:2Online publication date: 2-Nov-2023
  • (2022)Model Checking for AlphaCode-Generated Programs2022 7th International Conference on Intelligent Computing and Signal Processing (ICSP)10.1109/ICSP54964.2022.9778472(794-798)Online publication date: 15-Apr-2022
  • (2022)Experience report on the application of genetic algorithms to reduce costs of the software validation process in the automotive sector during an engine control unit projectSoftware Quality Journal10.1007/s11219-021-09582-x30:3(687-728)Online publication date: 15-Jan-2022
  • (2020)Challenges concerning test case specifications in automotive software testing: assessment of frequency and criticalitySoftware Quality Journal10.1007/s11219-020-09523-0Online publication date: 18-Nov-2020
  • (2019)Application of rule‐based expert systems in hardware‐in‐the‐loop simulation case study: Software and performance validation of an engine electronic control unitJournal of Software: Evolution and Process10.1002/smr.2223Online publication date: 31-Jul-2019
  • (2018)Challenges with automotive test case specificationsProceedings of the 40th International Conference on Software Engineering: Companion Proceeedings10.1145/3183440.3195070(131-132)Online publication date: 27-May-2018
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media