skip to main content
10.1145/2695664.2695935acmconferencesArticle/Chapter ViewAbstractPublication PagessacConference Proceedingsconference-collections
research-article

Automated system-level safety testing using constraint patterns for automotive operating systems

Published:13 April 2015Publication History

ABSTRACT

The automotive operating system is a typical safety-critical system that is tightly coupled with the operational environment through system services. However, existing automated techniques come short of testing the interface of such operating systems. We introduced an automated test generation method for system-level safety testing of the automotive operating systems, by utilizing the operational constraints defined in the specification. This work extends the idea by adding configuration-dependent and state-dependent constraint patterns, and by developing a tool chain to automate the constraint-based system-level testing. The effectiveness of our approach is demonstrated through a series of experiments, and a comparative analysis is performed between our method and concolic testing.

References

  1. AUTomotive Open Source ARchitecture.Google ScholarGoogle Scholar
  2. OSEK/VDX operating system specification 2.2.3.Google ScholarGoogle Scholar
  3. C. Baier and J. Katoen. Principles of model checking. 2008.Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. J.-L. Bechennec, M. Briday, S. Faucou, and Y. Trinquet. Trampoline: an opensource implementation of the OSEK/VDX RTOS specification. 2006.Google ScholarGoogle Scholar
  5. J. Burnim and K. Sen. Heuristics for scalable dynamic test generation. In Proceedings of the 2008 23rd IEEE/ACM international conference on automated software engineering. IEEE Computer Society, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. J. Chen and T. Aoki. Conformance testing for OSEK/VDX operating system using model checking. In 18th Asia-Pacific Software Engineering Conference, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Y. Choi. Constraint specification and test generation for OSEK/VDX-based operating systems. In Software Engineering and Formal Methods, pages 305--319. Springer, 2013.Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Y. Choi and T. Byun. Constraint-based test generation for automotive operating systems. In Software and Systems Modeling, in press.Google ScholarGoogle Scholar
  9. P. Godefroid, P. de Halleux, A. V. Nori, S. K. Rajamani, W. Schulte, N. Tillmann, and M. Y. Levin. Automating software testing using program analysis. IEEE Software, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. A. Gupta, K. L. McMillan, and Z. Fu. Automated assumption generation for compositional verification. Formal Methods in System Design, 32:285--301, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. R. M. Hierons, K. Bogdanov, J. P. Bowen, R. Cleaveland, J. Derrick, J. Dick, M. Gheorghe, M. Harman, K. Kapoor, P. Krause, et al. Using formal specifications to support testing. ACM Computing Surveys, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. D. John. OSEK/VDX conformance testing - MODISTARC. In Proceedings of OSEK/VDX Open Systems in Automotive Networks, 1998.Google ScholarGoogle Scholar
  13. P. Koopman, K. DeVale, and J. DeVale. Interface robustness testing: Experience and lessons learned from the ballista project. Dependability Benchmarking for Computer Systems, 72:201, 2008.Google ScholarGoogle ScholarCross RefCross Ref
  14. N. P. Kropp, P. J. Koopman, and D. P. Siewiorek. Automated robustness testing of off-the-shelf software components. In Fault-Tolerant Computing, 1998. Digest of Papers. Twenty-Eighth Annual International Symposium on, pages 230--239. IEEE, 1998. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. N. Leveson. Safeware: System Safety and Computers. Addison Wesley, 1995. Google ScholarGoogle ScholarCross RefCross Ref
  16. R. A. D. Millo and A. J. Offutt. Constraint-based automatic test data generation. 17(9):900--910, September 1991. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. NuSMV: A New Symbolic Model Checking. Available at http://nusmv.irst.itc.it/.Google ScholarGoogle Scholar
  18. M. Park, T. Byun, and Y. Choi. Property-based code slicing for efficient verification of OSEK/VDX operating systems. 2012.Google ScholarGoogle ScholarCross RefCross Ref
  19. K. Sen, D. Marinov, and G. Agha. CUTE: a concolic unit testing engine for C. In 10th European Software Engineering Conference/13th ACM SIGSOFT International Symposium on Foundations of Software Engineering, 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. L. Tan, O. Sokolsky, and I. Lee. Specification-based testing with linear temporal logic. In IEEE International Conference on Information Reuse and Integration, 2004.Google ScholarGoogle Scholar
  21. O. Tkachuk, M. Dwyer, and C. Pasareanu. Automated environment generation for software model checking. In 18th IEEE International Conference on Automated Software Engineering, pages 116--129, October 2003.Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. K. Yatake and T. Aoki. Automatic generation of model checking scripts based on environment modeling. In 17th International SPIN Conference on Software Model Checking, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Automated system-level safety testing using constraint patterns for automotive operating systems

            Recommendations

            Comments

            Login options

            Check if you have access through your login credentials or your institution to get full access on this article.

            Sign in
            • Published in

              cover image ACM Conferences
              SAC '15: Proceedings of the 30th Annual ACM Symposium on Applied Computing
              April 2015
              2418 pages
              ISBN:9781450331968
              DOI:10.1145/2695664

              Copyright © 2015 ACM

              Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

              Publisher

              Association for Computing Machinery

              New York, NY, United States

              Publication History

              • Published: 13 April 2015

              Permissions

              Request permissions about this article.

              Request Permissions

              Check for updates

              Qualifiers

              • research-article

              Acceptance Rates

              SAC '15 Paper Acceptance Rate291of1,211submissions,24%Overall Acceptance Rate1,650of6,669submissions,25%

            PDF Format

            View or Download as a PDF file.

            PDF

            eReader

            View online with eReader.

            eReader