skip to main content
10.1145/2631890.2631891acmconferencesArticle/Chapter ViewAbstractPublication PagesisstaConference Proceedingsconference-collections
Article

Testing methods used in the automotive industry: results from a survey

Published: 21 July 2014 Publication History

Abstract

About 90% of all the current car innovations are based on electronics and software. The software used in a car has increased a lot reaching the size of 100 Million lines of code. Therefore, testing of automotive software has become a very critical task. In this paper we report on a questionnaire survey we carried out asking for information about testing activities within the automotive industry. We report on testing and test automation methods and tools in current use. In the survey we distinguished the different fields in the automotive industry where software development happens, i.e., research, pre-development, and series development. In addition we also discuss the opinions of the survey participants to various outlook topics.

References

[1]
ISO 9001:2008 - Quality management systems – Requirements. International Organization for Standardization, Geneva, 2008.
[2]
ISO 26262:2011:Road vehicles – Functional safety. International Organization for Standardization, Geneva, 2011.
[3]
H. Altinger. Survey on automated testing within automotive domain, original questionnaire. www.ist. tugraz.at/_attach/Publish/AltingerHarald/ Survey_automated_testing_enu.pdf, Mar. 2014.
[4]
Autosar. Autosar. www.autosar.org, Mar. 2014.
[5]
H. Braess and U. Seiffert. Vieweg Handbuch Kraftfahrzeugtechnik. ATZ/MTZ-Fachbuch. Springer Fachmedien Wiesbaden, 2013.
[6]
R. N. Charette. This car runs on code. IEEE Spectrum, 46(3):3, 2009.
[7]
W. P. Klocwork. Software on wheels. www.klocwork.com, Oct. 2012.
[8]
H. Krisp, K. Lamberg, and R. Leinfellner. Automated real-time testing of electronic control units. papers.sae.org, 2007.
[9]
W. P. MathWorks. Comprehensive static analysis using polyspace products. www.mathworks.com, Sept. 2013.
[10]
U. S. D. o. T. NHTSA and USA.gov. Office of defects investigation (ODI) recalls database. www-odi.nhtsa.dot.gov, 1997.
[11]
J. Power and M. H. Financial. 2013 J.D. power initial quality study. autos.jdpower.com, June 2013.
[12]
T. P. Release. Toyota announces voluntary recall of certain toyota prius, RAV4, tacoma and lexus RX 350 vehicles. Dec. 2014.
[13]
C. Rommel and A. Girard. Automated defect prevention for embedded software quality. alm.parasoft.com, Feb. 2012.
[14]
M. Schneider, P. Merkle, and K. Hahmann. Test bench for complex ECU networks. www.vector.com, Oct. 2013.
[15]
H. Schuette and M. Ploeger. Hardware-in-the-loop testing of engine control units-a technical survey. papers.sae.org, 2007.
[16]
A. SIG. Automotive SPICE. www.automotivespice.com, May 2010.
[17]
The Motor Industry Software Reliability Asso- and ciation. MISRA-C:2004 - Guidelines for the use of the C language in critical systems. MISRA, Warwickshire, 2 edition, 2004.
[18]
J. Woodcock, P. G. Larsen, J. Bicarregui, and J. Fitzgerald. Formal methods: Practice and experience. ACM Comput. Surv., 41(4), Oct. 2009.
[19]
X. Zhang and H. Pham. An analysis of factors affecting software reliability. Journal of Systems and Software, 50(1):43–56, 2000.

Cited By

View all
  • (2024)Evaluation of SiL Testing Potential—Shifting from HiL by Identifying Compatible Requirements with vECUsVehicles10.3390/vehicles60200446:2(920-948)Online publication date: 29-May-2024
  • (2024)Intrusion Detection Systems in Automotive Ethernet Networks: Challenges, Opportunities and Future Research TrendsIEEE Internet of Things Magazine10.1109/IOTM.001.23001097:2(62-68)Online publication date: Mar-2024
  • (2024)Exploration of Narrative Design Method and Tool on Intelligent Cockpit Experience DesignCross-Cultural Design10.1007/978-3-031-60913-8_13(178-191)Online publication date: 1-Jun-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
JAMAICA 2014: Proceedings of the 2014 Workshop on Joining AcadeMiA and Industry Contributions to Test Automation and Model-Based Testing
July 2014
33 pages
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 July 2014

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. automotive industry
  2. survey
  3. testing
  4. tools

Qualifiers

  • Article

Conference

ISSTA '14
Sponsor:

Upcoming Conference

ISSTA '25

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)98
  • Downloads (Last 6 weeks)7
Reflects downloads up to 20 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Evaluation of SiL Testing Potential—Shifting from HiL by Identifying Compatible Requirements with vECUsVehicles10.3390/vehicles60200446:2(920-948)Online publication date: 29-May-2024
  • (2024)Intrusion Detection Systems in Automotive Ethernet Networks: Challenges, Opportunities and Future Research TrendsIEEE Internet of Things Magazine10.1109/IOTM.001.23001097:2(62-68)Online publication date: Mar-2024
  • (2024)Exploration of Narrative Design Method and Tool on Intelligent Cockpit Experience DesignCross-Cultural Design10.1007/978-3-031-60913-8_13(178-191)Online publication date: 1-Jun-2024
  • (2024)Formal Runtime Error Detection During Development in the Automotive IndustryVerification, Model Checking, and Abstract Interpretation10.1007/978-3-031-50524-9_1(3-26)Online publication date: 15-Jan-2024
  • (2023)Automatic Sensor Detection System for Automotive Industry Applications2023 8th International Conference on Smart and Sustainable Technologies (SpliTech)10.23919/SpliTech58164.2023.10193417(1-4)Online publication date: 20-Jun-2023
  • (2023)Search-Based Software Testing Driven by Automatically Generated and Manually Defined Fitness FunctionsACM Transactions on Software Engineering and Methodology10.1145/362474533:2(1-37)Online publication date: 23-Dec-2023
  • (2023)Survey of Model-Based Security Testing Approaches in the Automotive DomainIEEE Access10.1109/ACCESS.2023.328217611(55474-55514)Online publication date: 2023
  • (2022)Cybersecurity Testing for Automotive Domain: A SurveySensors10.3390/s2223921122:23(9211)Online publication date: 26-Nov-2022
  • (2022)Automatically Learning Formal Models from Autonomous Driving SoftwareElectronics10.3390/electronics1104064311:4(643)Online publication date: 18-Feb-2022
  • (2022)Build Automation Framework for Design Validation of Automotive Gateway Controllers2022 IFIP Networking Conference (IFIP Networking)10.23919/IFIPNetworking55013.2022.9829801(1-6)Online publication date: 13-Jun-2022
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media