skip to main content
10.1145/3321707.3321755acmconferencesArticle/Chapter ViewAbstractPublication PagesgeccoConference Proceedingsconference-collections
research-article

Stability analysis for safety of automotive multi-product lines: a search-based approach

Published: 13 July 2019 Publication History

Abstract

Safety assurance for automotive products is crucial and challenging. It becomes even more difficult when the variability in automotive products is considered. Recently, the notion of automotive multi-product lines (multi-PL) is proposed as a unified framework to accommodate different sources of variability in automotive products. In the context of automotive multi-PL, we propose a stability analysis for safety, motivated by our industrial collaboration, where we observed that under certain operation scenarios, safety varies drastically with small fluctuations in production parameters, environmental conditions, or driving inputs. To characterize instability, we formulate a multi-objective optimization problem, and solve it with a search-based approach. The proposed technique is applied to an industrial automotive multi-PL, and experimental results show its effectiveness to spot instability. Moreover, based on information gathered during the search, we provide some insights on both testing and quality engineering of automotive products.

Supplementary Material

ZIP File (p1241-lee_suppl.zip)
Supplemental material.

References

[1]
Raja B. Abdessalem, Shiva Nejati, Lionel C. Briand, and Thomas Stifter. 2016. Testing Advanced Driver Assistance Systems Using Multi-Objective Search and Neural Networks. In Proceedings of the 31st IEEE/ACM International Conference on Automated Software Engineering (ASE'16). ACM, 63--74.
[2]
Raja B. Abdessalem, Shiva Nejati, Lionel C. Briand, and Thomas Stifter. 2018. Testing Vision-Based Control Systems Using Learnable Evolutionary Algorithms. In Proceedings of the 40th International Conference on Software Engineering (ICSE'18). ACM, 1016--1026.
[3]
Raja B. Abdessalem, Annibale Panichella, Shiva Nejati, Lionel C. Briand, and Thomas Stifter. 2018. Testing Autonomous Cars for Feature Interaction Failures Using Many-Objective Search. In Proceedings of the 33rd ACM/IEEE International Conference on Automated Software Engineering (ASE'18). ACM, 143--154.
[4]
Shaukat Ali, Paolo Arcaini, Ichiro Hasuo, Fuyuki Ishikawa, and Nian-Ze Lee. 2019. Towards a Framework for the Analysis of Multi-Product Lines in the Automotive Domain. In Proceedings of the 13th International Workshop on Variability Modelling of Software-Intensive Systems (VAMOS '19). ACM, New York, NY, USA, Article 12, 6 pages.
[5]
Andrea Arcuri and Lionel C. Briand. 2011. A Practical Guide for Using Statistical Tests to Assess Randomized Algorithms in Software Engineering. In Proceedings of the 33rd International Conference on Software Engineering (ICSE'11). ACM, 1--10.
[6]
Andrea Arcuri and Gordon Fraser. 2011. On Parameter Tuning in Search Based Software Engineering. In Proceedings of the 3rd International Conference on Search Based Software Engineering (SSBSE'11). Springer, 33--47.
[7]
Harsh Beohar and Mohammad R. Mousavi. 2016. Input-Output Conformance Testing for Software Product Lines. Journal of Logical and Algebraic Methods in Programming 85, 6 (2016), 1131--1153.
[8]
Daniel Bruns, Vladimir Klebanov, and Ina Schaefer. 2010. Verification of Software Product Lines with Delta-Oriented Slicing. In Proceedings of the 1st International Conference on Formal Verification of Object-Oriented Software (FoVeOOS'10). Springer, 61--75.
[9]
Kalyanmoy Deb, Amrit Pratap, Sameer Agarwal, and T. A. M. T. Meyarivan. 2002. A Fast and Elitist Multiobjective Genetic Algorithm: NSGA-II. IEEE Transactions on Evolutionary Computation 6, 2 (2002), 182--197.
[10]
Alexandre Donzé and Oded Maler. 2010. Robust Satisfaction of Temporal Logic over Real-Valued Signals. In Proceedings of the 8th International Conference on Formal Modeling and Analysis of Timed Systems (FORMATS'10). Springer, 92--106.
[11]
Juan J. Durillo and Antonio J. Nebro. 2011. jMetal: A Java Framework for Multi-Objective Optimization. Advances in Engineering Software 42, 10 (2011), 760--771.
[12]
Zhun Fan, Yi Fang, Wenji Li, Jiewei Lu, Xinye Cai, and Caimin Wei. 2017. A Comparative Study of Constrained Multi-Objective Evolutionary Algorithms on Constrained Multi-Objective Optimization Problems. In 2017 IEEE Congress on Evolutionary Computation (CEC'17). IEEE, 209--216.
[13]
Mark Harman, Jens Krinke, Jian Ren, and Shin Yoo. 2009. Search Based Data Sensitivity Analysis Applied to Requirement Engineering. In Proceedings of the 11th Annual Conference on Genetic and Evolutionary Computation (GECCO'09). ACM, 1681--1688.
[14]
Mark Harman, Afshin Mansouri, and Yuanyuan Zhang. 2012. Search-Based Software Engineering: Trends, Techniques and Applications. ACM Computing Surveys (CSUR) 45, 1 (2012), 11.
[15]
Gerald Holl, Paul Grünbacher, and Rick Rabiser. 2012. A Systematic Review and An Expert Survey on Capabilities Supporting Multi Product Lines. Information and Software Technology 54, 8 (2012), 828--852.
[16]
James Kapinski, Jyotirmoy V. Deshmukh, Xiaoqing Jin, Hisahiro Ito, and Ken Butts. 2016. Simulation-Based Approaches for Verification of Embedded Control Systems: An Overview of Traditional and Advanced Modeling, Testing, and Verification Techniques. IEEE Control Systems 36, 6 (2016), 45--64.
[17]
Antonio J. Nebro, Juan J. Durillo, and Matthieu Vergne. 2015. Redesigning the jMetal Multi-Objective Optimization Framework. In Proceedings of the Companion Publication of the 17th Annual Conference on Genetic and Evolutionary Computation (GECCO Companion'15). ACM, 1093--1100.
[18]
Andrea Saltelli, Karen Chan, and Marian Scott. 2000. Sensitivity Analysis. Vol. 1. Wiley New York.
[19]
Larissa R. Soares, Pierre-Yves Schobbens, Ivan do Carmo Machado, and Eduardo S. de Almeida. 2018. Feature Interaction in Software Product Line Engineering: A Systematic Mapping Study. Information and Software Technology 98 (2018), 44--58.
[20]
Thomas Thüm, Ina Schaefer, Sven Apel, and Martin Hentschel. 2012. Family-Based Deductive Verification of Software Product Lines. In Proceedings of the 11th International Conference on Generative Programming and Component Engineering (GPCE'12). ACM, 11--20.
[21]
Frank J. van der Linden, Klaus Schmid, and Eelco Rommes. 2007. Software Product Lines in Action: The Best Industrial Practice in Product Line Engineering. Springer.
[22]
Shuai Wang, Shaukat Ali, Tao Yue, Yan Li, and Marius Liaaen. 2016. A Practical Guide to Select Quality Indicators for Assessing Pareto-Based Search Algorithms in Search-Based Software Engineering. In Proceedings of the 38th International Conference on Software Engineering (ICSE'16). IEEE, 631--642.
[23]
Claes Wohlin, Per Runeson, Martin Höst, Magnus C. Ohlsson, Björn Regnell, and Anders Wesslén. 2012. Experimentation in Software Engineering. Springer Science & Business Media.

Cited By

View all
  • (2022)How to Evaluate Solutions in Pareto-Based Search-Based Software Engineering: A Critical Review and Methodological GuidanceIEEE Transactions on Software Engineering10.1109/TSE.2020.303610848:5(1771-1799)Online publication date: 1-May-2022
  • (2021)Analyzing the impact of product configuration variations on advanced driver assistance systems with searchProceedings of the Genetic and Evolutionary Computation Conference10.1145/3449639.3459332(1106-1114)Online publication date: 26-Jun-2021
  • (2019)Assessing the Relation Between Hazards and Variability in Automotive Systems2019 24th International Conference on Engineering of Complex Computer Systems (ICECCS)10.1109/ICECCS.2019.00028(190-199)Online publication date: Nov-2019

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
GECCO '19: Proceedings of the Genetic and Evolutionary Computation Conference
July 2019
1545 pages
ISBN:9781450361118
DOI:10.1145/3321707
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 July 2019

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. automotive domain
  2. product line
  3. robustness
  4. safety
  5. search
  6. simulink
  7. stability analysis

Qualifiers

  • Research-article

Conference

GECCO '19
Sponsor:
GECCO '19: Genetic and Evolutionary Computation Conference
July 13 - 17, 2019
Prague, Czech Republic

Acceptance Rates

Overall Acceptance Rate 1,669 of 4,410 submissions, 38%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)8
  • Downloads (Last 6 weeks)2
Reflects downloads up to 17 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2022)How to Evaluate Solutions in Pareto-Based Search-Based Software Engineering: A Critical Review and Methodological GuidanceIEEE Transactions on Software Engineering10.1109/TSE.2020.303610848:5(1771-1799)Online publication date: 1-May-2022
  • (2021)Analyzing the impact of product configuration variations on advanced driver assistance systems with searchProceedings of the Genetic and Evolutionary Computation Conference10.1145/3449639.3459332(1106-1114)Online publication date: 26-Jun-2021
  • (2019)Assessing the Relation Between Hazards and Variability in Automotive Systems2019 24th International Conference on Engineering of Complex Computer Systems (ICECCS)10.1109/ICECCS.2019.00028(190-199)Online publication date: Nov-2019

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media