Model-based testing of embedded systems in hardware in the loop environment
Model-based testing of embedded systems in hardware in the loop environment
- Author(s): J.S. Keränen and T.D. Räty
- DOI: 10.1049/iet-sen.2011.0111
For access to this article, please select a purchase option:
Buy article PDF
Buy Knowledge Pack
IET members benefit from discounts to all IET publications and free access to E&T Magazine. If you are an IET member, log in to your account and the discounts will automatically be applied.
Thank you
Your recommendation has been sent to your librarian.
- Author(s): J.S. Keränen 1 and T.D. Räty 1
-
-
View affiliations
-
Affiliations:
1: VTT Technical Research Centre of Finland, Oulu, Finland
-
Affiliations:
1: VTT Technical Research Centre of Finland, Oulu, Finland
- Source:
Volume 6, Issue 4,
August 2012,
p.
364 – 376
DOI: 10.1049/iet-sen.2011.0111 , Print ISSN 1751-8806, Online ISSN 1751-8814
The evolution of software testing technologies has significantly reduced software testing execution times, but the test design and generation are still often implemented with slow manual-oriented methods. Model-based testing (MBT) offers automation to test design and generation, and different MBT solutions are familiar from research, but more effort needs to be done to adopt MBT for industrial use. Hardware in the loop (HIL) is a simulation and testing technique used in the development and testing of embedded systems. HIL is a challenging application field for MBT due to complex and non-deterministic nature of some embedded systems. To tackle this problem, the authors present a novel prototype platform in which online and offline MBT is applied to HIL environment. MBT in general has been introduced for HIL in scientific literature before, but the application of online MBT in HIL is a novel approach. The whole novel MBT in HIL prototype platform along with the used MBT tool, platform architecture and MBT process are presented accompanied by experimental results and analysis of two case studies with an example embedded system under test.
Inspec keywords: digital simulation; program testing; software architecture; automatic test software; embedded systems
Other keywords:
Subjects: Diagnostic, testing, debugging and evaluating systems; Software engineering techniques
References
-
-
1)
- D'Angelo, B., Sankaranarayanan, S., Sanchez, C.: `LOLA: runtime monitoring of synchronous systems', 12thInt. Symp. on Temporal Representation and Reasoning (TIME’05), June 2005, p. 166–174.
-
2)
- D. Giannakopoulou , C.S. Pasareanu , C. Blundell . Assume-guarantee testing for software components. IET Softw. , 6 , 547 - 562
-
3)
- SpecExplorer: Available at: http://research.microsoft.com/specexplorer, accessed January 2011.
-
4)
- O. Tkachuk , M.B. Dwyer . Environment generation for validating event-driven software using model checking. IET Softw. , 3 , 194 - 209
-
5)
- Veanes, M., Campbell, C., Schulte, W., Kohli, P.: `On-the-fly testing of reactive systems', Microsoft Research Technical Report MSR-TR-2005-05, January 2005.
-
6)
- Dalal, S.R., Jain, A., Karunanithi, N.: `Model-based testing in practice', Proc. Int. Conf. on Software Engineering, 1999, Los Angeles, CA, USA, p. 285–294.
-
7)
- T-VEC. Available at: http://www.t-vec.com, accessed January 2011.
-
8)
- D. Ramaswamy , R. McGee , S. Sivashankar , A. Deshpande , J. Allen , K. Rzemien , W. Stuart . (2004) A case study in hardware-in-the-loop testing: development of an ECU for a hybrid electric vehicle, ‘Software/Hardware Systems, Systems Engineering, Advanced Electronics Packaging, and Electromagnetic Compatibility’.
-
9)
- M. Utting , B. Legeard . (2007) Practical model-based testing: a tools approach.
-
10)
- dSPACE: Available at: http://www.dspaceinc.com/en/inc/home.cfm, accessed January 2011.
-
11)
- L. Madeyski , N. Radyk . Judy – a mutation testing tool for java. IET Softw. , 1 , 32 - 42
-
12)
- King, P.J., Copp, D.G.: `Hardware in the loop for automotive vehicle control systems development', UKACC Control 2004 Mini Symp., September 2004, p. 75–78.
-
13)
- Wieczorek, S., Fritzsche, M., Schnitter, J.: `Enhancing test driven development with model based testing and performance analysis', Testing: Academic and Industrial Conf. – Practice and Research Techniques, August 2008, p. 82–86.
-
14)
- Testing Technologies – TTworkbench: Available at: http://www.testingtech.com/products/ttworkbench.php, accessed January 2011.
-
15)
- Ernits, J., Veanes, M., Helander, J.: `Model-based testing of robots with NModel', Proc. Microsoft Research, June 2008.
-
16)
- L. Jianhui , K.R. Pattipati , Q. Liu , S. Chigusa . An integrated diagnostic development process for automotive engine control systems. IEEE Trans. Syst. Man Cybern. Part C: Appl. Rev. , 6 , 1163 - 1173
-
17)
- Bruntink, M., Van Deursen, A., Tourwe, T.: `Discovering faults in idiom-based exception handling', ICSE '06, May 2006.
-
18)
- Changbo, K., Yindong, J., Shuai, W., Xinya, S.: `A contract-checking test method for CTCS hardware-in-the-loop simulation system', Second IEEE Int. Conf. on Information Management and Engineering (ICIME), April 2010, p. 267–271.
-
19)
- Verified RT-Tester: Available at: http://www.verified.de/en/products/rt-tester, accessed January 2011.
-
20)
- Ahuja, S., Yao, D., Neema, S., Bapty, T., Shetty, S., Nordstrom, S.G.: `Dynamically reconfigurable monitoring in large scale real-time embedded systems', SoutheastCon, April 2005, p. 327–332.
-
21)
- D. Heffernan , S. Shaheen , C. Watterson . Monitoring embedded software timing properties with an SoC-resident monitor. IET Softw. , 2 , 140 - 153
-
22)
- All4Tec MaTeLo. Available at: http://www.all4tec.net, accessed January 2011.
-
23)
- Bringmann, E., Kramer, A.: `Model-based testing of automotive systems', First Int. Conf. on Software Testing, Verification, and Validation, April 2008, p. 485–493.
-
24)
- CAN in Automation: Available at: http://www.can-cia.org, accessed January 2011.
-
25)
- Reactive Systems Inc.: ‘Model-based testing and validation of control software with reactis’. White Paper, USA, 2008. Available at: http://www.reactive-systems.com/papers/bcsf.pdf.
-
26)
- S. Koehl , D. Jegminat . (2005) How to do hardware-in-the loop simulation right, ‘Controller System Software Testing and Validation’.
-
27)
- M. Ge , Y. Xu , R. Du . An intelligent online monitoring and diagnostic system for manufacturing automation. IEEE Trans. Autom. Sci. Eng. , 1 , 127 - 139
-
28)
- Baracos, P., Murere, G., Rabbath, C.A., Jin, W.: `Enabling PC-based HIL simulation for automotive applications', IEEE Int. Conf. on Electric Machines and Drives, June 2001, p. 721–729.
-
29)
- P. Samuel , R. Mall , A.K. Bothra . Automatic test case generation using unified modeling language (UML) state diagrams. IET Softw. , 2 , 79 - 93
-
30)
- Conformiq Qtronic: Available at: http://www.conformiq.com/products.php, accessed January 2011.
-
31)
- K. Lamberg , M. Beine , M. Eschmann , R. Otterbach . Model-based testing of embedded automotive software using Mtest. SAE Trans. J. Passenger Cars Electron. Electr. Syst. , 132 - 140
-
32)
- Siegl, S., Hielscher, K-S., German, R.: `Model driven testing of embedded automotive systems with timed usage models', IEEE Int. Conf. on Vehicular Electronics and Safety, July 2010, p. 110–115.
-
33)
- EmbeddedTester: Available at: http://www.btc-es.de/index.php?lang=2&idcatside=2, accessed January 2011.
-
34)
- MathWorks: Available at: http://www.mathworks.com/products/simulink/demos.html?file=/products/demos/shipping/simulink, accessed January 2011.
-
35)
- Conrad, M., Dörr, H., Fey, I., Yap, A.: `Model-based generation and structured representation of test scenarios', WSEST Workshop on Software-Embedded System Testing, November 1999, Gaithersburg.
-
36)
- C. Watterson , D. Heffernan . Runtime verification and monitoring of embedded systems. IET Softw. , 5 , 172 - 179
-
37)
- Jevtic, M., Zerbe, V., Brankov, S.: `Multilevel validation of online monitor for hard real-time systems', 24thInt. Conf. on Microelectronics (MIEL 2004), May 2004, p. 755–758.
-
38)
- Tan, L., Kim, J., Sokolsky, O., Lee, I.: `Model-based testing and monitoring for hybrid embedded systems', Proc. 2004 IEEE Int. Conf. on Information Reuse and Integration, 2004, p. 487–492.
-
39)
- McNeal, R., Belkhayat, M.: `Standard tools for hardware-in-the-loop (HIL) modeling and simulation', IEEE Electric Ship Technologies Symp., May 2007, p. 130–137.
-
40)
- Uppaal TRON: Available at: http://www.cs.aau.dk/~marius/tron/introduction.html, accessed January 2011.
-
41)
- Fangming, G., Harrison, W.S., Tilbury, D.M., Chengyin, Y.: `Hardware-in-the-loop for manufacturing automation control: current status and identified needs', IEEE Int. Conf. on Automation Science and Engineering, September 2007, p. 1105–1110.
-
42)
- Larsen, K.G., Mikucionis, M., Nielsen, B., Skou, A.: `Testing real-time embedded software using UPPAAL-TRON: an industrial case study', Proc. Fifth ACM Int. Conf. on Embedded Software, September 2005, p. 299–306.
-
43)
- D. Jeya Mala , V. Mohan , M. Kamalapriya . Automated software test optimisation framework – an artificial bee colony optimisation-based approach. IET Softw. , 5 , 334 - 348
-
1)