ABSTRACT
This paper aims to solve the challenge of quantifying the perfor- mance of Hardware-in-the-Loop (HIL) computer systems used for data re-injection. The system can be represented as a multiple queue and server system that operates on a First-In, First-Out (FIFO) basis. The task at hand involves establishing tight bounds on end-to-end delay and system backlog. This is necessary to optimise buffer and pre-buffer time configurations. Network Calculus (NC) is chosen as the basic analytical framework to achieve this. In the literature, there are different techniques for estimating arrival and service curves from measurement data which can be used for NC calcu- lations. We have selected four of these methods to be applied to datasets of industrial Timestamp Logging (TL). The problem arises because these conventional methods often produce bounds that are much larger (by a factor of 1000 or more) than the measured maximum values, resulting in inefficient design of HIL system pa- rameters and inefficient resource usage. The proposed approach, called TBASCEM, introduces a reverse engineering approach based on linear NC equations for estimating the parameters of arrival and service curves. By imposing constraints on the equation variables and employing non-linear optimization, TBASCEM searches for a burst parameter estimation which derives tight global delay bounds. In addition, TBASCEM simplifies the run-time measurement pro- cess, supporting real-time data acquisition to evaluate and optimise HIL system performance, and enhancing observability to adapt the HIL configuration to new sensor data. The benefits of TBASCEM are clearly that it enables an efficient performance logging of arrival and service curve parameters and with deriving tighter bounds in HIL systems, compared to evaluated state-of-the-art methods, mak- ing TBASCEM an invaluable tool for optimising and monitoring streaming applications in non-hard-real-time environments.
- Luigi Alcuri, Giuseppe Barbera, and Giuseppe D'Acquisto. 2005. Service Curve Estimation by Measurement: An Input Output Analysis of a Softswitch Model. In Quality of Service in Multiservice IP Networks, Marco Ajmone Marsan, Giuseppe Bianchi, Marco Listanti, and Michela Meo (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 49--60.Google Scholar
- Bulgaria Aleksandrov, Chavdar Acad, Bulgaria Rumenin, Christian Magele, Stoyanov, Bulgaria Sotirova, Ritchie, Toepfer, Hartmut Brauer, Marin Hristov, Repetto, Bulgaria Antchev, Bulgaria Mihailov, Bulgaria Romansky, Bulgaria Vasilev, Japan Tanaka, Ventsislav Valchev, Vladimir Shelyagin, Ukraine Acad, and Anna Stoynova. 2019. Review of hardware-in-the-loop -a hundred years progress in the pseudo-real testing. 54 (12 2019), 70--84.Google Scholar
- A.A. Baybulatov and V.G. Promyslov. 2019. Control System Availability Assessment Via Maximum Delay Calculation. In 2019 International Conference on Industrial Engineering, Applications and Manufacturing (ICIEAM). 1--6. https: //doi.org/10.1109/ICIEAM.2019.8743012Google ScholarCross Ref
- A.A. Baybulatov and V. G. Promyslov. 2017. A Technique for Envelope Regression in Network Calculus. In 2017 IEEE 11th International Conference on Application of Information and Communication Technologies (AICT). 1--4. https://doi.org/10. 1109/ICAICT.2017.8687034Google Scholar
- Anne Bouillard, Laurent Jouhet, and Eric Thierry. 2009. Service curves in Network Calculus: dos and don'ts.Google Scholar
- R.L. Cruz. 1991. A calculus for network delay. I. Network elements in isolation. IEEE Transactions on Information Theory 37, 1 (1991), 114--131. https://doi.org/ 10.1109/18.61109Google ScholarDigital Library
- dSPACE GmbH. 2017. FAQ 242 - Handling Overrun Situations. https://www. dspace.com/shared/support/faqpdf/faq242.pdfGoogle Scholar
- Markus Fidler. 2010. Survey of deterministic and stochastic service curve models in the network calculus. IEEE Communications Surveys & Tutorials 12, 1 (2010), 59--86. https://doi.org/10.1109/SURV.2010.020110.00019Google ScholarDigital Library
- Christoph Funda, Pablo Marín García, Reinhard German, and Kai-Steffen Hielscher. 2023. Arrival and Service Curve Measurement-Based Estimation Methods to Analyze and Design Soft Real-Time Streaming Systems with Network Calculus. In 2023 3rd International Conference on Electrical, Computer, Communications and Mechatronics Engineering (ICECCME). 1--8. https://doi.org/10.1109/ICECCME57830.2023.10253001Google ScholarCross Ref
- Christoph Funda, Kai-Steffen Jens Hielscher, and Reinhard German. 2021. Discrete event simulation for the purpose of real-time performance evaluation of distributed hardware-in-the-loop simulators for autonomous driving vehicle validation. Electron. Commun. Eur. Assoc. Softw. Sci. Technol. 80 (2021).Google Scholar
- Christoph Funda, Tobias Konheiser, Thomas Herpel, Reinhard German, and Kai- Steffen Hielscher. 2022. An industrial case study for performance evaluation of hardware-in-the-loop simulators with a combination of network calculus and discrete-event simulation. In 2022 International Conference on Electrical, Computer, Communications and Mechatronics Engineering (ICECCME). 1--7. https: //doi.org/10.1109/ICECCME55909.2022.9988051Google ScholarCross Ref
- Max Helm, Henning Stubbe, Dominik Scholz, Benedikt Jaeger, Sebastian Gallenmüller, Nemanja Deric, Endri Goshi, Hasanin Harkous, Zikai Zhou, Wolfgang Kellerer, and Georg Carle. 2021. Application of Network Calculus Models on Programmable Device Behavior. In 2021 33rd International Teletraffic Congress (ITC-33). Avignon, France, 1--9. https://gitlab2.informatik.uni-wuerzburg.de/itc-conference/itc-conferencepublic/-/ raw/master/itc33/hel21ITC33.pdf?inline=trueGoogle Scholar
- Wolfgang Kellerer and Amaury Van Bemten. 2016. Network Calculus: A Comprehensive Guide. Technical Report 201603. Technische Universität München Lehrstuhl für Kommunikationsnetze, Arcisstr. 21, 80333 München, German.Google Scholar
- Jean-Yves Le Boudec and Patrick Thiran (Eds.). 2001. Network Calculus. Springer Berlin Heidelberg, Berlin, Heidelberg, 3--81. https://doi.org/10.1007/3--540--45318- 0_1Google ScholarCross Ref
- Ralf Lübben and Markus Fidler. 2017. Service Curve Estimation-Based Characterization and Evaluation of Closed-Loop Flow Control. IEEE Transactions on Network and Service Management 14, 1 (2017), 161--175. https://doi.org/10.1109/ TNSM.2016.2638471Google ScholarDigital Library
- MATHWORKS. [n. d.]. Box chart (box plot) - MATLAB boxchart - MathWorks Deutschland - de.mathworks.com. https://de.mathworks.com/help/matlab/ref/ boxchart.html. [Accessed 22-02--2024].Google Scholar
- Alenka Hren. 2022. Hardware-in-the-loop simulations: A historical overview of engineering challenges. Electronics 11, 15 (2022), 2462.Google ScholarCross Ref
- Morgan Quigley, Ken Conley, Brian P. Gerkey, Josh Faust, Tully Foote, Jeremy Leibs, Rob Wheeler, and Andrew Y. Ng. 2009. ROS: an open-source Robot Operating System. In ICRA Workshop on Open Source Software.Google Scholar
- Astrid Undheim, Yuming Jiang, and Peder J. Emstad. 2007. Network Calculus Approach to Router Modeling with External Measurements. 2007 Second International Conference on Communications and Networking in China (2007), 276--280. https://api.semanticscholar.org/CorpusID:6662110Google ScholarCross Ref
- ErnestoWandeler. 2006. Modular Performance Analysis and Interface-Based Design for Embedded Real-Time Systems. Ph.D. Dissertation. ETH Zurich.Google Scholar
- Jing Xie and Min Xie. 2013. Delay bound analysis in real-time networks with priority scheduling using network calculus. In 2013 IEEE International Conference on Communications (ICC). IEEE, 2469--2474.Google ScholarCross Ref
Index Terms
- TBASCEM - Tight Bounds with Arrival and Service Curve Estimation by Measurements
Recommendations
Retrial queuing system with Markovian arrival flow and phase-type service time distribution
We consider a multi-server queuing system with retrial customers to model a call center. The flow of customers is described by a Markovian arrival process (MAP). The servers are identical and independent of each other. A customer's service time has a ...
Queues with Workload-Dependent Arrival and Service Rates
We consider two types of queues with workload-dependent arrival rate and service speed. Our study is motivated by queueing scenarios where the arrival rate and/or speed of the server depends on the amount of work present, like production systems and the ...
On the batch arrival batch service queue with finite buffer under server's vacation: MX/GY/1/N queue
This paper considers a finite-buffer batch arrival and batch service queue with single and multiple vacations. The steady-state distributions of the number of customers in the queue at service completion, vacation termination, departure, arbitrary and ...
Comments