skip to main content
10.1145/3629526.3645031acmconferencesArticle/Chapter ViewAbstractPublication PagesicpeConference Proceedingsconference-collections
research-article

TBASCEM - Tight Bounds with Arrival and Service Curve Estimation by Measurements

Authors Info & Claims
Published:07 May 2024Publication History

ABSTRACT

This paper aims to solve the challenge of quantifying the perfor- mance of Hardware-in-the-Loop (HIL) computer systems used for data re-injection. The system can be represented as a multiple queue and server system that operates on a First-In, First-Out (FIFO) basis. The task at hand involves establishing tight bounds on end-to-end delay and system backlog. This is necessary to optimise buffer and pre-buffer time configurations. Network Calculus (NC) is chosen as the basic analytical framework to achieve this. In the literature, there are different techniques for estimating arrival and service curves from measurement data which can be used for NC calcu- lations. We have selected four of these methods to be applied to datasets of industrial Timestamp Logging (TL). The problem arises because these conventional methods often produce bounds that are much larger (by a factor of 1000 or more) than the measured maximum values, resulting in inefficient design of HIL system pa- rameters and inefficient resource usage. The proposed approach, called TBASCEM, introduces a reverse engineering approach based on linear NC equations for estimating the parameters of arrival and service curves. By imposing constraints on the equation variables and employing non-linear optimization, TBASCEM searches for a burst parameter estimation which derives tight global delay bounds. In addition, TBASCEM simplifies the run-time measurement pro- cess, supporting real-time data acquisition to evaluate and optimise HIL system performance, and enhancing observability to adapt the HIL configuration to new sensor data. The benefits of TBASCEM are clearly that it enables an efficient performance logging of arrival and service curve parameters and with deriving tighter bounds in HIL systems, compared to evaluated state-of-the-art methods, mak- ing TBASCEM an invaluable tool for optimising and monitoring streaming applications in non-hard-real-time environments.

References

  1. Luigi Alcuri, Giuseppe Barbera, and Giuseppe D'Acquisto. 2005. Service Curve Estimation by Measurement: An Input Output Analysis of a Softswitch Model. In Quality of Service in Multiservice IP Networks, Marco Ajmone Marsan, Giuseppe Bianchi, Marco Listanti, and Michela Meo (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 49--60.Google ScholarGoogle Scholar
  2. Bulgaria Aleksandrov, Chavdar Acad, Bulgaria Rumenin, Christian Magele, Stoyanov, Bulgaria Sotirova, Ritchie, Toepfer, Hartmut Brauer, Marin Hristov, Repetto, Bulgaria Antchev, Bulgaria Mihailov, Bulgaria Romansky, Bulgaria Vasilev, Japan Tanaka, Ventsislav Valchev, Vladimir Shelyagin, Ukraine Acad, and Anna Stoynova. 2019. Review of hardware-in-the-loop -a hundred years progress in the pseudo-real testing. 54 (12 2019), 70--84.Google ScholarGoogle Scholar
  3. A.A. Baybulatov and V.G. Promyslov. 2019. Control System Availability Assessment Via Maximum Delay Calculation. In 2019 International Conference on Industrial Engineering, Applications and Manufacturing (ICIEAM). 1--6. https: //doi.org/10.1109/ICIEAM.2019.8743012Google ScholarGoogle ScholarCross RefCross Ref
  4. A.A. Baybulatov and V. G. Promyslov. 2017. A Technique for Envelope Regression in Network Calculus. In 2017 IEEE 11th International Conference on Application of Information and Communication Technologies (AICT). 1--4. https://doi.org/10. 1109/ICAICT.2017.8687034Google ScholarGoogle Scholar
  5. Anne Bouillard, Laurent Jouhet, and Eric Thierry. 2009. Service curves in Network Calculus: dos and don'ts.Google ScholarGoogle Scholar
  6. R.L. Cruz. 1991. A calculus for network delay. I. Network elements in isolation. IEEE Transactions on Information Theory 37, 1 (1991), 114--131. https://doi.org/ 10.1109/18.61109Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. dSPACE GmbH. 2017. FAQ 242 - Handling Overrun Situations. https://www. dspace.com/shared/support/faqpdf/faq242.pdfGoogle ScholarGoogle Scholar
  8. Markus Fidler. 2010. Survey of deterministic and stochastic service curve models in the network calculus. IEEE Communications Surveys & Tutorials 12, 1 (2010), 59--86. https://doi.org/10.1109/SURV.2010.020110.00019Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Christoph Funda, Pablo Marín García, Reinhard German, and Kai-Steffen Hielscher. 2023. Arrival and Service Curve Measurement-Based Estimation Methods to Analyze and Design Soft Real-Time Streaming Systems with Network Calculus. In 2023 3rd International Conference on Electrical, Computer, Communications and Mechatronics Engineering (ICECCME). 1--8. https://doi.org/10.1109/ICECCME57830.2023.10253001Google ScholarGoogle ScholarCross RefCross Ref
  10. Christoph Funda, Kai-Steffen Jens Hielscher, and Reinhard German. 2021. Discrete event simulation for the purpose of real-time performance evaluation of distributed hardware-in-the-loop simulators for autonomous driving vehicle validation. Electron. Commun. Eur. Assoc. Softw. Sci. Technol. 80 (2021).Google ScholarGoogle Scholar
  11. Christoph Funda, Tobias Konheiser, Thomas Herpel, Reinhard German, and Kai- Steffen Hielscher. 2022. An industrial case study for performance evaluation of hardware-in-the-loop simulators with a combination of network calculus and discrete-event simulation. In 2022 International Conference on Electrical, Computer, Communications and Mechatronics Engineering (ICECCME). 1--7. https: //doi.org/10.1109/ICECCME55909.2022.9988051Google ScholarGoogle ScholarCross RefCross Ref
  12. Max Helm, Henning Stubbe, Dominik Scholz, Benedikt Jaeger, Sebastian Gallenmüller, Nemanja Deric, Endri Goshi, Hasanin Harkous, Zikai Zhou, Wolfgang Kellerer, and Georg Carle. 2021. Application of Network Calculus Models on Programmable Device Behavior. In 2021 33rd International Teletraffic Congress (ITC-33). Avignon, France, 1--9. https://gitlab2.informatik.uni-wuerzburg.de/itc-conference/itc-conferencepublic/-/ raw/master/itc33/hel21ITC33.pdf?inline=trueGoogle ScholarGoogle Scholar
  13. Wolfgang Kellerer and Amaury Van Bemten. 2016. Network Calculus: A Comprehensive Guide. Technical Report 201603. Technische Universität München Lehrstuhl für Kommunikationsnetze, Arcisstr. 21, 80333 München, German.Google ScholarGoogle Scholar
  14. Jean-Yves Le Boudec and Patrick Thiran (Eds.). 2001. Network Calculus. Springer Berlin Heidelberg, Berlin, Heidelberg, 3--81. https://doi.org/10.1007/3--540--45318- 0_1Google ScholarGoogle ScholarCross RefCross Ref
  15. Ralf Lübben and Markus Fidler. 2017. Service Curve Estimation-Based Characterization and Evaluation of Closed-Loop Flow Control. IEEE Transactions on Network and Service Management 14, 1 (2017), 161--175. https://doi.org/10.1109/ TNSM.2016.2638471Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. MATHWORKS. [n. d.]. Box chart (box plot) - MATLAB boxchart - MathWorks Deutschland - de.mathworks.com. https://de.mathworks.com/help/matlab/ref/ boxchart.html. [Accessed 22-02--2024].Google ScholarGoogle Scholar
  17. Alenka Hren. 2022. Hardware-in-the-loop simulations: A historical overview of engineering challenges. Electronics 11, 15 (2022), 2462.Google ScholarGoogle ScholarCross RefCross Ref
  18. Morgan Quigley, Ken Conley, Brian P. Gerkey, Josh Faust, Tully Foote, Jeremy Leibs, Rob Wheeler, and Andrew Y. Ng. 2009. ROS: an open-source Robot Operating System. In ICRA Workshop on Open Source Software.Google ScholarGoogle Scholar
  19. Astrid Undheim, Yuming Jiang, and Peder J. Emstad. 2007. Network Calculus Approach to Router Modeling with External Measurements. 2007 Second International Conference on Communications and Networking in China (2007), 276--280. https://api.semanticscholar.org/CorpusID:6662110Google ScholarGoogle ScholarCross RefCross Ref
  20. ErnestoWandeler. 2006. Modular Performance Analysis and Interface-Based Design for Embedded Real-Time Systems. Ph.D. Dissertation. ETH Zurich.Google ScholarGoogle Scholar
  21. Jing Xie and Min Xie. 2013. Delay bound analysis in real-time networks with priority scheduling using network calculus. In 2013 IEEE International Conference on Communications (ICC). IEEE, 2469--2474.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. TBASCEM - Tight Bounds with Arrival and Service Curve Estimation by Measurements

              Recommendations

              Comments

              Login options

              Check if you have access through your login credentials or your institution to get full access on this article.

              Sign in
              • Published in

                cover image ACM Conferences
                ICPE '24: Proceedings of the 15th ACM/SPEC International Conference on Performance Engineering
                May 2024
                310 pages
                ISBN:9798400704444
                DOI:10.1145/3629526

                Copyright © 2024 ACM

                Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

                Publisher

                Association for Computing Machinery

                New York, NY, United States

                Publication History

                • Published: 7 May 2024

                Permissions

                Request permissions about this article.

                Request Permissions

                Check for updates

                Qualifiers

                • research-article

                Acceptance Rates

                Overall Acceptance Rate252of851submissions,30%
              • Article Metrics

                • Downloads (Last 12 months)32
                • Downloads (Last 6 weeks)32

                Other Metrics

              PDF Format

              View or Download as a PDF file.

              PDF

              eReader

              View online with eReader.

              eReader