Buffer-Based High-Coverage and Low-Overhead Request Event Monitoring in the Cloud | IEEE Journals & Magazine | IEEE Xplore

Buffer-Based High-Coverage and Low-Overhead Request Event Monitoring in the Cloud


Abstract:

Request latency directly affects the performance of modern cloud applications. Due to various causes in hosts and networks, requests can suffer from request latency anoma...Show More

Abstract:

Request latency directly affects the performance of modern cloud applications. Due to various causes in hosts and networks, requests can suffer from request latency anomalies (RLAs), which may violate the Service-Level Agreement. However, existing performance monitoring tools have incomplete coverage and inconsistent semantics for monitoring requests and cannot accurately diagnose RLAs. This paper presents BufScope, a high-coverage and low-overhead request event monitoring system, which monitors buffers to capture most RLA-related abnormal events with consistent request-level semantics in the end-to-end datapath of request. First, BufScope models the datapath of request as a buffer chain and defines events based on three properties of buffers, so as to end-to-end monitor the root causes of RLA. Then, to achieve consistent semantics for captured events, BufScope designs a request-level semantics injection mechanism to make events captured in networks have the victim requests’ ID. Finally, BufScope offloads the semantics operations and event collection in software to SmartNICs for low CPU overhead. We have implemented BufScope on commodity SmartNICs and programmable switches. Evaluation results show that BufScope can diagnose 98% RLAs with < 0.08% network bandwidth overhead and 0.6% application throughput decline.
Published in: IEEE/ACM Transactions on Networking ( Volume: 31, Issue: 4, August 2023)
Page(s): 1732 - 1747
Date of Publication: 12 January 2023

ISSN Information:

Funding Agency:


References

References is not available for this document.