Theodore Johnson
ABSTRACT
Monitoring a Tier-1 ISP's extremely large and diverse network places extreme scaling demands on a Data Stream Management System (DSMS). A typical application involves a large number stream queries executing on high volume streams, replicated at a large number of monitoring points, with the results fed to a stream warehouse supporting a large number of users. I will describe some of these challenges and how a DSMS and other tools have evolved to meet them.
- C. Cranor, T. Johnson, O. Spatscheck, V. Shkapenyuk: Gigascope: A Stream Database for Network Applications. SIGMOD. 2003: 647--651 Google Scholar
Digital Library
- Graham Cormode, Theodore Johnson, Flip Korn, S. Muthukrishnan, Oliver Spatscheck, D. Srivastava: Holistic UDAFs at streaming speeds. SIGMOD 2004: 35--46. Google ScholarDigital Library
- G. Cormode, F. Korn, S. Muthukrishnan, D. Srivastava. Space- and time-efficient deterministic algorithms for biased quantiles over data streams. PODS 2006:51. Google ScholarDigital Library
- L. Golab, T. Johnson, O. Spatscheck: Prefilter: Predicate Pushdown at Streaming Speeds. SSPS 2008. Google ScholarDigital Library
- T. Johnson, S. Muthukrishnan, V. Shkapenyuk, O. Spatscheck: Query-Aware Sampling for Data Streams. SSPS 2007: 664--673 Google ScholarDigital Library
- T. Johnson, S. Muthukrishnan, V. Shkapenyuk, O. Spatscheck: Query-Aware Partitioning for Monitoring Massive Network Data Streams. SIGMOD 2008 Google ScholarDigital Library
- J. Li, K. Tufte, V. Shkapenyuk, V. Papadimos, T. Johnson, D. Maier. Out-of-Order Processing: A New Architecture for High-Performance Stream Systems. SIGMOD 2008.Google ScholarDigital Library
- Y. Bai, H. Thakkat, H. Wang, C. Luo, C. Zaniolo. A data stream language and system designed for power and extensibility. CIKM 2006:337--346 Google ScholarDigital Library
Index Terms
- Scaling issues in network monitoring
Recommendations
Research of Network Monitoring Based on SNMP
IMCCC '13: Proceedings of the 2013 Third International Conference on Instrumentation, Measurement, Computer, Communication and ControlNetwork monitoring system is a collection about consisting of a set of tools for network monitoring and control, a combination of organic is used to manage networks and ensure the normal operation of the network software and hardware. It is not only to ...
Efficient Process of Top-k Range-Sum Queries over Multiple Streams with Minimized Global Error
Due to the resource limitation in the data stream environments, it has been reported that answering user queries according to the wavelet synopsis of a stream is an essential ability of a Data Stream Management System (DSMS). In the literature, recent ...
Algorithms and metrics for processing multiple heterogeneous continuous queries
The emergence of monitoring applications has precipitated the need for Data Stream Management Systems (DSMSs), which constantly monitor incoming data feeds (through registered continuous queries), in order to detect events of interest. In this article, ...
Comments