Sangameshwar Patil
ABSTRACT
Dependency among various machines, applications or different components of an application is an important issue for planning, operating and managing performance of data-centers and IT-infrastructure of an enterprise. Though this information is very critical, real-life experience with many data center administrators and users shows that it is often not available and it is gathered manually when the need arises. In this paper we present a method and tool for tracking the inter-dependence among IT infrastructure components in a data center using a combination of non intrusive and intrusive agent-based monitoring approach. If legal or operational constraints prevent use of the intrusive agent module, the tool still offers a lot of utility with its non-intrusive monitoring module and has zero impact on production environment. A useful feature of the tool is its ability to quantify the strength of dependency as per user-defined criteria. For web and database servers, the tool can carry out workload profiling on per-client, per-database, per-table basis without adding any overload on the servers. This significantly increases utility of the tool for additional business objectives like capacity planning and performance management. Efficacy of the solution has been proved in real-life case study carried out with large retail chain customer.
- Manoj K. Agarwal, Manish Gupta, Anindya Neogi, and Gautam Kar. 2003. Discovering dynamic dependencies in enterprise environments for problem determination. In Marcus Brunner and Alexander Keller, editors, DSOM, volume 2867 of Lecture Notes in Computer Science, pages 221--233. Springer, (2003).Google Scholar
- Marcos K. Aguilera, Jeffrey C. Mogul, Janet L. Wiener, Patrick Reynolds, and Athicha Muthitacharoen. 2003. Performance debugging for distributed systems of black boxes. In proceedings of 19th ACM Symposium on Operating System Principles (SOSP 2003). Google ScholarDigital Library
- S. Bagchi, J. L. Hellerstein, and G. Kar. 2001. Dependency analysis in distributed systems using fault injection: Application to problem determination in an e-commerce environment. In 12th Intl. Workshop on Distributed Systems: Operations & Management (2001).Google Scholar
- A. Brown, G. Kar, and A. Keller. 2001. An active approach to characterizing dynamic dependencies for problem determination in a distributed environment. In proceedings of IEEE/IFIP International Symposium on Integrated Network Management (2001)Google Scholar
- M. Steinle, K. Aberer, S. Girdzijauskas, and C. Lovis. 2006. Mapping moving landscapes by mining mountains of logs: Novel techniques for dependency model generation, In proceedings of VLDB (2006) Google ScholarDigital Library
- The network packet capture libraries, Libpcap: http://www.tcpdump.org/, Winpcap: http://www.winpcap.org/Google Scholar
- Wireshark packet sniffer, http://www.wireshark.org/docs/wsug_html_chunked/ChapterIntroduction.html#ChIntroWhatIsGoogle Scholar
- TCS innovation lab - Performance Engg. Research Center and TCS Scrutinet tool, http://www.tcs.com/about/tcs_difference/innovation/tcs_labs/Pages/default.aspxGoogle Scholar
- Pastmon, http://sourceforge.net/projects/pastmon/Google Scholar
- netstat utility, http://www.netstat.netGoogle Scholar
- lsof utility, http://www.netadmintools.com/html/lsof.man.htmlGoogle Scholar
- fport utility, http://www.foundstone.com/us/resources/proddesc/fport.htmGoogle Scholar
- Java Pet Store Reference Application, http://java.sun.com/developer/releases/petstore/Google Scholar
- Foglight, Workload Analysis for Oracle http://www.quest.com/Foglight-Performance-Analysis-for-Oracle/Google Scholar
- SQL Server Profiler, http://msdn.microsoft.com/en-us/library/ms187929.aspxGoogle Scholar
- MS SQL Server Resource Governor, http://msdn.microsoft.com/en-us/library/bb933866.aspxGoogle Scholar
Index Terms
- Run-time dependency tracking in data centers
Recommendations
Towards Economical Live Migration in Data Centers
Economics of Grids, Clouds, Systems, and ServicesAbstractLive migration of virtual machines (VMs) enables maintenance, load balancing, and power management in data centers. The cost of live migration on several key metrics combined with strict service-level objectives (SLOs), however, typically limits ...
Multi-objective virtual machine selection for migrating in virtualized data centers
ICPCA/SWS'12: Proceedings of the 2012 international conference on Pervasive Computing and the Networked WorldWith the increasing deployment of large-scale virtualized datacenters, using virtual machine (VM) migration technology to consolidate VMs is becoming very important for improving the efficiency of data center. The primary prerequisite for VM ...
Network System Structure Design for Data Centers in Large Enterprises Using Cloud Computing
In this article, the author discusses the network system structure design for data centers in large enterprises using cloud computing. First, she designs a framework for a cloud data center in large enterprise systems. Second, she establishes the data ...
Comments