skip to main content
10.1145/3155889.3155893acmotherconferencesArticle/Chapter ViewAbstractPublication PagesmiddlewareConference Proceedingsconference-collections
research-article

Netstore: leveraging network optimizations to improve distributed transaction processing performance

Published: 11 December 2017 Publication History

Abstract

A tremendous amount of data is processed daily in the cloud, which inevitably introduces large amounts of data transfer within a datacenter network. Numerous studies have reported that the network is often the performance bottleneck for cloud applications. While flow scheduling techniques have been proposed to mitigate this performance problem, distributed network-aware applications have not received much attention. The advent of software-defined networking (SDN) enables leveraging flow scheduling to make cloud applications network-aware, opening up the potential to improve the performance of these applications.
In this paper, we propose co-designing network and cloud applications to optimize performance in the presence of data-center network congestion. In particular, we built a network-aware distributed database framework which uses network state information to improve performance. We present two techniques to reduce transaction completion time for cloud database applications. First, we apply a novel load balancing algorithm at the network layer to support intelligent network route selection. Second, we introduce a network-aware caching algorithm to retrieve fresh data replicas from links in the network with low congestion. Our experimental results show that our techniques can significantly reduce average transaction completion times compared to an ECMP-based baseline.

References

[1]
2017. DSCP. https://en.wikipedia.org/wiki/Differentiated_services. (2017).
[2]
2017. Floodlight OpenFlow Controller. http://www.projectfloodlight.org/floodlight/. (2017).
[3]
Mohammad Al-Fares et al. 2010. Hedera: dynamic flow scheduling for data center networks. In NSDI'10. Boston, USA.
[4]
Mohammad Al-Fares, Alexander Loukissas, and Amin Vahdat. 2008. A Scalable, Commodity Data Center Network Architecture. In Proceedings of the ACM SIGCOMM 2008 Conference on Data Communication (SIGCOMM '08). ACM, New York, NY, USA, 63--74.
[5]
Mohammad Alizadeh et al. 2010. Data center TCP (DCTCP). In SIGCOMM '10. New Delhi, India.
[6]
Hitesh Ballani, Paolo Costa, Thomas Karagiannis, and Ant Rowstron. 2011. Towards predictable datacenter networks. In SIGCOMM '11. Toronto, ON, Canada.
[7]
Theophilus Benson, Aditya Akella, and David A. Maltz. 2010. Network traffic characteristics of data centers in the wild. In IMC '10. New York, NY, USA.
[8]
Peter Bodík, Ishai Menache, Mosharaf Chowdhury, Pradeepkumar Mani, David A. Maltz, and Ion Stoica. 2012. Surviving failures in bandwidth-constrained datacenters. In SIGCOMM '12. Helsinki, Finland.
[9]
Y. Breitbart, D. Georgakopoulos, M. Rusinkiewicz, and A. Silberschatz. 1991. On rigorous transaction scheduling. IEEE Transactions on Software Engineering 17, 9 (Sep 1991), 954--960.
[10]
Mosharaf Chowdhury and Ion Stoica. 2015. Efficient coflow scheduling without prior knowledge. In SIGCOMM '15. London, UK.
[11]
Mosharaf Chowdhury, Yuan Zhong, and Ion Stoica. 2014. Efficient coflow scheduling with Varys. In SIGCOMM '14. Chicago, USA.
[12]
Brian F. Cooper, Adam Silberstein, Erwin Tam, Raghu Ramakrishnan, and Russell Sears. 2010. Benchmarking Cloud Serving Systems with YCSB. In ACM Symposium on Cloud Computing. Indianapolis, Indiana, USA.
[13]
Carlo Curino, Evan Jones, Yang Zhang, and Sam Madden. 2010. Schism: A Workload-driven Approach to Database Replication and Partitioning. Proc. VLDB Endow. 3, 1--2 (Sept. 2010).
[14]
Fahad R. Dogar, Thomas Karagiannis, Hitesh Ballani, and Antony Rowstron. 2014. Decentralized task-aware scheduling for data center networks. In SIGCOMM '14. Chicago, USA.
[15]
Namit Jain et al. 2010. Data warehousing and analytics infrastructure at Facebook in Proceedings. In SIGMOD '10. Indianapolis, IN, USA.
[16]
Bob Lantz, Brandon Heller, and Nick McKeown. 2010. A network in a laptop: rapid prototyping for software-defined networks. In Hotnets-IX. Monterey, USA.
[17]
M. Alizadeh et al. 2013. pFabric: Minimal Near-Optimal Datacenter Transport. In SIGCOMM '13. Hong Kong, China.
[18]
Nick McKeown et al. 2008. OpenFlow: Enabling Innovation in Campus Networks. ACM SIGCOMM CCR 38 (2008).
[19]
Sajjad Rizvi, Xi Li, Bernard Wong, Fiodar Kazhamiaka, and Benjamin Cassell. 2016. Mayflower: Improving Distributed Filesystem Performance Through SDN/Filesystem Co-Design. In ICDCS '16. Nara, Japan.
[20]
Lukas Rupprecht, William Culhane, and Peter R. Pietzuch. 2017. SquirrelJoin: Network-Aware Distributed Join Processing with Lazy Partitioning. PVLDB 10, 11 (2017), 1250--1261.
[21]
Eric Schurmanand and Jake Brutlag. 2009. The user and business impact of server delays, additional bytes, and http chunking in web search. Velocity Conference Talk. (2009).
[22]
Akshay K. Signh, Xu Cui, Benjamin Cassel, Bernard Wong, and Khuzaima Daudjee. 2014. MicroFuge: A Middleware Approach to Providing Performance Isolation in Cloud Storage Systems. In ICDCS '14. Madrid, Spain.
[23]
Ricardo Vilaça, Rui Oliveira, and José Pereira. 2011. A Correlation-Aware Data Placement Strategy for Key-Value Stores. In Distributed Applications and Interoperable Systems, Pascal Felber and Romain Rouvoy (Eds.). Vol. 6723. Springer Berlin Heidelberg.
[24]
Christo Wilson, Hitesh Ballani, Thomas Karagiannis, and Ant Rowtron. 2011. Better never than late: meeting deadlines in datacenter networks. In SIGCOMM '11. Toronto, Canada.
[25]
Pengcheng Xiong, Hakan Hacigumus, and Jeffrey F. Naughton. 2014. A software-defined networking based approach for performance management of analytical queries on distributed data stores. In SIGMOD '14. Snowbird, USA.

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
ACTIVE '17: Proceedings of the Second International Workshop on Active Middleware on Modern Hardware
December 2017
20 pages
ISBN:9781450351676
DOI:10.1145/3155889
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 December 2017

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. distributed transaction processing
  2. network-aware database
  3. software-defined networking

Qualifiers

  • Research-article

Conference

Middleware '17
Middleware '17: 18th International Middleware Conference
December 11 - 15, 2017
Nevada, Las Vegas

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)3
  • Downloads (Last 6 weeks)0
Reflects downloads up to 16 Feb 2025

Other Metrics

Citations

Cited By

View all

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media