skip to main content
research-article

Leveraging Deep Learning to Improve Performance Predictability in Cloud Microservices with Seer

Published:25 July 2019Publication History
Skip Abstract Section

Abstract

Performance unpredictability is a major roadblock towards cloud adoption, and has performance, cost, and revenue ramifications. Predictable performance is even more critical as cloud services transition from monolithic designs to microservices. Detecting UOS violations after they occur in systems with microservices results in long recovery times, as hotspots propagate and amplify across dependent services.

References

  1. Decomposing twitter: Adventures in service-oriented architecture. http://tiny.cc/rg0k6yGoogle ScholarGoogle Scholar
  2. Golang microservices example. https://github.com/harlow/go-micro-services.Google ScholarGoogle Scholar
  3. Sockshop: A microservices demo application. http://tiny.cc/5c0k6y.Google ScholarGoogle Scholar
  4. Zipkin. http://zipkin.io.Google ScholarGoogle Scholar
  5. The evolition of microservices. http://tiny.cc/ka0k6y, 2016Google ScholarGoogle Scholar
  6. Luiz Barroso and Urs Hoelzle. The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines. 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Robert Bell, Yehuda Koren, and Chris Volinsky. The bellkor 2008 solution to the netflix prize. Technical report, 2007.Google ScholarGoogle Scholar
  8. Adrian Caulfield, Eric Chung, and et al. A cloud-sclae acceleration architecture. In MICRO, 2016. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Tianshi Chen, Zidong Du, and et al. DianNao: a small-footprint high-throughput accelerator for ubiquitous machine-learning. In Proc. of ASPLOS, 2014. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Michael Chow, David Meisner, Jason Flinn, Daniel Peek, and Thomas F. Wenisch. The mystery machine: End-toend performance analysis of large-scale internet services. In Proceedings of OSDI, 2014. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Eric S. Chung, Jeremy Fowers, and et al. Serving dnns in real time at datacenter scale with project brainwave. IEEE Micro, 38(2)m 2018.Google ScholarGoogle Scholar
  12. Jeffrey Dean and Luiz Andre Barroso. The tail at scale. In CACM, Vol. 56 No. 2. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Christina Delimitrou and Christos Kozyrakis. iBench: Quantifying Interference for Datacenter Workloads. In IISWC. 2013.Google ScholarGoogle Scholar
  14. Christina Delimitrou and Christos Kozyrakis. Paragon: Qos-Aware Scheduling for Heterogeneous Datacenters. In Proc of ASPLOS 2013. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Christina Delimitrou and Christos Kozyrakis. Quasar: Resource-efficient and Qos-Aware Cluster Management. In ASPLOS. 2014. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Christina Delimitrou and Christos Kozyrakis. HCloud: Resource-Efficient Provisioning in Shared Cloud Systems. In Proceedings of ASPLOS, April 2016. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Christina Delimitrou, Daniel Sanchez, and Christos Kozyrakis. Tarcil: Reconciling Scheduling Speed and Quality in Large shared Clusters. In Proceedings of SOCC, August 2015. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Rodrigo Fonseca, George Porter, Rnady H. Katz, Scott Shenker and Ion Stoica. X-trace: A pervasive network tracing framework. In Proceedings of NSDI, 2017. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Yu Gan and Christina Delimitrou. The Architectural Implications of Cloud Microservices. In CAL, vol. 27 iss. 2, Jul-Dec 2018.Google ScholarGoogle ScholarCross RefCross Ref
  20. Yu Gan, Meghna Pancholi, Dailun Cheng, Siyuan Hu, Yuan He, an Christina Delimtrou. Seer: leveraging Big Data to Navigate the Complexity of Cloud Debugging. In Proc. of HotCloud, 2018. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Yu Gan, Yanqi Zhang, and et al. An Open-Source Benchmark Suite for Microservice and Their Hardware-software Implications for Cloud and Edge Systems. In Proceedings of ASPLOS, April 2019. Google ScholarGoogle ScholarDigital LibraryDigital Library

Recommendations

Comments

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Sign in

Full Access

PDF Format

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader