ABSTRACT
Alibaba is moving toward one of the most efficient cloud infrastructures for global online shopping. On the 2017 Double 11 Global Shopping Festival, Alibaba's cloud platform achieved total sales of more than 25 billion dollars and supported peak volumes of 325,000 transactions and 256,000 payments per second. Most of the cloud-based e-commerce transactions were processed by hundreds of thousands of Java applications with above a billion lines of code. It is challenging to achieve comprehensive and efficient performance troubleshooting and optimization for large-scale online Java applications in production. We proposed new approaches to method profiling and code warmup for Java performance tuning. Our fine-grained, low-overhead method profiler improves the efficiency of Java performance troubleshooting. Moreover, our approach to ahead-of-time code warmup significantly reduces the runtime overheads of just-in-time compiler to address the bursty traffic. Our approaches have been implemented in Alibaba JDK (AJDK), a customized version of OpenJDK, and have been rolled out to Alibaba's cloud platform to support online critical business.
- Edd Barrett, Carl Friedrich Bolz-Tereick, Rebecca Killick, Sarah Mount, and Laurence Tratt. 2017. Virtual machine warmup blows hot and cold. Proceedings of the ACM on Programming Languages 1 (OOPSLA) (2017), 52:1--52:27. Google ScholarDigital Library
- Peter Hofer, David Gnedt, and Hanspeter Mössenböck. 2015. Lightweight Java Profiling with Partial Safepoints and Incremental Stack Tracing. In Proceedings of ICPE. 75--86. Google ScholarDigital Library
- Todd Mytkowicz, Amer Diwan, Matthias Hauswirth, and Peter F. Sweeney. 2010. Evaluating the accuracy of Java profilers. In Proceedings of PLDI. 187--197. Google ScholarDigital Library
- Oracle. 2006. OpenJDK. (2006). http://openjdk.java.netGoogle Scholar
- Oracle. 2011. HPROF: A Heap/CPU Profiling Tool. (2011). https://docs.oracle.com/javase/7/docs/technotes/samples/hprof.htmlGoogle Scholar
- Oracle. 2014. Java VisualVM. (2014). https://docs.oracle.com/javase/8/docs/technotes/guides/visualvm/profiler.htmlGoogle Scholar
- Azul Systems. 2014. Solving the Java warm-up issue in low-latency systems. (2014). https://www.azul.com/products/zing/readynow-technology-for-zing/Google Scholar
- Richard Warburton. 2011. Honest Profiler. (2011). https://github.com/jvm-profiling-tools/honest-profilerGoogle Scholar
Index Terms
- Java performance troubleshooting and optimization at alibaba
Recommendations
Cloud-Scale Java Profiling at Alibaba
ICPE '18: Companion of the 2018 ACM/SPEC International Conference on Performance EngineeringOn the 2017 Double 11 Global Shopping Festival, Alibaba's cloud platform achieved total sales of more than 25 billion dollars and supported peak volumes of 325,000 transactions and 256,000 payments per second. Most of the cloud-based e-commerce ...
Comments