Cited By
View all- Rodriguez AMateos CZunino A(2019)Improving scientific application execution on android mobile devices via code refactoringsSoftware—Practice & Experience10.1002/spe.241947:5(763-796)Online publication date: 4-Jan-2019
VM performance evaluation with functional models: an optimist's outlook
Article No.: 6, Pages 1 - 2
Abstract
The performance evaluation of virtual machines is notoriously difficult. Therefore, experimental methodology has recently drawn attention, leading to proposals on how to choose benchmarks, interpret results, and detect measurement bias. But this latter task currently relies on the presence of anomalous measurement results, i.e., on outliers, to raise suspicion. We therefore propose the use of functional performance models to detect bias even when benchmark results might appear unsuspicious. Failure to validate the model indicates either bias or a need to refine the model.
References
[1]
S. M. Blackburn, R. Garner, C. Hoffmann, A. M. Khang, K. S. McKinley, R. Bentzur, A. Diwan, D. Feinberg, D. Frampton, S. Z. Guyer, M. Hirzel, A. Hosking, M. Jump, H. Lee, J. E. B. Moss, B. Moss, A. Phansalkar, D. Stefanović, T. VanDrunen, D. von Dincklage, and B. Wiedermann. The DaCapo benchmarks: Java benchmarking development and analysis. In Proceedings of the 21st OOPSLA Conference, pages 169--190, 2006.
[2]
S. M. Blackburn, K. S. McKinley, R. Garner, C. Hoffmann, A. M. Khan, R. Bentzur, A. Diwan, D. Feinberg, D. Frampton, S. Z. Guyer, M. Hirzel, A. Hosking, M. Jump, H. Lee, J. E. B. Moss, A. Phansalkar, D. Stefanovik, T. VanDrunen, D. von Dincklage, and B. Wiedermann. Wake up and smell the coffee: evaluation methodology for the 21st century. Communications of the ACM, 51(8):83--89, 2008.
[3]
L. Eeckhout, A. Georges, and K. De Bosschere. How Java programs interact with virtual machines at the microarchitectural level. In Proceedings of the 18th OOPSLA Conference, pages 169--186, 2003.
[4]
A. Georges. Three Pitfalls in Java Performance Evaluation. PhD thesis, Universiteit Gent, 2008.
[5]
A. Georges, D. Buytaert, and L. Eeckhout. Statistically rigorous Java performance evaluation. In Proceedings of the 22nd OOPSLA Conference, pages 57--76, 2007.
[6]
D. Gu, C. Verbrugge, and E. M. Gagnon. Relative factors in performance analysis of Java virtual machines. In Proceedings of the 2nd VEE Conference, pages 111--121, 2006.
[7]
P. Kulkarni, M. Arnold, and M. Hind. Dynamic compilation: the benefits of early investing. In Proceedings of the 3rd VEE Conference, pages 94--104, 2007.
[8]
T. Mytkowicz, A. Diwan, M. Hauswirth, and P. F. Sweeney. Producing wrong data without doing anything obviously wrong! In Proceedings of the 14th ASPLOS Conference, pages 265--276, 2009.
Index Terms
- VM performance evaluation with functional models: an optimist's outlook
Recommendations
Performance Evaluation of VM Placement Using Classical Bin Packing and Genetic Algorithm for Cloud Environment
In current era, the trend of cloud computing is increasing with every passing day due to one of its dominant service i.e. Infrastructure as a service IAAS, which virtualizes the hardware by creating multiple instances of VMs on single physical machine. ...
Pre-Copy and post-copy VM live migration for memory intensive applications
Euro-Par'12: Proceedings of the 18th international conference on Parallel processing workshopsVirtualization technology provides a means for server consolidation, reducing the number of physical servers required for running a given workload. Virtual Machine (VM) live migration facilitates the transfer of a running (VM) between physical hosts ...
Virtual Device Passthrough for High Speed VM Networking
ANCS '15: Proceedings of the Eleventh ACM/IEEE Symposium on Architectures for networking and communications systemsSupporting network I/O at high packet rates in virtual machines is fundamental for the deployment of Cloud data centers and Network Function Virtualization. Historically, SR-IOV and hardware passthrough were thought as the only viable solution to reduce ...
Comments
Information & Contributors
Information
Published In
October 2009
47 pages
ISBN:9781605588742
DOI:10.1145/1711506
- Conference Chairs:
- Hridesh Rajan,
- Christoph Bockisch,
- Michael Haupt,
- Robert Dyer
Copyright © 2009 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 25 October 2009
Check for updates
Author Tags
Qualifiers
- Research-article
Conference
OOPSLA09
Sponsor:
OOPSLA09: ACM SIGPLAN Object Oriented Programming Systems and Applications Conference
October 25 - 29, 2009
Florida, Orlando
Acceptance Rates
Overall Acceptance Rate 4 of 4 submissions, 100%
Upcoming Conference
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 129Total Downloads
- Downloads (Last 12 months)1
- Downloads (Last 6 weeks)0
Reflects downloads up to 27 Feb 2025
Other Metrics
Citations
Cited By
View all- Rodriguez AMateos CZunino A(2019)Improving scientific application execution on android mobile devices via code refactoringsSoftware—Practice & Experience10.1002/spe.241947:5(763-796)Online publication date: 4-Jan-2019
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in