skip to main content
10.1145/2611354.2611369acmconferencesArticle/Chapter ViewAbstractPublication PagessystorConference Proceedingsconference-collections
tutorial

Towards a Flexible, Lightweight Virtualization Alternative

Published:30 June 2014Publication History

ABSTRACT

In recent times, two virtualization approaches have become dominant: hardware-level and operating system-level virtualization. They differ by where they draw the virtualization boundary between the virtualizing and the virtualized part of the system, resulting in vastly different properties. We argue that these two approaches are extremes in a continuum, and that boundaries in between the extremes may combine several good properties of both. We propose abstractions to make up one such new virtualization boundary, which combines hardware-level flexibility with OS-level resource sharing. We implement and evaluate a first prototype.

References

  1. GNU Hurd -- subhurds. http://www.gnu.org/software/hurd/hurd/subhurd.html.Google ScholarGoogle Scholar
  2. R. Appuswamy, D. C. van Moolenbroek, and A. S. Tanenbaum. Loris - A Dependable, Modular File-Based Storage Stack. In Dependable Computing (PRDC), 2010 IEEE 16th Pacific Rim International Symposium on, pages 165--174. IEEE, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. R. Appuswamy, D. C. van Moolenbroek, and A. S. Tanenbaum. Flexible, modular file volume virtualization in Loris. In Mass Storage Systems and Technologies (MSST), 2011 IEEE 27th Symposium on, pages 1--14. IEEE, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. P. Barham, B. Dragovic, K. Fraser, S. Hand, T. Harris, A. Ho, R. Neugebauer, I. Pratt, and A. Warfield. Xen and the Art of Virtualization. In Proceedings of the Nineteenth ACM Symposium on Operating Systems Principles, SOSP '03, pages 164--177, 2003. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. O. Buddenhagen. Advanced Lightweight Virtualization. http://tri-ceps.blogspot.com/2007/10/advanced-lightweight-virtualization.html, 2007.Google ScholarGoogle Scholar
  6. E. Bugnion, S. Devine, K. Govil, and M. Rosenblum. Disco: Running Commodity Operating Systems on Scalable Multiprocessors. ACM Trans. Comput. Syst., 15(4):412--447, Nov. 1997. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. C.-R. Chang, J.-J. Wu, and P. Liu. An empirical study on memory sharing of virtual machines for server consolidation. In Parallel and Distributed Processing with Applications (ISPA), 2011 IEEE 9th International Symposium on, pages 244--249. IEEE, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. P. M. Chen and B. D. Noble. When virtual is better than real. In Proceedings of the Eighth Workshop on Hot Topics in Operating Systems, HotOS '01, pages 133--, 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. C. Clark, K. Fraser, S. Hand, J. G. Hansen, E. Jul, C. Limpach, I. Pratt, and A. Warfield. Live Migration of Virtual Machines. In Proceedings of the 2Nd Conference on Symposium on Networked Systems Design & Implementation - Volume 2, NSDI'05, pages 273--286, 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. T. E. Denehy, A. C. Arpaci-Dusseau, and R. H. Arpaci-Dusseau. Bridging the Information Gap in Storage Protocol Stacks. In The Proc. of the USENIX Ann. Tech. Conf. (USENIX '02), pages 177--190, June 2002. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. H. Eiraku, Y. Shinjo, C. Pu, Y. Koh, and K. Kato. Fast networking with socket-outsourcing in hosted virtual machine environments. In Proceedings of the 2009 ACM symposium on Applied Computing, pages 310--317. ACM, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. M. Factor, K. Meth, D. Naor, O. Rodeh, and J. Satran. Object storage: The future building block for storage systems. In Proceedings of the 2005 IEEE International Symposium on Mass Storage Systems and Technology, LGDI '05, pages 119--123, 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. B. Ford, M. Hibler, J. Lepreau, P. Tullmann, G. Back, and S. Clawson. Microkernels meet recursive virtual machines. In Proc. of the second USENIX symposium on Operating systems design and implementation, OSDI'96, pages 137--151, 1996. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. T. Garfinkel and M. Rosenblum. A Virtual Machine Introspection Based Architecture for Intrusion Detection. In Proc. Network and Distributed Systems Security Symposium, pages 191--206, 2003.Google ScholarGoogle Scholar
  15. A. Gefflaut, T. Jaeger, Y. Park, J. Liedtke, K. J. Elphinstone, V. Uhlig, J. E. Tidswell, L. Deller, and L. Reuther. The SawMill multiserver approach. In Proceedings of the 9th workshop on ACM SIGOPS European workshop, pages 109--114. ACM, 2000. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. G. A. Gibson, D. F. Nagle, K. Amiri, J. Butler, F. W. Chang, H. Gobioff, C. Hardin, E. Riedel, D. Rochberg, and J. Zelenka. A cost-effective, high-bandwidth storage architecture. In Proceedings of the Eighth International Conference on Architectural Support for Programming Languages and Operating Systems, ASPLOS VIII, pages 92--103, 1998. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. R. P. Goldberg. Survey of Virtual Machine Research. IEEE Computer, 7(6):34--45, 1974. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. R. P. Goldberg and R. Hassinger. The double paging anomaly. In Proceedings of the May 6-10, 1974, national computer conference and exposition, pages 195--199. ACM, 1974. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. J. Gosling. The Java language specification. Addison-Wesley Professional, 2000. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. D. Gupta, L. Cherkasova, R. Gardner, and A. Vahdat. Enforcing Performance Isolation Across Virtual Machines in Xen. In Proceedings of the ACM/IFIP/USENIX 2006 International Conference on Middleware, Middleware '06, pages 342--362, 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. H. Härtig. Security Architectures Revisited. In Proceedings of the 10th Workshop on ACM SIGOPS European Workshop, EW 10, pages 16--23, 2002. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. H. Härtig, M. Hohmuth, J. Liedtke, J. Wolter, and S. Schönberg. The performance of μ-kernel-based systems. In Proceedings of the Sixteenth ACM Symposium on Operating Systems Principles, SOSP '97, pages 66--77, 1997. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. G. Heiser and B. Leslie. The OKL4 Microvisor: Convergence Point of Microkernels and Hypervisors. In Proceedings of the First ACM Asia-pacific Workshop on Workshop on Systems, APSys '10, pages 19--24, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. T. Hruby, D. Vogt, H. Bos, and A. S. Tanenbaum. Keep net working-on a dependable and fast networking stack. In Dependable Systems and Networks (DSN), 2012 42nd Annual IEEE/IFIP International Conference on, pages 1--12. IEEE, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. W. Jannen, C.-C. Tsai, and D. E. Porter. Virtualize storage, not disks. In Proceedings of the 14th USENIX Conference on Hot Topics in Operating Systems, HotOS'13, pages 3--3, 2013. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. S. T. Jones, A. C. Arpaci-Dusseau, and R. H. Arpaci-Dusseau. Geiger: Monitoring the Buffer Cache in a Virtual Machine Environment. In Proceedings of the 12th International Conference on Architectural Support for Programming Languages and Operating Systems, ASPLOS XII, pages 14--24, 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. W. K. Josephson, L. A. Bongo, D. Flynn, and K. Li. DFS: A File System for Virtualized Flash Storage. In FAST'10: Proc. of the Eighth USENIX Conf. on File and Storage Technologies. USENIX Association, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. P.-H. Kamp and R. N. Watson. Jails: Confining the omnipotent root. In Proceedings of the 2nd International SANE Conference, volume 43, page 116, 2000.Google ScholarGoogle Scholar
  29. D. Kim, H. Kim, M. Jeon, E. Seo, and J. Lee. Guest-aware priority-based virtual machine scheduling for highly consolidated server. In Proceedings of the 14th International Euro-Par Conference on Parallel Processing, Euro-Par '08, pages 285--294, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. H. Kim, H. Jo, and J. Lee. XHive: Efficient Cooperative Caching for Virtual Machines. IEEE Trans. Comput., 60(1):106--119, Jan. 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. J. F. Kloster, J. Kristensen, and A. Mejlholm. Determining the use of interdomain shareable pages using kernel introspection. Technical report, Aalborg University, 2007.Google ScholarGoogle Scholar
  32. K. Klues, B. Rhoden, Y. Zhu, A. Waterman, and E. Brewer. Processes and resource management in a scalable many-core OS. HotPar '10, 2010.Google ScholarGoogle Scholar
  33. A. Krioukov, L. N. Bairavasundaram, G. R. Goodson, K. Srinivasan, R. Thelen, A. C. Arpaci-Dusseau, and R. H. Arpaci-Dussea. Parity lost and parity regained. In Proc. of the Sixth USENIX conf. on File and storage technologies, FAST'08, pages 1--15, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. A. Lackorzyński, A. Warg, M. Völp, and H. Härtig. Flattening hierarchical scheduling. In Proceedings of the Tenth ACM International Conference on Embedded Software, EMSOFT '12, pages 93--102, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. J. R. Lange and P. Dinda. SymCall: Symbiotic Virtualization Through VMM-to-guest Upcalls. In Proceedings of the 7th ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments, VEE '11, pages 193--204, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. I. M. Leslie, D. McAuley, R. Black, T. Roscoe, P. Barham, D. Evers, R. Fairbairns, and E. Hyden. The design and implementation of an operating system to support distributed multimedia applications. Selected Areas in Communications, IEEE Journal on, 14(7):1280--1297, 1996. Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. P. Lu and K. Shen. Virtual machine memory access tracing with hypervisor exclusive cache. In Usenix Annual Technical Conference, pages 29--43, 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. D. Magenheimer, C. Mason, D. McCracken, and K. Hackel. Paravirtualized paging. In Proceedings of the First Conference on I/O Virtualization, WIOV'08, pages 6--6, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. K. Miller, F. Franz, M. Rittinghaus, M. Hillenbrand, and F. Bellosa. XLH: More Effective Memory Deduplication Scanners Through Cross-layer Hints. In Proceedings of the 2013 USENIX Conference on Annual Technical Conference, USENIX ATC'13, pages 279--290, 2013. Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. G. Miłós, D. G. Murray, S. Hand, and M. A. Fetterman. Satori: enlightened page sharing. In Proceedings of the 2009 conference on USENIX ATC USENIX Association, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. R. Nikolaev and G. Back. Virtuos: An operating system with kernel virtualization. In Proceedings of the Twenty-Fourth ACM Symposium on Operating Systems Principles, SOSP '13, pages 116--132, 2013. Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. S. Osman, D. Subhraveti, G. Su, and J. Nieh. The design and implementation of Zap: A system for migrating computing environments. In In Proceedings of the Fifth Symposium on Operating Systems Design and Implementation, pages 361--376, 2002. Google ScholarGoogle ScholarDigital LibraryDigital Library
  43. B. Pfaff, T. Garfinkel, and M. Rosenblum. Virtualization Aware File Systems: Getting Beyond the Limitations of Virtual Disks. In Proceedings of the 3rd Conference on Networked Systems Design & Implementation - Volume 3, NSDI'06, pages 26--26, 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library
  44. D. Price and A. Tucker. Solaris zones: Operating system support for consolidating commercial workloads. In LISA, pages 241--254, 2004. Google ScholarGoogle ScholarDigital LibraryDigital Library
  45. H. Raj and K. Schwan. O2S2: Enhanced Object-based Virtualized Storage. SIGOPS Oper. Syst. Rev., 42(6):24--29, Oct. 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  46. T. Roscoe, K. Elphinstone, and G. Heiser. Hype and virtue. In Proceedings of the 11th USENIX workshop on Hot topics in operating systems, page 4. USENIX Association, 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  47. L. Soares and M. Stumm. FlexSC: Flexible system call scheduling with exception-less system calls. In Proceedings of the 9th USENIX conference on Operating systems design and implementation, pages 1--8. USENIX Association, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  48. S. Soltesz, H. Pötzl, M. E. Fiuczynski, A. Bavier, and L. Peterson. Container-based Operating System Virtualization: A Scalable, High-performance Alternative to Hypervisors. In Proc. of the Second ACM SIGOPS/EuroSys European Conf. on Computer Systems, EuroSys'07, pages 275--287, 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  49. H. Tadokoro, K. Kourai, and S. Chiba. A secure system-wide process scheduler across virtual machines. In Dependable Computing (PRDC), 2010 IEEE 16th Pacific Rim International Symposium on, pages 27--36. IEEE, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  50. A. S. Tanenbaum and A. S. Woodhull. Operating Systems Design and Implementation (Third Edition). Prentice Hall, 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library
  51. V. Tarasov, D. Jain, D. Hildebrand, R. Tewari, G. Kuenning, and E. Zadok. Improving I/O Performance Using Virtual Disk Introspection. In Presented as part of the 5th USENIX Workshop on Hot Topics in Storage and File Systems, 2013. Google ScholarGoogle ScholarDigital LibraryDigital Library
  52. R. van Heuven van Staereling, R. Appuswamy, D. C. van Moolenbroek, and A. S. Tanenbaum. Efficient, Modular Metadata Management with Loris. In Proc. 6th IEEE International Conference on Networking, Architecture and Storage, pages 278--287. IEEE, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  53. D. C. van Moolenbroek, R. Appuswamy, and A. S. Tanenbaum. Integrated End-to-End Dependability in the Loris Storage Stack. In HotDep, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  54. D. C. van Moolenbroek, R. Appuswamy, and A. S. Tanenbaum. Transaction-based Process Crash Recovery of File System Namespace Modules. In Proceedings of the 19th IEEE Pacific Rim International Symposium on Dependable Computing, 2013. Google ScholarGoogle ScholarDigital LibraryDigital Library
  55. C. A. Waldspurger. Memory Resource Management in VMware ESX Server. SIGOPS Oper. Syst. Rev., 36(SI):181--194, Dec. 2002. Google ScholarGoogle ScholarDigital LibraryDigital Library
  56. C. Weinhold and H. Härtig. VPFS: Building a Virtual Private File System with a Small Trusted Computing Base. In Proceedings of the 3rd ACM SIGOPS/EuroSys European Conference on Computer Systems 2008, Eurosys '08, pages 81--93, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  57. D. Wentzlaff and A. Agarwal. Factored operating systems (fos): the case for a scalable operating system for multicores. ACM SIGOPS Operating Systems Review, 43(2):76--85, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  58. A. Whitaker, M. Shaw, and S. D. Gribble. Scale and performance in the Denali isolation kernel. ACM SIGOPS Operating Systems Review, 36(SI):195--209, 2002. Google ScholarGoogle ScholarDigital LibraryDigital Library
  59. M. Williamson. XenFS, 2009.Google ScholarGoogle Scholar
  60. B. Yee, D. Sehr, G. Dardyk, J. B. Chen, R. Muth, T. Ormandy, S. Okasaka, N. Narula, and N. Fullagar. Native client: A sandbox for portable, untrusted x86 native code. In Security and Privacy, 2009 30th IEEE Symposium on, pages 79--93. IEEE, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  61. Y. Yu, F. Guo, S. Nanda, L.-c. Lam, and T.-c. Chiueh. A Feather-weight Virtual Machine for Windows Applications. In Proceedings of the 2nd International Conference on Virtual Execution Environments, VEE '06, pages 24--34, 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Towards a Flexible, Lightweight Virtualization Alternative

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      SYSTOR 2014: Proceedings of International Conference on Systems and Storage
      June 2014
      168 pages
      ISBN:9781450329200
      DOI:10.1145/2611354

      Copyright © 2014 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 30 June 2014

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • tutorial
      • Research
      • Refereed limited

      Acceptance Rates

      Overall Acceptance Rate94of285submissions,33%

      Upcoming Conference

      SYSTOR '24
      The 17th ACM International Systems and Storage Conference
      September 23 - 25, 2024
      Tel-Aviv , Israel

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader