research-article

New wine in old skins: the case for distributed operating systems in the data center

Authors:

Malte Schwarzkopf,

Matthew P. Grosvenor,

Steven HandAuthors Info & Claims

APSys '13: Proceedings of the 4th Asia-Pacific Workshop on Systems

Article No.: 9, Pages 1 - 7

https://doi.org/10.1145/2500727.2500739

Published: 29 July 2013 Publication History

Abstract

Since their heyday the 1980s, distributed operating systems---spanning multiple autonomous machines, yet appearing to the user as a single machine---have seen only moderate academic interest. This is a little surprising, since modern data centers might present an appealing environment for their deployment. In this position paper, we discuss what has changed since the community lost interest in them, and why, nonetheless, distributed OSes have yet to be considered for data centers. Finally, we argue that the distributed OS concept is worth a revisit, and outline the benefits to be had from it in the context of the modern data center.

References

[1]

Accetta, M., Baron, R., Bolosky, W., Golub, D., Rashid, R., Tevanian, A., and Young, M. Mach: A new kernel foundation for UNIX development. In Proceedings of Summer USENIX Conference (1986).

[2]

Alizadeh, M., Greenberg, A., Maltz, D. A., Padhye, J., Patel, P., Prabhakar, B., Sengupta, S., and Sridharan, M. Data Center TCP (DCTCP). Computer Communication Review 40, 4 (2010), 63--74.

Digital Library

[3]

Ananthanarayanan, G., Ghodsi, A., Shenker, S., and Stoica, I. Disk-Locality in Datacenter Computing Considered Irrelevant. In Proceedings of HotOS (2011).

Digital Library

[4]

Baron, M. The Single-Chip Cloud Computer. Microprocessor Report 24, 4 (2010).

[5]

Barroso, L. A. Warehouse-scale computing: Entering the teenage decade. SIGARCH Computer Architecture News 39, 3 (June 2011).

Digital Library

[6]

Baumann, A., Barham, P., Dagand, P.-E., Harris, T., Isaacs, R., Peter, S., Roscoe, T., Schüpbach, A., and Singhania, A. The multikernel: a new OS architecture for scalable multi-core systems. In Proceedings of SOSP (2009).

Digital Library

[7]

Baumann, A., Lee, D., Fonseca, P., Glendenning, L., Lorch, J. R., Bond, B., Olinsky, R., and Hunt, G. C. Composing OS extensions safely and efficiently with Bascule. In Proceedings of EuroSys (2013).

Digital Library

[8]

Baumann, A., Peter, S., Schüpbach, A., Singhania, A., Roscoe, T., Barham, P., and Isaacs, R. Your computer is already a distributed system. Why isn't your OS? In Proceedings of HotOS (2009).

Digital Library

[9]

Bligh, M., Desnoyers, M., and Schultz, R. Linux Kernel Debugging on Google-sized Clusters. In Proceedings of the Ottawa Linux Symposium (2007).

[10]

Boyd-Wickizer, S., Chen, H., Chen, R., Mao, Y., Kaashoek, M. F., Morris, R., Pesterev, A., Stein, L., Wu, M., Dai, Y.-h., et al. Corey: An operating system for many cores. In Proceedings of OSDI (2008).

Digital Library

[11]

Chang, F., Dean, J., Ghemawat, S., Hsieh, W. C., Wallach, D. A., Burrows, M., Chandra, T., Fikes, A., and Gruber, R. E. Bigtable: A Distributed Storage System for Structured Data. In Proceedings of OSDI (2006).

Digital Library

[12]

Cheriton, D. The V distributed system. Commun. ACM 31, 3 (Mar. 1988), 314--333.

Digital Library

[13]

Dean, J., and Barroso, L. A. The tail at scale. Communications of the ACM 56, 2 (Feb. 2013), 74--80.

Digital Library

[14]

Dean, J., and Ghemawat, S. MapReduce: Simplified Data Processing on Large Clusters. In Proceedings of OSDI (2004).

Digital Library

[15]

Han, S., Marshall, S., Chun, B.-G., and Ratnasamy, S. MegaPipe: a new programming interface for scalable network I/O. In Proceedings of OSDI (2012), pp. 135--148.

Digital Library

[16]

Hand, S., Warfield, A., Fraser, K., Kotsovinos, E., and Magenheimer, D. J. Are virtual machine monitors microkernels done right? In Proceedings of HotOS (2005).

Digital Library

[17]

Heiser, G. and Elphinstone, K. and Vochteloo, J. and Russell, S. and Liedtke, J. The Mungi single-address-space operating system. Software: Practice and Experience 28, 9 (1998), 901--928.

Digital Library

[18]

Hoelzle, U., and Barroso, L. A. The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines, 1st ed. Morgan and Claypool Publishers, 2009.

Digital Library

[19]

Isard, M., Budiu, M., Yu, Y., Birrell, A., and Fetterly, D. Dryad: distributed dataparallel programs from sequential building blocks. Operating Systems Review 41, 3 (June 2007), 59.

Digital Library

[20]

Kurmus, A., Sorniotti, A., and Kapitza, R. Attack surface reduction for commodity OS kernels: trimmed garden plants may attract less bugs. In Proceedings of EuroSec (2011), pp. 6:1--6:6.

Digital Library

[21]

Lauer, H. C., and Needham, R. M. On the duality of operating system structures. Operating Systems Review 13, 2 (Apr. 1979), 3--19.

Digital Library

[22]

Lazowska, E. D., Levy, H. M., Almes, G. T., Fischer, M. J., Fowler, R. J., and Vestal, S. C. The architecture of the Eden system. In Proceedings of SOSP (1981).

Digital Library

[23]

Leach, P., Levine, P., Douros, B., Hamilton, J., Nelson, D., and Stumpf, B. The architecture of an integrated local network. Selected Areas in Communications 1, 5 (Nov. 1983), 842--857.

Digital Library

[24]

Liskov, B. Primitives for distributed computing. In Proceedings of SOSP (1979).

Digital Library

[25]

Mullender, S., van Rossum, G., Tananbaum, A., van Renesse, R., and van Staveren, H. Amoeba: a distributed operating system for the 1990s. Computer 23, 5 (May 1990), 44--53.

Digital Library

[26]

Murray, D. G., Schwarzkopf, M., Smowton, C., Smith, S., Madhavapeddy, A., and Hand, S. CIEL: a universal execution engine for distributed data-flow computing. In Proceedings of NSDI (2011).

Digital Library

[27]

Needham, R. M., and Herbert, A. J. The Cambridge distributed computing system. Addison Wesley Publish. Co., 1983.

[28]

Nightingale, E. B., Hodson, O., McIlroy, R., Hawblitzel, C., and Hunt, G. Helios: heterogeneous multiprocessing with satellite kernels. In Proceedings of SOSP (2009).

Digital Library

[29]

Nightingale, E. and Elson, J. and Hofmann, O. and Suzue, Y. and Fan, J. and Howell, J. Flat Datacenter Storage. In Proceedings of OSDI (2012).

Digital Library

[30]

Northcutt, J. D. Mechanisms for reliable distributed real-time operating systems: The Alpha Kernel. Academic Press Professional, Inc., 1987.

Digital Library

[31]

Ousterhout, J., Agrawal, P., Erickson, D., Kozyrakis, C., Leverich, J., Mazières, D., Mitra, S., Narayanan, A., Parulkar, G., Rosenblum, M., et al. The case for RAM-Clouds: scalable high-performance storage entirely in DRAM. Operating Systems Review 43, 4 (Jan. 2010), 92--105.

Digital Library

[32]

Ousterhout, J., Cherenson, A., Douglis, F., Nelson, M., and Welch, B. The Sprite network operating system. Computer 21, 2 (Feb. 1988), 23--36.

Digital Library

[33]

Patterson, D. A. Latency lags bandwith. Communications of the ACM 47, 10 (Oct. 2004), 71--75.

Digital Library

[34]

Popek, G., Walker, B., Chow, J., Edwards, D., Kline, C., Rudisin, G., and Thiel, G. LOCUS: a network transparent, high reliability distributed system. In Proceedings of SOSP (1981).

Digital Library

[35]

Porter, D. E. and Boyd-Wickizer, S. and Howell, J. and Olinsky, R. and Hunt, G. C. Rethinking the library OS from the top down. In Proceedings of ASPLOS (2011), pp. 291--304.

Digital Library

[36]

Reiss, C. and Tumanov, A. and Ganger, G. R. and Katz, R. H. and Kozuch, M. A. Heterogeneity and dynamicity of clouds at scale: Google trace analysis. In Proceedings of SoCC (2012).

Digital Library

[37]

Rizzo, L. netmap: a novel framework for fast packet I/O. In Proceedings of USENIX ATC (2012).

Digital Library

[38]

Rozier, M., Abrossimov, V., Armand, F., Boule, I., Gien, M., Guillemont, M., Herrmann, F., Kaiser, C., Langlois, S., Léonard, P., et al. Overview of the CHORUS Distributed Operating Systems. Computing Systems 1 (1991), 39--69.

[39]

Rumble, S. M., Ongaro, D., Stutsman, R., Rosenblum, M., and Ousterhout, J. K. Its time for low latency. In Proceedings of HotOS (2011).

Digital Library

[40]

Tanenbaum, A. S. Distributed operating systems anno 1992. What have we learned so far? Distributed Systems Engineering. 1, 1 (1993), 3.

[41]

Waychinson, M., and Corbet, J. KS2009: How Google uses Linux, 2009. http://lwn. net/Articles/357658/.

[42]

Weik, M. H. A Third Survey of Domestic Electronic Digital Computing Systems. Tech. rep., Ballistic Research Laboratories, Mar. 1961.

[43]

Wilkes, M. Memoirs of a computer pioneer. MIT Press, 1985.

Digital Library

[44]

Zaharia, M., Chowdhury, M., Das, T., Dave, A., Ma, J., McCauley, M., Franklin, M., Shenker, S., and Stoica, I. Resilient distributed datasets: A fault-tolerant abstraction for in-memory cluster computing. In Proceedings of NSDI (2012), p. 2.

Digital Library

Cited By

Hale KGunawi HMa X(2021)Coalescent computingProceedings of the 12th ACM SIGOPS Asia-Pacific Workshop on Systems10.1145/3476886.3477503(79-88)Online publication date: 24-Aug-2021
https://dl.acm.org/doi/10.1145/3476886.3477503
Pemberton NSchleier-Smith JGonzalez JAngel SKasikci BKohler E(2021)The RESTless cloudProceedings of the Workshop on Hot Topics in Operating Systems10.1145/3458336.3465280(49-57)Online publication date: 1-Jun-2021
https://dl.acm.org/doi/10.1145/3458336.3465280
Vasilakis NKarel BPalkhiwala YSonchack JDeHon ASmith JMcKinley KFisher K(2019)Ignis: scaling distribution-oblivious systems with light-touch distributionProceedings of the 40th ACM SIGPLAN Conference on Programming Language Design and Implementation10.1145/3314221.3314586(1010-1026)Online publication date: 8-Jun-2019
https://dl.acm.org/doi/10.1145/3314221.3314586
Show More Cited By

Recommendations

Out With The Old, In With The New?: Unpacking Member Turnover in Online Production Groups

Nearly any group is subject to turnover : some people leave, while others join. Turnover can be especially high in online groups, since participation typically is strictly voluntary. We investigated the effects of member turnover in online groups, ...
Old Wine in New Skins?: Revisiting the Software Architecture for IP Network Stacks on Constrained IoT Devices
IoT-Sys '15: Proceedings of the 2015 Workshop on IoT challenges in Mobile and Industrial Systems

In this paper, we argue that existing concepts for the design and implementation of network stacks for constrained devices do not comply with the requirements of current and upcoming Internet of Things (IoT) use cases. The IoT requires not only a ...
“A Righteous God and Savior”: Romans 1:17 and the Old Testament Concept of God’s Righteousness

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

APSys '13: Proceedings of the 4th Asia-Pacific Workshop on Systems

July 2013

131 pages

ISBN:9781450323161

DOI:10.1145/2500727

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Nanyang Technological University
SUTD: Singapore University of Technology and Design
NUS: NUS

In-Cooperation

SIGOPS: ACM Special Interest Group on Operating Systems

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 July 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article

Funding Sources

Conference

APSys '13

Sponsor:

SUTD
NUS

APSys '13: Asia-Pacific Workshop on Systems

July 29 - 30, 2013

Singapore, Singapore

Acceptance Rates

APSys '13 Paper Acceptance Rate 23 of 73 submissions, 32%;

Overall Acceptance Rate 169 of 430 submissions, 39%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

15
Total Citations
View Citations
317
Total Downloads

Downloads (Last 12 months)8
Downloads (Last 6 weeks)0

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Hale KGunawi HMa X(2021)Coalescent computingProceedings of the 12th ACM SIGOPS Asia-Pacific Workshop on Systems10.1145/3476886.3477503(79-88)Online publication date: 24-Aug-2021
https://dl.acm.org/doi/10.1145/3476886.3477503
Pemberton NSchleier-Smith JGonzalez JAngel SKasikci BKohler E(2021)The RESTless cloudProceedings of the Workshop on Hot Topics in Operating Systems10.1145/3458336.3465280(49-57)Online publication date: 1-Jun-2021
https://dl.acm.org/doi/10.1145/3458336.3465280
Vasilakis NKarel BPalkhiwala YSonchack JDeHon ASmith JMcKinley KFisher K(2019)Ignis: scaling distribution-oblivious systems with light-touch distributionProceedings of the 40th ACM SIGPLAN Conference on Programming Language Design and Implementation10.1145/3314221.3314586(1010-1026)Online publication date: 8-Jun-2019
https://dl.acm.org/doi/10.1145/3314221.3314586
Herrera-Luna IRechy-Ramirez ERios-Figueroa HMarin-Hernandez A(2019)Sensor Fusion Used in Applications for Hand Rehabilitation: A Systematic ReviewIEEE Sensors Journal10.1109/JSEN.2019.289708319:10(3581-3592)Online publication date: 15-May-2019
https://doi.org/10.1109/JSEN.2019.2897083
Shan YHuang YChen YZhang YArpaci-Dusseau AVoelker G(2018)LegoOSProceedings of the 13th USENIX conference on Operating Systems Design and Implementation10.5555/3291168.3291175(69-87)Online publication date: 8-Oct-2018
https://dl.acm.org/doi/10.5555/3291168.3291175
Vasilakis NGoel PDemoulin HSmith J(2018)The Web as a Distributed Computing PlatformProceedings of the 1st International Workshop on Edge Systems, Analytics and Networking10.1145/3213344.3213346(7-12)Online publication date: 10-Jun-2018
https://dl.acm.org/doi/10.1145/3213344.3213346
Barbalace ALyerly RJelesnianski CCarno AChuang HLegout VRavindran B(2017)Breaking the Boundaries in Heterogeneous-ISA DatacentersACM SIGARCH Computer Architecture News10.1145/3093337.303773845:1(645-659)Online publication date: 4-Apr-2017
https://dl.acm.org/doi/10.1145/3093337.3037738
Barbalace ALyerly RJelesnianski CCarno AChuang HLegout VRavindran B(2017)Breaking the Boundaries in Heterogeneous-ISA DatacentersACM SIGPLAN Notices10.1145/3093336.303773852:4(645-659)Online publication date: 4-Apr-2017
https://dl.acm.org/doi/10.1145/3093336.3037738
Barbalace ALyerly RJelesnianski CCarno AChuang HLegout VRavindran B(2017)Breaking the Boundaries in Heterogeneous-ISA DatacentersACM SIGOPS Operating Systems Review10.1145/3093315.303773851:2(645-659)Online publication date: 4-Apr-2017
https://doi.org/10.1145/3093315.3037738
Barbalace ALyerly RJelesnianski CCarno AChuang HLegout VRavindran BChen YTemam OCarter J(2017)Breaking the Boundaries in Heterogeneous-ISA DatacentersProceedings of the Twenty-Second International Conference on Architectural Support for Programming Languages and Operating Systems10.1145/3037697.3037738(645-659)Online publication date: 4-Apr-2017
https://dl.acm.org/doi/10.1145/3037697.3037738
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten