research-article

Switching the optical divide: fundamental challenges for hybrid electrical/optical datacenter networks

Authors:

Hamid Hajabdolali Bazzaz,

Malveeka Tewari,

T. S. Eugene Ng,

David G. Andersen,

Michael Kaminsky,

Michael A. Kozuch,

Amin VahdatAuthors Info & Claims

SOCC '11: Proceedings of the 2nd ACM Symposium on Cloud Computing

Article No.: 30, Pages 1 - 8

https://doi.org/10.1145/2038916.2038946

Published: 26 October 2011 Publication History

Abstract

Recent proposals to build hybrid electrical (packet-switched) and optical (circuit switched) data center interconnects promise to reduce the cost, complexity, and energy requirements of very large data center networks. Supporting realistic traffic patterns, however, exposes a number of unexpected and difficult challenges to actually deploying these systems "in the wild." In this paper, we explore several of these challenges, uncovered during a year of experience using hybrid interconnects. We discuss both the problems that must be addressed to make these interconnects truly useful, and the implications of these challenges on what solutions are likely to be ultimately feasible.

References

[1]

Apache Hadoop, http://hadoop.apache.org.

[2]

D. Andrei. Efficient provisioning of data-intensive applications over optical networks. Fall 2009. Ph.D. thesis, UC. Davis.

Digital Library

[3]

M. Casado, M. J. Freedman, J. Pettit, J. Luo, N. McKeown, and S. Shenker. Ethane: Taking control of the enterprise. In Proceedings of ACM SIGCOMM '07 Computer Communication Review. ACM, Aug. 2007.

Digital Library

[4]

A. R. Curtis, J. C. Mogul, J. Tourrilhes, P. Yalagandula, P. Sharma, and S. Banerjee. Devoflow: Scaling flow management for high-performance networks. In ACM SIGCOMM, Aug. 2011.

Digital Library

[5]

S. Das, G. Parulkar, P. Singh, D. Getachew, L. Ong, and N. Mckeown. Packet and circuit network convergence with openflow. In Optical Fiber Conference (OFC/NFOEC'10), Mar. 2010.

[6]

J. Dean and S. Ghemawat. Mapreduce: Simplified data processing on large clusters. In OSDI 2004, pages 137--150, Apr. 2004.

Digital Library

[7]

J. Edmonds. Paths, trees and flowers. Canadian Journal on Mathematics, pages 449--467, 1965.

[8]

N. Farrington, G. Porter, S. Radhakrishnan, H. Bazzaz, V. Subramanya, Y. Fainman, G. Papen, and A. Vahdat. Helios: A hybrid electrical/optical switch architecture for modular data centers. In ACM SIGCOMM, Aug. 2010.

Digital Library

[9]

N. Farrington, Y. Fainman, H. Liu, G. Papen, and A. Vahdat. Hardware requirement for optical circuit switched data center networks. In Optical Fiber Conference (OFC/NFOEC'11), Mar. 2011.

[10]

A. Greenberg, G. Hjalmtysson, D. A. Maltz, A. Myers, J. Rexford, G. Xie, H. Yan, J. Zhan, and H. Zhang. Clean slate 4d approach to network control and management. In Proceeding of ACM SIGCOMM Computer Communication Review. ACM, Oct. 2005.

Digital Library

[11]

C. Guo, G. Lu, H. Wang, S. Yang, C. Kong, P. Sun, W. Wu, and Y. Zhang. Secondnet: A data center network virtualization architecture with bandwidth guarantees. In ACM CoNEXT'10, Dec. 2010.

Digital Library

[12]

R. Jain, D. Chiu, and W. Hawe. A quantitative measure of fairness and discrimination for resource allocation in shared computer system. Eastern Research Laboratory, Digital Equipment Corp., 1984.

[13]

T. Koponen, M. Casado, N. Gude, J. Stribling, L. Poutievski, M. Zhu, R. Ramanathan, Y. Iwata, H. Inoue, T. Hama, and S. Shenker. Onix: a distributed control platform for large-scale production networks. In Proceedings of the 9th USENIX conference on Operating systems design and implementation. USENIX Association, Oct. 2010.

Digital Library

[14]

J. R. Lange, A. I. Sundararaj, and P. A. Dinda. Automatic dynamic run-time optical network reservations. In In Proceedings of the Fourteenth International Symposium on High Performance Distributed Computing (HPDC), pages 255--264, July 2005.

Digital Library

[15]

H. Liu, C. F. Lam, and C. Johnson. Scaling optical interconnects in datacenter networks opportunities and challenges for wdm. In Proceedings of the 2010 18th IEEE Symposium on High Performance Interconnects, HOTT '10. IEEE Computer Society, Aug. 2010.

Digital Library

[16]

N. McKeown, T. Anderson, H. Balakrishnan, G. Parulkar, L. Peterson, J. Rexford, S. Shenker, and J. Turner. Openflow: Enabling innovation in campus networks. ACM SIGCOMM CCR, Mar. 2008.

Digital Library

[17]

A. Rasmussen, G. Porter, M. Conley, H. V. Madhyastha, R. N. Mysore, A. Pucher, and A. Vahdat. Tritonsort: A balanced large-scale sorting system. In USENIX NSDI'11, Mar. 2011.

Digital Library

[18]

A. Shieh, S. Kandula, A. Greenberg, and C. Kim. Sharing the data center network. In USENIX NSDI'11, Mar. 2011.

Digital Library

[19]

A. Singla, A. Singh, K. Ramachandran, L. Xu, and Y. Zhang. Proteus: a topology malleable data center network. In Proceedings of the Ninth ACM SIGCOMM Workshop on Hot Topics in Networks. ACM, Oct. 2010.

Digital Library

[20]

A. Vahdat, H. Liu, X. Zhao, and C. Johnson. The emerging optical data center. In Optical Fiber Communication Conference. Optical Society of America, Mar. 2011.

[21]

G. Wang, D. G. Andersen, M. Kaminsky, D. Papagiannaki, T. S. E. Ng, M. Kozuch, and M. Ryan. c-Through: Part-time optics in data centers. In ACM SIGCOMM, Aug. 2010.

Digital Library

[22]

R. Wang, D. Butnariu, and J. Rexford. Openflow-based server load balancing gone wild. In Workshop of HotICE'11, Mar. 2011.

Digital Library

[23]

H. Yan, D. A. Maltz, T. S. E. Ng, H. Gogineni, H. Zhang, and Z. Cai. Tesseract: A 4D Network Control Plane. In USENIX NSDI'07, Apr. 2007.

Digital Library

[24]

M. Yoo, C. Qiao, and S. Dixit. Qos performance of optical burst switching in ip-over-wdm networks. IEEE Journal of Selected Areas in Communications, Vol.18, No. 10, 2000.

Digital Library

[25]

M. Yoo, C. Qiao, and S. Dixit. Optical burst switching for service differentiation in the next-generation optical internet. IEEE Communication Magzine, Feb. 2001.

Digital Library

Cited By

Matsumoto RKonoike RMatsuura HSuzuki KInoue TIkeda KNamiki SSato K(2023)Performance Analysis of Scalable Optical Circuit Switch Employing Fast-Tunable AMZI Filters for Coherent DetectionJournal of Lightwave Technology10.1109/JLT.2022.320072241:3(934-948)Online publication date: 1-Feb-2023
https://doi.org/10.1109/JLT.2022.3200722
Ben Yoo S(2022)Photonic Switching Technologies, Architectures, and Integrated-Systems for Future Disaggregated and Optically Reconfigurable Data Centers2022 International Conference on Optical Network Design and Modeling (ONDM)10.23919/ONDM54585.2022.9782842(1-6)Online publication date: 16-May-2022
https://doi.org/10.23919/ONDM54585.2022.9782842
Ye TLi JPan XLee T(2022)Asynchronous Optical Traffic Offloading of Hybrid Optical/Electrical Data Center NetworksIEEE Transactions on Cloud Computing10.1109/TCC.2020.299248910:2(805-820)Online publication date: 1-Apr-2022
https://doi.org/10.1109/TCC.2020.2992489
Show More Cited By

Index Terms

Switching the optical divide: fundamental challenges for hybrid electrical/optical datacenter networks
1. Networks
  1. Network properties
    1. Network structure
  2. Network types
    1. Packet-switching networks
    2. Wired access networks

Recommendations

c-Through: part-time optics in data centers
SIGCOMM '10: Proceedings of the ACM SIGCOMM 2010 conference

Data-intensive applications that operate on large volumes of data have motivated a fresh look at the design of data center networks. The first wave of proposals focused on designing pure packet-switched networks that provide full bisection bandwidth. ...
c-Through: part-time optics in data centers
SIGCOMM '10

Data-intensive applications that operate on large volumes of data have motivated a fresh look at the design of data center networks. The first wave of proposals focused on designing pure packet-switched networks that provide full bisection bandwidth. ...
A RWA performance comparison for hybrid optical networks combining circuit and multi-wavelength packet switching
ONDM'09: Proceedings of the 13th international conference on Optical Network Design and Modeling

This paper compares several routing and wavelength assignment algorithms for a hybrid optical network architecture combining optical circuit switching (OCS) and multi-wavelength optical packet switching (MW-OPS). In this network, due to the fact that ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SOCC '11: Proceedings of the 2nd ACM Symposium on Cloud Computing

October 2011

377 pages

ISBN:9781450309769

DOI:10.1145/2038916

Program Chairs:
Jeffrey S. Chase
Duke University
,
Amr El Abbadi
Univ of California, Santa Barbara

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 October 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Conference

SOCC '11

Sponsor:

SOCC '11: ACM Symposium on Cloud Computing in conjunction with SOSP 2011

October 26 - 28, 2011

Cascais, Portugal

Acceptance Rates

Overall Acceptance Rate 169 of 722 submissions, 23%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

64
Total Citations
View Citations
762
Total Downloads

Downloads (Last 12 months)16
Downloads (Last 6 weeks)3

Reflects downloads up to 01 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Matsumoto RKonoike RMatsuura HSuzuki KInoue TIkeda KNamiki SSato K(2023)Performance Analysis of Scalable Optical Circuit Switch Employing Fast-Tunable AMZI Filters for Coherent DetectionJournal of Lightwave Technology10.1109/JLT.2022.320072241:3(934-948)Online publication date: 1-Feb-2023
https://doi.org/10.1109/JLT.2022.3200722
Ben Yoo S(2022)Photonic Switching Technologies, Architectures, and Integrated-Systems for Future Disaggregated and Optically Reconfigurable Data Centers2022 International Conference on Optical Network Design and Modeling (ONDM)10.23919/ONDM54585.2022.9782842(1-6)Online publication date: 16-May-2022
https://doi.org/10.23919/ONDM54585.2022.9782842
Ye TLi JPan XLee T(2022)Asynchronous Optical Traffic Offloading of Hybrid Optical/Electrical Data Center NetworksIEEE Transactions on Cloud Computing10.1109/TCC.2020.299248910:2(805-820)Online publication date: 1-Apr-2022
https://doi.org/10.1109/TCC.2020.2992489
Ben Yoo S(2022)Prospects and Challenges of Photonic Switching in Data Centers and Computing SystemsJournal of Lightwave Technology10.1109/JLT.2021.313657040:8(2214-2243)Online publication date: 15-Apr-2022
https://doi.org/10.1109/JLT.2021.3136570
Das SSahni S(2021)Two-Aggregator Topology Optimization Using Single Paths in Data Center NetworksIEEE Transactions on Cloud Computing10.1109/TCC.2018.28850539:2(807-820)Online publication date: 1-Apr-2021
https://doi.org/10.1109/TCC.2018.2885053
Peng JLi QTang SFang HZhu Z(2021)Offloading NFV Orchestration to ToR Switches: How to Leverage PDP to Realize Agile Service Function Chaining in HOE-DCNsICC 2021 - IEEE International Conference on Communications10.1109/ICC42927.2021.9500555(1-6)Online publication date: Jun-2021
https://doi.org/10.1109/ICC42927.2021.9500555
Kilper DPeyghambarian N(2020)Changing evolution of optical communication systems at the network edgesApplied Optics10.1364/AO.39411959:22(G209)Online publication date: 10-Jul-2020
https://doi.org/10.1364/AO.394119
Kilper D(2020)Energy Efficiency in Optical NetworksSpringer Handbook of Optical Networks10.1007/978-3-030-16250-4_19(631-664)Online publication date: 2020
https://doi.org/10.1007/978-3-030-16250-4_19
Dodoo JSun WZhu FHu W(2019)Energy Consumption of Hybrid Data Center Networks2019 15th International Conference on Network and Service Management (CNSM)10.23919/CNSM46954.2019.9012694(1-5)Online publication date: Oct-2019
https://doi.org/10.23919/CNSM46954.2019.9012694
Mike Liang CXue HYang MZhou L(2019)The Case for Learning-and-System Co-designACM SIGOPS Operating Systems Review10.1145/3352020.335203153:1(68-74)Online publication date: 25-Jul-2019
https://dl.acm.org/doi/10.1145/3352020.3352031
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten