IP-NUMA for low-latency communication
Authors: 
Takeshi Matsuya, Yohei Kuga, Hideaki Yoshifuji, 
Rodney Van Meter, Jun MuraiAuthors Info & Claims
Takeshi Matsuya, Yohei Kuga, Hideaki Yoshifuji, Rodney Van Meter, Jun MuraiAuthors Info & ClaimsArticle No.: 13, Pages 1 - 4
Abstract
With cloud service becoming more popular, low-latency communication is required between servers in a data center. Low-latency node-to-node or application-to-application notification can be achieved in a NUMA [1] (Non-Uniform Memory Access) system, but requires dedicated, special-purpose network infrastructure. However, IP networks are commonly used in data centers. Using a custom FPGA-based NIC, we create NUMA-like behavior using hardware-generated IP packets which can be transmitted over commodity Ethernet switches and IP routers. We demonstrate ping-pong acknowledgments between two PCs equipped with our IP-NUMA boards. Our IP-NUMA implementation exhibits latency as much as ten times lower than software using Berkeley sockets over a consumer-grade Ethernet switch. iSCSI initiator-target communications and transaction-based distributed software systems will benefit from the reduced latency.
References
[1]
William J. Bolosky, Michael L. Scott, Robert P. Fitzgerald, Robert J. Fowler, and Alan L. Cox. NUMA policies and their relation to memory architecture. SIGARCH Comput. Archit. News, 19(2):212--221, April 1991.
[2]
W. Richard Stevens. UNIX Network Programming. Prentice-Hall, Inc., Upper Saddle River, NJ, USA, 1990.
[3]
Lattice Semiconductor Corporation. LatticeECP3 Versa Development Kit, 2013.
[4]
Intel Corporation. PAUSE • Spin Loop Hint. In Intel 64 and IA-32 Architectures Software Developer • s Manual, volume 2B, pages 4--57, 2014.
[5]
M. Eisler. XDR: External Data Representation Standard. RFC 4506 (INTERNET STANDARD), May 2006.
[6]
G. Delp, A. Sethi, and D. Farber. An analysis of MemNet---an experiment in high-speed shared-memory local networking. In SIGCOMM '88: Symposium proceedings on Communications architectures and protocols, pages 165--174, New York, NY, USA, 1988. ACM.
[7]
Greg Finn. An integration of network communication with workstation architecture. ACM Computer Communication Review, October 1991.
[8]
David L. Tennenhouse, Joel F. Adam, David Carver, Henry H. Houh, Michael Ismert, Christopher Lindblad, William F. Stasior, David Wetherall, David R. Bacher, and Theresa Chang. The viewstation: A software-intensive approach to media processing and distribution. Multimedia Syst., 3(3):104--115, 1995.
[9]
Mark Hayter and Derek McAuley. The desk area network. SIGOPS Oper. Syst. Rev., 25(4):14--21, October 1991.
[10]
Rodney Van Meter, Steven Hotz, and Gregory Finn. Derived virtual devices: A secure distributed file system mechanism. In Ben Kobler, editor, Proc. Fifth NASA Goddard Conference on Mass Storage Systems and Technologies, September 1996.
[11]
Intel Corporation. In Intel Data Direct I/O Technology (Intel DDIO): A Primer, 2012.
Index Terms
- IP-NUMA for low-latency communication
Recommendations
Dynamically-Allocated Multi-Queue Buffers for VLSI Communication Switches
Small n*n switches are key components of interconnection networks used in multiprocessors and multicomputers. The architecture of these n*n switches, particularly their internal buffers, is critical for achieving high-throughput low-latency ...
Low‐loss TCP/IP header compression for wireless networks
AbstractWireless is becoming a popular way to connect mobile computers to the Internet and other networks. The bandwidth of wireless links will probably always be limited due to properties of the physical medium and regulatory limits on the use of ...
Small scale multiprocessor soft IP (SSM IP): single FPGA chip area and performance evaluation
FPGA '09: Proceedings of the ACM/SIGDA international symposium on Field programmable gate arraysFuture generation multiprocessor system on chip (MPSOC) will be based on hundreds of processors connected through network on chips. One of the challenges is to tackle the design productivity required to reach this goal. We propose a NOC based small scale ...
Comments
Information & Contributors
Information
Published In
Copyright © 2014 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
- JSPS: Japanese Society for the Promotion of Science
- WIDE
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 18 June 2014
Check for updates
Author Tags
Qualifiers
- Short-paper
Conference
CFI '14
Sponsor:
- JSPS
Acceptance Rates
CFI '14 Paper Acceptance Rate 13 of 23 submissions, 57%;
Overall Acceptance Rate 29 of 55 submissions, 53%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 100Total Downloads
- Downloads (Last 12 months)3
- Downloads (Last 6 weeks)1
Reflects downloads up to 08 Mar 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in