research-article

Systematic Analysis of DDS Implementations

Authors:

David Buettner,

Tobias Preclik,

Carsten Trinitis,

Martin SchulzAuthors Info & Claims

Middleware '23: Proceedings of the 24th International Middleware Conference

Pages 234 - 246

https://doi.org/10.1145/3590140.3629118

Published: 27 November 2023 Publication History

Abstract

Publish-subscribe messaging is a popular communication paradigm in the (Industrial) Internet of Things, and the Data Distribution Service (DDS) is a well known standard for pub-sub communication middleware. Many vendor implementations of DDS exist, leaving users with the need to choose according to project and performance requirements. However, the wide range of parameters in DDS implementations not covered in the standard specification make this selection difficult and time-consuming. We present DDS-Perf, a novel and versatile cross-vendor benchmarking tool for performance analysis, and use it to provide data from studies on 4 popular DDS implementations (OpenDDS, RTI Connext, FastDDS and CycloneDDS) across a wide range of experimental setups. DDS-Perf allows us to provide a consistent methodology across all vendors, increasing fairness and comparability. Overall, we find that RTI Connext achieves the best all-round performance (exhibiting the best bandwidth and peak sample rate), while FastDDS (best end-to-end latency) and CycloneDDS also show promising results.

References

[1]

Object Management Group. "OMG Data Distribution Service (DDS)." (Apr. 2015), [Online]. Available: https://www.omg.org/spec/DDS/1.4/PDF (visited on 06/21/2022).

[2]

RTI Inc. "Human Robot Interaction Laboratory - European Space Agency." (May 9, 2020), [Online]. Available: https://www.rti.com/hubfs/_Collateral/Customer_Snapshots/rticustomer-snapshot-esa.pdf (visited on 02/25/2023).

[3]

eProsima. "Hexagon and Airbus: Fast DDS for real-time maritime surveillance." (Feb. 2022), [Online]. Available: https://www.eprosima.com/index.php/company-all/news/256-hexagon-airbus-fast-dds (visited on 02/25/2023).

[4]

Object Computing, Inc. "Plotlogic Reimagines Precision Mining With OpenDDS Technology." (Apr. 12, 2021), [Online]. Available: https://objectcomputing.com/case-studies/plotlogic-reimagines-precision-mining-with-opendds (visited on 02/25/2023).

[5]

DDS Foundation. "DDS Portal - Data Distribution Services." (2021), [Online]. Available: https://www.dds-foundation.org/ (visited on 06/21/2022).

[6]

Object Computing, Inc., OpenDDS Developer's Guide, 2021. [Online]. Available: https://download.objectcomputing.com/OpenDDS/previous-releases/OpenDDS-3.17.pdf (visited on 06/21/2022).

[7]

Real-Time Innovations, Inc., RTI Connext Modern C++ API, 2021. [Online]. Available: https://community.rti.com/static/documentation/connext-dds/6.1.0/doc/api/connext_dds/api_cpp2/index.html (visited on 06/21/2022).

[8]

eProsima, FastDDS 2.6.1 Documentation, 2021. [Online]. Available: https://fast-dds.docs.eprosima.com/en/latest/fastdds/getting_started/getting_started.html (visited on 06/21/2022).

[9]

Eclipse Cyclone DDS committers, Eclipse CycloneDDS latest documentation, 2021. [Online]. Available: https://cyclonedds.io/docs/cyclonedds/latest/ (visited on 06/21/2022).

[10]

G. Aures, "DDS vs. MQTT vs. VSL for IoT," in Proceedings of the Seminar Innovative Internet Technologies and Mobile Communications (IITM), Summer Semester 2019, G. Carle, S. Günther, and B. Jaeger, Eds., ser. Network Architectures and Services (NET), vol. NET-2019-10-1, Munich, Germany: Chair of Network Architectures and Services, Department of Computer Science, Technical University of Munich, Oct. 2019, pp. 1--5.

[11]

Object Management Group. "OMG Data Distribution Service (DDS)." (Dec. 2004), [Online]. Available: https://www.omg.org/spec/DDS/1.0/PDF (visited on 12/06/2022).

[12]

Object Management Group. "Pending Requests for Comments." (Feb. 25, 2023), [Online]. Available: https://www.omg.org/public_schedule/ (visited on 02/25/2023).

[13]

S. Profanter, A. Tekat, K. Dorofeev, M. Rickert, and A. Knoll, "OPC UA versus ROS, DDS, and MQTT: Performance Evaluation of Industry 4.0 Protocols," in 2019 IEEE International Conference on Industrial Technology (ICIT), 2019, pp. 955--962.

[14]

Y. Chen and T. Kunz, "Performance evaluation of IoT protocols under a constrained wireless access network," in 2016 International Conference on Selected Topics in Mobile and Wireless Networking (MoWNeT), 2016, pp. 1--7.

[15]

Z. Kang and A. Dubey, "Evaluating DDS, MQTT, and ZeroMQ Under Different IoT Traffic Conditions," 2020.

[16]

P. Bellavista, A. Corradi, L. Foschini, and A. Pernafini, "Data Distribution Service (DDS): A performance comparison of OpenSplice and RTI implementations," in 2013 IEEE Symposium on Computers and Communications (ISCC), 2013, pp. 000 377--000 383.

[17]

A. T. Park, R. Dill, D. D. Hodson, and W. C. Henry, "DDS-Cerberus: Ticketing Performance Experiments and Analysis," in 2021 International Conference on Computational Science and Computational Intelligence (CSCI), 2021, pp. 1465--1469.

[18]

A. T. Park, N. Peck, R. Dill, D. D. Hodson, M. R. Grimaila, and W. C. Henry, "Quantifying DDS-cerberus network control overhead," The Journal of Supercomputing, Sep. 2022, issb: 1573--0484. [Online]. Available: https://doi.org/10.1007/s11227-022-04770-3.

Digital Library

[19]

Y. Maruyama, S. Kato, and T. Azumi, "Exploring the Performance of ROS2," in Proceedings of the 13th International Conference on Embedded Software, ser. EMSOFT '16, Pittsburgh, Pennsylvania: Association for Computing Machinery, 2016, isbn: 9781450344852. [Online]. Available: https://doi.org/10.1145/2968478.2968502.

Digital Library

[20]

X. Chen, X. Kong, Y. Ling, and X. Cao, "DDS Performance Evaluation for PREEMPT_RT Linux," in 2021 International Conference on Computer, Blockchain and Financial Development (CBFD), 2021, pp. 84--89.

[21]

S. Solpan and K. Kucuk, "DDS-XRCE Standard Performance Evaluation of Different Communication Scenarios in IoT Technologies," EAI Endorsed Transactions on Internet of Things, vol. 8, no. 4, e1, Nov. 2022. [Online]. Available: https://publications.eai.eu/index.php/IoT/article/view/2691.

[22]

R. Serrano-Torres, M. García-Valls, and P. Basanta-Val, "Virtualizing DDS middleware: Performance challenges and measurements," in 2013 11th IEEE International Conference on Industrial Informatics (INDIN), 2013, pp. 71--76.

[23]

R. Serrano-Torres, M. Garcia-Valls, and P. Basanta-Val, "Performance evaluation of virtualized DDS Middleware," in Simposio de tiempo real, Madrid, 2014, pp. 18--19.

[24]

eProsima. "Benchmarking DDS Implementations." (2022), [Online]. Available: https://www.eprosima.com/index.php/resources-all/performance/fast-dds-vs-cyclone-dds-performance (visited on 06/21/2022).

[25]

M. Aartsen et al., "Analyzing Interoperability and Security Overhead of ROS2 DDS Middleware," in 2022 30th Mediterranean Conference on Control and Automation (MED), 2022, pp. 976--981.

[26]

Object Management Group. "The OMG® Specifications Catalog." (Feb. 25, 2023), [Online]. Available: https://www.omg.org/spec/#categories/DDS/ (visited on 02/25/2023).

[27]

Raspberry Pi Foundation. "Raspberry Pi 3 Model B+." (2020), [Online]. Available: https://datasheets.raspberrypi.com/rpi3/raspberry-pi-3-b-plus-product-brief.pdf (visited on 02/20/2023).

[28]

M. Shin, M. Park, D. Oh, B. Kim, and J. Lee, "Clock synchronization for one-way delay measurement: A survey," in Advanced Communication and Networking, T.-h. Kim, H. Adeli, R. J. Robles, and M. Balitanas, Eds., Berlin, Heidelberg: Springer Berlin Heidelberg, 2011, pp. 1--10, isbn: 978-3-642-23312-8.

[29]

G. Almes, S. Kalidindi, and M. Zekauskas, "A one-way delay metric for ippm," Tech. Rep., 1999.

[30]

G. Mace, A. V. Kempen, S. Kreuzer, G. Neville-Neil, and W. Owczarek, ptpd - Precision Time Protocol daemon (1588-2008) - Manual page ptpd(8), v2.3.1, Jun. 2015.

[31]

A. Kuznetsov, clockdiff - measure clock difference between hosts - Manual page clockdiff(8), iputils s20180629, Jun. 2018.

[32]

D. Z. Lou et al., "Industrial networking enabling iiot communication," IIC: WHT: IN23, vol. 1, 2018.

[33]

I. Perez, A. Mavridou, T. Pressburger, A. Will, and P. J. Martin, "Monitoring ROS2: From requirements to autonomous robots," Electronic Proceedings in Theoretical Computer Science, vol. 371, pp. 208--216, Sep. 2022. [Online]. Available: https://doi.org/10.4204%2Feptcs.371.15.

[34]

I. Shin, D. Choi, and H. Choi, "Monitoring of digital substations using dds," in 2019 54th International Universities Power Engineering Conference (UPEC), 2019, pp. 1--5.

[35]

V. Agarwal, S. Sharma, and P. Agarwal, "Iot based smart transport management and vehicle-to-vehicle communication system," in Computer Networks, Big Data and IoT, A. Pandian, X. Fernando, and S. M. S. Islam, Eds., Singapore: Springer Singapore, 2021, pp. 709--716, isbn: 978-981-16-0965-7.

[36]

R. Shiva Shankar, R. Devareddi, G. Mahesh, and V. MNSSVKR Gupta, "Develop a smart data warehouse for auto spare parts autonomous dispensing and rack restoration by using iot with dds protocol," in Computer Networks, Big Data and IoT, A. P. Pandian, X. Fernando, and W. Haoxiang, Eds., Singapore: Springer Nature Singapore, 2022, pp. 879--895, isbn: 978-981-19-0898-9.

[37]

M. García-Valls, P. Basanta-Val, and I. Estévez-Ayres, "Adaptive real-time video transmission over dds," in 2010 8th IEEE international conference on industrial informatics, IEEE, 2010, pp. 130--135.

Cited By

Bode VTrinitis CSchulz MBuettner DPreclik T(2025)Advancing user-space networking for DDS message-oriented middleware: Further extensionsPervasive and Mobile Computing10.1016/j.pmcj.2025.102013107(102013)Online publication date: Feb-2025
https://doi.org/10.1016/j.pmcj.2025.102013
Bode VTrinitis CSchulz MBuettner DPreclik T(2024)Adopting User-Space Networking for DDS Message-Oriented Middleware2024 IEEE International Conference on Pervasive Computing and Communications (PerCom)10.1109/PerCom59722.2024.10494460(36-46)Online publication date: 11-Mar-2024
https://doi.org/10.1109/PerCom59722.2024.10494460

Index Terms

Systematic Analysis of DDS Implementations
1. Computer systems organization
  1. Architectures
    1. Distributed architectures
      1. Peer-to-peer architectures
  2. Dependable and fault-tolerant systems and networks
    1. Reliability
2. Networks
  1. Network performance evaluation
    1. Network performance analysis
  2. Network protocols
    1. Presentation protocols

Recommendations

Benchmarking message-oriented middleware: TIB/RV versus SonicMQ: Research Articles
Foundations of Middleware Technologies

Message-oriented middleware (MOM) has become a vital part of the complex application integration projects. MOM is used to pass data and workflow in the form of messages between different enterprise applications. The performance of integrated ...
A cloud-enabled coordination service for internet-scale OMG DDS applications
DEBS '14: Proceedings of the 8th ACM International Conference on Distributed Event-Based Systems

The OMG Data Distribution Service (DDS), which is a standard specification for data-centric publish/subscribe communications, has shown promise for use in internet of things (IoT) applications because of its loosely coupled and scalable nature, and ...
Abstract model of an object-oriented layer for distributed systems based on the DDS standard
CompSysTech '11: Proceedings of the 12th International Conference on Computer Systems and Technologies

Data-Distribution Service (DDS) is the first open international middleware standard directly addressing publish-subscribe communications for distributed systems. The paper is dedicated to an object-oriented layer (OOL) for a development of distributed ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

Middleware '23: Proceedings of the 24th International Middleware Conference

November 2023

334 pages

ISBN:9798400701771

DOI:10.1145/3590140

Copyright © 2023 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

ACM: Association for Computing Machinery

In-Cooperation

IFIP: International Federation for Information Processing

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 November 2023

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

Middleware '23

Sponsor:

ACM

Middleware '23: 24th International Middleware Conference

December 11 - 15, 2023

Bologna, Italy

Acceptance Rates

Overall Acceptance Rate 203 of 948 submissions, 21%

Upcoming Conference

MIDDLEWARE '25

26th International Middleware Conference

December 15 - 19, 2025

Nashville , TN , USA

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
259
Total Downloads

Downloads (Last 12 months)175
Downloads (Last 6 weeks)19

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Bode VTrinitis CSchulz MBuettner DPreclik T(2025)Advancing user-space networking for DDS message-oriented middleware: Further extensionsPervasive and Mobile Computing10.1016/j.pmcj.2025.102013107(102013)Online publication date: Feb-2025
https://doi.org/10.1016/j.pmcj.2025.102013
Bode VTrinitis CSchulz MBuettner DPreclik T(2024)Adopting User-Space Networking for DDS Message-Oriented Middleware2024 IEEE International Conference on Pervasive Computing and Communications (PerCom)10.1109/PerCom59722.2024.10494460(36-46)Online publication date: 11-Mar-2024
https://doi.org/10.1109/PerCom59722.2024.10494460

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten