skip to main content
10.1145/3272036.3272040acmconferencesArticle/Chapter ViewAbstractPublication PagesmswimConference Proceedingsconference-collections
research-article

Blockchain-Based Distributed Software-Defined Vehicular Networks via Deep Q-Learning

Published: 25 October 2018 Publication History

Abstract

Nowadays, in order to support flexibility, agility, and ubiquitous accessibility among vehicles, software defined networking has been proposed to integrate with vehicular networks, known as software defined vehicular network (SDVN). Due to a variety of data, flows, and vehicles in SDVN, a distributed SDVN is necessary. However, how to reach consensus in distributed SDVN efficiently and safely is an intractable problem. In this paper, we use a permissioned blockchain approach to reach consensus in distributed SDVN. The existing permissioned blockchain has a number of drawbacks, such as low throughput. We virtualize the underlying resources (e.g., computing resources and networking resources), jointly considering the trust features of blockchain nodes to improve the throughput. Accordingly, we formulate view change, computing resources allocation, and networking resources allocation as a joint optimization problem. In order to solve this joint problem, we use a novel deep Q-learning approach. Simulation results show the effectiveness of our proposed scheme.

References

[1]
1} Martín Abadi, Ashish Agarwal, Paul Barham, Eugene Brevdo, Zhifeng Chen, Craig Citro, Greg S Corrado, Andy Davis, Jeffrey Dean, Matthieu Devin, et al. 2016. Tensorflow: Large-scale machine learning on heterogeneous distributed systems. arXiv preprint arXiv:1603.04467 (2016).
[2]
Elli Androulaki, Artem Barger, Vita Bortnikov, Christian Cachin, Konstantinos Christidis, Angelo De Caro, David Enyeart, Christopher Ferris, Gennady Laventman, Yacov Manevich, et al. 2018. Hyperledger fabric: a distributed operating system for permissioned blockchains. In Proc. Conf. on Thirteenth EuroSys. 30.
[3]
Pierre-Louis Aublin, Sonia Ben Mokhtar, and Vivien Quéma. 2013. RBFT: Redundant byzantine fault tolerance. In Proc. Conf. Distributed Comp. Sys.' 13. 297--306.
[4]
Miguel Castro and Barbara Liskov. 2002. Practical Byzantine fault tolerance and proactive recovery. ACM Trans. on Comp. Sys. 20, 4 (2002), 398--461.
[5]
Trishul M Chilimbi, Yutaka Suzue, Johnson Apacible, and Karthik Kalyanaraman. 2014. Project Adam: Building an Efficient and Scalable Deep Learning Training System. In OSDI, Vol. 14. 571--582.
[6]
Joao M Duarte, Torsten Braun, and Leandro A Villas. 2017. Addressing the effects of low vehicle density in highly mobile vehicular named-data networks. In Proc. ACM DIVANet'17. 117--124.
[7]
Ying He, F Richard Yu, Nan Zhao, Hongxi Yin, and Azzedine Boukerche. 2017. Deep Reinforcement Learning (DRL)-based Resource Management in Software-Defined and Virtualized Vehicular Ad Hoc Networks. In Proc. ACM DIVANet'17. 47--54.
[8]
Xumin Huang, Rong Yu, Jiawen Kang, Yejun He, and Yan Zhang. 2017. Exploring mobile edge computing for 5G-enabled software defined vehicular networks. IEEE Wire. Comm. 24, 6 (2017), 55--63.
[9]
Uri Klarman, Soumya Basu, Aleksandar Kuzmanovic, and Emin Gun Sirer. {n. d.}. bloXroute: A Scalable Trustless Blockchain Distribution Network WHITEPAPER. ({n. d.}).
[10]
Teemu Koponen, Martin Casado, Natasha Gude, Jeremy Stribling, Leon Poutievski, Min Zhu, Rajiv Ramanathan, Yuichiro Iwata, Hiroaki Inoue, Takayuki Hama, et al. 2010. Onix: A distributed control platform for large-scale production networks. In OSDI, Vol. 10. 1--6.
[11]
Chao Qiu, F Richard Yu, Fangmin Xu, Haipeng Yao, and Chenglin Zhao. 2018. Permissioned Blockchain-Based Distributed Software-Defined Industrial Internet of Things. In Globecom Workshops (GC Wkshps), 2018 IEEE. 1--7.
[12]
Chao Qiu, Chenglin Zhao, Fangmin Xu, and Tianpu Yang. 2016. Sleeping mode of multi-controller in green software-defined networking. EURASIP Journal on Wireless Commu. and Net. 2016, 1 (2016), 282.
[13]
Amin Tootoonchian and Yashar Ganjali. 2010. Hyperflow: A distributed control plane for openflow. In Pro. Conf. Internet Netw. Manag. 3--3.
[14]
Fei Richard Yu, Jianmin Liu, Ying He, Pengbo Si, and Yanhua Zhang. 2018. Virtualization for Distributed Ledger Technology (vDLT). IEEE Access 6 (2018), 25019--25028.
[15]
Yaomin Zhang, Haijun Zhang, Keping Long, Xiaoming Xie, and Victor Leung. 2017. Resource Allocation in Software Defined Fog Vehicular Networks. In Proc. ACM DIVANet'17. 71--76.

Cited By

View all
  • (2024)SARSA RL for Edge Connectivity Management in Vehicular Edge Networks2024 IEEE 13th International Conference on Cloud Networking (CloudNet)10.1109/CloudNet62863.2024.10815889(1-8)Online publication date: 27-Nov-2024
  • (2024)Using SDN Technology to Control C‐ITSCooperative Intelligent Transport Systems10.1002/9781394325849.ch5(97-114)Online publication date: 11-Oct-2024
  • (2023)A Review of Blockchain Technology in Knowledge-Defined Networking, Its Application, Benefits, and ChallengesNetwork10.3390/network30300173:3(343-421)Online publication date: 30-Aug-2023
  • Show More Cited By

Index Terms

  1. Blockchain-Based Distributed Software-Defined Vehicular Networks via Deep Q-Learning

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    DIVANet'18: Proceedings of the 8th ACM Symposium on Design and Analysis of Intelligent Vehicular Networks and Applications
    October 2018
    93 pages
    ISBN:9781450359641
    DOI:10.1145/3272036
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 25 October 2018

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. blockchain
    2. byzantine fault tolerance
    3. deep q-learning
    4. software defined vehicular networks
    5. throughput

    Qualifiers

    • Research-article

    Funding Sources

    Conference

    MSWIM '18
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 70 of 308 submissions, 23%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)11
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 20 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)SARSA RL for Edge Connectivity Management in Vehicular Edge Networks2024 IEEE 13th International Conference on Cloud Networking (CloudNet)10.1109/CloudNet62863.2024.10815889(1-8)Online publication date: 27-Nov-2024
    • (2024)Using SDN Technology to Control C‐ITSCooperative Intelligent Transport Systems10.1002/9781394325849.ch5(97-114)Online publication date: 11-Oct-2024
    • (2023)A Review of Blockchain Technology in Knowledge-Defined Networking, Its Application, Benefits, and ChallengesNetwork10.3390/network30300173:3(343-421)Online publication date: 30-Aug-2023
    • (2023)A survey of Internet of vehicles/vehicle to everything security based on BlockchainSCIENTIA SINICA Informationis10.1360/SSI-2022-001953:5(841)Online publication date: 6-May-2023
    • (2023)Byzantine-Fault-Tolerant Consensus via Reinforcement Learning for Permissioned Blockchain-Empowered V2X NetworkIEEE Transactions on Intelligent Vehicles10.1109/TIV.2022.31685758:1(172-183)Online publication date: Jan-2023
    • (2023)Essential Technics of Cybersecurity for Intelligent Connected Vehicles: Comprehensive Review and PerspectiveIEEE Internet of Things Journal10.1109/JIOT.2023.329955410:24(21787-21810)Online publication date: 15-Dec-2023
    • (2023)A Promising Integration of SDN and Blockchain for IoT Networks: A SurveyIEEE Access10.1109/ACCESS.2023.326077711(29800-29822)Online publication date: 2023
    • (2022)LBSV: Lightweight Blockchain Security Protocol for Secure Storage and Communication in SDN-Enabled IoVIEEE Transactions on Vehicular Technology10.1109/TVT.2022.316396071:6(5983-5994)Online publication date: Jun-2022
    • (2022)An Energy-Efficient Controller Management Scheme for Software-Defined Vehicular NetworksIEEE Transactions on Sustainable Computing10.1109/TSUSC.2021.30864187:1(61-74)Online publication date: 1-Jan-2022
    • (2022)Multiaccess Edge Integrated Networking for Internet of Vehicles: A Blockchain-Based Deep Compressed Cooperative Learning ApproachIEEE Transactions on Intelligent Transportation Systems10.1109/TITS.2022.318392723:11(21593-21607)Online publication date: Nov-2022
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media