skip to main content
10.1145/3573942.3573988acmotherconferencesArticle/Chapter ViewAbstractPublication PagesaiprConference Proceedingsconference-collections
research-article

Collaborative Computation Offloading in Multi-UAV-MEC Networks: A Reinforcement Learning Approach

Published: 16 May 2023 Publication History

Abstract

To cope with the unprecedented surge in demand for data computing, the promising unmanned aerial vehicle (UAV) assisted mobile edge computing (MEC) has been proposed to enable the network edges to provide closer data processing for users. Hence, data offloading from user to the MEC server will require more efficient. The integration of nonorthogonal multiple access (NOMA) technique with MEC has been shown to provide applications with lower latency and higher energy efficiency. To further enhance offloading performance, in this work, we propose an offloading scheme based on the data division and fusion reinforcement learning (DF-RL) algorithm to handle tasks through multi-user and multi-UAV collaboration. We formulate the optimization problem to minimize the delay and energy consumption of the system, and optimize the offloading strategy through the DF-RL algorithm. Firstly, the data fusion module is used to reduce the processing of repetitive tasks. Secondly, the task is divided into sub-tasks by task segmentation module to better complete the cooperation between UAVs. Finally, reinforcement learning (RL) is used to solve the problem and the optimal offloading strategy decision is obtained. Simulation results show that our algorithm not only has great superiority, but also improves the successful rate of the tasks.

References

[1]
Kiani A and Ansari N 2018 Edge computing aware NOMA for 5G networks IEEE Internet Things J 5(2) 1299-1306.
[2]
Su R, Zhang D, Venkatesan R, Gong Z, Li C, Ding F, Jiang F and Zhu Z 2019 Resource allocation for network slicing in 5G telecommunication networks: A survey of principles and models IEEE Netw 33(6) 172-179.
[3]
Abbas N, Zhang Y, Taherkordi A and Skeie T 2018 Mobile edge computing: A survey IEEE Internet Things J 5(1) 450-465.
[4]
Lu W, Si P, Gao Y, Han H, Liu Z, Wu Y and Gong Y 2021 Trajectory and resource optimization in OFDM based UAV-powered IoT network IEEE Trans. Green Commun. Netw 5(3) 1259-1270.
[5]
Mozaffari M, Saad W, Bennis M and Debbah M 2017 Performance optimization for UAV-enabled wireless communications under flight time constraints GLOBECOM 2017 – 2017 IEEE Global Commun. Conf 1-6.
[6]
Zhou F, Wu Y, Hu Q R and Qian Y 2018 Computation rate maximization in UAV-enabled wireless-powered mobile-edge computing systems IEEE J. Sel. Areas Commun 36(9) 1927-1941.
[7]
Y. Du, K. Yang, K. Wang, G. Zhang, Y. Zhao and D. Chen 2019 Joint resources and workflow scheduling in UAV-enabled wirelessly-powered MEC for IoT systems IEEE Trans. Veh. Technol 68(10) 10187-10200.
[8]
Liu Y, Xie S and Zhang Y 2020 Cooperative offloading and resource management for UAV-enabled mobile edge computing in power IoT system IEEE Trans. Veh. Technol 69(10) 12229-12239.
[9]
Abushattal A, Althunibat S, Qaraqe M and Arslan H 2021 A secure downlink NOMA scheme against unknown internal eavesdroppers IEEE Wireless Commun. Letters 10(6) 1281-1285.
[10]
S. Li, B. Li and W. Zhao, “Joint optimization of caching and computation in multi-server NOMA-MEC system via reinforcement learning,” IEEE Access, vol. 8, pp. 112762-112771, 2020.
[11]
Wu Y, Ni K, Zhang C, Qian L P and Tsang D H K 2018 NOMA-assisted multi-access mobile edge computing: A joint optimization of computation offloading and time allocation IEEE Trans. Veh. Technol 67(12) 12244-12258.
[12]
Zhang X, Zhang J, Xiong J, Zhou L and Wei J 2020 Energy-efficient Multi-UAV-enabled multiaccess edge computing incorporating NOMA IEEE Internet Things J 7(6) 5613-5627.
[13]
I. Budhiraja, N. Kumar, S. Tyagi and S. Tanwar 2021 Energy consumption minimization scheme for NOMA-based mobile edge computation networks Underlaying UAV IEEE Systems J.

Index Terms

  1. Collaborative Computation Offloading in Multi-UAV-MEC Networks: A Reinforcement Learning Approach

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    AIPR '22: Proceedings of the 2022 5th International Conference on Artificial Intelligence and Pattern Recognition
    September 2022
    1221 pages
    ISBN:9781450396899
    DOI:10.1145/3573942
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 16 May 2023

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Data fusion
    2. MEC
    3. Reinforcement learning
    4. Task offload
    5. Task successful rate

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    AIPR 2022

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 54
      Total Downloads
    • Downloads (Last 12 months)23
    • Downloads (Last 6 weeks)4
    Reflects downloads up to 01 Mar 2025

    Other Metrics

    Citations

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media