Skip to main content
SpringerLink
Log in

UAV-assisted wireless charging and data processing of power IoT devices

  • Regular Paper
  • Published:
Computing Aims and scope Submit manuscript

Abstract

To ensure the reliability and operational efficiency of the grid system, this paper proposes an unmanned aerial vehicle (UAV)-assisted Power Internet of Things (PIoT), which obtains real-time grid data through PIoT devices to support the management optimization of the grid system. Compared with traditional UAV-assisted communication networks, this paper enables data collection and energy transmission services for PIoT devices through UAVs. Firstly, the flight-hover-communication protocol is used. When the UAVs approach the target devices, they stop flying and remain hovering to provide services. The UAV selects full duplex mode in the hovering state, i.e., within the coverage area of the UAV, it can collect data from the target device while providing charging for other devices. Secondly, the UAVs can provide services to the required devices in sequence. Considering the priorities of the devices, both the data queue state and the energy pair state of network devices are considered comprehensively. Therefore, the optimization problem is constructed as a multi-objective optimization problem. First, the multi-objective optimization problem is transformed into a Markov process. Then, a multi-objective dynamic resource allocation algorithm based on reinforcement learning is proposed for solving the multi-objective optimization problem. The simulation results show that the proposed resource allocation scheme can effectively achieve a reasonable allocation of UAV resources, joint multi-objective optimization, and improved system performance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Algorithm 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

Availability of data and materials

All data generated or analyzed during this study are included in this manuscript. Code may be available from the corresponding author on request.

References

  1. Deng X, Jiang Y, Yang L, Yi L, Chen J, Liu Y, Li X (2020) Learning-automata-based confident information coverage barriers for smart ocean internet of things. IEEE Internet Things J 7(10):9919–9929

    Article  Google Scholar 

  2. Song F, Zhu M, Zhou Y, You I, Zhang H (2020) Smart collaborative tracking for ubiquitous power IoT in edge-cloud interplay domain. IEEE Internet Things J 7(7):6046–6055

    Article  Google Scholar 

  3. Dong M, Ota K, Yang LT, Chang S, Zhu H, Zhou Z (2014) Mobile agent-based energy-aware and user-centric data collection in wireless sensor networks. Comput Netw 74:58–70

    Article  Google Scholar 

  4. Song F, Ai Z, Zhou Y, You I, Choo R, Zhang H (2020) Smart collaborative automation for receive buffer control in multipath industrial networks. IEEE Trans Ind Inf 16(2):1385–1394

    Article  Google Scholar 

  5. Song F, Li L, You I, Yu S, Zhang H (2022) Optimizing high-speed mobile networks with smart collaborative theory. IEEE Wirel Commun 29(3):48–54

    Article  CAS  Google Scholar 

  6. Song F, Ai Z, Zhang H, You I, Li S (2021) Smart collaborative balancing for dependable network components in cyber-physical systems. IEEE Trans Ind Inf 17(10):6916–6924

    Article  Google Scholar 

  7. Song F, Li L, You I, Zhang H (2021) Enabling heterogeneous deterministic networks with smart collaborative theory. IEEE Netw 35(3):64–71

    Article  Google Scholar 

  8. Wang F, Xu J, Cui S (2020) Optimal energy allocation and task offloading policy for wireless powered mobile edge computing systems. IEEE Trans Wirel Commun 19(4):2443–2459

    Article  Google Scholar 

  9. Fang X, Misra S, Xue G, Yang D (2012) Smart grid the new and improved power grid: a survey. IEEE Commun Surv Tutor 14(4):944–980

    Article  Google Scholar 

  10. Qin P, Fu Y, Zhao X, Wu K, Liu J, Wang M (2022) Optimal task offloading and resource allocation for C-NOMA heterogeneous air-ground integrated power internet of things networks. IEEE Trans Wirel Commun 21(11):9276–9292

    Article  Google Scholar 

  11. Bedi G, Venayagamoorthy GK, Singh R, Brooks RR, Wang K-C (2018) Review of Internet of Things (IoT) in electric power and energy systems. IEEE Internet Things J 5(2):847–870

    Article  Google Scholar 

  12. Sun R, Wang Y, Su R, Cheng N, Shen XS (2019) A destination-aided wireless energy transfer scheme in multi-antenna relay sensor networks. IEEE Wirel Commun Lett 8(3):689–692

    Article  Google Scholar 

  13. Anajemba JH, Tue T, Iwendi C, Ohwoekevwo A, Srivastava G, Jo O (2020) Realizing efficient security and privacy in IoT networks. Sensors 20(9):1–24

    Article  Google Scholar 

  14. Guo H, Liu J (2020) UAV-enhanced intelligent offloading for internet of things at the edge. IEEE Trans Ind Inf 16(4):2737–2746

    Article  Google Scholar 

  15. Wang B, Sun Y, Sun Z, Nguyen LD, Duong TQ (2020) UAV-assisted emergency communications in social IoT: a dynamic hypergraph coloring approach. IEEE Internet Things J 7(8):7663–7677

    Article  Google Scholar 

  16. Wang H, Wang J, Ding G, Wang L, Tsiftsis TA, Sharma PK (2018) Resource allocation for energy harvesting-powered D2D communication underlaying UAV-assisted networks. IEEE Trans Green Commun Netw 2(1):14–24

    Article  Google Scholar 

  17. Cheng N et al (2019) Space/aerial-assisted computing offloading for IoT applications: a learning-based approach. IEEE J Sel Areas Commun 37(5):1117–1129

    Article  Google Scholar 

  18. Chen M, Hao Y, Lin K, Yuan Z, Hu L (2018) Label-less learning for traffic control in an edge network. IEEE Netw 32(6):8–14

    Article  Google Scholar 

  19. Zeng Y, Zhang R, Lim TJ (2016) Wireless communications with unmanned aerial vehicles: opportunities and challenges. IEEE Commun Mag 54(5):36–42

    Article  Google Scholar 

  20. Liu Z, Meng X, Yang Y, Ma K, Guan X (2022) Energy-efficient UAV-aided ocean monitoring networks: joint resource allocation and trajectory design. IEEE Internet Things J 9(18):17871–17884

    Article  Google Scholar 

  21. Zhou Z, Zhang C, Xu C, Xiong F, Zhang Y, Umer T (2018) Energy-efficient industrial internet of UAVs for power line inspection in smart grid. IEEE Trans Ind Inf 14(6):2705–2714

    Article  Google Scholar 

  22. Dai M, Wu Y, Qian L, Su Z, Lin B, Chen N (2023) UAV-assisted multi-access computation offloading via hybrid NOMA and FDMA in marine networks. IEEE Trans Netw Sci Eng 10(1):113–127

    Article  MathSciNet  Google Scholar 

  23. Jia Z, Sheng M, Li J, Niyato D, Han Z (2021) LEO-satellite-assisted UAV: joint trajectory and data collection for internet of remote things in 6G aerial access networks. IEEE Internet Things J 8(12):9814–9826

    Article  Google Scholar 

  24. Zhang T, Lei J, Liu Y, Feng C, Nallanathan A (2021) Trajectory optimization for UAV emergency communication with limited user equipment energy: a safe-DQN approach. IEEE Trans Green Commun Netw 5(3):1236–1247

    Article  Google Scholar 

  25. Yang Y, Wei X, Xu R, Peng L (2022) Joint optimization of AoI, SINR, completeness, and energy in UAV-aided SDCNs: coalition formation game and cooperative order. IEEE Trans Green Commun Netw 6(1):265–280

    Article  Google Scholar 

  26. Wang W, Srivastava G, Lin JC-W, Yang Y, Alazab M, Gadekallu TR (2023) Data freshness optimization under CAA in the UAV-aided MECN: a potential game perspective. IEEE Trans Intell Transp Syst 24(11):12912–12921

    Article  Google Scholar 

  27. Yang Y, Wang W, Xu R, Srivastava G, Alazab M, Gadekallu TR, Su C (2022) AoI optimization for UAV-aided MEC networks under channel access attacks: a game theoretic viewpoint. In: IEEE international conference on communications, Seoul, Republic of Korea, May 2022, pp 1–6

  28. Yang Y, Wang W, Liu L, Dev K, Qureshi NMF (2023) AoI optimization in the UAV-aided traffic monitoring network under attack: a stackelberg game viewpoint. IEEE Trans Intell Transp Syst 24(1):932–941

    Article  Google Scholar 

  29. Gu J, Wang H, Ding G, Xu Y, Xue Z, Zhou H (2020) Energy-constrained completion time minimization in UAV-enabled internet of things. IEEE Internet Things J 7(6):5491–5503

    Article  Google Scholar 

  30. Gao X, Zhu X, Zhai L (2023) Minimization of aerial cost and mission completion time in multi-UAV-enabled IoT networks. IEEE Trans Commun 71(9):5335–5347

    Article  Google Scholar 

  31. Yang G, Yao Y (2023) Resource allocation control of UAV-assisted IoT communication device. IEEE Trans Intell Transp Syst 24(11):13341–13349

    Article  Google Scholar 

  32. Liu L, Xiong K, Cao J, Lu Y, Fan P, Letaief KB (2022) Average AoI minimization in UAV-assisted data collection with RF wireless power transfer: a deep reinforcement learning scheme. IEEE Internet Things J 9(7):5216–5228

    Article  Google Scholar 

  33. Liu Y, Xiong K, Lu Y, Ni Q, Fan P, Letaief KB (2021) UAV-aided wireless power transfer and data collection in Rician fading. IEEE J Sel Areas Commun 39(10):3097–3113

    Article  Google Scholar 

  34. Pang Y, Zhang Y, Gu Y, Pan M, Han Z, Li P (2014) Efficient data collection for wireless rechargeable sensor clusters in Harsh terrains using UAVs. In: 2014 IEEE global communications conference, Austin, TX, USA, pp 234–239

  35. Yan H, Chen Y, Yang S-H (2020) UAV-enabled wireless power transfer with base station charging and UAV power consumption. IEEE Trans Veh Technol 69(11):12883–12896

    Article  Google Scholar 

  36. Xie L, Xu J, Zhang R (2019) Throughput maximization for UAV-enabled wireless powered communication networks. IEEE Internet Things J 6(2):1690–1703

    Article  Google Scholar 

  37. Hu X, Wong K-K, Zhang Y (2020) Wireless-powered edge computing with cooperative UAV: task, time scheduling and trajectory design. IEEE Trans Wirel Commun 19(12):8083–8098

    Article  Google Scholar 

  38. Ye H-T, Kang X, Joung J, Liang Y-C (2020) Optimization for full-duplex rotary-wing UAV-enabled wireless-powered IoT networks. IEEE Trans Wirel Commun 19(7):5057–5072

    Article  Google Scholar 

  39. Yang Z, Xu W, Shikh-Bahaei M (2020) Energy efficient UAV communication with energy harvesting. IEEE Trans Veh Technol 69(2):1913–1927

    Article  Google Scholar 

  40. Ye H-T, Kang X, Joung J, Liang Y-C (2021) Joint uplink-and-downlink optimization of 3-D UAV swarm deployment for wireless-powered IoT networks. IEEE Internet Things J 8(17):13397–13413

    Article  Google Scholar 

  41. Yu Y, Tang J, Huang J, Zhang X, So DKC, Wong K-K (2021) Multi-objective optimization for UAV-assisted wireless powered IoT networks based on extended DDPG algorithm. IEEE Trans Commun 69(9):6361–6374

    Article  Google Scholar 

  42. Zeng Y, Xu J, Zhang R (2019) Energy minimization for wireless communication with rotary-wing UAV. IEEE Trans Wirel Commun 18(4):2329–2345

    Article  Google Scholar 

  43. Boshkovska E, Ng DWK, Zlatanov N, Schober R (2015) Practical non-linear energy harvesting model and resource allocation for SWIPT systems. IEEE Commun Lett 19(12):2082–2085

    Article  Google Scholar 

  44. Sun Q-M, Zhang C, Jiang N-Y, Yu J-J, Xu L (2020) Data-driven nonlinear near-optimal regulation based on multi-dimensional Taylor network dynamic programming. IEEE Access 8:36476–36484

    Article  Google Scholar 

  45. Jiang W, Feng D, Sun Y, Feng G, Wang Z, Xia X-G (2022) Proactive content caching based on actor-critic reinforcement learning for mobile edge networks. IEEE Trans Cogn Commun Netw 8(2):1239–1252

    Article  Google Scholar 

  46. Ye J, Zhang YJA (2020) DRAG: deep reinforcement learning based base station activation in heterogeneous networks. IEEE Trans Mob Comput 19(9):2076–2087

    Article  Google Scholar 

  47. Lillicrap TP, Hunt JJ, Pritzel A, Heess N, Erez T, Tassa Y, Silver D, Wierstra D (2015) Continuous control with deep reinforcement learning, arXiv preprint arXiv:1509.02971

  48. Kong X et al (2022) Deep reinforcement learning-based energy-efficient edge computing for internet of vehicles. IEEE Trans Ind Inf 18(9):6308–6316

    Article  Google Scholar 

  49. Hu H, Xiong K, Qu G, Ni Q, Fan P, Letaief KB (2021) AoI-minimal trajectory planning and data collection in UAV-assisted wireless powered IoT networks. IEEE Internet Things J 8(2):1211–1223

    Article  Google Scholar 

  50. Fan X, Liu M, Chen Y, Sun S, Li Z, Guo X (2023) RIS-assisted UAV for fresh data collection in 3D urban environments: a deep reinforcement learning approach. IEEE Trans Veh Technol 72(1):632–647

    Article  Google Scholar 

  51. Han X, Yang W, Li M, Zhang L, Yan F, Ma X (2020) A trajectory planning algorithm for data collection in UAV-aided wireless sensor networks. In: 2020 IEEE 6th international conference on computer and communications (ICCC), Chengdu, China, pp 846–851

Download references

Author information

Authors and Affiliations

  1. School of Computer and Communication Engineering, University of Science and Technology Beijing, Beijing, 100083, China

    Ting Lyu, Jianwei An, Meng Li, Feifei Liu & Haitao Xu

Authors
  1. Ting Lyu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jianwei An
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Meng Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Feifei Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Haitao Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

TL, JA, and HX wrote the main manuscript text, ML and FL prepared figures and tables. All authors reviewed the manuscript.

Corresponding authors

Correspondence to Jianwei An or Haitao Xu.

Ethics declarations

Confict of interest

The authors declare no competing interests.

Ethics approval

Not applicable.

Consent to participate

Not applicable.

Consent for publication

The publication has been approved by all co-authors.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lyu, T., An, J., Li, M. et al. UAV-assisted wireless charging and data processing of power IoT devices. Computing 106, 789–819 (2024). https://doi.org/10.1007/s00607-023-01245-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00607-023-01245-y

Keywords

Mathematics Subject Classification

Search

Navigation