Skip to main content

Learning-Based Aerial Charging Scheduling for UAV-Based Data Collection

  • Conference paper
  • First Online:
Book cover Wireless Algorithms, Systems, and Applications (WASA 2021)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 12938))

Abstract

A major challenge to wide application of small size unmanned aerial vehicles (UAVs) is the limited working time. For recharging UAVs, ground-station based schemes had been proposed, for which contact charging by magnetic coupling and contactless charging by laser beam can be used. However, UAVs have to interrupt ongoing missions and cost extra time and energy on recharging. In this work, with the aim of charging UAVs without interrupting the mission, we propose the novel concept of charging UAVs aerially via wireless power transmission (WPT). In this case, the mission UAVs (MUAVs) can be recharged by the charging UAV (CUAV) while on the fly. Firstly, the feasibility of aerially wireless charging for small UAVs is verified. Then we consider the practical application of multiple MUAVs for collecting data from several points of interest (PoIs), where the MUAVs will be recharged by the CUAV. Accordingly, the issue of scheduling the CUAV’s flying path and charging process to minimize the mission time arises. To this end, deep reinforcement learning based algorithms for scheduling CUAV recharging MUAVs is proposed. The CUAV explores and optimizes the scheduling strategies, thereby improving the working efficiency. Extensive evaluations and comparisons show the effectiveness of the proposed scheme.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Note that the path planning and scheduling for MUAVs to collect data is not considered in this work.

References

  1. Liu, J., Wang, X., Bai, B., Dai, H.: Age-optimal trajectory planning for UAV-assisted data collection. In: IEEE INFOCOM 2018 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS), Honolulu, HI (2018)

    Google Scholar 

  2. Avola, D., Foresti, G.L., Martinel, N., Micheloni, C., Pannone, D., Piciarelli, C.: Aerial video surveillance system for small-scale UAV environment monitoring. In: 2017 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), Lecce (2017)

    Google Scholar 

  3. Zhang, B., Liu, C.H., Tang, J., Xu, Z., Ma, J., Wang, W.: Learning-based energy-efficient data collection by unmanned vehicles in smart cities. IEEE Trans. Industr. Inf. 14(4), 1666–1676 (2018)

    Article  Google Scholar 

  4. Song, B.D., Park, K., Kim, J.: Persistent UAV delivery logistics: MILP formulation and efficient heuristic. Comput. Ind. Eng. 120, 418–428 (2018)

    Article  Google Scholar 

  5. Han, Z., Zhu, X., Xu, L.: Scheduling rechargeable UAVs for long time barrier coverage. In: 2020 IEEE 26th International Conference on Parallel and Distributed Systems (ICPADS), pp. 282–289 (2020)

    Google Scholar 

  6. Junaid, A.B., Lee, Y., Kim, Y.: Design and implementation of autonomous wireless charging station for rotary-wing UAVs. Aerosp. Sci. Technol. 54, 253–266 (2016)

    Article  Google Scholar 

  7. Chen, W., Zhao, S., Shi, Q., Zhang, R.: Resonant beam charging-powered UAV-assisted sensing data collection. IEEE Trans. Veh. Technol. 69(1), 1086–1090 (2020)

    Article  Google Scholar 

  8. Lillicrap, T.P., et al.: Continuous control with deep reinforcement learning. arXiv preprint arXiv:1509.02971 (2015)

  9. Lu, X., Wang, P., Niyato, D., Kim, D.I., Han, Z.: Wireless charging technologies: fundamentals, standards, and network applications. IEEE Commun. Surv. Tutor. 18(2), 1413–1452 (2016)

    Article  Google Scholar 

  10. Ke, D., Liu, C., Jiang, C., Zhao, F.: Design of an effective wireless air charging system for electric unmanned aerial vehicles. In: 2017–43rd Annual Conference of the IEEE Industrial Electronics Society (IECON), Beijing (2017)

    Google Scholar 

  11. Yu, K., Budhiraja, A.K., Tokekar, P.: Algorithms for routing of unmanned aerial vehicles with mobile recharging stations. In: 2018 IEEE International Conference on Robotics and Automation (ICRA), Brisbane, QLD (2018)

    Google Scholar 

  12. Li, K., See, K., Koh, W., Zhang, J.: Design of 2.45 GHz microwave wireless power transfer system for battery charging applications. In: 2017 Progress in Electromagnetics Research Symposium - Fall (PIERS - FALL), Singapore (2017)

    Google Scholar 

  13. Ho, S.L., Wang, J., Fu, W.N., Sun, M.: A comparative study between novel witricity and traditional inductive magnetic coupling in wireless charging. IEEE Trans. Magn. 47(5), 1522–1525 (2011)

    Article  Google Scholar 

  14. Zhang, Q., Fang, W., Liu, Q., Wu, J., Xia, P., Yang, L.: Distributed laser charging: a wireless power transfer approach. IEEE Internet Things J. 5(5), 3853–3864 (2018)

    Article  Google Scholar 

  15. QCW Stacked Array with ’Fast Axis Collimation’ QD-Q1yzz-BO/QD-Q1yzz-BSO/QD-Q1yzz-BSSO. https://www.laserdiodesource.com/files/pdfs/laserdiodesource_com/product-966/808nm_500W_stack_Quantel_Laser_Diodes-1416380890.pdf

  16. Sediq, A.B., Gohary, R.H., Schoenen, R., Yanikomeroglu, H.: Optimal tradeoff between sum-rate efficiency and Jain’s fairness index in resource allocation. IEEE Trans. Wireless Commun. 12(7), 3496–3509 (2013)

    Article  Google Scholar 

  17. Plappert, M.: Parameter space noise for exploration. arXiv preprint arXiv:1706.01905 (2017)

Download references

Acknowledgement

This work was supported by the National Natural Science Foundation of China (No. 62071230 and No. 61972199).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Kun Zhu .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Yang, J., Zhu, K., Zhu, X., Wang, J. (2021). Learning-Based Aerial Charging Scheduling for UAV-Based Data Collection. In: Liu, Z., Wu, F., Das, S.K. (eds) Wireless Algorithms, Systems, and Applications. WASA 2021. Lecture Notes in Computer Science(), vol 12938. Springer, Cham. https://doi.org/10.1007/978-3-030-86130-8_47

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-86130-8_47

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-86129-2

  • Online ISBN: 978-3-030-86130-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics