Skip to main content

Advertisement

SpringerLink
Log in

Throughput optimization for backscatter-and-NOMA-enabled wireless powered cognitive radio network

  • Published:
Telecommunication Systems Aims and scope Submit manuscript

Abstract

In a typical wireless powered cognitive radio network, secondary transmitters (STs) perform energy harvesting when the channel is busy and perform active transmission using the harvested energy when the channel is idle. In order to further enhance the throughput of the network, we enable time-division-multiple-access-based backscatter communication (BackCom) when the channel is busy and non-orthogonal-multiple-access (NOMA)-based active transmission when the channel is idle. We aim to maximize the longterm average sum-throughput of all the STs by allocating each ST’s BackCom time, energy harvesting time and transmit power for the NOMA-based active transmission. With consideration of limited battery capacity and time-varying channel, we formulate the problem as a Markov decision process. Both Q-learning and deep Q-learning (DQL) algorithms are proposed to solve the problem to obtain fully online policies. Simulation results show that the proposed DQL algorithm not only efficiently deals with the dynamics of the environment but also improves the average throughput up to 27.5% compared with Q-learning and up to 4 times compared with random policy.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Al-Fuqaha, A., Guizani, M., Mohammadi, M., Aledhari, M., & Ayyash, M. (2015). Internet of Things: A survey on enabling technologies, protocols, and applications. IEEE Communications Surveys & Tutorials, 17(4), 2347–2376.

    Article  Google Scholar 

  2. Wollschlaeger, M., Sauter, T., & Jasperneite, J. (2017). The future of industrial communication: Automation networks in the era of the internet of things and industry 4.0. IEEE Industrial Electronics Magazine, 11(1), 17–27.

    Article  Google Scholar 

  3. Muthu, B., Sivaparthipan, C., Manogaran, G., Sundarasekar, R., Kadry, S., Shanthini, A., & Dasel, A. (2020). IoT based wearable sensor for diseases prediction and symptom analysis in healthcare sector. Peer-to-Peer Networking and Applications, 13(6), 2123–2134.

    Article  Google Scholar 

  4. Liu, X., & Ansari, N. (2019). Toward green IoT: Energy solutions and key challenges. IEEE Communications Magazine, 57(3), 104–110.

    Article  Google Scholar 

  5. Niyato, D., Kim, D. I., Maso, M., & Han, Z. (2017). Wireless powered communication networks: Research directions and technological approaches. IEEE Wireless Communications, 24(6), 88–97.

    Article  Google Scholar 

  6. Clerckx, B., Zhang, R., Schober, R., Ng, D. W. K., Kim, D. I., & Poor, H. V. (2018). Fundamentals of wireless information and power transfer: From RF energy harvester models to signal and system designs. IEEE Journal on Selected Areas in Communications, 37(1), 4–33.

    Article  Google Scholar 

  7. Lu, X., Niyato, D., Wang, P., Kim, D. I., & Han, Z. (2015). Wireless charger networking for mobile devices: Fundamentals, standards, and applications. IEEE Wireless Communications, 22(2), 126–135.

    Article  Google Scholar 

  8. Jabbar, H., Song, Y. S., & Jeong, T. T. (2010). RF energy harvesting system and circuits for charging of mobile devices. IEEE Transactions on Consumer Electronics, 56(1), 247–253.

    Article  Google Scholar 

  9. Kellogg, B., Parks, A., Gollakota, S., Smith, J.R., & Wetherall, D. (2014). Wi-Fi backscatter: Internet connectivity for RF-powered devices. In Proceedings of the 2014 ACM conference on SIGCOMM, pp. 607–618.

  10. Wang, G., Gao, F., Fan, R., & Tellambura, C. (2016). Ambient backscatter communication systems: Detection and performance analysis. IEEE Transactions on Communications, 64(11), 4836–4846.

    Article  Google Scholar 

  11. Hoang, D.T., Niyato, D., Wang, P., Kim, D.I., & Han, Z. (2016). The tradeoff analysis in RF-powered backscatter cognitive radio networks. In 2016 IEEE global communications conference (GLOBECOM), 1–6. IEEE.

  12. Dai, L., Wang, B., Yuan, Y., Han, S., Chih-Lin, I., & Wang, Z. (2015). Non-orthogonal multiple access for 5G: Solutions, challenges, opportunities, and future research trends. IEEE Communications Magazine, 53(9), 74–81.

    Article  Google Scholar 

  13. Wan, D., Wen, M., Ji, F., Yu, H., & Chen, F. (2018). Non-orthogonal multiple access for cooperative communications: Challenges, opportunities, and trends. IEEE Wireless Communications, 25(2), 109–117.

    Article  Google Scholar 

  14. Hoang, D. T., Niyato, D., Wang, P., Kim, D. I., & Han, Z. (2017). Ambient backscatter: A new approach to improve network performance for RF-powered cognitive radio networks. IEEE Transactions on Communications, 65(9), 3659–3674.

    Article  Google Scholar 

  15. Kishore, R., Gurugopinath, S., Sofotasios, P. C., Muhaidat, S., & Al-Dhahir, N. (2019). Opportunistic ambient backscatter communication in RF-powered cognitive radio networks. IEEE Transactions on Cognitive Communications and Networking, 5(2), 413–426.

    Article  Google Scholar 

  16. Su, X., Li, Y., Gao, M., Wang, Z., Li, Y., & Zhu, Y.-H. (2021). Online policies for throughput maximization of backscatter assisted wireless powered communication via reinforcement learning approaches. Pervasive and Mobile Computing, 77, 101463.

    Article  Google Scholar 

  17. Hoang, D.T., Niyato, D., Wang, P., & Kim, D.I. (2017). Optimal time sharing in RF-powered backscatter cognitive radio networks. In 2017 IEEE international conference on communications (ICC), 1–6. IEEE.

  18. Shi, L., Hu, R. Q., Gunther, J., Ye, Y., & Zhang, H. (2020). Energy efficiency for RF-powered backscatter networks using HTT protocol. IEEE Transactions on Vehicular Technology, 69(11), 13932–13936.

    Article  Google Scholar 

  19. Lyu, B., Guo, H., Yang, Z., & Gui, G. (2018). Throughput maximization for hybrid backscatter assisted cognitive wireless powered radio networks. IEEE Internet of Things Journal, 5(3), 2015–2024.

    Article  Google Scholar 

  20. Yang, C., Wang, X., & Chin, K.-W. (2019). On max-min throughput in backscatter-assisted wirelessly powered IoT. IEEE Internet of Things Journal, 7(1), 137–147.

    Article  Google Scholar 

  21. Diamantoulakis, P. D., Pappi, K. N., Ding, Z., & Karagiannidis, G. K. (2016). Wireless-powered communications with non-orthogonal multiple access. IEEE Transactions on Wireless Communications, 15(12), 8422–8436.

    Article  Google Scholar 

  22. Zewde, T. A., & Gursoy, M. C. (2018). NOMA-based energy-efficient wireless powered communications. IEEE Transactions on Green Communications and Networking, 2(3), 679–692.

    Article  Google Scholar 

  23. Chingoska, H., Hadzi-Velkov, Z., Nikoloska, I., & Zlatanov, N. (2016). Resource allocation in wireless powered communication networks with non-orthogonal multiple access. IEEE Wireless Communications Letters, 5(6), 684–687.

    Article  Google Scholar 

  24. Zhou, W. (2020). Max-min throughput in hybrid of wireless powered NOMA and backscatter communications. IEEE Access, 8, 204459–204470.

    Article  Google Scholar 

  25. Van Huynh, N., Hoang, D. T., Nguyen, D. N., Dutkiewicz, E., Niyato, D., & Wang, P. (2019). Optimal and low-complexity dynamic spectrum access for RF-powered ambient backscatter system with online reinforcement learning. IEEE Transactions on Communications, 67(8), 5736–5752.

    Article  Google Scholar 

  26. Anh, T.T., Luong, N.C., Niyato, D., Liang, Y.-C., & Kim, D.I. (2019). Deep reinforcement learning for time scheduling in RF-powered backscatter cognitive radio networks. In 2019 IEEE wireless communications and networking conference (WCNC), 1–7. IEEE.

  27. Guo, S., & Zhao, X. (2022). Deep reinforcement learning optimal transmission algorithm for cognitive Internet of Things with RF energy harvesting. IEEE Transactions on Cognitive Communications and Networking, 8(2), 1216–1227.

    Article  Google Scholar 

  28. Gong, S., Zou, Y., Xu, J., Hoang, D. T., Lyu, B., & Niyato, D. (2021). Optimization-driven hierarchical learning framework for wireless powered backscatter-aided relay communications. IEEE Transactions on Wireless Communications, 21(2), 1378–1391.

    Article  Google Scholar 

  29. Wu, G., Chen, Z., Zhang, D., & Liu, J. (2019). Resource allocation algorithm with worst case delay guarantees in energy harvesting body area networks. Peer-to-Peer Networking and Applications, 12(1), 74–87.

    Article  Google Scholar 

  30. Liu, V., Parks, A., Talla, V., Gollakota, S., Wetherall, D., & Smith, J. R. (2013). Ambient backscatter: Wireless communication out of thin air. ACM SIGCOMM Computer Communication Review, 43(4), 39–50.

    Article  Google Scholar 

  31. Li, Y., Su, X., Jiang, H., & Chen, C.S. (2021). Throughput maximization for wireless powered communication: Reinforcement learning approaches. In 2021 IEEE/ACM 29th international symposium on quality of service (IWQoS), 1–10. IEEE.

  32. Ni, Z., Chen, Z., Zhang, Q., & Zhou, C. (2019). Analysis of RF energy harvesting in uplink-NOMA IoT-based network. In: 2019 IEEE 90th vehicular technology conference (VTC2019-Fall), pp. 1–5. IEEE.

  33. Zhou, F., Wu, Y., Liang, Y.-C., Li, Z., Wang, Y., & Wong, K.-K. (2018). State of the art, taxonomy, and open issues on cognitive radio networks with NOMA. IEEE Wireless Communications, 25(2), 100–108.

    Article  Google Scholar 

  34. Cao, K., Wang, B., Ding, H., Lv, L., Tian, J., Hu, H., & Gong, F. (2021). Achieving reliable and secure communications in wireless-powered NOMA systems. IEEE Transactions on Vehicular Technology, 70(2), 1978–1983.

    Article  Google Scholar 

  35. Li, B., Si, F., Zhao, W., & Zhang, H. (2021). Wireless powered mobile edge computing with NOMA and user cooperation. IEEE Transactions on Vehicular Technology, 70(2), 1957–1961.

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported in part by Natural Science Foundation of Zhejiang Province (LZ21F020005, LZ22F020004, LQ21F020018), National Natural Science Foundation of China (61772472) and the Fundamental Research Funds for the Provincial Universities of Zhejiang (RF-A2019002).

Author information

Authors and Affiliations

  1. School of Computer Science and Technology, Zhejiang University of Technoloy, 288 Liuhe Road, Hangzhou, 310023, Zhejiang, China

    Yuzhe Chen, Yanjun Li, Meihui Gao, Xianzhong Tian & Kaikai Chi

Authors
  1. Yuzhe Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yanjun Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Meihui Gao
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Xianzhong Tian
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Kaikai Chi
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

YC: Methodology, Formal analysis, Simulation, Writing. YL: Conceptualization, Methodology, Writing—review & editing. MG: Conceptualization, Methodology, Writing—review & editing. XT: Conceptualization, Methodology, Review. KC: Conceptualization, Methodology, Review.

Corresponding author

Correspondence to Yanjun Li.

Ethics declarations

Conflict of interest

The authors declare no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chen, Y., Li, Y., Gao, M. et al. Throughput optimization for backscatter-and-NOMA-enabled wireless powered cognitive radio network. Telecommun Syst 83, 135–146 (2023). https://doi.org/10.1007/s11235-023-01012-6

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11235-023-01012-6

Keywords

Search

Navigation