Skip to main content
Springer Nature Link
Log in

Learning-Based Relay Selection for Cooperative Networks with Space–Time Network Coding

  • Published:
Wireless Personal Communications Aims and scope Submit manuscript

Abstract

Space–time network coding has recently been used in cooperative communication to mitigate the problem of transmission delay in wireless systems as well as handle the issue of imperfect synchronization. However, using all relays for transmission to forward the network coded signals can still cause delay in such networks, resulting in lower throughput. In this paper, we propose a Q-learning based relay selection algorithm (QL-RSA) that maximizes the total capacity of the network by learning the cooperative network environment. QL-RSA is distributed, as each source is capable of self-learning in order to select the optimal relays separately, without exchanging information with the other source nodes. Similarly, the proposed algorithm is adaptive as it can efficiently learn the network under varying channel conditions to select the relays. We choose different sets of relays and study the impact of relay selection on the performance in terms of the throughput and outage using QL-RSA.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. Alamouti, S. M. (1998). A simple transmit diversity technique for wireless communications. IEEE Journal on Selected Areas in Communications, 16(8), 1451–1458.

    Article  Google Scholar 

  2. Liu, K. J. R., Sadek, A. K., Su, W., & Kwasinski, A. (2008). Cooperative communications and networking. Cambridge: Cambridge University Press.

    Book  MATH  Google Scholar 

  3. Sadek, A. K., Su, W., & Liu, K. J. R. (2007). Multinode cooperative communication in wireless networks. IEEE Transactions on Signal Processing, 55(1), 341–355.

    Article  MathSciNet  MATH  Google Scholar 

  4. Su, W., Sadek, A. K., & Liu, K. J. (2008). Cooperative communication protocols in wireless networks: performance analysis and optimum power allocation. Wireless Personal Communications, 44(2), 181–217.

    Article  Google Scholar 

  5. Laneman, J. N., Tse, D. N., & Wornell, G. W. (2004). Cooperative diversity wireless networks: Efficient protocols and outage behavior. IEEE Transactions on Information Theory, 50(12), 3062–3080.

    Article  MathSciNet  MATH  Google Scholar 

  6. Lai, H. Q., & Liu, K. J. R. (2011). Space–time network coding. IEEE Transactions on Signal Processing, 59(4), 1706–1718.

    Article  MathSciNet  MATH  Google Scholar 

  7. Zhang, S., Liew, C., & Lam, P. (2006). Physical layer network coding. In Proceedings of the international conference on mobile computing and networking (MobiCom) (pp. 358–365). Los Angeles, CA, USA.

  8. Baidas, M. W., Lai, H.-Q., & Liu, K. J. R. (2010). Many-to-many communications via space–time network coding. Proceedings of IEEE wireless communications and networking conference (WCNC), (pp. 1–6). Sydney, Australia.

  9. Xiong, K., Fan, P., Yang, H.-C., & Letaief, K. B. (2014). Space–time network coding with overhearing relays. IEEE Transactions on Wireless Communications, 13(7), 3567–3582.

    Article  Google Scholar 

  10. Xiong, K., Li, T., Fan, P., Zhong, Z., & Letaief, K. B. (2013). Outage probability of space–time network coding with amplify-and-forward relays. Proceedings of IEEE Global communications conference (GLOBECOM) (pp. 3571–3576). Atlanta, GA, USA.

  11. Baidas, M. W., & MacKenzie, A. B. (2014). Many-to-many space–time network coding for amplify-and-forward cooperative networks: node selection and performance analysis. EURASIP Journal on Wireless Communications and Networking. https://doi.org/10.1186/1687-1499-2014-48.

  12. Ibrahim, A. S., Sadek, A. K., Su, W., & Liu, K. J. R. (2008). Relay selection in multi-node cooperative communications: When to cooperate and whom to cooperate with? IEEE Transactions on Wireless Communications, 7(7), 2814–2827.

    Article  Google Scholar 

  13. Zhao, Y., Adve, R., & Lim, T. J. (2007). Improving amplify-and-forward relay networks: Optimal power allocation versus selection. IEEE Transactions on Wireless Communications, 6(8), 3114–3122.

    Google Scholar 

  14. Sutton, R. S., & Barto, A. G. (1998). Reinforcement learning. Cambridge, MA: MIT Press.

    MATH  Google Scholar 

  15. Thilina, K. M., Choi, K. W., Saquib, N., & Hossain, E. (2013). Machine learning techniques for cooperative spectrum sensing in cognitive radio networks. IEEE Journal on Selected Areas in Communications, 31(11), 2209–2221.

    Article  Google Scholar 

  16. Semov, P., Al-Shatri, H., Tonchev, K., et al. (2017). Implementation of machine learning for autonomic capabilities in self-organizing heterogeneous networks. Wireless Personal Communications, 92(1), 149–168.

    Article  Google Scholar 

  17. Baidas, M. W. (2014). Cooperation in wireless networks: A game-theoretic framework with reinforcement learning. IET Communications, 8(5), 740–753.

    Article  Google Scholar 

  18. Jadoon, M. A., & Kim, S. (2017). Relay selection algorithm for wireless cooperative networks: A learning-based approach. IET Communications, 11(7), 1061–1066.

    Article  Google Scholar 

  19. Saha, A. Ghosh, A., & Hamouda, W. (2014). Learning based relay selection for cooperative networks. In Proceedings of IEEE global commununcation on conference (GLOBECOM) (pp. 386–391). Austin, TX, USA.

Download references

Acknowledgements

This research was supported by the Research Program through the National Research Foundation of Korea (NRF-2016R1D1A1B03934653, NRF-2019R1A2C1005920).

Author information

Authors and Affiliations

  1. Coding and Information Theory Lab, School of Electrical, University of Ulsan, Ulsan, 44610, South Korea

    Muhammad Awais Jadoon & Sunghwan Kim

Authors
  1. Muhammad Awais Jadoon
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Sunghwan Kim
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Sunghwan Kim.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Jadoon, M.A., Kim, S. Learning-Based Relay Selection for Cooperative Networks with Space–Time Network Coding. Wireless Pers Commun 108, 907–920 (2019). https://doi.org/10.1007/s11277-019-06439-2

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11277-019-06439-2

Keywords