Skip to main content

Preamble Selection and Allocation Algorithm Based on Q Learning

  • Conference paper
  • First Online:
Artificial Intelligence and Security (ICAIS 2021)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 12736))

Included in the following conference series:

  • 1853 Accesses

Abstract

Machine-type Communication (MTC) is one of the three typical scenarios of 5G cellular communication network and is supposed to support connection density of 1 million devices per square kilometer. Random access initiated by such a large amount of devices may lead to congestion, conflicts and packet loss. This work designed a Q-learning-based dynamic preamble allocation scheme to solve the overload problem caused by large-scale MTC devices. The core enhancement considered in this work is Early Data Transmission (EDT) mechanism. MTC devices were divided into two groups of delay-sensitive and delay-tolerant according to the maximum delay tolerance of the services. Some of the preamble resources were pre-reserved for Delay-Sensitive Devices (DSD). Each DSD selected a preamble randomly from the pre-reserved set and performed EDT. Each Delay-Tolerant Device (DTD) selected a preamble randomly from the rest of the preambles and performed normal 4-step random access procedure. The number of elements in the pre-reserved set was dynamically adjusted using Q-learning algorithm according to the successful access proportion of the two types of devices. And then the base station would update and broadcast the service types which were permitted to use EDT. Simulation results show that the scheme proposed in this work improves the successful access proportion and meet the delay requirement of DSDs, and guarantees the throughput of the system at the same time.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Ghavimi, F., Che, H.H.: M2M communications in 3GPP LTE/LTE-A networks: architectures, service requirements, challenges, and applications. IEEE Commun. Surv. Tutorials 17(2), 525–549 (2015)

    Article  Google Scholar 

  2. Pocovi, G., Shariatmadari, H., Berardinelli, G., et al.: Achieving ultra-reliable low-latency communications: challenges and envisioned system enhancements. IEEE Netw. 32(2), 8–15 (2018)

    Article  Google Scholar 

  3. 3GPP, “Study on Small Cell Enhancements for E-UTRA and EUTRAN: higher layer aspects,” 3rd Generation Partnership Project (3GPP), TR 36.842, December 2013. http://www.3gpp.org/ftp/Specs/archive/36-series/36.842/

  4. Imran, A., Zoha, A., Dayya, A.: Challenges in 5G: how to empower SON with big data for enabling 5G. IEEE Netw. 28(6), 27–33 (2014)

    Article  Google Scholar 

  5. Li, R.P., Zhao, Z.F., Zhou, X., et al.: Intelligent 5G: when cellular networks meet artificial intelligence. IEEE Wirel. Commun. 2–10 (2017)

    Google Scholar 

  6. Galetic, V., Bojic, I., Kusec, M., et al.: Basic principles of Machine-to-Machine communication and its impact on telecommunications industry, pp. 380–385. Proc. MIPRO, Opatija (2011)

    Google Scholar 

  7. Jung, K.-R., Park, A., Lee, S.: Machine-type-communication (MTC) device grouping algorithm for congestion avoidance of MTC oriented LTE network. In: Kim, T.-H., Stoica, A., Chang, R.-S. (eds.) SUComS 2010. CCIS, vol. 78, pp. 167–178. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-16444-6_22

    Chapter  Google Scholar 

  8. Tang, J., Sun, D., Liu, S., et al.: Enabling deep learning on IoT devices. Computer 50(10), 92–96 (2017)

    Article  Google Scholar 

  9. Mahmood, N.H., Lopez, M., Laselva, D., et al.: Reliability oriented dual connectivity for URLLC services in 5G new radio, pp. 1–6. Proc. ISWCS, Lisbon (2018)

    Google Scholar 

  10. 3GPP, “Study on RAN improvements for machine-type communications,” Technical report, TR 37.868 (2012)

    Google Scholar 

  11. Choi, J.: On the adaptive determination of the number of preambles in RACH for MTC. IEEE Commun. Lett. 20(7), 1385–1388 (2016)

    Google Scholar 

  12. Zhao, X., Wang, C., Wang, W.: Dynamic preamble grouping and access control scheme in machine-to-machine communication. In: Proceedings of WCSP, Xi'an, China, pp.1–6 (2019)

    Google Scholar 

  13. Hussain, F., Anpalagan, A., Khwaja, A.S., Naeem, M.: Resource allocation and congestion control in clustered M2M communication using Q-learning. Trans. Emerg. Telecommun. Technol. 28(4), 1–12 (2017)

    Google Scholar 

  14. Hoglund, A., Van, D.P., Tirronen, T., Liberg, O., Sui, Y., Yavuz, E.A.: 3GPP release 15 early data transmission. IEEE Commun. Standards Mag. 2(2), 90–96 (2018)

    Article  Google Scholar 

  15. 3GPP RP-171043. Revision of study on 5G non-orthogonal multiple access, ZTE Corporation

    Google Scholar 

  16. Sony, “Discussions on 2 Steps RACH Procedure,” 3rd Generation Partnership Project(3GPP),TRR1–1700668, January 2017. https://portal.3gpp.org/ngppapp/CreateTdoc.aspx?mode=view&contributionId=755711

  17. Thota, J., Aijaz, A.: On performance evaluation of random access enhancements for 5G uRLLC. In: IEEE Wireless Communications and Networking Conference (WCNC), pp. 1–7. Marrakesh, Morocco (2019)

    Google Scholar 

  18. Raftopoulou, M., Jorguseski, L., Litjens, R.: Design and assessment of low-latency random access procedures in 5G networks. In: European Conference on Networks and Communications (EuCNC), Valencia, Spain, pp. 406–411 (2019)

    Google Scholar 

  19. HUAWEI. Mobile Broadband Review 2014H1[R] (2014)

    Google Scholar 

Download references

Funding

This work was supported by the Science and Technology Project of State Grid Corporation of China under Grant No. SGSDDK00KJJS1900405.

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Yuan, W., Zang, Y., Zhang, L. (2021). Preamble Selection and Allocation Algorithm Based on Q Learning. In: Sun, X., Zhang, X., Xia, Z., Bertino, E. (eds) Artificial Intelligence and Security. ICAIS 2021. Lecture Notes in Computer Science(), vol 12736. Springer, Cham. https://doi.org/10.1007/978-3-030-78609-0_38

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-78609-0_38

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-78608-3

  • Online ISBN: 978-3-030-78609-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics