Yong Hu
ABSTRACT
Orthogonal Frequency Division Multiple Access-based Uplink Random Access (OFDMA-UORA) is a significant media access control mechanism in IEEE 802.11ax. An optimized OFDMA random access back-off (OBO) scheme is proposed to improve the performance of both light and heavy load networks. In the process of uplink random access,multiple users compete for multiple channels at the same time and follow an unknown joint Markov model. Users avoid collisions when competing for channels and maximize the throughput of the entire uplink process. The process can be formulated as a partially observable Markov decision process with unknown system dynamics. To this end, we apply the concepts of reinforcement learning and implement a deep q-network (DQN).Based on the original OBO mechanism, the OFDMA contention window size is dynamically decided via a deep reinforcement learning framework. For the proposed Deep Reinforcement Learning (DRL) solution, we design a discrete action agent that accommodates the contention window size by taking the channel and user state into account, e.g. the number of active users, available resources unit, and retries. Simulation results confirmed the advantages of the proposed scheme in throughput, delay, and access rate. This scheme can therefore be adopted in practical 802.11ax use cases to improve the network performance.
- J. Bai, H. Fang, J. Suh, O. Aboul-Magd, and X. Wang. 2018. Adaptive Uplink OFDMA Random Access Grouping Scheme for Ultra-Dense Networks in IEEE 802.11ax. In 2018 IEEE/CIC International Conference on Communications in China (ICCC).Google Scholar
- Taweh Beysolow Ii. 2019. Introduction to Reinforcement Learning. (2019).Google Scholar
- Ray-Guang Cheng, Chi-Ming Yang, Bariq S. Firmansyah, and Ruki Harwahyu. 2022. Uplink OFDMA-Based Random Access Mechanism With Bursty Arrivals for IEEE 802.11ax Systems. IEEE Networking Letters 4, 1 (2022), 34–38. https://doi.org/10.1109/LNET.2021.3138277Google ScholarCross Ref
- J. Kim, H. Lee, and S. Bahk. 2019. CRUI: Collision Reduction and Utilization Improvement in OFDMA-Based 802.11ax Networks. In GLOBECOM 2019 - 2019 IEEE Global Communications Conference.Google Scholar
- Katarzyna Kosek-Szott and Krzysztof Domino. 2022. An Efficient Backoff Procedure for IEEE 802.11ax Uplink OFDMA-Based Random Access. IEEE Access 10(2022), 8855–8863. https://doi.org/10.1109/ACCESS.2022.3140560Google ScholarCross Ref
- L. Lanante, C. Ghosh, and S. Roy. 2020. Hybrid OFDMA Random Access with Resource Unit Sensing for Next-gen 802.11ax WLANs. IEEE Transactions on Mobile Computing PP, 99 (2020), 1–1.Google Scholar
- M. Nurchis and B. Bellalta. 2019. Target Wake Time: Scheduled Access in IEEE 802.11ax WLANs. Institute of Electrical and Electronics Engineers (IEEE)2 (2019).Google Scholar
- J. Wang, M. Wu, Q. Chen, Y. Zheng, and Y. H. Zhu. 2019. Probability Complementary Transmission Scheme for Uplink OFDMA-based Random Access in 802.11ax WLAN. In 2019 IEEE Wireless Communications and Networking Conference (WCNC).Google ScholarDigital Library
- L. U. Weifeng, G. U. Mengmeng, and L. Yang. 2017. Subcarrier Requirement Analysis for Downlink OFDMA Cellular System. Chinese Journal of Electronics05 (2017), 202–207.Google Scholar
- D. Xie, J. Zhang, A. Tang, and X. Wang. 2020. Multi-Dimensional Busy-Tone Arbitration for OFDMA Random Access in IEEE 802.11ax. IEEE Transactions on Wireless Communications PP, 99(2020), 1–1.Google Scholar
- Annan Yang, Bo Li, Mao Yang, Zhongjiang Yan, and Yi Xie. 2020. Utility optimization of grouping-based uplink OFDMA random access for the next generation WLANs. Wireless Networks10(2020), 1–15.Google Scholar
- ZHENG, Yuan, WANG, Jiabin, CHEN, Qinghua, ZHU, and Yihua. 2020. Retransmission Number Aware Channel Access Scheme for IEEE 802.11ax Based WLAN. Chinese Journal of Electronics v.29, 02 (2020), 157–166.Google Scholar
Index Terms
- Deep Reinforcement Learning for Dynamic OCW in UORA
Recommendations
A channel reservation based cooperative multi-channel MAC protocol for the next generation WLAN
Recently, explosive growth of bandwidth demands has motivated many technological revolutions in the Wireless Local Area Networks (WLANs) such as the IEEE 802.11ax task group, which is established to enhance the throughput performance for the Next ...
Dynamic frequency allocation of femtocells for guaranteed macrocell throughput in OFDMA networks
ICUIMC '12: Proceedings of the 6th International Conference on Ubiquitous Information Management and CommunicationRecently, femtocells have been introduced for indoor coverage extension and higher bandwidth services. However, the frequency allocation problem between the femtocells and the macrocell causes co-channel interference to be treated carefully. In this ...
An OFDMA-based joint reservation and cooperation MAC protocol for the next generation WLAN
The rapidly increasing use of mobile devices and the explosive growth of wireless traffic demands continuously drive the development of wireless networks. IEEE 802.11ax, as the emerging standard for the next generation wireless local area network (WLAN),...
Comments