Multi-Armed Bandit Based Base Stations Deployment in Millimeter Wave Network
Pages 1126 - 1133
Abstract
Millimeter wave (mmWave) network is indispensable for providing Gbps service in 5G communication system. However, the deployment of base stations (BSs) is more challenging than that of traditional cellular system, due to the irregular coverage and susceptible to environment such as blockage and fading. Aiming at providing a specific solution to this issue, a multi-armed bandit (MAB) based scheme is proposed to determine the best locations of BSs in mmWave system under 3D environment. To combat the random nature caused by fading and blocking in mmWave BSs deployment, the proposed solution trains the MAB agent by interactive with the environment through reward. To guarantee both coverage and capacity of the system, signal to interference plus noise ratio (SINR) is taken into consideration of reward design. Moreover, to deal with the combination explosion problem in the design of the MAB arm which corresponds to the subset of the candidate BSs locations, the candidate BSs are clustered before MAB is employed. To validate the performance of the proposed scheme, simulations are conducted based on data produced by the ray tracing software. The results show that, compared with benchmark scheme, both the system capacity and coverage performance of the proposed method are improved. Moreover, as this method can capture the time-varying behavior of the channel, it finds the optimal BSs locations that maximize long-term performance.
References
[1]
Manuel García Sánchez, “Millimeter-Wave Communications,” Electronics, vol. 9, no. 2, 2020.
[2]
Georgia E. Athanasiadou, Panagiotis Fytampanis, Dimitra A. Zarbouti, George V. Tsoulos, Panagiotis K. Gkonis, and Dimitra I. Kaklamani, “Radio Network Planning towards 5G mmWave Standalone Small-Cell Architectures,” Electronics, vol. 9, no. 2, p. 339, Feb 2020.
[3]
Valavanis, Ioannis, Athanasiadou, Georgia, Zarbouti, Dimitra, and Tsoulos, “Base-Station Location Optimization for LTE Systems with Genetic Algorithms,” 20th European Wireless Conference, 2014.
[4]
Meng H, Long F, and Guo L, “Cooperating base station location optimization using genetic algorithm,” Control and Decision Conference (CCDC). IEEE, 2016, pp. 4820-4824.
[5]
S. Lee, S. Lee, K. Kim, and Y. H. Kim, “Base station placement algorithm for large-scale lte heterogeneous networks,” PloS one, vol. 10, no. 10, p. e0139190, Oct 2015.
[6]
N. Palizban, S. Szyszkowicz, and H. Yanikomeroglu, “Automation of millimeter wave network planning for outdoor coverage in dense urban areas using wall-mounted base stations,” IEEE Wireless Commun. Lett., vol. 6, no. 2, pp. 206–209, Apr 2017.
[7]
M. J. Abdel-Rahman, F. Al-Ogaili, M. A. Kishk, A. B. Mackenzie, P. C. Sofotasios, S. Muhaidat, and A. Nabil, “DBmmWave: Chance-constrained joint AP deployment and beam steering in mmWave networks with coverage probability constraints,” IEEE Netw. Lett., vol. 1, no. 4, pp. 151–155, Dec 2019.
[8]
F. Erden, C. K. Anjinappa, E. Ozturk, and I. Guvenc, “Outdoor mmWave base station placement: A multi-armed bandit learning approach,” 2020. [Online]. Available: arXiv:2003.03494.
[9]
M. R. Akdeniz, Y. Liu, M. K. Samimi, S. Sun, S. Rangan, and E. Erkip, “Millimeter wave channel modeling and cellular capacity evaluation,” IEEE Journal on Selected Areas in Communications, vol. 32, no. 6, pp. 1164–1179, 2014.
[10]
Dong M, Kim T, Cho M, Lee K, and Yoon S. Link, “Quality-Guaranteed Minimum-Cost Millimeter-Wave Base Station Deployment,” IEEE Transactions on Wireless Communications, 2021.
[11]
W. Chen, Y. Wang, and Y. Yuan, “Combinatorial multi-armed bandit: General framework and applications,” in Proc. Int. Conf. Mach. Learn., 2013, pp. 151–159.
[12]
I. Aykin, B. Akgun, M. Feng, and M. Krunz, “MAMBA: A multi-armed bandit framework for beam tracking in millimeter-wave systems,” in Proc. IEEE INFOCOM, pp. 1469–1478, Jul 2020.
[13]
M. B. Booth, V. Suresh, N. Michelusi, and D. J. Love, “Multi-armed bandit beam alignment and tracking for mobile millimeter wave communications,” IEEE Commun. Lett., vol. 23, no. 7, pp. 1244–1248, Jul 2019.
[14]
Orly Avner and Shie Mannor, “Multi-user lax communications: a multi-armed bandit approach.” In IEEE INFOCOM 2016-The 35th Annual IEEE International Conference on Computer Communications, 2016, pp. 1-9.
[15]
Gupta, Manoj, Chandra, and Pravin, “MP-K-Means: Modified Partition Based Cluster Initialization Method for K-Means Algorithm.” International Journal of Recent Technology and Engineering, vol. 8, pp. 1140-1148, 2019.
[16]
Sébastien Bubeck, Nicolo Cesa-Bianchi, “Regret analysis of stochastic and nonstochastic multi-armed bandit problems.” Foundations and Trends in Machine Learning, 5(1):1–122, 2012.
[17]
L. Simic, J. Riihijärvi, A. Venkatesh, and P. Mahoonen, “Demo abstract: An open source toolchain for planning and visualizing highly directional mm-wave cellular networks in the 5G era,” 2017 IEEE Conference on Computer Communications Workshops, 2017, pp. 966-967.
Index Terms
- Multi-Armed Bandit Based Base Stations Deployment in Millimeter Wave Network
Recommendations
Multi-armed bandit problem with known trend
We consider a variant of the multi-armed bandit model, which we call multi-armed bandit problem with known trend, where the gambler knows the shape of the reward function of each arm but not its distribution. This new problem is motivated by different ...
Multi-armed Bandit with Additional Observations
SIGMETRICS '18We study multi-armed bandit (MAB) problems with additional observations, where in each round, the decision maker selects an arm to play and can also observe rewards of additional arms (within a given budget) by paying certain costs. We propose ...
Multi-armed Bandit with Additional Observations
We study multi-armed bandit (MAB) problems with additional observations, where in each round, the decision maker selects an arm to play and can also observe rewards of additional arms (within a given budget) by paying certain costs. In the case of ...
Comments
Information & Contributors
Information
Published In
September 2022
1221 pages
ISBN:9781450396899
DOI:10.1145/3573942
Copyright © 2022 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 16 May 2023
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Funding Sources
- Key Project of Natural Science Foundation of Shaanxi Province
- Key Industrial Chain Project of Shaanxi Province
- the National Natural Science Foundation of China
Conference
AIPR 2022
AIPR 2022: 2022 5th International Conference on Artificial Intelligence and Pattern Recognition
September 23 - 25, 2022
Xiamen, China
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 34Total Downloads
- Downloads (Last 12 months)6
- Downloads (Last 6 weeks)2
Reflects downloads up to 01 Mar 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format