skip to main content
10.1145/3576842.3582383acmconferencesArticle/Chapter ViewAbstractPublication PagesiotdiConference Proceedingsconference-collections
research-article

Handling Coexistence of LoRa with Other Networks through Embedded Reinforcement Learning

Published: 09 May 2023 Publication History

Abstract

The rapid growth of various Low-Power Wide-Area Network (LPWAN) technologies in the limited spectrum brings forth the challenge of their coexistence. Today, LPWANs are not equipped to handle this impending challenge. It is difficult to employ sophisticated media access control protocol for low-power nodes. Coexistence handling for WiFi or traditional short-range wireless network will not work for LPWANs. Due to long range, their nodes can be subject to an unprecedented number of hidden nodes, requiring highly energy-efficient techniques to handle such coexistence. In this paper, we address the coexistence problem for LoRa, a leading LPWAN technology. To improve the performance of a LoRa network under coexistence with many independent networks, we propose the design of a novel embedded learning agent based on a lightweight reinforcement learning at LoRa nodes. This is done by developing a Q-learning framework while ensuring minimal memory and computation overhead at LoRa nodes. The framework exploits transmission acknowledgments as feedback from the network based on what a node makes transmission decisions. To our knowledge, this is the first Q-learning approach for handling coexistence of low-power networks. Considering various coexistence scenarios of a LoRa network, we evaluate our approach through experiments indoors and outdoors. The outdoor results show that our Q-learning approach on average achieves an improvement of 46% in packet reception rate while reducing energy consumption by 66% in a LoRa network. In indoor experiments, we have observed some coexistence scenarios where a current LoRa network loses all the packets while our approach enables 99% packet reception rate with up to 90% improvement in energy consumption.

References

[1]
[n.d.]. LG308 Gateway. https://www.dragino.com/products/lora-lorawan-gateway/item/140-lg308.html.
[2]
[n.d.]. The Things Stack. https://www.thethingsindustries.com/stack/.
[3]
LoRa alliance. 2017. LoRaWAN specification. https://lora-alliance.org/resource-hub/lorawanr-specification-v11.
[4]
R. Arroyo-Valles, R. Alaiz-Rodriguez, A. Guerrero-Curieses, and J. Cid-Sueiro. [n.d.]. Q-Probabilistic Routing in Wireless Sensor Networks. In 2007 3rd International Conference on Intelligent Sensors, Sensor Networks and Information.
[5]
Orfanidis Charalampos, Feeney Laura Marie, and Gunningberg Per. [n.d.]. Investigating interference between LoRa and IEEE 802.15. 4g networks. In 2017 IEEE 13th International Conference on Wireless and Mobile Computing, Networking and Communications (WiMob).
[6]
Gonglong Chen, Wei Dong, and Jiamei Lv. [n.d.]. Lofi: Enabling 2.4 ghz lora and wifi coexistence by detecting extremely weak signals. In IEEE INFOCOM 2021-IEEE Conference on Computer Communications.
[7]
cstack 2020. ChirpStack LoRaWAN Network Server. https://www.chirpstack.io
[8]
Sezana Fahmida, Venkata Prashant Modekurthy, Dali Ismail, Aakriti Jain, and Abusayeed Saifullah. 2022. Real-Time Communication over LoRa Networks. In 2022 IEEE/ACM Seventh International Conference on Internet-of-Things Design and Implementation (IoTDI). IEEE, 14–27.
[9]
Sezana Fahmida, Venkata P Modekurthy, Mahbubur Rahman, Abusayeed Saifullah, and Marco Brocanelli. 2020. Long-lived LoRa: Prolonging the lifetime of a LoRa network. In 2020 IEEE 28th International Conference on Network Protocols (ICNP). IEEE, 1–12.
[10]
A. Galindo-Serrano and L. Giupponi. 2010. Distributed Q-Learning for Aggregated Interference Control in Cognitive Radio Networks. IEEE Transactions on Vehicular Technology (2010).
[11]
gatewayhat 2020. RAK2245 HAT/Pilot Gateway. https://cdn-shop.adafruit.com/product-files/4284/4284_Get_Start_with_RAK2245_Pi_HAT_V2.4R.pdf
[12]
O. Georgiou and U. Raza. 2017. Low Power Wide Area Network Analysis: Can LoRa Scale?IEEE Wireless Communications Letters (2017).
[13]
Xu Huang, Jie Jiang, Shuang-Hua Yang, and Yulong Ding. 2020. A Reinforcement Learning Based Medium Access Control Method for LoRa Networks. In 2020 IEEE International Conference on Networking, Sensing and Control (ICNSC).
[14]
L. Krupka, L. Vojtech, and M. Neruda. 2016. The issue of LPWAN technology coexistence in IoT environment. In 2016 17th International Conference on Mechatronics - Mechatronika (ME).
[15]
Zhenzhen Liu and I. Elhanany. [n.d.]. RL-MAC: A QoS-Aware Reinforcement Learning based MAC Protocol for Wireless Sensor Networks. In 2006 IEEE International Conference on Networking, Sensing and Control.
[16]
lmic 2020. LMIC 1.6 for RPI GPS/LoRa HAT. https://github.com/wklenk/lmic-rpi-lora-gps-hat
[17]
lorahat 2020. Dragino GPS/LoRa HAT. https://www.dragino.com/products/lora/item/106-lora-gps-hat.html
[18]
[18] LoRaleader2 [n.d.]. https://www.i-scoop.eu/internet-of-things-guide/iot-network-lora-lorawan/.
[19]
LoRaWAN [n.d.]. LoRaWAN. https://www.lora-alliance.org.
[20]
Ziyang Lu, Chen Zhong, and M Cenk Gursoy. [n.d.]. Dynamic channel access and power control in wireless interference networks via multi-agent deep reinforcement learning. IEEE Transactions on Vehicular Technology ([n. d.]).
[21]
Davide Magrin, Marco Centenaro, and Lorenzo Vangelista. [n.d.]. Performance evaluation of LoRa networks in a smart city scenario. In Communications (ICC), 2017 IEEE International Conference On.
[22]
S Marek. 2016. Comcast Will Test LoRaWAN IoT Networks in Two Markets. https://www.sdxcentral.com/articles/news/comcast-will-test-lora-iot-network-two-markets/2016/10/.
[23]
Kais Mekkia, Eddy Bajica, Frederic Chaxela, and Fernand Meyer. 2018. A comparative study of LPWAN technologies for large-scale IoT deployment. In ICT Express.
[24]
Florian Meyer and Volker Turau. [n.d.]. QMA: A Resource-efficient, Q-learning-based Multiple Access Scheme for the IIoT. In 2021 IEEE 41st International Conference on Distributed Computing Systems (ICDCS).
[25]
Konstantin Mikhaylov, Juha Petäjäjärvi, and Janne Janhunen. [n.d.]. On LoRaWAN scalability: Empirical evaluation of susceptibility to inter-network interference. In 2017 European Conference on Networks and Communications (EuCNC).
[26]
ns3 [n.d.]. NS-3. https://www.nsnam.org/.
[27]
Z. Qin, Y. Liu, G. Y. Li, and J. A. McCann. 2017. Modelling and analysis of low-power wide-area networks. In 2017 IEEE International Conference on Communications (ICC).
[28]
rpi3 2020. Raspberry Pi 3 B+. https://www.raspberrypi.org/products/raspberry-pi-3-model-b-plus/
[29]
Abusayeed Saifullah, Mahbubur Rahman, Dali Ismail, Chenyang Lu, Jie Liu, and Ranveer Chandra. 2018. Low-Power Wide-Area Networks over White Spaces. ACM/IEEE Transactions on Networking (2018).
[30]
semtech [n.d.]. Semtech Sensor Innovation Forum. https://www.semtech.com/company/press/semtech-to-keynote-flexible-easy-to-deploy-iot-solutions-at-the-iot-and-sensor-innovation-forum.
[31]
Semtech. 2019. SX1276 Datasheet. https://semtech.my.salesforce.com/sfc/p/#E0000000JelG/a/2R0000001OKx/JUYM3TvBMenQzU4LS8ZJcM58BIjCcoZcUpHV0gnZ.y0
[32]
Muhammad Osama Shahid, Millan Philipose, Krishna Chintalapudi, Suman Banerjee, and Bhuvana Krishnaswamy. [n.d.]. Concurrent Interference Cancellation: Decoding Multi-Packet Collisions in LoRa. In Proceedings of the 2021 ACM SIGCOMM 2021 Conference.
[33]
R. S. Sutton and A. G Barto. 1998. Reinforcement Learning: An Introduction. The MIT Press.
[34]
Andrew Tanenbaum and David Wetherall. 2011. Computer Networks (5th Edition). Prentice Hall. Chapter 4.
[35]
Shuai Tong, Zhenqiang Xu, and Jiliang Wang. 2020. CoLoRa: Enabling Multi-Packet Reception in LoRa. In IEEE INFOCOM 2020 - IEEE Conference on Computer Communications. IEEE Press, 2303–2311. https://doi.org/10.1109/INFOCOM41043.2020.9155509
[36]
[36] usrp [n.d.]. http://www.ettus.com/product/details/UB210-KIT.
[37]
Thiemo Voigt, Martin Bor, Utz Roedig, and Juan Alonso. [n.d.]. Mitigating Inter-network Interference in LoRa Networks. In Proceedings of the 2017 International Conference on Embedded Wireless Systems and Networks.
[38]
Xiong Wang, Linghe Kong, Liang He, and Guihai Chen. [n.d.]. mLoRa: A Multi-Packet Reception Protocol in LoRa networks. In 2019 IEEE 27th International Conference on Network Protocols (ICNP).
[39]
Xianjin Xia, Yuanqing Zheng, and Tao Gu. 2020. FTrack: Parallel Decoding for LoRa Transmissions. IEEE/ACM Transactions on Networking (2020).
[40]
Zhenqiang Xu, Pengjin Xie, and Jiliang Wang. 2021. Pyramid: Real-Time LoRa Collision Decoding with Peak Tracking. In IEEE INFOCOM 2021 - IEEE Conference on Computer Communications.
[41]
D. Yang, Y. Xu, and M. Gidlund. 2010. Coexistence of IEEE802.15.4 based networks: A survey. In IECON 2010 - 36th Annual Conference on IEEE Industrial Electronics Society.
[42]
Dong Yang, Youzhi Xu, and Mikael Gidlund. 2011. Wireless Coexistence between IEEE 802.11- and IEEE 802.15.4-Based Networks: A Survey. International Journal of Distributed Sensor Networks (2011).
[43]
K. L. A. Yau, P. Komisarczuk, and D. T. Paul. 2010. Enhancing network performance in Distributed Cognitive Radio Networks using single-agent and multi-agent Reinforcement Learning. In IEEE Local Computer Network Conference.
[44]
Kok-Lim Alvin Yau, Peter Komisarczuk, and Paul D. Teal. [n.d.]. Review: Reinforcement Learning for Context Awareness and Intelligence in Wireless Networks: Review, New Features and Open Issues. J. Netw. Comput. Appl. ([n. d.]).
[45]
F. R. Yu, V. W. S. Wong, and V. C. M. Leung. 2008. A New QoS Provisioning Method for Adaptive Multimedia in Wireless Networks. IEEE Transactions on Vehicular Technology (2008).
[46]
Yi Yu, Lina Mroueh, Shuo Li, and Michel Terré. [n.d.]. Multi-Agent Q-Learning Algorithm for Dynamic Power and Rate Allocation in LoRa Networks. In 2020 IEEE International Symposium on Personal, Indoor and Mobile Radio Communications.
[47]
Hailu Zhang, Minghui Min, Liang Xiao, Sicong Liu, Peng Cheng, and Mugen Peng. [n.d.]. Reinforcement learning-based interference control for ultra-dense small cells. In 2018 IEEE Global Communications Conference (GLOBECOM).

Cited By

View all
  • (2024)Optimal Routing Protocol in LPWAN Using SWC: A Novel Reinforcement Learning FrameworkIEEE Sensors Journal10.1109/JSEN.2024.337846324:9(15607-15619)Online publication date: 1-May-2024
  • (2024)Handling Jamming Attacks in a LoRa Network2024 IEEE/ACM Ninth International Conference on Internet-of-Things Design and Implementation (IoTDI)10.1109/IoTDI61053.2024.00017(146-157)Online publication date: 13-May-2024
  • (2024)A Battery Lifespan-Aware Protocol for LPWAN2024 IEEE 44th International Conference on Distributed Computing Systems (ICDCS)10.1109/ICDCS60910.2024.00101(1050-1061)Online publication date: 23-Jul-2024

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
IoTDI '23: Proceedings of the 8th ACM/IEEE Conference on Internet of Things Design and Implementation
May 2023
514 pages
ISBN:9798400700378
DOI:10.1145/3576842
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 May 2023

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Internet-of-Things
  2. IoT
  3. LoRa
  4. Low Power Wide-Area Networks
  5. Q-learning
  6. Reinforcement Learning

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

IoTDI '23
Sponsor:

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)54
  • Downloads (Last 6 weeks)4
Reflects downloads up to 14 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Optimal Routing Protocol in LPWAN Using SWC: A Novel Reinforcement Learning FrameworkIEEE Sensors Journal10.1109/JSEN.2024.337846324:9(15607-15619)Online publication date: 1-May-2024
  • (2024)Handling Jamming Attacks in a LoRa Network2024 IEEE/ACM Ninth International Conference on Internet-of-Things Design and Implementation (IoTDI)10.1109/IoTDI61053.2024.00017(146-157)Online publication date: 13-May-2024
  • (2024)A Battery Lifespan-Aware Protocol for LPWAN2024 IEEE 44th International Conference on Distributed Computing Systems (ICDCS)10.1109/ICDCS60910.2024.00101(1050-1061)Online publication date: 23-Jul-2024

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media