ABSTRACT
The rapid growth of various Low-Power Wide-Area Network (LPWAN) technologies in the limited spectrum brings forth the challenge of their coexistence. Today, LPWANs are not equipped to handle this impending challenge. It is difficult to employ sophisticated media access control protocol for low-power nodes. Coexistence handling for WiFi or traditional short-range wireless network will not work for LPWANs. Due to long range, their nodes can be subject to an unprecedented number of hidden nodes, requiring highly energy-efficient techniques to handle such coexistence. In this paper, we address the coexistence problem for LoRa, a leading LPWAN technology. To improve the performance of a LoRa network under coexistence with many independent networks, we propose the design of a novel embedded learning agent based on a lightweight reinforcement learning at LoRa nodes. This is done by developing a Q-learning framework while ensuring minimal memory and computation overhead at LoRa nodes. The framework exploits transmission acknowledgments as feedback from the network based on what a node makes transmission decisions. To our knowledge, this is the first Q-learning approach for handling coexistence of low-power networks. Considering various coexistence scenarios of a LoRa network, we evaluate our approach through experiments indoors and outdoors. The outdoor results show that our Q-learning approach on average achieves an improvement of 46% in packet reception rate while reducing energy consumption by 66% in a LoRa network. In indoor experiments, we have observed some coexistence scenarios where a current LoRa network loses all the packets while our approach enables 99% packet reception rate with up to 90% improvement in energy consumption.
- [n.d.]. LG308 Gateway. https://www.dragino.com/products/lora-lorawan-gateway/item/140-lg308.html.Google Scholar
- [n.d.]. The Things Stack. https://www.thethingsindustries.com/stack/.Google Scholar
- LoRa alliance. 2017. LoRaWAN specification. https://lora-alliance.org/resource-hub/lorawanr-specification-v11.Google Scholar
- R. Arroyo-Valles, R. Alaiz-Rodriguez, A. Guerrero-Curieses, and J. Cid-Sueiro. [n.d.]. Q-Probabilistic Routing in Wireless Sensor Networks. In 2007 3rd International Conference on Intelligent Sensors, Sensor Networks and Information.Google Scholar
- Orfanidis Charalampos, Feeney Laura Marie, and Gunningberg Per. [n.d.]. Investigating interference between LoRa and IEEE 802.15. 4g networks. In 2017 IEEE 13th International Conference on Wireless and Mobile Computing, Networking and Communications (WiMob).Google Scholar
- Gonglong Chen, Wei Dong, and Jiamei Lv. [n.d.]. Lofi: Enabling 2.4 ghz lora and wifi coexistence by detecting extremely weak signals. In IEEE INFOCOM 2021-IEEE Conference on Computer Communications.Google Scholar
- cstack 2020. ChirpStack LoRaWAN Network Server. https://www.chirpstack.ioGoogle Scholar
- Sezana Fahmida, Venkata Prashant Modekurthy, Dali Ismail, Aakriti Jain, and Abusayeed Saifullah. 2022. Real-Time Communication over LoRa Networks. In 2022 IEEE/ACM Seventh International Conference on Internet-of-Things Design and Implementation (IoTDI). IEEE, 14–27.Google ScholarCross Ref
- Sezana Fahmida, Venkata P Modekurthy, Mahbubur Rahman, Abusayeed Saifullah, and Marco Brocanelli. 2020. Long-lived LoRa: Prolonging the lifetime of a LoRa network. In 2020 IEEE 28th International Conference on Network Protocols (ICNP). IEEE, 1–12.Google ScholarCross Ref
- A. Galindo-Serrano and L. Giupponi. 2010. Distributed Q-Learning for Aggregated Interference Control in Cognitive Radio Networks. IEEE Transactions on Vehicular Technology (2010).Google Scholar
- gatewayhat 2020. RAK2245 HAT/Pilot Gateway. https://cdn-shop.adafruit.com/product-files/4284/4284_Get_Start_with_RAK2245_Pi_HAT_V2.4R.pdfGoogle Scholar
- O. Georgiou and U. Raza. 2017. Low Power Wide Area Network Analysis: Can LoRa Scale?IEEE Wireless Communications Letters (2017).Google Scholar
- Xu Huang, Jie Jiang, Shuang-Hua Yang, and Yulong Ding. 2020. A Reinforcement Learning Based Medium Access Control Method for LoRa Networks. In 2020 IEEE International Conference on Networking, Sensing and Control (ICNSC).Google ScholarCross Ref
- L. Krupka, L. Vojtech, and M. Neruda. 2016. The issue of LPWAN technology coexistence in IoT environment. In 2016 17th International Conference on Mechatronics - Mechatronika (ME).Google Scholar
- Zhenzhen Liu and I. Elhanany. [n.d.]. RL-MAC: A QoS-Aware Reinforcement Learning based MAC Protocol for Wireless Sensor Networks. In 2006 IEEE International Conference on Networking, Sensing and Control.Google Scholar
- lmic 2020. LMIC 1.6 for RPI GPS/LoRa HAT. https://github.com/wklenk/lmic-rpi-lora-gps-hatGoogle Scholar
- lorahat 2020. Dragino GPS/LoRa HAT. https://www.dragino.com/products/lora/item/106-lora-gps-hat.htmlGoogle Scholar
- [18] LoRaleader2 [n.d.]. https://www.i-scoop.eu/internet-of-things-guide/iot-network-lora-lorawan/.Google Scholar
- LoRaWAN [n.d.]. LoRaWAN. https://www.lora-alliance.org.Google Scholar
- Ziyang Lu, Chen Zhong, and M Cenk Gursoy. [n.d.]. Dynamic channel access and power control in wireless interference networks via multi-agent deep reinforcement learning. IEEE Transactions on Vehicular Technology ([n. d.]).Google Scholar
- Davide Magrin, Marco Centenaro, and Lorenzo Vangelista. [n.d.]. Performance evaluation of LoRa networks in a smart city scenario. In Communications (ICC), 2017 IEEE International Conference On.Google Scholar
- S Marek. 2016. Comcast Will Test LoRaWAN IoT Networks in Two Markets. https://www.sdxcentral.com/articles/news/comcast-will-test-lora-iot-network-two-markets/2016/10/.Google Scholar
- Kais Mekkia, Eddy Bajica, Frederic Chaxela, and Fernand Meyer. 2018. A comparative study of LPWAN technologies for large-scale IoT deployment. In ICT Express.Google Scholar
- Florian Meyer and Volker Turau. [n.d.]. QMA: A Resource-efficient, Q-learning-based Multiple Access Scheme for the IIoT. In 2021 IEEE 41st International Conference on Distributed Computing Systems (ICDCS).Google Scholar
- Konstantin Mikhaylov, Juha Petäjäjärvi, and Janne Janhunen. [n.d.]. On LoRaWAN scalability: Empirical evaluation of susceptibility to inter-network interference. In 2017 European Conference on Networks and Communications (EuCNC).Google Scholar
- ns3 [n.d.]. NS-3. https://www.nsnam.org/.Google Scholar
- Z. Qin, Y. Liu, G. Y. Li, and J. A. McCann. 2017. Modelling and analysis of low-power wide-area networks. In 2017 IEEE International Conference on Communications (ICC).Google ScholarCross Ref
- rpi3 2020. Raspberry Pi 3 B+. https://www.raspberrypi.org/products/raspberry-pi-3-model-b-plus/Google Scholar
- Abusayeed Saifullah, Mahbubur Rahman, Dali Ismail, Chenyang Lu, Jie Liu, and Ranveer Chandra. 2018. Low-Power Wide-Area Networks over White Spaces. ACM/IEEE Transactions on Networking (2018).Google ScholarDigital Library
- semtech [n.d.]. Semtech Sensor Innovation Forum. https://www.semtech.com/company/press/semtech-to-keynote-flexible-easy-to-deploy-iot-solutions-at-the-iot-and-sensor-innovation-forum.Google Scholar
- Semtech. 2019. SX1276 Datasheet. https://semtech.my.salesforce.com/sfc/p/#E0000000JelG/a/2R0000001OKx/JUYM3TvBMenQzU4LS8ZJcM58BIjCcoZcUpHV0gnZ.y0Google Scholar
- Muhammad Osama Shahid, Millan Philipose, Krishna Chintalapudi, Suman Banerjee, and Bhuvana Krishnaswamy. [n.d.]. Concurrent Interference Cancellation: Decoding Multi-Packet Collisions in LoRa. In Proceedings of the 2021 ACM SIGCOMM 2021 Conference.Google Scholar
- R. S. Sutton and A. G Barto. 1998. Reinforcement Learning: An Introduction. The MIT Press.Google ScholarDigital Library
- Andrew Tanenbaum and David Wetherall. 2011. Computer Networks (5th Edition). Prentice Hall. Chapter 4.Google ScholarDigital Library
- Shuai Tong, Zhenqiang Xu, and Jiliang Wang. 2020. CoLoRa: Enabling Multi-Packet Reception in LoRa. In IEEE INFOCOM 2020 - IEEE Conference on Computer Communications. IEEE Press, 2303–2311. https://doi.org/10.1109/INFOCOM41043.2020.9155509Google ScholarDigital Library
- [36] usrp [n.d.]. http://www.ettus.com/product/details/UB210-KIT.Google Scholar
- Thiemo Voigt, Martin Bor, Utz Roedig, and Juan Alonso. [n.d.]. Mitigating Inter-network Interference in LoRa Networks. In Proceedings of the 2017 International Conference on Embedded Wireless Systems and Networks.Google Scholar
- Xiong Wang, Linghe Kong, Liang He, and Guihai Chen. [n.d.]. mLoRa: A Multi-Packet Reception Protocol in LoRa networks. In 2019 IEEE 27th International Conference on Network Protocols (ICNP).Google Scholar
- Xianjin Xia, Yuanqing Zheng, and Tao Gu. 2020. FTrack: Parallel Decoding for LoRa Transmissions. IEEE/ACM Transactions on Networking (2020).Google Scholar
- Zhenqiang Xu, Pengjin Xie, and Jiliang Wang. 2021. Pyramid: Real-Time LoRa Collision Decoding with Peak Tracking. In IEEE INFOCOM 2021 - IEEE Conference on Computer Communications.Google Scholar
- D. Yang, Y. Xu, and M. Gidlund. 2010. Coexistence of IEEE802.15.4 based networks: A survey. In IECON 2010 - 36th Annual Conference on IEEE Industrial Electronics Society.Google Scholar
- Dong Yang, Youzhi Xu, and Mikael Gidlund. 2011. Wireless Coexistence between IEEE 802.11- and IEEE 802.15.4-Based Networks: A Survey. International Journal of Distributed Sensor Networks (2011).Google ScholarCross Ref
- K. L. A. Yau, P. Komisarczuk, and D. T. Paul. 2010. Enhancing network performance in Distributed Cognitive Radio Networks using single-agent and multi-agent Reinforcement Learning. In IEEE Local Computer Network Conference.Google ScholarDigital Library
- Kok-Lim Alvin Yau, Peter Komisarczuk, and Paul D. Teal. [n.d.]. Review: Reinforcement Learning for Context Awareness and Intelligence in Wireless Networks: Review, New Features and Open Issues. J. Netw. Comput. Appl. ([n. d.]).Google Scholar
- F. R. Yu, V. W. S. Wong, and V. C. M. Leung. 2008. A New QoS Provisioning Method for Adaptive Multimedia in Wireless Networks. IEEE Transactions on Vehicular Technology (2008).Google ScholarCross Ref
- Yi Yu, Lina Mroueh, Shuo Li, and Michel Terré. [n.d.]. Multi-Agent Q-Learning Algorithm for Dynamic Power and Rate Allocation in LoRa Networks. In 2020 IEEE International Symposium on Personal, Indoor and Mobile Radio Communications.Google Scholar
- Hailu Zhang, Minghui Min, Liang Xiao, Sicong Liu, Peng Cheng, and Mugen Peng. [n.d.]. Reinforcement learning-based interference control for ultra-dense small cells. In 2018 IEEE Global Communications Conference (GLOBECOM).Google Scholar
Index Terms
- Handling Coexistence of LoRa with Other Networks through Embedded Reinforcement Learning
Recommendations
Embedded federated learning over a LoRa mesh network
AbstractIn on-device training of machine learning models on microcontrollers a neural network is trained on the device. A specific approach for collaborative on-device training is federated learning. In this paper, we propose embedded federated learning ...
SRLoRa: Neural-enhanced LoRa Weak Signal Decoding with Multi-gateway Super Resolution
MobiHoc '23: Proceedings of the Twenty-fourth International Symposium on Theory, Algorithmic Foundations, and Protocol Design for Mobile Networks and Mobile ComputingLoRa and its enabled LoRa wide-area network (LoRaWAN) have been seen as an important part of the next-generation network for massive Internet-of-Things (IoT). Due to LoRa's low-power and long-range nature, LoRa signals are much weaker than the noise ...
SDR-LoRa: dissecting and implementing LoRa on software-defined radios to advance experimental IoT research
WiNTECH '22: Proceedings of the 16th ACM Workshop on Wireless Network Testbeds, Experimental evaluation & CHaracterizationIn this paper, we present SDR-LoRa, a full-fledged SDR implementation of a LoRa transmitter and receiver. First, we reverse-engineer the LoRa physical layer (PHY) functionalities, including the procedures of packet modulation, demodulation, and preamble ...
Comments