RCIF: Toward Robust Distributed DNN Collaborative Inference Under Highly Lossy IoT Networks | IEEE Journals & Magazine | IEEE Xplore

RCIF: Toward Robust Distributed DNN Collaborative Inference Under Highly Lossy IoT Networks


Abstract:

With the rapid growth of the number of devices generating and collecting data, there has been a surge in the large-scale emergence of artificial intelligence (AI) applica...Show More

Abstract:

With the rapid growth of the number of devices generating and collecting data, there has been a surge in the large-scale emergence of artificial intelligence (AI) applications predicated on Internet of Things (IoT) networks and terminals. Collaborative inference is a prospective paradigm for accelerating deep neural network (DNN) inference by harnessing the computational resources of multiple IoT devices. However, in highly lossy network environments, such as those encountered in wireless communication systems, the transmission loss of intermediate feature maps between devices can result in significant degradation of co-inference accuracy. In this article, we first conduct a comprehensive investigation into the impact of intermediate feature map loss in real-world wireless scenarios and provide an in-depth analysis of loss patterns under UDP transmission. Motivated by these observations, we introduce robust co-inference framework (RCIF), a novel framework that employs a hierarchical mask strategy to selectively drop activations at two different scales of feature maps. This approach enhances the robustness of DNN co-inference in the presence of network losses. Our evaluation on a variety of data sets and network architectures demonstrates that RCIF significantly enhances the accuracy and robustness of distributed DNN co-inference under highly lossy network conditions. Specifically, our results show that RCIF can achieve up to a 659% increase in accuracy compared to the original model under particularly poor network conditions.
Published in: IEEE Internet of Things Journal ( Volume: 11, Issue: 15, 01 August 2024)
Page(s): 25939 - 25949
Date of Publication: 17 April 2024

ISSN Information:

Funding Agency:


Contact IEEE to Subscribe

References

References is not available for this document.