research-article

On the Design of Edge-Assisted Mobile IoT Augmented and Mixed Reality Applications

Authors:

Rodolfo W. L. CoutinhoAuthors Info & Claims

Q2SWinet '21: Proceedings of the 17th ACM Symposium on QoS and Security for Wireless and Mobile Networks

Pages 131 - 136

https://doi.org/10.1145/3479242.3487326

Published: 22 November 2021 Publication History

Abstract

Mobile IoT-based augmented and mixed reality (AR/MR) applications are gained increased attention by providing immersive experiences for applications in different domains. In such applications, live video streaming will be processed in a real-time manner for object detection, identification, and tracking, as well as to render virtual overlays on the user's field of view. However, mobile IoT AR/MR applications have a high demand for processing and storage resources that can not be supplied by resource-constrained IoT devices. Hence, edge computing will be fundamental to support mobile IoT AR/MR applications by deploying resources in the proximity of IoT devices. Thus, heavy computation tasks are offloaded to and executed at remote edge servers. In this paper, we discuss the recent solutions designed to enable edge computing for mobile IoT AR/MR applications. We shed light on the limitations of current task offloading approaches designed for edge-assisted IoT applications, and present recent works to support edge-assisted IoT AR/MR applications. We highlight the main challenges and discuss the advantages and limitations of current approaches designed for local and remote object detection in mobile AR/MR applications. Finally, we point out some future research directions in need of further investigation.

References

[1]

Kevin Boos, David Chu, and Eduardo Cuervo. 2016. FlashBack: Immersive Virtual Reality on Mobile Devices via Rendering Memoization. In Proc. of the 14th Annual Int'l Conf. on Mobile Systems, Applications, and Services (MobiSys). 291--304.

Digital Library

[2]

Azzedine Boukerche and Rodolfo W. L. Coutinho. 2018. Smart Disaster Detection and Response System for Smart Cities. In Proc. of the IEEE Symposium on Computers and Communications (ISCC). 01102--01107.

[3]

Kaifei Chen, Tong Li, Hyung-Sin Kim, David E. Culler, and Randy H. Katz. 2018. MARVEL: Enabling Mobile Augmented Reality with Low Energy and Low Latency. In Proceedings of the 16th ACM Conf. on Embedded Networked Sensor Systems (SenSys) . 292--304.

Digital Library

[4]

Rodolfo W. L. Coutinho and Azzedine Boukerche. 2020. Modeling and Analysis of a Shared Edge Caching System for Connected Cars and Industrial IoT-Based Applications. IEEE Transactions on Industrial Informatics, Vol. 16, 3 (2020), 2003--2012.

[5]

Apostolos Galanopoulos, Jose A. Ayala-Romero, Douglas J. Leith, and George Iosifidis. 2021. AutoML for Video Analytics with Edge Computing. In Proc. of the IEEE INFOCOM . 1--10.

[6]

Shichao Guan and Azzedine Boukerche. 2019 a. Design and Implementation of Offloading and Resource Management Techniques in a Mobile Cloud Environment. In Proc. of the 17th ACM Int'l Symposium on Mobility Management and Wireless Access (MobiWac). 97--102.

Digital Library

[7]

Shichao Guan and Azzedine Boukerche. 2019 b. A MEC-based Distributed Offloading Model for Ubiquitous and Time-constraint Offloading. In Proc. of the IEEE/ACM 23rd Int'l Symposium on Distributed Simulation and Real Time Applications (DS-RT) . 1--8.

Digital Library

[8]

Mengxi Hanyao, Yibo Jin, Zhuzhong Qian, Sheng Zhang, and Sanglu Lu. 2021. Edge-assisted Online On-device Object Detection for Real-time Video Analytics. In Proc. of the IEEE INFOCOM. 1--10.

[9]

Jiliang Li, Minghui Dai, and Zhou Su. 2020. Energy-Aware Task Offloading in the Internet of Things. IEEE Wireless Communications, Vol. 27, 5 (2020), 112--117.

[10]

Yangzhe Liao, Liqing Shou, Quan Yu, Qingsong Ai, and Quan Liu. 2020. Joint offloading decision and resource allocation for mobile edge computing enabled networks. Computer Communications, Vol. 154 (2020), 361--369.

[11]

Luyang Liu, Hongyu Li, and Marco Gruteser. 2019. Edge Assisted Real-Time Object Detection for Mobile Augmented Reality. In Proc. of the 25th Annual Int'l Conf. on Mobile Computing and Networking (MobiCom). Article 25, bibinfonumpages16 pages.

Digital Library

[12]

Xiaolan Liu, Jiadong Yu, Zhiyong Feng, and Yue Gao. 2020. Multi-agent reinforcement learning for resource allocation in IoT networks with edge computing. China Communications, Vol. 17, 9 (2020), 220--236.

[13]

Houssemeddine Mazouzi, Nadjib Achir, and Khaled Boussetta. 2019. Elastic Offloading of Multitasking Applications to Mobile Edge Computing. In Proc. of the 22nd Int'l ACM Conf. on Modeling, Analysis and Simulation of Wireless and Mobile Systems (MSWiM). 307--314.

Digital Library

[14]

Mithun Mukherjee et almbox. 2020. Computation Offloading Strategy in Heterogeneous Fog Computing with Energy and Delay Constraints. In Proc. of the IEEE Int'l Conf. on Communications (ICC). 1--5.

[15]

Sung Woon Park, Azzedine Boukerche, and Shichao Guan. 2020. A Novel Deep Reinforcement Learning based service migration model for Mobile Edge Computing. In Proc. of the IEEE/ACM 24th Int'l Symposium on Distributed Simulation and Real Time Applications (DS-RT) . 1--8.

Digital Library

[16]

Christian Quadri, Vincenzo Mancuso, Marco Ajmone Marsan, and Gian Paolo Rossi. 2020. Platooning on the Edge. In Proc. of the 23rd Int'l ACM Conf. on Modeling, Analysis and Simulation of Wireless and Mobile Systems (MSWiM) . 1--10.

Digital Library

[17]

Xukan Ran, Haolianz Chen, Xiaodan Zhu, Zhenming Liu, and Jiasi Chen. 2018. DeepDecision: A Mobile Deep Learning Framework for Edge Video Analytics. In Proc. of the IEEE INFOCOM. 1421--1429.

[18]

Abegaz Mohammed Seid, Gordon Owusu Boateng, Bruce Mareri, Guolin Sun, and Wei Jiang. 2021. Multi-Agent DRL for Task Offloading and Resource Allocation in Multi-UAV Enabled IoT Edge Network. IEEE Transactions on Network and Service Management (2021), 1--1.

[19]

Om-Kolsoom Shahryari, Hossein Pedram, Vahid Khajehvand, and Mehdi Dehghan TakhtFooladi. 2021. Energy and task completion time trade-off for task offloading in fog-enabled IoT networks. Pervasive and Mobile Computing, Vol. 74 (2021), 101395.

[20]

Sintija Stevanoska, Danco Davcev, Elena M. Jovanovska, and Kosta Mitreski. 2020. IoT-Based System for Real-Time Monitoring and Insect Detection in Vineyards. In Proc. of the 18th ACM Symposium on Mobility Management and Wireless Access (MobiWac) . 133--136.

Digital Library

[21]

Peng Sun, Azzedine Boukerche, and Rodolfo W. L. Coutinho. 2019. A Novel Cloudlet-Dwell-Time Estimation Method for Assisting Vehicular Edge Computing Applications. In Proc. of the IEEE Global Communications Conference (GLOBECOM). 1--6.

[22]

Hoa Tran-Dang and Dong-Seong Kim. 2021. FRATO: Fog Resource Based Adaptive Task Offloading for Delay-Minimizing IoT Service Provisioning. IEEE Transactions on Parallel and Distributed Systems, Vol. 32, 10 (2021), 2491--2508.

[23]

Xu Wang, Zheng Yang, Jiahang Wu, Yi Zhao, and Zimu Zhou. 2021. EdgeDuet: Tiling Small Object Detection for Edge Assisted Autonomous Mobile Vision. In Proc. of the IEEE INFOCOM. 1--10.

[24]

Quan Yuan, Jinglin Li, Haibo Zhou, Tao Lin, Guiyang Luo, and Xuemin Shen. 2020. A Joint Service Migration and Mobility Optimization Approach for Vehicular Edge Computing. IEEE Transactions on Vehicular Technology, Vol. 69, 8 (2020), 9041--9052.

[25]

Wenxiao Zhang, Bo Han, and Pan Hui. 2017. On the Networking Challenges of Mobile Augmented Reality. In Proc. of the Workshop on Virtual Reality and Augmented Reality Network (VR/AR Network) . 24--29.

Digital Library

[26]

Mingxiong Zhao, Jun-Jie Yu, Wen-Tao Li, Di Liu, Shaowen Yao, Wei Feng, Changyang She, and Tony Q. S. Quek. 2021. Energy-Aware Task Offloading and Resource Allocation for Time-Sensitive Services in Mobile Edge Computing Systems. IEEE Transactions on Vehicular Technology (2021), 1--16.

Cited By

Qian WCoutinho R(2025)Load-Aware Orchestrator for Edge-Computing-Aided Wireless Augmented RealityIEEE Internet of Things Journal10.1109/JIOT.2024.349453312:6(6595-6606)Online publication date: 15-Mar-2025
https://doi.org/10.1109/JIOT.2024.3494533
Aminiyeganeh KCoutinho RBoukerche A(2024)IoT video analytics for surveillance-based systems in smart citiesComputer Communications10.1016/j.comcom.2024.05.021224(95-105)Online publication date: Aug-2024
https://doi.org/10.1016/j.comcom.2024.05.021
Shahrbabaki PCoutinho RShayan Y(2024)SDN-LBAd Hoc Networks10.1016/j.adhoc.2024.103398155:COnline publication date: 17-Apr-2024
https://dl.acm.org/doi/10.1016/j.adhoc.2024.103398
Show More Cited By

Index Terms

On the Design of Edge-Assisted Mobile IoT Augmented and Mixed Reality Applications

Recommendations

5G edge enhanced mobile augmented reality
MobiCom '20: Proceedings of the 26th Annual International Conference on Mobile Computing and Networking

Mobile Augmented Reality (MAR) provides a unique experience where the physical world is augmented with virtual annotations. MAR involves computation-heavy algorithms that could potentially be offloaded to edge servers on 5G networks, which significantly ...
Immersive Interconnected Virtual and Augmented Reality: A 5G and IoT Perspective
Abstract
Despite remarkable advances, current augmented and virtual reality (AR/VR) applications are a largely individual and local experience. Interconnected AR/VR, where participants can virtually interact across vast distances, remains a distant dream. ...
Performance Evaluation of Edge Computing-Aided IoT Augmented Reality Systems
Q2SWinet '22: Proceedings of the 18th ACM International Symposium on QoS and Security for Wireless and Mobile Networks

Envisioned mobile augmented reality (MAR) ushers a new plethora of smart applications. However, the resource-constrained nature of head-mounted devices (HMDs) has limited the development of MAR systems. In this regard, edge computing has emerged as a ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

Q2SWinet '21: Proceedings of the 17th ACM Symposium on QoS and Security for Wireless and Mobile Networks

November 2021

143 pages

ISBN:9781450390804

DOI:10.1145/3479242

General Chair:
Periklis Chatzimisios
International Hellenic University, Greece
,
Program Chairs:
Rodolfo W. L. Coutinho
Concordia University, Canada
,
Mirela Notare
University of Technology in Fly Transportation, Brazil

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGSIM: ACM Special Interest Group on Simulation and Modeling

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 November 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

MSWiM '21

Sponsor:

SIGSIM

MSWiM '21: 24th ACM International Conference on Modeling, Analysis and Simulation of Wireless and Mobile Systems

November 22 - 26, 2021

Alicante, Spain

Acceptance Rates

Overall Acceptance Rate 46 of 131 submissions, 35%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
238
Total Downloads

Downloads (Last 12 months)23
Downloads (Last 6 weeks)0

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Qian WCoutinho R(2025)Load-Aware Orchestrator for Edge-Computing-Aided Wireless Augmented RealityIEEE Internet of Things Journal10.1109/JIOT.2024.349453312:6(6595-6606)Online publication date: 15-Mar-2025
https://doi.org/10.1109/JIOT.2024.3494533
Aminiyeganeh KCoutinho RBoukerche A(2024)IoT video analytics for surveillance-based systems in smart citiesComputer Communications10.1016/j.comcom.2024.05.021224(95-105)Online publication date: Aug-2024
https://doi.org/10.1016/j.comcom.2024.05.021
Shahrbabaki PCoutinho RShayan Y(2024)SDN-LBAd Hoc Networks10.1016/j.adhoc.2024.103398155:COnline publication date: 17-Apr-2024
https://dl.acm.org/doi/10.1016/j.adhoc.2024.103398
Qian WCoutinho R(2023)A Reinforcement Learning-based Orchestrator for Edge Computing Resource Allocation in Mobile Augmented Reality Systems2023 IEEE 34th Annual International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC)10.1109/PIMRC56721.2023.10293868(1-6)Online publication date: 5-Sep-2023
https://doi.org/10.1109/PIMRC56721.2023.10293868
Coutinho RBoukerche A(2023)Modeling and Performance Evaluation of Collaborative IoT Cross-Camera Video AnalyticsICC 2023 - IEEE International Conference on Communications10.1109/ICC45041.2023.10279068(1804-1809)Online publication date: 28-May-2023
https://doi.org/10.1109/ICC45041.2023.10279068
Coutinho RBoukerche A(2022)UAV-Mounted Cloudlet Systems for Emergency Response in Industrial AreasIEEE Transactions on Industrial Informatics10.1109/TII.2022.317411318:11(8007-8016)Online publication date: Nov-2022
https://doi.org/10.1109/TII.2022.3174113
Shahrbabaki PL. Coutinho RShayan Y(2022)A Novel SDN-enabled Edge Computing Load Balancing Scheme for IoT Video AnalyticsGLOBECOM 2022 - 2022 IEEE Global Communications Conference10.1109/GLOBECOM48099.2022.10000605(5025-5030)Online publication date: 4-Dec-2022
https://doi.org/10.1109/GLOBECOM48099.2022.10000605
Lin PWu WYang J(2021)A QR Code-Based Approach to Differentiating the Display of Augmented Reality ContentApplied Sciences10.3390/app11241180111:24(11801)Online publication date: 12-Dec-2021
https://doi.org/10.3390/app112411801

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten