Edge caching and computing in 5G for mobile augmented reality and haptic internet

doi:10.1016/j.comcom.2020.04.054

Computer Communications

Volume 158, 15 May 2020, Pages 24-31

https://doi.org/10.1016/j.comcom.2020.04.054 Get rights and content

Abstract

Deploying cache and computing resources in 5G mobile communication networks is considered an important way to reduce network transmission delay and redundant content transmission, improve content distribution efficiency and network computing processing capabilities. Through the construction of 5G user experience models for mobile augmented reality and tactile internet, the subjective expected experience of 5G users in mobile augmented reality applications is investigated. Based on the experimental results, the composition of mobile augmented reality, and the factors that affect 5G user, mobile 5G user experience model for augmented reality is as a design goal for mobile augmented reality. And research on mobile edge cloud computing powered by renewable energy. Based on the analysis of renewable energy, a 5G user computing task delay and power grid power consumption minimization model was established. It is decomposed into two sub-problems of computational resource allocation and task placement using alternating optimization. The sub-problems of computing tasks under renewable energy supply are obtained by solving the sub-problems. The experimental results show that the offload mode proposed in this paper is superior to the other two modes when the processing ratio before and after the task is less than 1, and the user contact frequency is greater than 0.0014. At the same time, it is obtained that the service node with higher mobility and larger computing power is allocated. The more workload, the more energy can be reduced in the network, thereby improving the performance of the system.

Introduction

Augmented reality technology integrates computer-generated virtual information (including visual information, auditory information and tactile information, etc.) into the real world, and complements the real world, making virtual information become a part of the surrounding real world from the senses [1], [2]. The haptic Internet is a communication method for transmitting haptic data, and realizes higher-level remote communication with each other by transmitting haptics [3], [4]. In the past, audio and video could not achieve haptic effects like meeting handshake. Mobile edge caching and computing based on mobile augmented reality and haptic Internet as two important challenges and opportunities for the development of 5G networks. Making full use of heterogeneous and diverse storage computing resources, 5G user mobility and dynamic renewable energy supply to improve cache and computing services and reduce network energy consumption has theoretical and practical significance.

The immersive displays of tactile internet and augmented reality are divided into the following categories: head-mounted display, projection display, handheld display and ordinary display. Because the helmet display mode can limit the operator’s field of vision to the range of interest, it is more immersive than other methods, and it is the most widely used display mode [5], [6], [7], [8]. Literature [9], [10], [11] Developed a set of realistic graphic prediction display systems, using wireframe and solid robot graphic models to represent real robots at the far end, while introducing camera calibration technology, superimposing virtual robot models on video images transmitted from the far end In the above, it is expected to compensate the delay of the teleoperation system and improve the operability by operating the virtual robot. Reference [12], [13], [14], [15] superimposed the wireframe model of the robot on the stereo video image. Without modeling the environment, the remote control robot completed a simple grab and place operation on the object, and realized stereoscopic visual feedback of augmented reality. Its remote robot control uses direct control, which has great limitations when completing complex tasks. Mobile edge caching enables 5G users to obtain requested content from small cells or other devices, enabling local availability of content without the need to obtain content from content service providers through mobile core networks and cable networks [16], [17], [18], thereby Reducing the imbalance between wireless demand capacity and available capacity [19], alleviating the backhaul bottleneck of 5G networks, improving latency guarantees, and reducing network energy consumption. Edge caching generally includes two steps, content placement and delivery. Content placement includes determining the cached content, the location of the cache, and how to download the content to the cache node. Content delivery refers to how the content is delivered to the requesting 5G user. is an important feature of edge caching [20], [21], [22]. It mainly introduces the description of the mobility of 5G users from the perspectives of space and time. The spatial angle refers to the physical location information related to the 5G user’s mobile model, and the temporal angle refers to the time information related to the 5G user’s mobile model. However, due to the large amount of delays in the end-to-end transmission of computing tasks and limited spectrum resources, the throughput of wireless access networks is insufficient, so mobile cloud computing services have become more difficult to deploy and maintain [23], [24], [25]. Through real experiments, how to calculate the offloading strategy based on real-time bandwidth and minimize the terminal energy consumption is given [26]. An environment-aware computing task offloading strategy is presented, that is, whether to offload based on real-time communication status. For parallel task offloading on mobile devices [27], a type of heuristic offloading mechanism is designed to minimize the delay of 5G user tasks. For the cloud computing under the cellular network [28], the interaction between offloading decision of mobile cloud computing and wireless resource management in wireless heterogeneous networks was first discussed. Under this architecture, mobile 5G users can enjoy high-quality cloud services, and do not consider the lack of spectrum resources. Although there have been many researches on key technologies of cache and computing in SG mobile communication networks, there are still many research challenges to be solved. Among them, the core network cache resource allocation mechanism, edge network content cache and cooperative distribution mechanism, and edge network computing offload mechanism are three important research topics that SG mobile communication networks face after introducing cache and computing resources.

This article focuses on 5G caching and computing for mobile augmented reality and haptic Internet. Firstly, understand the 5G user experience in mobile augmented reality through experiments, and conduct an overall analysis of the experimental results. Based on the composition of mobile augmented reality of 5G user experience, build a 5G user experience model for mobile augmented reality. Based on the analysis of renewable energy, an optimization model with minimum task delay and grid energy consumption was established, and it was decomposed into two sub-problems using alternating optimization: the placement of computing tasks (the computing tasks are offloaded to the edge cloud deployed in small cells) , Or offload to the edge cloud deployed on the macro base station) and the allocation of computing resources (for computing tasks offloaded to the edge cloud, how does the edge cloud allocate computing resources to computing tasks). By solving the sub-problems, the offloading strategy of computing tasks under the power of renewable energy is obtained. Finally, the experimental results show that the offload mode proposed in this paper is superior to the other two modes when the processing ratio before and after the task is less than 1, and the user contact frequency is greater than 0.0014. At the same time, it is given to service nodes with high mobility and large computing power. The more work is distributed the more energy can be reduced in the network, thereby improving the performance of the system.

Section snippets

Construction of 5G user experience model for mobile augmented reality and haptic internet

First, classify 5G user in mobile augmented reality and haptic Internet; then, analyze the impact of the components of mobile augmented reality on the formation of 5G user experience; finally, combine the impact of the use environment on mobile augmented reality 5G user experience to build mobile Augmented reality 5G user experience model. The main purpose of building a mobile augmented reality 5G user experience model is to explain the relationship between the components of mobile augmented

Research on efficient cache resource allocation mechanism in 5G core network

The content cache energy cost is mainly due to the energy consumption caused by content cache and content update. Therefore, a model of energy consumption proportion was established, that is, $E_{c a c h e} = \sum_{k = 1}^{M} \sum_{i = 1}^{N} α τ_{i k} y_{x, k} v_{i k} T$

Among them, $α$ represents the energy consumption value of the content cache or content update of the unit cache capacity; $v_{i k}$ represents the number of content updates (or the content update frequency) within the unit time T. In particular, in order to avoid overload of the cache

Results and discussion

Set the number of times the two nodes meet in a unit time from 0.00004 to 0.00032, set the summary point M of the cell to 300 to 3000, and set P to 0.001 to give an experimental analysis.

In Fig. 5a, set M to 500, set n to 10, set $λ$ to 0.0001, and change the values of N to 30, 35, 40, and 45 respectively. It can be concluded from Fig. 5a that the effect of N on $S_{i} (t)$ is not obvious. This is because under the premise of clonable tasks, each service node may be transformed into a task node, so N

Conclusion

From the perspective of user perception, this article analyzes in detail the factors that affect user perception in mobile augmented reality. Based on the design method of user experience in interactive information services, a 5G user experience model of mobile augmented reality and tactile Internet is constructed. A novel offloading model of computing tasks is proposed and its offloading strategy is analyzed. A mobile ad hoc micro-cloud computing model based on opportunism is proposed. The

CRediT authorship contribution statement

Yuan Cheng: Formal analysis.

Declaration of Competing Interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Acknowledgment

This paper supported by the 2019 Scientific research fund project in Yunnan province department of education, China : The protection and inheritance of Nixi black pottery based on AR technology (Project number: 2019J0056).

Yuan Cheng was born in Xi’an, China, In 1981. from 2000 to 2004, He studied in Shaanxi university of science and technology and received his bachelor’s degree in 2004. From 2004 to 2007, He studied in Shaanxi university of science and technology and received his master’s degree in 2007. Currently, He works in Kunming university of science and technology. He has published twenty papers, One of which has been indexed by SCI. His research interests are included industrial design and VR technology.

References (28)

HuangTa-Ko et al.
Augmented reality (AR) and virtual reality (VR) applied in dentistry
Kaohsiung J. Med. Sci.
(2018)
RenJinke et al.
An edge-computing based architecture for mobile augmented reality
IEEE Netw.
(2019)
AhnJaewon et al.
Power efficient clustering scheme for 5G mobile edge computing environment
Mob. Netw. Appl.
(2018)
MajewskiMaciej et al.
Conceptual design of innovative speech interfaces with augmented reality and interactive systems for controlling loader cranes
Adv. Intell. Syst. Comput.
(2016)
KimY. et al.
Virtual reality and augmented reality in plastic surgery: A review
Arch. Plast. Surg.
(2017)
AhnEuijai et al.
Real-time adjustment of contrast saliency for improved information visibility in mobile augmented reality
Virtual Real.
(2017)
LeeL.S.A. et al.
Integrating interactive multimedia objects in mobile augmented reality for sarawak tourism
Adv. Sci. Lett.
(2018)
ShanbariHamzah et al.
Using augmented reality video in enhancing masonry and roof component comprehension for construction management students
Eng. Constr. Archit. Manage.
(2016)
CancianiM. et al.
3D survey and augmented reality for cultural heritage. The case study of aurelian wall at castra praetoria in Rome
ISPRS - Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci.
(2016)
BosPhilip J. et al.
28-2: Invited paper : Simple method to reduce accommodation fatigue in virtual reality and augmented reality displays
Proc. Soc. Inf. Disp.
(2016)

OkumuraH. et al.

Investigating integration between auditory and visual location information presented in an augmented-reality device

J. Acoust. Soc. Am.

(2016)

BingLi et al.

An MEC and NFV integrated network architecture

ZTE Commun.

(2017)

MarkakisEvangelos K. et al.

Computing, caching, and communication at the edge: The cornerstone for building a versatile 5G ecosystem

IEEE Commun. Mag.

(2017)

CulbertsonHeather et al.

Ungrounded haptic augmented reality system for displaying roughness and friction

IEEE/ASME Trans. Mechatronics

(2017)

Cited by (23)

Stochastic buffer-and-server-aided relay-assisted mobile edge computing in time-slotted systems
2022, Computer Communications
Citation Excerpt :
Consequently, the network providers have encountered new challenges to address the task computation requests from these devices in a timely manner. In this regard, Mobile Edge Computing (MEC) has emerged as a new approach to reduce the Average Response Time (ART) for the requested tasks by the IoT Devices (IoTDs) and other resource-constrained mobile stations [4–7]. In MEC, different components of the wireless networks are empowered with computing resources, which enable them to process the requested tasks by their own servers.
Mobile Edge Computing (MEC) has attracted significant research efforts in the recent years. However, these works consider mostly the computation resources located at the cloud centers and wireless access nodes, ignoring the possibility of utilizing server-empowered relays to improve the performance. In this paper, we study stochastic relay-assisted MEC in systems with discrete transmission time-line and block fading wireless channels. In order to clearly identify and inspect the fundamental affecting factors, we investigate the building block of this architecture, namely a hierarchical network consisting of a source, a buffer-and-server-aided relay and another higher-level computing node. We provide a framework to take into account the effects of the fading channels, the task arrival dynamics as well as the queuing delays in both the transmission and computation buffers, which facilitates the derivation of the expression for the Average Response Time (ART). Based on that and the system average power consumption in each slot, we introduce the concept of Average Response Energy (ARE) as a novel metric to capture the energy efficiency in MEC while considering the stochastic nature of the system parameters. Accordingly, we propose two offloading schemes with their respective problem formulations, namely the Minimum ART (MART) and the Minimum ARE (MARE) schemes, to optimize the transmission power and task assignment probability while keeping the system queues stable. We demonstrate the difference of the formulated problems with the relevant problem in a recent work, analyze the properties of the problems and noting them, we propose effective solution methods. Using extensive simulations, we validate the presented analysis and show the effectiveness of the proposed schemes in comparison with various baseline methods adapting existing approaches. Moreover, we provide essential insights on the performance of the proposed schemes in terms of the average delay and power consumption in the different scenarios.
Multimedia services placement algorithm for cloud–fog hierarchical environments
2022, Computer Communications
Citation Excerpt :
By the way, even with the improvements in wireless technologies offered by the 5G, reliable, high-quality video delivery still poses several challenges, such as dealing with a large number of heterogeneous devices and meeting the increasing requirements of users. To overcome these and other problems, it is desirable to use a distributed architecture that stores and processes services logically between the Cloud and the data source [10]. FG and Edge Computing (EC) present themselves as a joint solution to meet these latency-sensitive services, where the management of all resources occurs in a coordinated and tiered manner, from the Cloud to the end devices.
With the rapid development of mobile communication, multimedia services have experienced explosive growth in the last few years. The high quantity of mobile users, both consuming and producing these services to and from the Cloud Computing (CC), can outpace the available bandwidth capacity. Fog Computing (FG) presents itself as a solution to improve on this and other issues. With a reduction in network latency, real-time applications benefit from improved response time and greater overall user experience. Taking this into account, the main goal of this work is threefold. Firstly, it is proposed a method to build an environment based on Cloud–Fog Computing (CFC). Secondly, it is designed two models based on Autoregressive Integrated Moving Average (ARIMA) and Long Short-Term Memory (LSTM). The goal is to predict demand and reserve the nodes’ storage capacity to improve the positioning of multimedia services. Later, an algorithm for the multimedia service placement problem which is aware of data traffic prediction is proposed. The goal is to select the minimum number of nodes, considering their hardware capacities for providing multimedia services in such a way that the latency for servicing all the demands is minimized. An evaluation with actual data showed that the proposed algorithm selects the nodes closer to the user to meet their demands. This improves the services delivered to end-users and enhances the deployed network to mitigate provider costs. Moreover, reduce the demand to Cloud allowing turning off servers in the data center not to waste energy.
AR-Assisted Children Book For Smart Teaching And Learning Of Turkish Alphabets
2022, Virtual Reality and Intelligent Hardware
Augmented reality (AR), virtual reality (VR), and remote-controlled devices are driving the need for a better 5G infrastructure to support faster data transmission. In this study, mobile AR is emphasized as a viable and widespread solution that can be easily scaled to millions of end-users and educators because it is lightweight and low-cost and can be implemented in a cross-platform manner. Low-efficiency smart devices and high latencies for real-time interactions via regular mobile networks are primary barriers to the use of AR in education. New 5G cellular networks can mitigate some of these issues via network slicing, device-to-device communication, and mobile edge computing.
In this study, we use a new technology to solve some of these problems. The proposed software monitors image targets on a printed book and renders 3D objects and alphabetic models. In addition, the application considers phonetics. The sound (phonetic) and 3D representation of a letter are played as soon as the image target is detected. 3D models of the Turkish alphabet are created by using Adobe Photoshop with Unity3D and Vuforia SDK.
The proposed application teaches Turkish alphabets and phonetics by using 3D object models, 3D letters, and 3D phrases, including letters and sounds.
A proactive caching and offloading technique using machine learning for mobile edge computing users
2022, Computer Communications
Citation Excerpt :
Data caching requires incoming data and its existence time for temporary storage. This differentiation improves the queuing rate for concurrent resource allocation and computation [3]. The cached requests are allocated with computing resources and server access to accept user or application requests.
The mobile edge computing (MEC) paradigm provides cloud and application services at the “edge” of user networks for providing ubiquitous access to resources. The heterogeneous services cause varying network traffic that sometimes increases delay. In edge-based services, concurrency in data distribution requires caching and offloading features. This article introduces a proactive caching technique with offloading (PCTO) ability by considering the need for parallel user services. The proposed method performs demand-aware offloading to meet the concurrent service dissemination requirements. Network-level caching and its forecast in concurrent service distribution are performed to reduce the response time. The offloading and caching processes are streamlined using deep recurrent learning for the failing service distribution intervals. In the learning process, the machine is trained for prior failures and for pursuing offloading instances. Based on the learning output, the caching level and offloading rate are determined for the queuing services. The performance of the proposed method is verified using the metrics service ratio, response failures, latency, offloading rate, and caching ratio.
Game-based incentive mechanism for enabling edge video caching over passive optical networks
2021, Computer Communications
Citation Excerpt :
Such a video delivery manner (Fig. 1) incurs not only large traffic transmission delay but also high network bandwidth and energy consumption [6]. Edge caching, which utilizes the storages at the network edge to realize content retrieval, has been emerged as an ideal solution to reduce content transfer latency and network resources consumption [7–10]. A basic method for supporting edge caching over PONs is to deploy storages on ONUs, which has been demonstrated in some recent researches [11–13].
With the ever-increasing mobile video traffic, edge caching enabled passive optical networks (PONs), where storages are deployed on optical network units (ONUs), are becoming a desirable back-end for mobile backhaul (MBH). By caching videos on ONUs, video requests generated in MBH can be efficiently accommodated. Thus, many previous works focus on leveraging the caching capabilities of ONUs to maximize the video cache-hit ratio. However, it is largely ignored how to stimulate individual ONUs to contribute their storages for caching videos. In this paper, we propose a game-based incentive mechanism through which the content provider (CP) rewards ONUs for their storage-contributions. We firstly formulate a two-level Stackelberg game to capture the interaction between the CP and ONUs. At the first level, the CP determines rewarding policy to maximize its utility. At the second level, ONUs react with the amount of provided storages with the aim to cooperatively maximize the social utility or competitively maximize their respective utilities, and thereby two sub-games are further modeled to depict the cooperation and competition among ONUs. We then give the specific strategies of cooperative ONUs and competitive ONUs, respectively. We also show the existence of an equilibrium in the formulated Stackelberg game. The performance of the proposed incentive scheme is finally evaluated by simulations.
Internet of Things and augmented reality in the age of 5G
2020, Computer Communications
Citation Excerpt :
Deploying cache and computing resources in 5G mobile communication networks is considered an important way to reduce network transmission delay and redundant content transmission, improve content distribution efficiency and network computing processing capabilities. Through the construction of 5G user experience models for mobile augmented reality and tactile internet, the subjective expected experience of 5G users in mobile augmented reality applications is investigated in “Edge caching and computing in 5G for mobile augmented reality and haptic internet” [19]. Based on the experimental results, the composition of mobile augmented reality, and the factors that affect 5G user, mobile 5G user experience model for augmented reality is as a design goal for mobile augmented reality.
The Internet of Things is a system in which computing equipment, machinery, and digital machines are related to each other. It has a universal unique identification code (UID) and the ability to transmit data through the network without the need for human-to-human or human-to-device interaction. Augmented reality technology is a technology that ingeniously integrates virtual information with the real world, which uses computer-generated text, images, three-dimensional models, music, video and other virtual information to simulate and apply them to the real world, these two kinds of information are mutually exclusive and supplement to achieve “enhancement” of the real world. In the past few decades, people have made great efforts on the Internet of Things, which makes it possible or accessible to be applied in various fields, including home robotics, intelligent cities and Augmented Reality (AR). Therefore, these applications have captured the attention and enhanced aspirations of researchers in fields of machine vision, computer graphics and computer vision.

View all citing articles on Scopus

View full text

Edge caching and computing in 5G for mobile augmented reality and haptic internet

Abstract

Introduction

Section snippets

Construction of 5G user experience model for mobile augmented reality and haptic internet

Research on efficient cache resource allocation mechanism in 5G core network

Results and discussion

Conclusion

CRediT authorship contribution statement

Declaration of Competing Interest

Acknowledgment

Kaohsiung J. Med. Sci.

An edge-computing based architecture for mobile augmented reality

IEEE Netw.

Power efficient clustering scheme for 5G mobile edge computing environment

Mob. Netw. Appl.

Conceptual design of innovative speech interfaces with augmented reality and interactive systems for controlling loader cranes

Adv. Intell. Syst. Comput.

Virtual reality and augmented reality in plastic surgery: A review

Arch. Plast. Surg.

Real-time adjustment of contrast saliency for improved information visibility in mobile augmented reality

Virtual Real.

Integrating interactive multimedia objects in mobile augmented reality for sarawak tourism

Adv. Sci. Lett.

Using augmented reality video in enhancing masonry and roof component comprehension for construction management students

Eng. Constr. Archit. Manage.

3D survey and augmented reality for cultural heritage. The case study of aurelian wall at castra praetoria in Rome

ISPRS - Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci.

28-2: Invited paper : Simple method to reduce accommodation fatigue in virtual reality and augmented reality displays

Proc. Soc. Inf. Disp.

Investigating integration between auditory and visual location information presented in an augmented-reality device

J. Acoust. Soc. Am.

An MEC and NFV integrated network architecture

ZTE Commun.

Computing, caching, and communication at the edge: The cornerstone for building a versatile 5G ecosystem

IEEE Commun. Mag.

Ungrounded haptic augmented reality system for displaying roughness and friction

IEEE/ASME Trans. Mechatronics