Chih-Kai Huang
Skip Abstract Section
Abstract
The next-generation 5G cellular networks are designed to support the internet of things (IoT) networks; network components and services are virtualized and run either in virtual machines (VMs) or containers. Moreover, edge clouds (which are closer to end users) are leveraged to reduce end-to-end latency especially for some IoT applications, which require short response time. However, the computational resources are limited in edge clouds. To minimize overall service latency, it is crucial to determine carefully which services should be provided in edge clouds and serve more mobile or IoT devices locally. In this article, we propose a novel service cache framework called S-Cache, which automatically caches popular services in edge clouds. In addition, we design a new cache replacement policy to maximize the cache hit rates. Our evaluations use real log files from Google to form two datasets to evaluate the performance. The proposed cache replacement policy is compared with other policies such as greedy-dual-size-frequency (GDSF) and least-frequently-used (LFU). The experimental results show that the cache hit rates are improved by 39% on average, and the average latency of our cache replacement policy decreases 41% and 38% on average in these two datasets. This indicates that our approach is superior to other existing cache policies and is more suitable in multi-access edge computing environments. In the implementation, S-Cache relies on OpenStack to clone services to edge clouds and direct the network traffic. We also evaluate the cost of cloning the service to an edge cloud. The cloning cost of various real applications is studied by experiments under the presented framework and different environments.
- Marc Abrams, Charles R. Standridge, Ghaleb Abdulla, Edward A. Fox, and Stephen Williams. 1996. Removal policies in network caches for World-Wide Web documents. ACM SIGCOMM Computer Communication Review 26 (1996), 293–305.Google Scholar
Digital Library
- Soam Acharya and Brian Smith. 2000. Middleman: A video caching proxy server. In Proceedings of the 10th International Workshop on Network and Operating System Support for Digital Audio and Video (NOSSDAV”00).Google Scholar
- Alexandru Agache, Marc Brooker, Alexandra Iordache, Anthony Liguori, Rolf Neugebauer, Phil Piwonka, and Diana-Maria Popa. 2020. Firecracker: Lightweight virtualization for serverless applications. In Proceedings of the 17th USENIX Symposium on Networked Systems Design and Implementation (NSDI’20). 419–434. https://www.usenix.org/conference/nsdi20/presentation/agache.Google Scholar
- Amazon Web Services. n.d. Alexa Top Sites. Retrieved April 5, 2021 from https://aws.amazon.com/alexa-top-sites/.Google Scholar
- Yossi Azar, Ilan Reuven Cohen, and Debmalya Panigrahi. 2018. Randomized algorithms for online vector load balancing. In Proceedings of the 29th Annual ACM-SIAM Symposium on Discrete Algorithms (SODA’18). 980–991.Google Scholar
- Pei Cao and Sandy Irani. 1997. Cost-aware www proxy caching algorithms. In Proceedings of the USENIX Symposium on Internet Technologies and Systems, Vol. 12. 193–206.Google Scholar
- L. Chen, S. Zhou, and J. Xu. 2017. Energy efficient mobile edge computing in dense cellular networks. In Proceedings of the 2017 IEEE International Conference on Communications (ICC’17). 1–6. DOI:https://doi.org/10.1109/ICC.2017.7997128Google Scholar
- Ludmila Cherkasova. 1998. Improving WWW Proxies Performance with Greedy-Dual-Size-Frequency Caching Policy. Hewlett-Packard Laboratories.Google Scholar
- J. Dilley, B. Maggs, J. Parikh, H. Prokop, R. Sitaraman, and B. Weihl. 2002. Globally distributed content delivery. IEEE Internet Computing 6, 5 (2002), 50–58.Google ScholarDigital Library
- Thinh Quang Dinh, Jianhua Tang, Quang Duy La, and Tony Q. S. Quek. 2017. Offloading in mobile edge computing: Task allocation and computational frequency scaling. IEEE Transactions on Communications 65, 8 (2017), 3571–3584.Google Scholar
- Mohammed S. Elbamby, Mehdi Bennis, and Walid Saad. 2017. Proactive edge computing in latency-constrained fog networks. In Proceedings of the European Conference on Networks and Communications (EuCNC’17). IEEE,Los Alamitos, CA, 1–6.Google Scholar
- Yang Ge, Yukan Zhang, Qinru Qiu, and Yung-Hsiang Lu. 2012. A game theoretic resource allocation for overall energy minimization in mobile cloud computing system. In Proceedings of the 2012 ACM/IEEE International Symposium on Low Power Electronics and Design. ACM, New York, NY, 279–284.Google Scholar
- Aaron Gember, Anand Krishnamurthy, Saul St. John, Robert Grandl, Xiaoyang Gao, Ashok Anand, Theophilus Benson, Vyas Sekar, and Aditya Akella. 2013. Stratos: A network-aware orchestration layer for virtual middleboxes in clouds. arXiv:1305.0209.Google Scholar
- Aaron Gember, Raajay Viswanathan, Chaithan Prakash, Robert Grandl, Junaid Khalid, Sourav Das, and Akella Aditya. 2014. OpenNF: Enabling innovation in network function control. ACM SIGCOMM Computer Communication Review 44 (2014), 163–174.Google Scholar
- Chih-Kai Huang and Shan-Hsiang Shen. 2018. Prototype of S-Cache. Retrieved April 5, 2021 from https://github.com/UoFixED/prototype-of-S-Cache.Google Scholar
- Dong Huang, Ping Wang, and Dusit Niyato. 2012. A dynamic offloading algorithm for mobile computing. IEEE Transactions on Wireless Communications 11, 6 (2012), 1991–1995.Google ScholarCross Ref
- K. Kadarla, S. C. Sharma, T. Bhardwaj, and A. Chaudhary. 2017. A simulation study of response times in cloud environment for IoT-based healthcare workloads. In Proceedings of the 2017 IEEE 14th International Conference on Mobile Ad Hoc and Sensor Systems (MASS’17). 678–683.Google Scholar
- Rakpong Kaewpuang, Dusit Niyato, Ping Wang, and Ekram Hossain. 2013. A framework for cooperative resource management in mobile cloud computing. IEEE Journal on Selected Areas in Communications 31, 12 (2013), 2685–2700.Google ScholarCross Ref
- Sami Kekki, Walter Featherstone, Yonggang Fang, Pekka Kuure, Alice Li, Anurag Ranjan, Debashish Purkayastha, et al. 2018. MEC in 5G Networks. White Paper. ETSI.Google Scholar
- Jiangchuan Liu and Bo Li. 2004. A QoS-based joint scheduling and caching algorithm for multimedia objects. World Wide Web 7, 3 (2004), 281–296.Google ScholarDigital Library
- Juan Liu, Yuyi Mao, Jun Zhang, and Khaled B. Letaief. 2016. Delay-optimal computation task scheduling for mobile-edge computing systems. In Proceedings of the IEEE International Symposium on Information Theory (ISIT’16). IEEE, Los Alamitos, CA, 1451–1455.Google Scholar
- Yuyi Mao, Changsheng You, Jun Zhang, Kaibin Huang, and Khaled B. Letaief. 2017. Mobile edge computing: Survey and research outlook. arXiv:1701.01090v1.Google Scholar
- Micron. 2018. CRUCIAL MX500 SSD. Retrieved April 5, 2021 from https://www.crucial.com/usa/en/storage-ssd-mx500?cm_re=us-top-nav-_-us-flyout-ssd-_-us-ssd-learn-mx500.Google Scholar
- Rashid Mijumbi, Joan Serrat, Juan-Luis Gorricho, Niels Bouten, Filip De Turck, and Raouf Boutaba. 2016. Network function virtualization: State-of-the-art and research challenges. IEEE Communications Surveys & Tutorials 18, 1 (2016), 236–262.Google ScholarDigital Library
- Muller, O. Atan, M. van der Schaar, and A. Klein. 2017. Context-aware proactive content caching with service differentiation in wireless networks. IEEE Transactions on Wireless Communications 16, 2 (Feb. 2017), 1024–1036. DOI:https://doi.org/10.1109/TWC.2016.2636139Google Scholar
- Next Generation Mobile Networks Alliance. 2015. 5G. White Paper. Next Generation Mobile Networks Alliance.Google Scholar
- Yuval Peres, Kunal Talwar, and Udi Wieder. 2010. The (1 + )-choice process and weighted balls-into-bins. In Proceedings of the 21st Annual ACM-SIAM Symposium on Discrete Algorithms (SODA’10). 1613–1619.Google Scholar
- Justas Poderys, Matteo Artuso, Claus Michael Oest Lensbøl, Henrik Lehrmann Christiansen, and José Soler. 2018. Caching at the mobile edge: A practical implementation. IEEE Access 6 (2018), 8630–8637.Google Scholar
- Charles Reiss, John Wilkes, and Joseph L. Hellerstein. 2011. Google Cluster-Usage Traces: Format + Schema. Technical Report. Google Inc. (Revised November 17, 2014 for version 2.1. Posted at https://github.com/google/cluster-data.)Google Scholar
- Amazon Web Services. 2020. AWS Fargate—Run Containers Without Managing Servers or Clusters. Retrieved April 5, 2021 from https://aws.amazon.com/fargate/.Google Scholar
- Amazon Web Services. 2020. AWS Lambda—Serverless Compute. Retrieved April 5, 2021 from https://aws.amazon.com/lambda/.Google Scholar
- Sakir Sezer, Sandra Scott-Hayward, Pushpinder Kaur Chouhan, Barbara Fraser, David Lake, Jim Finnegan, Niel Viljoen, Marc Miller, and Navneet Rao. 2013. Are we ready for SDN? Implementation challenges for software-defined networks. IEEE Communications Magazine 51, 7 (2013), 36–43.Google ScholarCross Ref
- Shan-Hsiang Shen and Aditya Akella. 2013. An information-aware QoE-centric mobile video cache. In Proceedings of the 19th Annual International Conference on Mobile Computing (MobiCom’13). ACM, New York, NY, 401–412.Google Scholar
- Weisong Shi, Jie Cao, Quan Zhang, Youhuizi Li, and Lanyu Xu. 2016. Edge computing: Vision and challenges. IEEE Internet of Things Journal 3, 5 (2016), 637–646.Google ScholarCross Ref
- Alok Shrivastwa, Sunil Sarat, Kevin Jackson, Cody Bunch, Egle Sigler, and Tony Campbell. 2016. OpenStack: Building a Cloud Environment. Packt Publishing.Google Scholar
- Yuxuan Sun, Sheng Zhou, and Jie Xu. 2017. EMM: Energy-aware mobility management for mobile edge computing in ultra dense networks. IEEE Journal on Selected Areas in Communications 35, 11 (2017), 2637–2646.Google ScholarCross Ref
- Olivier Verscheure, Chitra Venkatramani, Pascal Frossard, and Lisa Amini. 2002. Joint server scheduling and proxy caching for video delivery. Computer Communications 25, 4 (2002), 413–423.Google ScholarDigital Library
- T. Wang, L. Song, and Z. Han. 2015. Dynamic femtocaching for mobile users. In Proceedings of the 2015 IEEE Wireless Communications and Networking Conference (WCNC’15). 861–865. DOI:https://doi.org/10.1109/WCNC.2015.7127582Google Scholar
- Z. Wang and Y. Cai. 2019. Management optimization of mobile edge computing (MEC) in 5G networks. In Proceedings of the 2019 IEEE International Conference on Communications Workshops (ICC Workshops’19). 1–6.Google Scholar
- Udi Wieder. 2017. Hashing, load balancing and multiple choice. Foundations and Trends in Theoretical Computer Science 12, 3-4 (2017), 275–379. DOI:https://doi.org/10.1561/0400000070Google ScholarCross Ref
- Kun-Lung Wu, Philip S. Yu, and Joel L. Wolf. 2001. Segment-based proxy caching of multimedia streams. In Proceedings of the 10th International Conference on World Wide Web (WWW’01). ACM, New York, NY, 36–44.Google Scholar
- Qiaomin Xie, Xiaobo Dong, Yi Lu, and Rayadurgam Srikant. 2015. Power of d choices for large-scale bin packing: A loss model. In Proceedings of the 2015 ACM SIGMETRICS International Conference on Measurement and Modeling of Computer Systems (SIGMETRICS’15). ACM, New York, NY, 321–334. DOI:https://doi.org/10.1145/2745844.2745849Google Scholar
- Jie Xu, Lixing Chen, and Shaolei Ren. 2017. Online learning for offloading and autoscaling in energy harvesting mobile edge computing. IEEE Transactions on Cognitive Communications and Networking 3, 3 (2017), 361–373.Google ScholarCross Ref
- Jie Xu, Lixing Chen, and Pan Zhou. 2018. Joint service caching and task offloading for mobile edge computing in dense networks. arXiv preprint arXiv:1801.05868. (2018).Google Scholar
- Rong Yu, Jiefei Ding, Sabita Maharjan, Stein Gjessing, Yan Zhang, and Danny H. K. Tsang. 2018. Decentralized and optimal resource cooperation in geo-distributed mobile cloud computing. IEEE Transactions on Emerging Topics in Computing 6, 1 (2018), 72–84.Google ScholarCross Ref
- Peng Zhang, Xiang Shi, and Samee U. Khan. 2017. Can quantitative finance benefit from IoT? In Proceedings of the Workshop on Smart Internet of Things (SmartIoT’17). ACM, Article 12, 6 pages. DOI:https://doi.org/10.1145/3132479.3132491Google Scholar
- Tianchu Zhao, Sheng Zhou, Xueying Guo, Yun Zhao, and Zhisheng Niu. 2015. A cooperative scheduling scheme of local cloud and Internet cloud for delay-aware mobile cloud computing. In Proceedings of the 2015 IEEE Globecom Workshops (GC Wkshps’15). IEEE, Los Alamitos, CA, 1–6.Google Scholar
Index Terms
- Enabling Service Cache in Edge Clouds
Recommendations
S-Cache: Toward an Low Latency Service Caching for Edge Clouds
PERSIST-IoT '19: Proceedings of the ACM MobiHoc Workshop on Pervasive Systems in the IoT EraThe next generation 5G cellular networks will include internet of things (IoT) networks. Moreover, network components are virtualized and running in virtual machines (VMs). Edge clouds, which are closer to end users, are leveraged to reduce end-to-end ...
Increasing hardware data prefetching performance using the second-level cache
Techniques to reduce or tolerate large memory latencies are critical for achieving high processor performance. Hardware data prefetching is one of the most heavily studied solutions, but it is essentially applied to first-level caches where it can ...
A new cache replacement algorithm for last-level caches by exploiting tag-distance correlation of cache lines
Cache memory plays a crucial role in determining the performance of processors, especially for embedded processors where area and power are tightly constrained. It is necessary to have effective management mechanisms, such as cache replacement policies, ...
Comments