skip to main content
10.1145/3485447.3512146acmconferencesArticle/Chapter ViewAbstractPublication PagesthewebconfConference Proceedingsconference-collections
research-article

MagNet: Cooperative Edge Caching by Automatic Content Congregating

Published: 25 April 2022 Publication History

Abstract

Nowadays, the surge of Internet contents and the need for high Quality of Experience (QoE) put the backbone network under unprecedented pressure. The emerging edge caching solutions help ease the pressure by caching contents closer to users. However, these solutions suffer from two challenges: 1) a low hit ratio due to edges’ high density and small coverages. 2) unbalanced edges’ workloads caused by dynamic requests and heterogeneous edge capacities. In this paper, we formulate a typical cooperative edge caching problem and propose the MagNet, a decentralized and cooperative edge caching system to address these two challenges. The proposed MagNet system consists of two innovative mechanisms: 1) the Automatic Content Congregating (ACC), which utilizes a neural embedding algorithm to capture underlying patterns of historical traces to cluster contents into some types. The ACC then can guide requests to their optimal edges according to their types so that contents congregate automatically in different edges by type. This process forms a virtuous cycle between edges and requests, driving a high hit ratio. 2) the Mutual Assistance Group (MAG), which lets idle edges share overloaded edges’ workloads by forming temporary groups promptly. To evaluate the performance of MagNet, we conduct experiments to compare it with classical, Machine Learning (ML)-based and cooperative caching solutions using the real-world trace. The results show that the MagNet can improve the hit ratio from 40% and 60% to 75% for non-cooperative and cooperative solutions, respectively, and significantly improve the balance of edges’ workloads.

References

[1]
Akamai. 2021. Media Delivery Network Map. https://www.akamai.com/visualizations/media-delivery-network-map
[2]
Oren Barkan and Noam Koenigstein. 2016. Item2vec: neural item embedding for collaborative filtering. In 2016 IEEE 26th International Workshop on Machine Learning for Signal Processing (MLSP). IEEE, 1–6.
[3]
Piotr Bojanowski, Edouard Grave, Armand Joulin, and Tomas Mikolov. 2016. Enriching Word Vectors with Subword Information. arXiv preprint arXiv:1607.04606(2016).
[4]
Pedro Casas, Alessandro D’Alconzo, Pierdomenico Fiadino, Arian Bär, and Alessandro Finamore. 2014. On the analysis of QoE-based performance degradation in YouTube traffic. In 10th International Conference on Network and Service Management (CNSM) and Workshop. IEEE, 1–9.
[5]
Joonho Choi, Abu Sayeem Reaz, and Biswanath Mukherjee. 2012. A Survey of User Behavior in VoD Service and Bandwidth-Saving Multicast Streaming Schemes. IEEE Communications Surveys Tutorials 14, 1 (2012), 156–169.
[6]
Cisco. 2020. Cisco Annual Internet Report (2018–2023) White Paper. https://www.cisco.com/c/en/us/solutions/collateral/executive-perspectives/annual-internet-report/white-paper-c11-741490.html
[7]
Xun Fan, Ethan Katz-Bassett, and John Heidemann. 2015. Assessing affinity between users and CDN sites. In International Workshop on Traffic Monitoring and Analysis. Springer, 95–110.
[8]
Google. 2021. Google Cloud CDN Locations. https://cloud.google.com/cdn/docs/locations
[9]
James Gosling. 1997. The feel of Java. Computer 30, 6 (1997), 53–57.
[10]
Palash Goyal and Emilio Ferrara. 2018. Graph embedding techniques, applications, and performance: A survey. Knowledge-Based Systems 151 (2018), 78–94.
[11]
Yu Guan, Xinggong Zhang, and Zongming Guo. 2019. CACA: Learning-Based Content-Aware Cache Admission for Video Content in Edge Caching. In Proceedings of the 27th ACM International Conference on Multimedia. ACM, 456–464.
[12]
David Guthrie, Ben Allison, Wei Liu, Louise Guthrie, and Yorick Wilks. 2006. A closer look at skip-gram modelling. In LREC, Vol. 6. Citeseer, 1222–1225.
[13]
Song Jiang and Xiaodong Zhang. 2002. LIRS: An efficient low inter-reference recency set replacement policy to improve buffer cache performance. ACM SIGMETRICS Performance Evaluation Review 30, 1 (2002), 31–42.
[14]
Wei Jiang, Gang Feng, Shuang Qin, Tak Shing Peter Yum, and Guohong Cao. 2019. Multi-agent reinforcement learning for efficient content caching in mobile D2D networks. IEEE Transactions on Wireless Communications 18, 3(2019), 1610–1622.
[15]
HR Johnson and JA Larson. 1979. Data management for microcomputers. In 1979 Compcon Fall. IEEE, 191–192.
[16]
Armand Joulin, Edouard Grave, Piotr Bojanowski, Matthijs Douze, Hérve Jégou, and Tomas Mikolov. 2016. FastText.zip: Compressing text classification models. arXiv preprint arXiv:1612.03651(2016).
[17]
Naoki Kobayashi and Akinori Yonezawa. 1994. Type-theoretic foundations for concurrent object-oriented programing. ACM SIGPLAN Notices 29, 10 (1994), 31–45.
[18]
K Kumaran and E Sasikala. 2021. Learning based Latency Minimization Techniques in Mobile Edge Computing (MEC) systems: A Comprehensive Survey. In 2021 International Conference on System, Computation, Automation and Networking (ICSCAN). IEEE, 1–6.
[19]
Ali Larbi, Louiza Bouallouche-Medjkoune, and Djamil Aissani. 2018. Improving cache effectiveness based on cooperative cache management in MANETs. Wireless Personal Communications 98, 3 (2018), 2497–2519.
[20]
Anatole Lécuyer, Fabien Lotte, Richard B Reilly, Robert Leeb, Michitaka Hirose, and Mel Slater. 2008. Brain-computer interfaces, virtual reality, and videogames. Computer 41, 10 (2008), 66–72.
[21]
Donghee Lee, Jongmoo Choi, Jong-Hun Kim, Sam H Noh, Sang Lyul Min, Yookun Cho, and Chong Sang Kim. 1999. On the existence of a spectrum of policies that subsumes the least recently used (LRU) and least frequently used (LFU) policies. In Proceedings of the 1999 ACM SIGMETRICS international conference on Measurement and modeling of computer systems. 134–143.
[22]
Chia-Feng Lin, Muh-Chyi Leu, Chih-Wei Chang, and Shyan-Ming Yuan. 2011. The study and methods for cloud based CDN. In 2011 International Conference on Cyber-Enabled Distributed Computing and Knowledge Discovery. IEEE, 469–475.
[23]
Yuyi Mao, Changsheng You, Jun Zhang, Kaibin Huang, and Khaled B. Letaief. 2017. A Survey on Mobile Edge Computing: The Communication Perspective. IEEE Communications Surveys Tutorials 19, 4 (2017), 2322–2358.
[24]
Nimrod Megiddo and Dharmendra S Modha. 2003. ARC: A Self-Tuning, Low Overhead Replacement Cache. In Fast, Vol. 3. USENIX Association, 115–130.
[25]
Georgios Papaioannou and Iordanis Koutsopoulos. 2019. Tile-based caching optimization for 360 videos. In Proceedings of the Twentieth ACM International Symposium on Mobile Ad Hoc Networking and Computing. ACM, 171–180.
[26]
Quoc-Viet Pham, Fang Fang, Vu Nguyen Ha, Md Jalil Piran, Mai Le, Long Bao Le, Won-Joo Hwang, and Zhiguo Ding. 2020. A survey of multi-access edge computing in 5G and beyond: Fundamentals, technology integration, and state-of-the-art. IEEE Access 8(2020), 116974–117017.
[27]
Stefan Podlipnig and Laszlo Böszörmenyi. 2003. A Survey of Web Cache Replacement Strategies. ACM Comput. Surv. 35, 4 (2003), 374–398.
[28]
Buvaneswari A Ramanan, Lawrence M Drabeck, Mark Haner, Nachi Nithi, Thierry E Klein, and Chitra Sawkar. 2013. Cacheability analysis of HTTP traffic in an operational LTE network. In 2013 Wireless Telecommunications Symposium (WTS). IEEE, 1–8.
[29]
Liana V. Rodriguez, Farzana Yusuf, Steven Lyons, Eysler Paz, Raju Rangaswami, Jason Liu, Ming Zhao, and Giri Narasimhan. 2021. Learning Cache Replacement with CACHEUS. In 19th USENIX Conference on File and Storage Technologies (FAST 21). USENIX Association, 341–354.
[30]
Mahadev Satyanarayanan. 2017. The emergence of edge computing. Computer 50, 1 (2017), 30–39.
[31]
Karthikeyan Shanmugam, Negin Golrezaei, Alexandros G Dimakis, Andreas F Molisch, and Giuseppe Caire. 2013. Femtocaching: Wireless content delivery through distributed caching helpers. IEEE Transactions on Information Theory 59, 12 (2013), 8402–8413.
[32]
Ao-Jan Su, David R Choffnes, Aleksandar Kuzmanovic, and Fabian E Bustamante. 2009. Drafting behind Akamai: Inferring network conditions based on CDN redirections. IEEE/ACM transactions on networking 17, 6 (2009), 1752–1765.
[33]
Xiaoyuan Su and Taghi M Khoshgoftaar. 2009. A survey of collaborative filtering techniques. Advances in artificial intelligence 2009 (2009).
[34]
Anthony Tang and Omid Fakourfar. 2017. Watching 360 videos together. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 4501–4506.
[35]
Hao Tian, Xiaolong Xu, Tingyu Lin, Yong Cheng, Cheng Qian, Lei Ren, and Muhammad Bilal. 2021. DIMA: distributed cooperative microservice caching for internet of things in edge computing by deep reinforcement learning. World Wide Web (2021), 1–24.
[36]
Anh-Tien Tran, Demeke Shumeye Lakew, The-Vi Nguyen, Van-Dat Tuong, Thanh Phung Truong, Nhu-Ngoc Dao, and Sungrae Cho. 2021. Hit Ratio and Latency Optimization for Caching Systems: A Survey. In 2021 International Conference on Information Networking (ICOIN). IEEE, 577–581.
[37]
Emeka E. Ugwuanyi, Saptarshi Ghosh, Muddesar Iqbal, Tasos Dagiuklas, Shahid Mumtaz, and Anwer Al-Dulaimi. 2019. Co-Operative and Hybrid Replacement Caching for Multi-Access Mobile Edge Computing. In 2019 European Conference on Networks and Communications (EuCNC). IEEE, 394–399.
[38]
Uptime. 2021. Uptime Institute Global Data Center Survey 2021. https://uptimeinstitute.com/
[39]
Linh Van Ma, Van Quan Nguyen, Jaehyung Park, and Jinsul Kim. 2018. NFV-Based Mobile Edge Computing for Lowering Latency of 4K Video Streaming. In 2018 Tenth International Conference on Ubiquitous and Future Networks (ICUFN). IEEE, 670–673.
[40]
Giuseppe Vietri, Liana V. Rodriguez, Wendy A. Martinez, Steven Lyons, Jason Liu, Raju Rangaswami, Ming Zhao, and Giri Narasimhan. 2018. Driving Cache Replacement with ML-based LeCaR. In 10th USENIX Workshop on Hot Topics in Storage and File Systems (HotStorage 18). USENIX Association.
[41]
Fangxin Wang, Feng Wang, Jiangchuan Liu, Ryan Shea, and Lifeng Sun. 2020. Intelligent Video Caching at Network Edge: A Multi-Agent Deep Reinforcement Learning Approach. In IEEE INFOCOM 2020. 2499–2508.
[42]
Xinhua. 2021. China reports expansion in 5G network coverage. http://english.www.gov.cn/statecouncil/ministries/202107/18/content_WS60f424d4c6d0df57f98dd302.html
[43]
Chen Zhong, M Cenk Gursoy, and Senem Velipasalar. 2018. A deep reinforcement learning-based framework for content caching. In 2018 52nd Annual Conference on Information Sciences and Systems (CISS). IEEE, 1–6.
[44]
Hao Zhu, Yang Cao, Wei Wang, Tao Jiang, and Shi Jin. 2018. Deep reinforcement learning for mobile edge caching: Review, new features, and open issues. IEEE Network 32, 6 (2018), 50–57.
[45]
Tongyu Zong, Chen Li, Yuanyuan Lei, Guangyu Li, Houwei Cao, and Yong Liu. 2021. Cocktail Edge Caching: Ride Dynamic Trends of Content Popularity with Ensemble Learning. In IEEE INFOCOM 2021. IEEE, 1–10.

Cited By

View all
  • (2025)Edge Data Deduplication Under Uncertainties: A Robust Optimization ApproachIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2024.349395936:1(84-95)Online publication date: 1-Jan-2025
  • (2025)Ripple: Enabling Decentralized Data Deduplication at the EdgeIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2024.349395336:1(55-66)Online publication date: 1-Jan-2025
  • (2025)EdgeHydra: Fault-Tolerant Edge Data Distribution Based on Erasure CodingIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2024.349303436:1(29-42)Online publication date: 1-Jan-2025
  • Show More Cited By

Index Terms

  1. MagNet: Cooperative Edge Caching by Automatic Content Congregating
        Index terms have been assigned to the content through auto-classification.

        Recommendations

        Comments

        Information & Contributors

        Information

        Published In

        cover image ACM Conferences
        WWW '22: Proceedings of the ACM Web Conference 2022
        April 2022
        3764 pages
        ISBN:9781450390965
        DOI:10.1145/3485447
        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Sponsors

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        Published: 25 April 2022

        Permissions

        Request permissions for this article.

        Check for updates

        Author Tags

        1. cache
        2. cooperative
        3. edge computing
        4. embedding
        5. workload balance

        Qualifiers

        • Research-article
        • Research
        • Refereed limited

        Conference

        WWW '22
        Sponsor:
        WWW '22: The ACM Web Conference 2022
        April 25 - 29, 2022
        Virtual Event, Lyon, France

        Acceptance Rates

        Overall Acceptance Rate 1,899 of 8,196 submissions, 23%

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • Downloads (Last 12 months)73
        • Downloads (Last 6 weeks)4
        Reflects downloads up to 08 Mar 2025

        Other Metrics

        Citations

        Cited By

        View all
        • (2025)Edge Data Deduplication Under Uncertainties: A Robust Optimization ApproachIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2024.349395936:1(84-95)Online publication date: 1-Jan-2025
        • (2025)Ripple: Enabling Decentralized Data Deduplication at the EdgeIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2024.349395336:1(55-66)Online publication date: 1-Jan-2025
        • (2025)EdgeHydra: Fault-Tolerant Edge Data Distribution Based on Erasure CodingIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2024.349303436:1(29-42)Online publication date: 1-Jan-2025
        • (2024)KEPC-PushProceedings of the 2024 USENIX Conference on Usenix Annual Technical Conference10.5555/3691992.3692011(321-338)Online publication date: 10-Jul-2024
        • (2024)GEES: Enabling Location Privacy-Preserving Energy Saving in Multi-Access Edge ComputingProceedings of the ACM Web Conference 202410.1145/3589334.3645329(2735-2746)Online publication date: 13-May-2024
        • (2024)FEUAGame: Fairness-Aware Edge User Allocation for App VendorsIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2024.340954835:8(1429-1443)Online publication date: 1-Aug-2024
        • (2024)EdgeShield: Enabling Collaborative DDoS Mitigation at the EdgeIEEE Transactions on Mobile Computing10.1109/TMC.2024.344326023:12(14502-14513)Online publication date: 1-Dec-2024
        • (2024)A Cooperative Caching System in Heterogeneous Edge NetworksIEEE Transactions on Mobile Computing10.1109/TMC.2023.333695523:7(7635-7649)Online publication date: 1-Jul-2024
        • (2024)FACC: A Flexible and Asynchronous Updating Strategy for Cooperative Edge Caching2024 IEEE 3rd Workshop on Machine Learning on Edge in Sensor Systems (SenSys-ML)10.1109/SenSys-ML62579.2024.00006(3-8)Online publication date: 13-May-2024
        • (2024)Enhancing Edge Caching with User Preferences and Access Patterns in Wireless Networks2024 IEEE International Symposium on Parallel and Distributed Processing with Applications (ISPA)10.1109/ISPA63168.2024.00302(2211-2214)Online publication date: 30-Oct-2024
        • Show More Cited By

        View Options

        Login options

        View options

        PDF

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        HTML Format

        View this article in HTML Format.

        HTML Format

        Figures

        Tables

        Media

        Share

        Share

        Share this Publication link

        Share on social media