Skip to main content
Log in

An intelligent memory caching architecture for data-intensive multimedia applications

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

With the rapid developments in cloud computing and mobile networks, multimedia content can be accessed conveniently. Recently, some novel intelligent caching-based approaches have been proposed to improve the memory architectures for multimedia applications. These applications often face bottleneck related challenges which result in performance degradation and service delay issues. Intelligent multimedia network applications access the shared data by using a specific network file system. This results in answering the processing related constraints on hard-drive storage and might result in bringing bottleneck issues. Therefore, to improve the performance of these multimedia network applications, we present an intelligent distributed memory caching system. We integrate the multimedia application message passing interface in a multi-threaded environment and propose an algorithm which can handle concurrent response behavior for different multimedia applications. Results demonstrate that our proposed scheme outperforms traditional approaches in terms of throughput and file read access features.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

References

  1. Tai L, Li L, Jun D (2019) Multimedia based intelligent network big data optimization model. Multimed Tools Appl 78(4):4579–4603

    Article  Google Scholar 

  2. Prakash PB, Vijila CKS (2019) Novel Scheduling Based Intelligent Video Streaming for Device-to-Device Communication in Wireless Networks. Wirel Pers Commun 104(2):617–631

    Article  Google Scholar 

  3. Alowayyed S, Piontek T, Suter JL, Hoenen O, Groen D, Luk O, Bosak B et al (2019) Patterns for high performance multiscale computing. Futur Gener Comput Syst 91:335–346

    Article  Google Scholar 

  4. Yang, Jian, Joseph Izraelevitz, and Steven Swanson. "Orion: a distributed file system for non-volatile main memory and RDMA-capable networks." In 17th {USENIX} Conference on File and Storage Technologies ({FAST} 19), pp. 221–234. 2019.

  5. Kim J, Kim Y, Khan A, Park S (2019) Understanding the performance of storage class memory file systems in the NUMA architecture. Clust Comput 22(2):347–360

    Article  Google Scholar 

  6. Haghighi MA, Maeen M, Haghparast M (2019) An Energy-Efficient Dynamic Resource Management Approach Based on Clustering and Meta-Heuristic Algorithms in Cloud Computing IaaS Platforms. Wireless Personal Commun 104(4):1367–1391

    Article  Google Scholar 

  7. Mahgoub, Ashraf, Paul Wood, Alexander Medoff, Subrata Mitra, Folker Meyer, Somali Chaterji, and Saurabh Bagchi. "{SOPHIA}: Online Reconfiguration of Clustered NoSQL Databases for Time-Varying Workloads." In 2019 {USENIX} Annual Technical Conference ({USENIX}{ATC} 19), pp. 223–240. 2019.

  8. Daglis, Alexandros, Mark Sutherland, and Babak Falsafi. "RPCValet: NI-Driven Tail-Aware Balancing of μs-Scale RPCs." In Proceedings of the Twenty-Fourth International Conference on Architectural Support for Programming Languages and Operating Systems, pp. 35–48. ACM, 2019.

  9. Yang S, Son S, Choi M-J, Moon Y-S (2019) Performance improvement of apache storm using InfiniBand RDMA. J Supercomput:1–27

  10. Nakao, Masahiro, Tetsuya Odajima, Hitoshi Murai, Akihiro Tabuchi, Norihisa Fujita, Toshihiro Hanawa, Taisuke Boku, and Mitsuhisa Sato. "Evaluation of XcalableACC with tightly coupled accelerators/InfiniBand hybrid communication on accelerated cluster." Int J High Perform Comput Appl (2019): 1094342018821163.

  11. Fang J, Hao X, Fan Q, Li K, Zhao H (2019) Efficient data transfer in a heterogeneous multicore-based CE systems using cache performance optimization. IEEE Consum Electron Mag 8(5):46–50

    Article  Google Scholar 

  12. Fujita H, Cao C, Sur S, Archer C, Paulson E, Garzaran M (2019) Efficient implementation of MPI-3 RMA over openFabrics interfaces. Parallel Comput 87:1–10

    Article  Google Scholar 

  13. Coffman, Jerrie, Arlin Davis, Sean Hefty, Roy Larsen, William R. Magro, and Robert J. Woodruff. "Network with a constrained usage model supporting remote direct memory access." U.S. Patent 7,817,634, issued October 19, 2010.

  14. Yoshimura, Takeshi, Tatsuhiro Chiba, and Hiroshi Horii. "EvFS: user-level, event-driven file system for non-volatile memory." In 11th {USENIX} Workshop on Hot Topics in Storage and File Systems (HotStorage 19). 2019.

  15. Jung, Kumseok, Julien Gascon-Samson, and Karthik Pattabiraman. "OneOS: IoT Platform based on {POSIX} and Actors." In 2nd {USENIX} Workshop on Hot Topics in Edge Computing (HotEdge 19). 2019.

  16. Xu, Jian, and Steven Swanson. "{NOVA}: A Log-structured File System for Hybrid Volatile/Non-volatile Main Memories." In 14th {USENIX} Conference on File and Storage Technologies ({FAST} 16), pp. 323–338. 2016.

  17. Hubail, Murtadha AI, Ali Alsuliman, Michael Blow, Michael Carey, Dmitry Lychagin, Ian Maxon, and Till Westmann. "Couchbase Analytics: NoETL for Scalable NoSQL Data Analysis." Proc. VLDB Endow 12, no. 12 (2019): 2275–2286.

  18. Andersen, David G., Jason Franklin, Michael Kaminsky, Amar Phanishayee, Lawrence Tan, and Vijay Vasudevan. "FAWN: A fast array of wimpy nodes." In Proceedings of the ACM SIGOPS 22nd symposium on Operating systems principles, pp. 1–14. ACM, 2009.

  19. Lim, Kevin, David Meisner, Ali G. Saidi, Parthasarathy Ranganathan, and Thomas F. Wenisch. "Thin servers with smart pipes: designing SoC accelerators for memcached." In ACM SIGARCH Computer Architecture News, vol. 41, no. 3, pp. 36–47. ACM, 2013.

  20. Lim, Hyeontaek, Bin Fan, David G. Andersen, and Michael Kaminsky. "SILT: A memory-efficient, high-performance key-value store." In Proceedings of the Twenty-Third ACM Symposium on Operating Systems Principles, pp. 1–13. ACM, 2011.

  21. Xu Y, Frachtenberg E, Jiang S, Paleczny M (2013) Characterizing facebook's memcached workload. IEEE Internet Comput 18(2):41–49

    Article  Google Scholar 

  22. Xu Y, Frachtenberg E, Jiang S (2014) Building a high-performance key–value cache as an energy-efficient appliance. Perform Eval 79:24–37

    Article  Google Scholar 

  23. Wang, Liufeng, Huaimin Wang, Lu Cai, Rui Chu, Pengfei Zhang, and Lanzheng Liu. "A hierarchical memory service mechanism in server consolidation environment." In 2011 IEEE 17th International Conference on Parallel and Distributed Systems, pp. 40–47. IEEE, 2011.

  24. Adya, Atul, John Dunagan, and Alec Wolman. "Centrifuge: Integrated Lease Management and Partitioning for Cloud Services." In NSDI, vol. 10, pp. 1–16. 2010.

  25. Eran, Haggai, Lior Zeno, Maroun Tork, Gabi Malka, and Mark Silberstein. "{NICA}: An Infrastructure for Inline Acceleration of Network Applications." In 2019 {USENIX} Annual Technical Conference ({USENIX}{ATC} 19), pp. 345–362. 2019.

  26. Abdi, Mania, Amin Mosayyebzadeh, Mohammad Hossein Hajkazemi, Ata Turk, Orran Krieger, and Peter Desnoyers. "Caching in the Multiverse." In 11th {USENIX} Workshop on Hot Topics in Storage and File Systems (HotStorage 19). 2019.

  27. Chen, Chien-Hung, Ting-Yuan Hsia, Yen-Nun Huang, and Sy-Yen Kuo. "Data prefetching and eviction mechanisms of in-memory storage systems based on scheduling for big data processing." IEEE Trans Paral Distri Syst (2019).

  28. Lu, Jiaheng, and Irena Holubová. "Multi-model Databases: A New Journey to Handle the Variety of Data." ACM Computing Surveys (CSUR) 52, no. 3 (2019): 55.

  29. Catal F, Tcholtchev N, Höfig E, Hoffmann A (2019) Visualization of traffic flows in a simulated network environment to investigate abnormal network behavior in complex network infrastructures. Proc Comput Sci 151:279–286

    Article  Google Scholar 

  30. Ruan, Zhenyuan, Tong He, and Jason Cong. "{INSIDER}: Designing In-Storage Computing System for Emerging High-Performance Drive." In 2019 {USENIX} Annual Technical Conference ({USENIX}{ATC} 19), pp. 379–394. 2019.

  31. Park, Jiwoong, Yongseok Son, Heon Young Yeom, and Yoonhee Kim. "SoftDC: software-based dynamically connected transport." Cluster Computing (2019): 1–11.

  32. Choi, Won Gi, and Sanghyun Park. "A write-friendly approach to manage namespace of Hadoop distributed file system by utilizing nonvolatile memory." The Journal of Supercomputing (2019): 1–31.

  33. Giménez-Alventosa V, Moltó G, Caballer M (2019) A framework and a performance assessment for serverless MapReduce on AWS lambda. Futur Gener Comput Syst 97:259–274

    Article  Google Scholar 

  34. Huang B, Sun Z, Chen H, Mao J, Zhang Z (2014) BufferBank: a distributed cache infrastructure for peer-to-peer application. Peer-to-Peer Network Appl 7(4):485–496

    Article  Google Scholar 

  35. Balaji, Pavan, Sundeep Narravula, Karthikeyan Vaidyanathan, Savitha Krishnamoorthy, Jiesheng Wu, and Dhabaleswar K. Panda. "Sockets Direct Protocol over InfiniBand in clusters: is it beneficial?." In IEEE International Symposium on-ISPASS Performance Analysis of Systems and Software, 2004, pp. 28–35. IEEE, 2004.

  36. Novakovic, Stanko, Alexandros Daglis, Dmitrii Ustiugov, Edouard Bugnion, Babak Falsafi, and Boris Grot. "Mitigating load imbalance in distributed data serving with rack-scale memory pooling." ACM Transactions on Computer Systems (TOCS) 36, no. 2 (2019): 6.

  37. Chakrabarti, Somnath, Matthew Hoekstra, Dmitrii Kuvaiskii, and Mona Vij. "Scaling Intel® Software Guard Extensions Applications with Intel® SGX Card." In Proceedings of the 8th International Workshop on Hardware and Architectural Support for Security and Privacy, p. 6. ACM, 2019.

  38. Venkataramani, Vanchinathan, Mun Choon Chan, and Tulika Mitra. "Scratchpad-Memory Management for Multi-Threaded Applications on Many-Core Architectures." ACM Transactions on Embedded Computing Systems (TECS) 18, no. 1 (2019): 10.

  39. Pazos, Nuria, Paolo Ienne, Yusuf Leblebici, and Alexander Maxiaguine. "Parallel modelling paradigm in multimedia applications: Mapping and scheduling onto a multi-processor system-on-chip platform." In The Global Signal Processing Conference (GSPx), no. CONF. 2004.

  40. Nadeem MS, Franqueira VNL, Zhai X, Kurugollu F (2019) A survey of deep learning solutions for multimedia visual content analysis. IEEE Access 7:84003–84019

    Article  Google Scholar 

  41. Griffin, Gregory, Alex Holub, and Pietro Perona. "Caltech-256 object category dataset." (2007).

  42. Ha, Kiryong, Padmanabhan Pillai, Grace Lewis, Soumya Simanta, Sarah Clinch, Nigel Davies, and Mahadev Satyanarayanan. "The impact of mobile multimedia applications on data center consolidation." In IEEE international conference on cloud engineering (IC2E), pp. 166–176, 2013.

  43. Felemban M, Basalamah S, Ghafoor A (2013) A distributed cloud architecture for mobile multimedia services. IEEE Netw 27(5):20–27

    Article  Google Scholar 

  44. Nan, Xiaoming, Yifeng He, and Ling Guan. "Optimal resource allocation for multimedia cloud in priority service scheme." In IEEE International Symposium on Circuits and Systems, pp. 1111–1114, 2012.

  45. Yassine A, Shirehjini AAN, Shirmohammadi S (2016) Bandwidth on-demand for multimedia big data transfer across geo-distributed cloud data centers. IEEE Trans Cloud Comput

  46. Han G, Que W, Jia G, Shu L (2016) An efficient virtual machine consolidation scheme for multimedia cloud computing. Sensors 16(2):246

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Shahaboddin Shamshirband.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Abbasi, A.A., Javed, S. & Shamshirband, S. An intelligent memory caching architecture for data-intensive multimedia applications. Multimed Tools Appl 80, 16743–16761 (2021). https://doi.org/10.1007/s11042-020-08805-w

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-020-08805-w

Keywords

Navigation