Hwangje Han
ABSTRACT
Dynamically adaptive streaming over HTTP (DASH), the most common streaming technique, requires a video server to store all the transcoded versions, resulting in a lot of storage space, thereby consuming a significant disk power. A disk array can be divided into hot and cold zones to allow cold disks to be spun down, but this poses several questions such as (1) which video segments can be stored on the hot disks, (2) how to allocate video segments among the hot disks, and (3) how to handle requests to the cold disks. To address this, we propose three new algorithms; (1) a hot data classification algorithm to determine which segments should be stored on the hot disks, by taking segment popularity and quality-of-experience (QoE) into account, (2) a video segment allocation algorithm to balance workloads among the hot disks, and (3) a disk bandwidth allocation algorithm which determines the bit-rate of each segment with the aim of maximizing overall QoE. Experimental results show that our scheme can reduce the power consumption between 29% and 46% compared with the method of storing all the transcoded versions at the cost of 1.5% QoE degradation.
- Youtube bandwidth: terrabytes per day, http://blog.forret.com/2006/05/youtube-bandwidth-terabytes-per-day/.Google Scholar
- T. Stockhammer. Dynamic adaptive streaming over http: standards and design principles. In Proceedings of the ACM Multimedia Systems Conference, pages 133--144, 2011. Google ScholarDigital Library
- L. Toni, R. Aparicio-Pardo, G. Simon, A. Blanc, and P. Frossard. Optimal set of video representations in adaptive streaming. In Proceedings of the ACM Multimedia Systems Conference, pages 271--282, 2014. Google ScholarDigital Library
- D. Krishnappa, M. Zink, and R. Sitaraman. Optimizing the video transcoding workflow in content delivery networks. In Proceedings of the ACM Multimedia Systems Conference, pages 37--48, 2015. Google ScholarDigital Library
- M. Dayarathna, Y. Wen and R. Fan. Data center energy consumption modeling: A survey. IEEE communication surveys & tutorials, 18(1):732--794, Jan. 2016.Google Scholar
- M. G. Khatib and Z. Bandic. PCAP: Performance -aware power capping for the disk drive in the cloud. In Proceedings of the USENIX FAST, pages 227--240, Feb. 2016. Google ScholarDigital Library
- R. Black, A. Donnelly, D. Harper, A. Ogus, and A. Rowstron. Feeding the pelican: Using archival hard drives for cold storage racks. In Proceedings of the USENIX Workshop on Hot Topics in Storage and File Systems, pages 29--34, June 2016. Google ScholarDigital Library
- B. Shen, S. Lee, and S. Basu. Caching strategies in transcoding-enabled proxy systems for streaming media distribution networks. IEEE Transactions on Multimedia, 6(2):375--386, Apr. 2004. Google ScholarDigital Library
- H. Zhao, Q. Zheng, W. Zhang, B. Du, and H. Li. A segment-based storage and transcoding trade-off strategy for multi-version vod systems in the cloud. IEEE Transactions on Multimedia, 19(1):149--159, Jan. 2017. Google ScholarDigital Library
- R. Aparicio-Pardo, K. Pires, A. Blanc, and G. Simon. Transcoding live adaptive video streams at a massive scale in the cloud. In Proceedings of the ACM Multimedia Systems Conference, pages 49--60, 2015. Google ScholarDigital Library
- W. Zhang, Y. Wen, J. Cai, and D. Wu. Towards transcoding as a service in multimedia cloud: Energy-efficient job dispatching algorithm. IEEE Transactions on Vehicular Technology, 63(5):2002--2012, June 2014.Google ScholarCross Ref
- M. Song, Y. Lee, and J. Park. Scheduling a video transcoding server to save energy. ACM Transactions on Multimedia Computing Communications and Applications, 11(2s):45, Feb. 2015. Google ScholarDigital Library
- https://www.enterprisetech.com/2013/10/25/facebook-loads-innovative-cold-storage-datacenter/.Google Scholar
- Z. Wang, A. Bovik, H. Sheikh, and E. Simoncelli. Image quality assessment: From error visibility to structural similarity. IEEE Transactions on Image Processing, 13(4):600--612, Apr. 2004. Google ScholarDigital Library
- D. Pisinger. Algorithms for Knapsack Problems. PhD thesis, University of Copenhagen, 1995.Google Scholar
- M. Song, Y. Lee, and E. Kim. Saving disk energy in video servers by combining caching and prefetching. ACM Transactions on Multimedia Computing Communications and Applications, 10(1s):15, Jan. 2014. Google ScholarDigital Library
- T. Zinner, O. Hohlfeld, O. Abboud, and T. Hossfeld. Impact of frame rate and resolution on objective qoe metrics. In Proceedings of the IEEE International Workshop on Quality of Multimedia Experience, pages 29--34, June 2010.Google ScholarCross Ref
- https://toolstud.io/.Google Scholar
- A. Dan, D. Sitaram, and P. Shahabuddin. Dynamic batching policies for an on-demand video server. Multimedia Systems Journal, 4(3):112--121, 1996. Google ScholarDigital Library
- S. Lim, Y. Ko, G. Jung, J. Kim, and M. Jang. Inter-chunk popualrity-based edge-first caching in content-centric networking. IEEE Communication Letters, 18(8):1331--1334, 2014.Google ScholarCross Ref
- https://www.wdc.com/content/dam/wdc/website/downloadable_assets/eng/spec_data_sheet/2879-800002.pdf.Google Scholar
Index Terms
- QoE-Aware Video Storage Power Management Based on Hot and Cold Data Classification
Recommendations
Coupling Right-Provisioned Cold Storage Data Centers with Deduplication
ICPP '21: Proceedings of the 50th International Conference on Parallel ProcessingModern cloud-scale cold storage data centers have begun to support right-provisioning of a rack’s resources (power, cooling, etc.), which allows only a small fraction of all hard disks to be active (spinning) concurrently at any given time to reduce ...
Performance of garbage collection algorithms for flash-based solid state drives with hot/cold data
To avoid a poor random write performance, flash-based solid state drives typically rely on an internal log-structure. This log-structure reduces the write amplification and thereby improves the write throughput and extends the drive's lifespan. In this ...
Comments