Skip to main content

Joint Video Transcoding and Representation Selection for Edge-Assisted Multi-party Video Conferencing

  • Conference paper
  • First Online:
Algorithms and Architectures for Parallel Processing (ICA3PP 2023)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 14487))

  • 116 Accesses

Abstract

Current cloud-based multi-party video conferencing suffers from heavy workloads on media servers caused by video transcoding. Emerging edge computing can assist in offloading transcoding tasks to edge nodes. However, the resource-limited nature of edge nodes poses new challenges. First, edge nodes can real-timely transcode a video into only a subset of representations, raising the video transcoding problem of what is the set of representations each participant should transcode its video stream into. Second, since participants’ downlink resources are limited, one needs to solve the representation selection problem of what representation each participant should select for receiving another participant’s video. Third, the above two problems are coupled and should be optimized simultaneously. Hence, this paper studies the joint video transcoding and representation selection problem for edge-assisted multi-party video conferencing, with the aim of maximizing the overall QoE under the resource and real-time video transcoding constraints. Such a problem is formulated as a non-linear integer program and is NP-hard. To solve it, we leverage the submodular optimization technique and propose a \((1-\frac{1}{e})\) -approximate algorithm with the polynomial computation complexity. Finally, extensive trace-driven simulations are conducted to evaluate the proposed algorithm. The results show that it outperforms the alternatives by 1.5–2.5\(\times \) on average in terms of overall QoE.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 59.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 79.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Ahmed, A., Shafiq, Z., Bedi, H., Khakpour, A.: Suffering from buffering? Detecting QoE impairments in live video streams. In: 2017 IEEE 25th International Conference on Network Protocols (ICNP), pp. 1–10. IEEE (2017)

    Google Scholar 

  2. Akhtar, Z., et al.: Oboe: auto-tuning video ABR algorithms to network conditions. In: Proceedings of the 2018 Conference of the ACM Special Interest Group on Data Communication, pp. 44–58 (2018)

    Google Scholar 

  3. Block, P., et al.: Social network-based distancing strategies to flatten the Covid-19 curve in a post-lockdown world. Nat. Hum. Behav. 4(6), 588–596 (2020). https://doi.org/10.1038/s41562-020-0898-6

    Article  Google Scholar 

  4. Cermak, G., Pinson, M., Wolf, S.: The relationship among video quality, screen resolution, and bit rate. IEEE Trans. Broadcast. 57(2), 258–262 (2011)

    Article  Google Scholar 

  5. Chang, H., Varvello, M., Hao, F., Mukherjee, S.: Can you see me now? A measurement study of Zoom, Webex, and Meet. In: Proceedings of the 21st ACM Internet Measurement Conference, pp. 216–228 (2021)

    Google Scholar 

  6. Chen, X., Chen, M., Li, B., Zhao, Y., Wu, Y., Li, J.: Celerity: a low-delay multi-party conferencing solution. In: Proceedings of the 19th ACM International Conference on Multimedia, pp. 493–502 (2011)

    Google Scholar 

  7. Dogga, P., Chakraborty, S., Mitra, S., Netravali, R.: Edge-based transcoding for adaptive live video streaming. In: HotEdge (2019)

    Google Scholar 

  8. Feng, Y., Li, B., Li, B.: Airlift: video conferencing as a cloud service using inter-datacenter networks. In: 2012 20th IEEE International Conference on Network Protocols (ICNP), pp. 1–11. IEEE (2012)

    Google Scholar 

  9. FFmpeg (2022). https://ffmpeg.org/. Accessed Jan 2022

  10. Preset parameter in H.264 (2022). https://trac.ffmpeg.org/wiki/Encode/H.264. Accessed Jan 2022

  11. Fujishige, S.: Submodular Functions and Optimization. Elsevier (2005)

    Google Scholar 

  12. Hajiesmaili, M.H., Mak, L.T., Wang, Z., Wu, C., Chen, M., Khonsari, A.: Cost-effective low-delay design for multiparty cloud video conferencing. IEEE Trans. Multimedia 19(12), 2760–2774 (2017)

    Article  Google Scholar 

  13. Krause, A., Golovin, D.: Submodular function maximization. Tractability 3, 71–104 (2014)

    Article  MathSciNet  Google Scholar 

  14. Kurdoglu, E., Liu, Y., Wang, Y.: Dealing with user heterogeneity in P2P multi-party video conferencing: layered distribution versus partitioned simulcast. IEEE Trans. Multimedia 18(1), 90–101 (2015)

    Article  Google Scholar 

  15. Liu, Y., Yu, F.R., Li, X., Ji, H., Leung, V.C.: Decentralized resource allocation for video transcoding and delivery in blockchain-based system with mobile edge computing. IEEE Trans. Veh. Technol. 68(11), 11169–11185 (2019)

    Article  Google Scholar 

  16. Mao, H., Netravali, R., Alizadeh, M.: Neural adaptive video streaming with pensieve. In: Proceedings of the Conference of the ACM Special Interest Group on Data Communication, pp. 197–210 (2017)

    Google Scholar 

  17. Video conferencing market (2023). http://www.gminsights.com/industry-analysis/video-conferencing-market. Accessed 15 May 2023

  18. Ooi, W.T., van Renesse, R.: Distributing media transformation over multiple media gateways. In: Proceedings of the Ninth ACM International Conference on Multimedia, pp. 159–168 (2001)

    Google Scholar 

  19. Sengupta, S., Ganguly, N., Chakraborty, S., De, P.: HotDASH: hotspot aware adaptive video streaming using deep reinforcement learning. In: 2018 IEEE 26th International Conference on Network Protocols (ICNP), pp. 165–175. IEEE (2018)

    Google Scholar 

  20. Shi, W., et al.: Learning-based fuzzy bitrate matching at the edge for adaptive video streaming. In: Proceedings of the ACM Web Conference 2022, pp. 3289–3297 (2022)

    Google Scholar 

  21. Spiteri, K., Urgaonkar, R., Sitaraman, R.K.: Bola: Near-optimal bitrate adaptation for online videos. IEEE/ACM Trans. Netw. 28(4), 1698–1711 (2020)

    Article  Google Scholar 

  22. Van Der Hooft, J., et al.: HTTP/2-based adaptive streaming of HEVC video over 4G/LTE networks. IEEE Commun. Lett. 20(11), 2177–2180 (2016)

    Article  Google Scholar 

  23. Wang, Z., et al.: MultiLive: adaptive bitrate control for low-delay multi-party interactive live streaming. IEEE/ACM Trans. Netw. 30(2), 923–938 (2021)

    Article  Google Scholar 

  24. Wei, J., Bojja Venkatakrishnan, S.: DecVi: adaptive video conferencing on open peer-to-peer networks. In: 24th International Conference on Distributed Computing and Networking, pp. 336–341 (2023)

    Google Scholar 

  25. Wu, Y., Wu, C., Li, B., Lau, F.C.: vSkyConf: cloud-assisted multi-party mobile video conferencing. In: Proceedings of the Second ACM SIGCOMM Workshop on Mobile Cloud Computing, pp. 33–38 (2013)

    Google Scholar 

  26. Yadav, P.K., Shafiei, A., Ooi, W.T.: QUETRA: a queuing theory approach to dash rate adaptation. In: Proceedings of the 25th ACM International Conference on Multimedia, pp. 1130–1138 (2017)

    Google Scholar 

Download references

Acknowledgments

This work is partially supported by National Science Foundation of China, under grant No. 61832005; China University Industry Research Innovation Foundation, under grant No. 2021FNA04005.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Zhuzhong Qian .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Kong, F. et al. (2024). Joint Video Transcoding and Representation Selection for Edge-Assisted Multi-party Video Conferencing. In: Tari, Z., Li, K., Wu, H. (eds) Algorithms and Architectures for Parallel Processing. ICA3PP 2023. Lecture Notes in Computer Science, vol 14487. Springer, Singapore. https://doi.org/10.1007/978-981-97-0834-5_22

Download citation

  • DOI: https://doi.org/10.1007/978-981-97-0834-5_22

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-97-0833-8

  • Online ISBN: 978-981-97-0834-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics