Skip to main content
SpringerLink
Log in

A client-driven media synchronization mechanism for RTP packet-based video streaming

  • Special Issue Paper
  • Published:
Journal of Real-Time Image Processing Aims and scope Submit manuscript

Abstract

Media synchronization is used to correctly playback a video stream with its associated audio. To support synchronization between video and audio streams transported over IP networks, an RTP/RTCP protocol suite is usually employed. In conventional server-driven media synchronization, the server needs to periodically transmit an RTCP sender report (SR) packet to provide the client with a UTC time in NTP format corresponding to the RTP timestamp carried by each RTP packet. In this paper, we propose a precise client-driven media synchronization mechanism for an RTP packet-based multimedia streaming service. In the proposed method, the server does not need to send any RTCP SR packets for synchronization. Instead, the client device derives the precise normal play time (NPT) for each video and audio stream from the received RTP packets containing an RTP timestamp. Simulations show that the proposed client-driven synchronization method can provide accurate media synchronization without employing an RTCP SR packet and accordingly reduce the initial synchronization delay, the processing complexity at the client device, the number of required user datagram protocol ports, and the amount of control traffic injected into the network.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. Schulzrinne, H., Casner, S., Frederick, R., Jacobson, V.: Real-time transport protocol. In: IETF RFC 3550, (2003)

  2. Wu, D., Hou, Y., Zhang, Y.: Transporting real-time video over the internet: challenges and approaches. Proc. IEEE 88(12), 1855–1877 (2000)

    Article  Google Scholar 

  3. Bertoglio, L., Migliorati, P.: Intermedia synchronization for video conference over IP. Sig. Process. Image Commun. 15(1), 149–164 (1999)

    Article  Google Scholar 

  4. Kazyuki, T., Imai, N., Isomur, M., Idoue, A.: A media synchronization method for real-time group communication in a multiple device environment. In: International Conference on Intelligence in Next Generation Networks (ICIN), pp. 1–6 (2009)

  5. Mills, D.: Network time protocol (version 3) specification, implementation and analysis. In: IETF RFC 1305, (1992)

  6. Perkins, C.: RTP: audio and video for the Internet, 3rd edn. Addison Wesley, pp. 15–48 (2005)

  7. Begic, Z., Bajric, H., Kos, M.: Rapid synchronization of RTP multicast sessions. In: EURO-NF Conference on Next Generation Internet, pp. 1–7 (2010)

  8. Segui, F., Cebollada, J., Mauri, J.: Multimedia group synchronization algorithm based on RTP/RTCP. In: IEEE International Symposium on Multimedia, pp. 754–757 (2006)

  9. Boukerche, A., Owens, H.: Media synchronization and QoS packet scheduling algorithms for wireless systems. Mob. Netw. Appl. 10(1), 233–249 (2005)

    Article  Google Scholar 

  10. Wenger, S., Hannuksela, M., Westerlund, M., Singer, D.: RTP payload format for H.264 video. In: IETF RFC 3984, (2005)

  11. You, Y., Kim, D., Jung, S.: Novel A/V synchronization method for portable T-DMB players supporting BIFS. IEEE Trans. Consumer Electron. 55(4), 1860–1865 (2009)

    Article  Google Scholar 

  12. Watson, M., Buettner, P.: Design and implementation of AAC decoders. IEEE Trans. Consumer Electron. 46(3), 819–824 (2000)

    Article  Google Scholar 

  13. Miller, G., Licklider, J.: The intelligibility of interrupted speech. J. Acoust. Soc. Am. 22(2), 167–173 (1950)

    Article  Google Scholar 

  14. Timmerer, C., Waltl, M., Rainer, B., Hellwagner, H.: Assessing the quality of sensory experience for multimedia presentations. Sig. Process. Image Commun. 27(8), 909–916 (2012)

    Article  Google Scholar 

  15. Curcio, I., M. Lundan, M.: Human perception of lip synchronization in mobile environment. In: IEEE International Symposium on a World of Wireless, Mobile, and Multimedia Networks (WoWMoM), pp. 1–7 (2007)

  16. Din, S., Bulterman, D.: Synchronization techniques in distributed multimedia presentation, In: The Fourth International Conferences on Advances in Multimedia (MMEDIA), pp. 1–9 (2012)

  17. Open-source version of Apple’s QuickTime streaming server technology: Darwin Streaming Server, available on-line at http://dss.macosforge.org/(2013)

  18. Steinmetz, R.: Human perception of jitter and media synchronization. IEEE J. Sel. Areas Commun. 14(1), 61–72 (1996)

    Article  Google Scholar 

  19. Huang, Z., Nahrstedt, K.: Perception-based playout scheduling for high-quality real-time interactive multimedia. In: IEEE Conference on Computer Communications (INFOCOM), pp. 2786–2790 (2012)

  20. ITU-T Rec. H.264 and ISO/IEC 14496-10, AVC.: Advanced video coding for generic audiovisual services, (2005)

  21. ITU-T Rec. H.265 and ISO/IEC 23008-2 MPEG-H Part 2.: High efficiency video coding (HEVC), (2013)

Download references

Acknowledgments

This research was supported by the MSIP (Ministry of Science, ICT and Future Planning), Korea, under the ITRC (Information Technology Research Center) support program (IITP-2015-H8501-15-1001) supervised by the IITP (Institute for Information & Communications Technology Promotion), and by the Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education, Science and Technology (NRF-2013R1A1A2011635).

Author information

Authors and Affiliations

  1. Yonsei University, Wonju, Republic of Korea

    Tae-jun Jung & Kwang-deok Seo

Authors
  1. Tae-jun Jung
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Kwang-deok Seo
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Kwang-deok Seo.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Jung, Tj., Seo, Kd. A client-driven media synchronization mechanism for RTP packet-based video streaming. J Real-Time Image Proc 12, 455–464 (2016). https://doi.org/10.1007/s11554-015-0497-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11554-015-0497-3

Keywords

Search

Navigation