Abstract
If the frame size of a multimedia encoder is small, Internet Protocol (IP) streaming applications need to pack many encoded media frames in each Real-time Transport Protocol (RTP) packet to avoid unnecessary header overhead. The generic forward error correction (FEC) mechanisms proposed in the literature for RTP transmission do not perform optimally in terms of stability when the RTP payload consists of several individual data elements of equal priority. In this paper, we present a novel approach for generating FEC packets optimized for applications packing multiple individually decodable media frames in each RTP payload. In the proposed method, a set of frames and its corresponding FEC data are spread among multiple packets so that the experienced frame loss rate does not vary greatly under different packet loss patterns. We verify the performance improvement gained against traditional generic FEC by analyzing and comparing the variance of the residual frame loss rate in the proposed packetization scheme and in the baseline generic FEC.











Similar content being viewed by others
References
Bormann C (ed) (2001) Robust header compression (ROHC): framework and four profiles: RTP, UDP, ESP and uncompressed. IETF RFC 3095
Chan K, Lu J, Chuang J (1999, May) Block shuffling and adaptive interleaving for still image transmission over Rayleigh fading channels. In: IEEE Transactions on Vehicular Technology 48(3):1002–1011
Claypool M, Zhu Y (2003, May) Using interleaving to ameliorate the effects of packet loss in a video stream. In: Proc. of the International Workshop on Multimedia Network Systems and Applications (MNSA). Providence, Rhode Island, pp. 508–513
Garey MR, Johnson DS (1979) Computers and intractability. A guide to the NP-completeness. Freeman, New York
3rd Generation Partnership Project (2004) Transparent end-to-end packet switched streaming service (PSS); RTP usage model. 3GPP TR 26.937 V6.0.0
Korhonen J (2002, May) Error robustness scheme for perceptually coded audio based on interframe shuffling of samples. In: Proc. of IEEE International Conference on Acoustics, Speech and Signal Processing, Orlando, Florida, pp. 2053–2056
Li V, Zhang Z (2002) Internet multicast routing and transport protocols. In: Proc. of the IEEE 90(3):360–391
Loguinov D, Radha H (2001, November) Measurement study of low bitrate internet video streaming. In: Proc. of the ACM SIGCOMM Workshop on Internet Measurement, San Francisco, pp. 281–293
Markopoulou A, Tobagi F, Karam M (2003, October) Assessing the quality of voice communications over internet backbones. In: IEEE/ACM Transactions of Networking 11(5):747–760
Nonnenmacher J, Biersach E, Towsley J (1998, August) Parity-based loss recovery for reliable multicast transmission. In: IEEE/ACM Transactions on Networking 6(4):289–300
Perkins C, Crowcroft J (2000, March,) Effects of interleaving on RTP header compression. In: Proc. of the IEEE INFOCOM, Tel Aviv, Israel, pp. 111–117
Perkins C, Hodson O, Hardman V (1998, September/October) A survey of packet loss recovery techniques for streaming audio. In: IEEE Network 12(5):40–48
Rey J, Leon D, D, Rey J, Miyazaki A, Varsa V, Hakenberg R (2004, January) RTP retransmission payload format. IETF AVT Internet Draft. Work in progress
Rosenberg J, Schultzrinne H (1999) An RTP payload format for generic forward error correction. IETF RFC 2733
Schultzrinne H, Casner S, Frederick R, Jacobson V (2003) RTP: a transport protocol for real-time applications. IETF RFC 3550
Stockhammer T, Wiegand T, Oelbaum T, Obermeier F (2003, September) Video coding and transport layer techniques for H.264/AVC-based transmission over packet-lossy networks. In: Proceedings of IEEE International Conference on Image Processing, vol. 3, Barcelona, Spain, pp. 481–484
Wah BW, Su X, Lin D (2001, September) A survey of error-concealment schemes for real-time audio and video transmissions over the internet. In: Proc. of IEEE International Symposium on Multimedia Software Engineering, Taipei, Taiwan, pp. 17–24
Wang Y, Huang W, Korhonen J (2004, October) A framework for robust and scalable audio streaming. In: Proc. of the ACM Multimedia '04, New York, pp. 144–151
Zhai F, Eisenberg Y, Luna CE, Pappas TN, Berry R, Katsaggelos AK (2003, October) Packetization schemes for forward error correction in internet video streaming. In: Proc. of the Allerton Conference on Communication, Control and Computing
Zhu Q-F, Wang Y, Shaw L (1993, June) Coding and cell loss recovery for DCT-based packet video. In: IEEE Transactions on Circuits and Systems for Video Technology 3(3):248–258
Zlatokrilov H, Levy H (2004, March) Packet dispersion and quality of voice over IP applications in IP networks. In: Proc. of IEEE INFOCOM 2, Hong Kong, pp. 1170–1180
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Korhonen, J., Huang, Y. & Wang, Y. Generic forward error correction of short frames for IP streaming applications. Multimed Tools Appl 29, 305–323 (2006). https://doi.org/10.1007/s11042-006-0016-4
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-006-0016-4