Skip to main content
Log in

Generic forward error correction of short frames for IP streaming applications

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

If the frame size of a multimedia encoder is small, Internet Protocol (IP) streaming applications need to pack many encoded media frames in each Real-time Transport Protocol (RTP) packet to avoid unnecessary header overhead. The generic forward error correction (FEC) mechanisms proposed in the literature for RTP transmission do not perform optimally in terms of stability when the RTP payload consists of several individual data elements of equal priority. In this paper, we present a novel approach for generating FEC packets optimized for applications packing multiple individually decodable media frames in each RTP payload. In the proposed method, a set of frames and its corresponding FEC data are spread among multiple packets so that the experienced frame loss rate does not vary greatly under different packet loss patterns. We verify the performance improvement gained against traditional generic FEC by analyzing and comparing the variance of the residual frame loss rate in the proposed packetization scheme and in the baseline generic FEC.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. Bormann C (ed) (2001) Robust header compression (ROHC): framework and four profiles: RTP, UDP, ESP and uncompressed. IETF RFC 3095

  2. Chan K, Lu J, Chuang J (1999, May) Block shuffling and adaptive interleaving for still image transmission over Rayleigh fading channels. In: IEEE Transactions on Vehicular Technology 48(3):1002–1011

  3. Claypool M, Zhu Y (2003, May) Using interleaving to ameliorate the effects of packet loss in a video stream. In: Proc. of the International Workshop on Multimedia Network Systems and Applications (MNSA). Providence, Rhode Island, pp. 508–513

  4. Garey MR, Johnson DS (1979) Computers and intractability. A guide to the NP-completeness. Freeman, New York

    MATH  Google Scholar 

  5. 3rd Generation Partnership Project (2004) Transparent end-to-end packet switched streaming service (PSS); RTP usage model. 3GPP TR 26.937 V6.0.0

  6. Korhonen J (2002, May) Error robustness scheme for perceptually coded audio based on interframe shuffling of samples. In: Proc. of IEEE International Conference on Acoustics, Speech and Signal Processing, Orlando, Florida, pp. 2053–2056

  7. Li V, Zhang Z (2002) Internet multicast routing and transport protocols. In: Proc. of the IEEE 90(3):360–391

  8. Loguinov D, Radha H (2001, November) Measurement study of low bitrate internet video streaming. In: Proc. of the ACM SIGCOMM Workshop on Internet Measurement, San Francisco, pp. 281–293

  9. Markopoulou A, Tobagi F, Karam M (2003, October) Assessing the quality of voice communications over internet backbones. In: IEEE/ACM Transactions of Networking 11(5):747–760

  10. Nonnenmacher J, Biersach E, Towsley J (1998, August) Parity-based loss recovery for reliable multicast transmission. In: IEEE/ACM Transactions on Networking 6(4):289–300

  11. Perkins C, Crowcroft J (2000, March,) Effects of interleaving on RTP header compression. In: Proc. of the IEEE INFOCOM, Tel Aviv, Israel, pp. 111–117

  12. Perkins C, Hodson O, Hardman V (1998, September/October) A survey of packet loss recovery techniques for streaming audio. In: IEEE Network 12(5):40–48

  13. Rey J, Leon D, D, Rey J, Miyazaki A, Varsa V, Hakenberg R (2004, January) RTP retransmission payload format. IETF AVT Internet Draft. Work in progress

  14. Rosenberg J, Schultzrinne H (1999) An RTP payload format for generic forward error correction. IETF RFC 2733

  15. Schultzrinne H, Casner S, Frederick R, Jacobson V (2003) RTP: a transport protocol for real-time applications. IETF RFC 3550

  16. Stockhammer T, Wiegand T, Oelbaum T, Obermeier F (2003, September) Video coding and transport layer techniques for H.264/AVC-based transmission over packet-lossy networks. In: Proceedings of IEEE International Conference on Image Processing, vol. 3, Barcelona, Spain, pp. 481–484

  17. Wah BW, Su X, Lin D (2001, September) A survey of error-concealment schemes for real-time audio and video transmissions over the internet. In: Proc. of IEEE International Symposium on Multimedia Software Engineering, Taipei, Taiwan, pp. 17–24

  18. Wang Y, Huang W, Korhonen J (2004, October) A framework for robust and scalable audio streaming. In: Proc. of the ACM Multimedia '04, New York, pp. 144–151

  19. Zhai F, Eisenberg Y, Luna CE, Pappas TN, Berry R, Katsaggelos AK (2003, October) Packetization schemes for forward error correction in internet video streaming. In: Proc. of the Allerton Conference on Communication, Control and Computing

  20. Zhu Q-F, Wang Y, Shaw L (1993, June) Coding and cell loss recovery for DCT-based packet video. In: IEEE Transactions on Circuits and Systems for Video Technology 3(3):248–258

  21. Zlatokrilov H, Levy H (2004, March) Packet dispersion and quality of voice over IP applications in IP networks. In: Proc. of IEEE INFOCOM 2, Hong Kong, pp. 1170–1180

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ye Wang.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Korhonen, J., Huang, Y. & Wang, Y. Generic forward error correction of short frames for IP streaming applications. Multimed Tools Appl 29, 305–323 (2006). https://doi.org/10.1007/s11042-006-0016-4

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-006-0016-4

Keywords

Navigation