skip to main content
10.1145/1027527.1027554acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
Article

A framework for robust and scalable audio streaming

Published: 10 October 2004 Publication History

Abstract

We propose a framework to achieve bandwidth efficient, error robust and bitrate scalable audio streaming. Our approach is compatible with most audio compression format. The main contributions of this paper include: 1) the proposal of a Multi-Stage Interleaving (MSI) strategy which translates packet loss into loss of separate frequency components that are less perceptually significant; and 2) the design of a Layered Unequal-Sized Packetization (LUSP) scheme which enables bitrate scalability and prioritized packet transmission. The combination of the proposed MSI and LUSP allows the use of a set of simple yet effective methods of error concealment in the compressed domain. Our approach offers significant advantages over existing methods in terms of memory consumption (a savings of over 40 times in the sample MP3 implementation), and computational complexity, which are critical issues for battery-powered small devices.

References

[1]
Brandenburg, K., "MP3 and AAC Explained," Audio Engineering Society (AES) 17th International Conference on High Quality Audio Coding, Florence, Italy, September 1999
[2]
Grill, B., "A Bit Rate Scalable Perceptual Coder for MPEG-4 Audio," 103rd AES Convention, 1997, Preprint 4620
[3]
Li, J., "Embedded Audio Coding (EAC) With Implicit Auditory Masking," ACM Multimedia 2002, Juan-Les-Pins, France
[4]
Leslie, B., Sandler, M., "Packet Loss Resilient, Scalable Audio Compression and Streaming for IP Networks," 2nd International Conference on 3G Mobile Communication Technologies, pp 119--123, March 2001
[5]
Wah, B.W., Su, X. and Lin, D., "A Survey of Error Concealment Schemes for Real-time Audio and Video Transmissions over the Internet," IEEE International Symposium on Multimedia Software Engineering, Taipei, Taiwan, pp.17--24, December 2000
[6]
Perkins, C., Hodson, O., Hardman, V., "A Survey of Packet Loss Recovery Techniques for Streaming Audio," IEEE Network, pp.40--48, Sept/Oct, 1998
[7]
Zhang, Q., Wang, G., Xiong, Z., Zhou, J., Zhu, W., "Error Robust Scalable Audio Streaming over Wireless IP Networks", to appear in IEEE Trans. On Multimedia, 2004.
[8]
Herre, J., Eberlein, E., "Error Concealment in the spectral domain", 93rd AES Convention, Oct 1992, Preprint 3364
[9]
Quackenbush, S., Driessen, P., "Error Mitigation in MPEG-4 Audio Packet Communication Systems," 115th AES Convention, Oct 2003, New York, USA, Preprint 5981
[10]
Bucklein, R., "The Audibility of Frequency Response Irregularities," J. of AES, Vol.29, No.3, pp.126--131, 1981
[11]
Moore, B.C.J, "Masking in the Human Auditory System," In Collected Papers on Digital Audio Bit-Rate Reduction (Gilchrist and Crewin, eds.), pp. 9--19, AES, 1996
[12]
Brandenburg, K., Stoll, G., "ISO-MPEG-1 Audio: A Generic Standard for Coding of High Quality Digital Audio," In Collected Papers on Digital Audio Bit-Rate Reduction (Gilchrist and Crewin, eds.), pp. 31--42, AES, 1996
[13]
<http://www.3gpp.org/>
[14]
Wenger, S., "Common Conditions for Wire-line, Low Delay IP/UDP/RTP Packet Loss Resilient Testing," ITU VCEG 14th Meeting, Santa Barbara, CA, USA, September 2001
[15]
Niedzwiecki, M., Cisowski, K., "Smart Copying - A New Approach to Reconstruction of Audio Signals," IEEE Trans. Signal Processing, pp.58--63, Vol. 49, No. 10, October 2001
[16]
Korhonen, J., Wang, Y., "Schemes for Error Resilient Streaming of Perceptually Coded Audio," IEEE ICASSP2003, Hong Kong, pp. 740--743, April 2003

Cited By

View all
  • (2009)Improving audio files availability in file sharing networksProceedings of the XV Brazilian Symposium on Multimedia and the Web10.1145/1858477.1858493(1-8)Online publication date: 5-Oct-2009
  • (2009)A Survey of Music Structure Analysis Techniques for Music ApplicationsRecent Advances in Multimedia Signal Processing and Communications10.1007/978-3-642-02900-4_21(551-577)Online publication date: 2009
  • (2008)Progressive Audio Scrambling in Compressed DomainIEEE Transactions on Multimedia10.1109/TMM.2008.200137310:6(960-968)Online publication date: 1-Oct-2008
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
MULTIMEDIA '04: Proceedings of the 12th annual ACM international conference on Multimedia
October 2004
1028 pages
ISBN:1581138938
DOI:10.1145/1027527
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 October 2004

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. compressed domain processing
  2. layered unequal-sized packetization (LUSP)
  3. multi-stage interleaving (MSI)
  4. robustness
  5. scalability
  6. streaming

Qualifiers

  • Article

Conference

MM04

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 18 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2009)Improving audio files availability in file sharing networksProceedings of the XV Brazilian Symposium on Multimedia and the Web10.1145/1858477.1858493(1-8)Online publication date: 5-Oct-2009
  • (2009)A Survey of Music Structure Analysis Techniques for Music ApplicationsRecent Advances in Multimedia Signal Processing and Communications10.1007/978-3-642-02900-4_21(551-577)Online publication date: 2009
  • (2008)Progressive Audio Scrambling in Compressed DomainIEEE Transactions on Multimedia10.1109/TMM.2008.200137310:6(960-968)Online publication date: 1-Oct-2008
  • (2006)Modelling dependency in multimedia streamsProceedings of the 14th ACM international conference on Multimedia10.1145/1180639.1180845(941-950)Online publication date: 23-Oct-2006
  • (2006)Scalable audio coding for compression and loss resilient streamingIEE Proceedings - Vision, Image, and Signal Processing10.1049/ip-vis:20050054153:3(331)Online publication date: 2006
  • (2006)Generic forward error correction of short frames for IP streaming applicationsMultimedia Tools and Applications10.1007/s11042-006-0016-429:3(305-323)Online publication date: 21-Jun-2006
  • (2005)Power-aware bandwidth and stereo-image scalable audio decodingProceedings of the 13th annual ACM international conference on Multimedia10.1145/1101149.1101207(291-294)Online publication date: 6-Nov-2005
  • (2005)Power-efficient streaming for mobile terminalsProceedings of the international workshop on Network and operating systems support for digital audio and video10.1145/1065983.1065994(39-44)Online publication date: 13-Jun-2005
  • (2005)Progressive Scrambling for MP3 Audio2005 IEEE International Symposium on Circuits and Systems10.1109/ISCAS.2005.1465888(5525-5528)Online publication date: 2005
  • (2005)A perception-aware low-power software audio decoder for portable devices3rd Workshop on Embedded Systems for Real-Time Multimedia, 2005.10.1109/ESTMED.2005.1518060(13-18)Online publication date: 2005

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media