Zixia Huang
Klara Nahrstedt
Skip Abstract Section
Abstract
The evolution of multimedia applications has drastically changed human life and behaviors. New communication technologies lead to new requirements for multimedia synchronization. This article presents a historical view of temporal synchronization studies focusing on continuous multimedia. We demonstrate how the development of multimedia systems has created new challenges for synchronization technologies. We conclude with a new application-dependent, multilocation, multirequirement synchronization framework to address these new challenges.
- Akyildiz, I. F. and Yen, W. 1996. Multimedia group synchronization protocols for integrated services networks. IEEE J. Select. Areas Commun. 14, 1, 162--173. Google Scholar
Digital Library
- Anderson, D. P. and Homsy, G. 1991. A continuous media I/O server and its synchronization mechanism. IEEE Comput. 24, 10, 51--57. Google ScholarDigital Library
- Bailey, B., Konstan, J., Cooley, R., and Dejong, M. 1998. Nsync—a toolkit for building interactive multimedia presentations. In Proceedings of the ACM International Conference on Multimedia. 257--266. Google ScholarDigital Library
- Barrios, R. 1995. Examination of early sound musicals, with extensive coverage of Vitaphone. In A Song in the Dark, Oxford University Press.Google Scholar
- BellLabs. 1969. The picture of the future. Bell Labs Record 47, 134--186.Google Scholar
- Blakowski, G. and Steinmetz, R. 1996. A media synchronization survey: Reference model, specification, and case studies. IEEE J. Select. Areas Commun. 14, 1, 5--35. Google ScholarDigital Library
- Blesser, B. 1978. Digitization of audio: A comprehensive examination of theory, implementation, and current practice. J. Audio Engi. Soci. 26, 739--771.Google Scholar
- Boronat, F., Cebollada, J. C. G., and Mauri, J. L. 2008. Study of delay jitter with and without peak rate enforcement. J. Multimedia Tools Appli. 40, 2, 285--319. Google ScholarDigital Library
- Boronat, F., Lloret, J., and Garcia, M. 2009. Multimedia group and inter-stream synchronization techniques: A comparative study. Inf. Syst. 34, 108--131. Google ScholarDigital Library
- Brandenburg, R., Stokking, H., van Deventer, O., Vaishnari, I., Boronat, F., and Montagud, M. 2012. IETF draft: RTCP for inter-destination media synchronization. http://tods.ietf.org/agenda/80/slides/artcore-5.pdf.Google Scholar
- Buchanan, M. and Zellweger, P. 2005. Automatic temporal layout mechanisms revisited. ACM Trans. Multimedia Comput. Commun. Appl. 1, 1, 60--88. Google ScholarDigital Library
- Bulterman, D. 1993. Specification and support of adaptable networked multimedia. Multimedia Syst. 1, 2, 68--76.Google ScholarDigital Library
- Bunn, J., Newman, H., and Wilkinson, R. 1998. Status report from the Caltech/CERN/HP “GIOD” joint project: Globally interconnected object databases. In Proceedings of the Conference on Computing in High Energy Physics.Google Scholar
- Campbell, A., Coulson, G., Garcla, F., and Hutchison, D. 1992. Orchestration services for distributed multimedia synchronisation. In Proceedings of the IFIP International Conference on High Performance Networking. Google ScholarDigital Library
- Cluver, K. and Noll, P. 1996. Reconstruction of missing speech frames using sub-band excitation. In Proceedings of the IEEE International Symposium on Time-Frequency and Time-Scale Analysis. 277--280.Google Scholar
- Cronin, E., Kurc, A. R., Filstrup, B., and Jamin, S. 2004. An efficient synchronization mechanism for mirrored game architectures. In Proceedings of the 1st Workshop on Network and Support Systems for Games. Google ScholarDigital Library
- Curcio, I. and Lundan, M. 2007. Human perception of lip synchronization in mobile environment. In Proceedings of the IEEE International Symposium on a World of Wireless, Mobile and Multimedia Networks.Google Scholar
- Damer, B. 1998. Avatars: Exploring and Building Virtual Worlds on the Internet. Peachpit Press. Google ScholarDigital Library
- Dannenberg, R. and Stern, R. 1993. Experiments concerning the allowable skew of two audio channels operating in the stereo mode. Personal Communications.Google Scholar
- Ehley, L., Furth, B., and Ilyas, M. 1994. Evaluation of multimedia synchronization techniques. In Proceedings of the International Conference on Multimedia Computing and Systems. 110--119.Google Scholar
- Fujimoto, T., Ishibashi, Y., and Sugawara, S. 2008. Influences of inter-stream synchronization error on collaborative work in haptic and visual environments. In Proceedings of the IEEE Symposium on Haptic Interfaces for Virtual Environment and Teleoperator System. 113--119. Google ScholarDigital Library
- Gardner, B. 1992. A realtime multichannel room simulator. In Proceedings of the 124th Meeting of the Acoustical Society of America.Google Scholar
- Ghinea, G. and Ademoye, O. A. 2010. Perceived synchronization of olfactory multimedia. IEEE Trans. Syst. Man, Cybernet. 40, 4, 657--663. Google ScholarDigital Library
- Goldmann, L., Lee, J.-S., and Ebrahimi, T. 2010. Temporal synchronization in stereoscopic video: Influence on quality of experience and automatic asynchrony detection. In Proceedings of the IEEE International Conference on Image Processing. 3241--3244.Google Scholar
- Hodges, M., Sasnett, R., and Ackerman, M. 1989. Athena Mouse: A construction set for multimedia applications. IEEE Software. Google ScholarDigital Library
- Hoshino, S., Ishibashi, Y., Fukushima, N., and Sugawara, S. 2011. Qoe assessment in olfactory and haptic media transmission: Influence of inter-stream synchronization error. In Proceedings of the IEEE International Workshop on Communications Quality and Reliability. 1--6.Google Scholar
- Hu, N. and Steenkiste, P. 2002. Estimating available bandwidth using packet pair probing. Tech. rep. CMU-CS-02-166. Carnegie Mellon University.Google Scholar
- Huang, Z. 2012. Synchronized distribution framework for high-quality multi-modal interactive teleimmersion. Ph.D. Dissertation, University of Illinois at Urbana-Champaign, Urbana, IL.Google Scholar
- Huang, Z., Mei, C., Li, L., and Woo, T. 2011. Cloudstream: Delivering high-quality streaming video through a cloud-based H.264/SVC proxy. In Proceedings of the IEEE International Conference on Computer Communications.Google Scholar
- Huang, Z., Wu, W., Nahrstedt, K., Arefin, A., and Rivas, R. 2010. Tsync: A new synchronization framework for multi-site 3D tele-immersion. In Proceedings of the ACM Workshop on Network and Operating Systems Support for Digital Audio and Video. Google ScholarDigital Library
- Huang, Z., Wu, W., Nahrstedt, K., Rivas, R., and Arefin, A. 2011. Synccast: Synchronized dissemination in multi-site interactive 3D tele-immersion. In Proceedings of the ACM Multimedia Systems Conference. Google ScholarDigital Library
- IEEE. 2008. IEEE 1588 standard: Precise time synchronization as the basis for real time applications in automation. http://www.nist.gov/el/isd/ieee/ieee1588.cfm.Google Scholar
- IETF. 2003. IETF RFC3550 standard - RTP: A transport protocol for real-time applications. http://www.ietf.org/rfc/rfc3550.txt.Google Scholar
- Ishibashi, Y. and Tasaka, S. 2000. A comparative survey of synchronization algorithms for continuous media in network environments. In Proceedings of the IEEE Conference on Local Computer Networks. 337--348. Google ScholarDigital Library
- Ishibashi, Y., Tsuji, A., and Tasaka, S. 1997. A group synchronization mechanism for stored media in multicast communications. In Proceedings of the Annual Joint Conference of the IEEE Computer and Communications Societies. 692--700. Google ScholarDigital Library
- Kohler, E., Handley, M., and Floyd, S. 2006. RFC4340: Datagram congestion control protocol (DCCP).Google Scholar
- Leroux, P., Verstraete, V., De Turck, F., and Demeester, P. 2007. Synchronized interactive services for mobile devices over ipdc/dvb-h and umts. In Proceedings of the IEEE/IFIP International Workshop on Broadband Convergence Networks. 1--12.Google Scholar
- Little, T. 1993. A framework for synchronous delivery of time-depdent multimedia data. Multimedia Syst. 1, 2, 87--94.Google ScholarDigital Library
- Little, T. and Ghafoor, A. 1991. Spatio-temporal composition of distributed multimedia objects for value-added networks. IEEE Computer 24, 10, 42--50. Google ScholarDigital Library
- Meyer, T., Effelsberg, W., and Steinmetz, R. 1994. A taxonomy on multimedia synchronization. In Proceedings of the IEEE Workshop on Future Trends of Distributed Computing Systems. 97--103.Google Scholar
- Michel, U. 2006. History of acoustic beamforming. In Proceedings of the Berlin Beamforming Conference.Google Scholar
- PictureTel. 1991. Picturetel in project with I.B.M. New York Times, October 22, 1991.Google Scholar
- Qiao, L. and Nahrstedt, K. 1997. Lip synchronizatioin within an adaptive VoD. In Proceedings of the SPIE Multimedia Computing and Network. 170--181.Google Scholar
- Ramanathan, S. and Rangan, P. 1993. Feedback techniques for intra-media continuity and inter-media synchronization in distributed media systems. Computer J. 36, 1, 19--31.Google ScholarCross Ref
- Ravindran, K. and Bansal, V. 1993. Delay compensation protocols for synchronization of multimedia data streams. IEEE Trans. Knowl. Data Eng. 4, 5, 574--589. Google ScholarDigital Library
- Rothermel, K. and Helbig, T. 1995. An adaptive stream synchronization protocol. In Proceedings of the ACM International Workshop on Network and Operating System Support for Digital Audio and Video. 189--202. Google ScholarDigital Library
- Rouskas, G. N. and Baldine, I. 1997. Multicast routing with end-to-end delay and delay variation constraints. IEEE J. Select. Areas Commun. 15, 3, 346--356. Google ScholarDigital Library
- Shi, S. Y., Turner, J. S., and Waldvogel, M. 2001. Dimensioning server access bandwidth and multicast routing in overlay networks. In Proceedings of the ACM International Workshop on Network and Operating System Support for Digital Audio and Video. 83--92. Google ScholarDigital Library
- Steinmetz, R. 1990. Analyse von synchronisation mechanismen mit anwendung im multimedia-bereich. In Proceedings of the GI ITG Workshop Sprachen und System zur Parallelverarbeitung. 39--47.Google Scholar
- Steinmetz, R. and Engler, C. 1993. Human perception of media synchronization. Tech. rep. 43.9310, IBM European Networking Center Heidelberg.Google Scholar
- Steinmetz, R. and Nahrstedt, K. 1995. Multimedia Computing, Communications and Applications. Prentice Hall. Google ScholarDigital Library
- Stockham, T. 1972. A/D and D/A converters: Their effect on digital audio fidelity. In Digital Signal Processing, IEEE Press, 55--66.Google Scholar
- Tov, S.-Y. 2005. Happy 10th birthday, VoIP. Haaretz, June 16, 2005.Google Scholar
- Wahl, T. and Rothermel, K. 1994. Representing time in multimedia systems. In Proceedings of the IEEE International Conference on Multimedia Computing and Systems. 538--543.Google Scholar
- Wallis, A. 1995. Cambridge corners the future in networking. TWANZ 5, 10.Google Scholar
- Williams, A., Gross, K., Brandenburg, R., and Stokking, H. 2013. RTP clock source signalling. IETF.Google Scholar
- Woo, M., Qazi, N., and Ghafoor, A. 1994. A synchronization framework for communication of pre-orchestrated multimedia information. IEEE Netw. 1, 8, 52--61. Google ScholarDigital Library
- Yang, Z., Wu, W., Nahrstedt, K., Kurillo, G., and Bajcsy, R. 2010. Enabling multi-party 3d tele-immersive environments with viewcast. ACM Trans. Multimedia Comput. Commun. Appl. 6, 2. Google ScholarCross Ref
- Yavatkar, R. 1992. MCP: A protocol for coordination and temporal synchronization in collaborative applications. In Proceedings of the IEEE International Conference Distributed Computing Systems. 606--613.Google ScholarCross Ref
- Zimmermann, R. and Liang, K. 2008. Spatialized audio streaming for networked virtual environments. In Proceedings of the ACM International Conference on Multimedia. 299--308. Google ScholarDigital Library
Index Terms
- Evolution of temporal multimedia synchronization principles: A historical viewpoint
Recommendations
Modeling distributed multimedia synchronization with DSPN
AbstractMultimedia synchronization is the essential technology for the integration of multimedia in distributed multimedia systems. The multimedia synchronization model has been recognized by many researchers as a premise of the implementation of ...
Design and Evaluation of a Distributed Multimedia Synchronization Algorithm using Media Scalings and Variable Service Rates
ICPADS '97: Proceedings of the 1997 International Conference on Parallel and Distributed SystemsThis paper presents a distributed multimedia synchronization algorithm that supports both intramedia and intermedia Synchronizations. The intramedia synchronization is achieved by media scaling techniques, and the intermedia synchronization is achieved ...
A New Look At Multimedia Synchronization in Distributed Environments
ISPAN '99: Proceedings of the 1999 International Symposium on Parallel Architectures, Algorithms and NetworksA multimedia system requires to handle automatically and uniformly the generation, manipulation, presentation, storage, and communication of independent discrete and continuous media data. The synchronization between various kinds of media data is a key ...
Comments