Michel D. Bondy
ABSTRACT
In this paper, we describe an experimental performance-driven animation system for an avatar face using model-based video coding and audio-track driven lip animation.
- 1.Aizawa, K., and Huang T.S. Model Based Image Coding: Advanced Video Coding Techniques for very Low Bit-Rate Applications. Proc. IEEE, vol. 3, No. 2 (Feb. 1995), pp.259-271.Google Scholar
Cross Ref
- 2.Schaphors, R. Videownferencing and Videotelephony: Technology and Standards. Artech House, Inc., 1996. Google ScholarDigital Library
- 3.Ohzu, H., and Habara, K. Behind the scenes of Virtual reality: Vision and motion. Proc. IEEE, vol. 84, No. 5, May 1996.Google Scholar
- 4.Waters, K. A. Muscle Model for Animating 3D Facial Expressions. Computer Graphics. 21(4): 17, July 1987. Google ScholarDigital Library
- 5.Ekman, P., and Friesen, W. Manual for the Facial Action Coding System. Consulting Psychologists Press, Palo Alto, 1986.Google Scholar
- 6.Azarbayejani, A., and Pentland, A. Recursive estimation of motion, structure, and focal length. IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 17, no. 6, 1995. Google ScholarDigital Library
- 7.Cordea M.D., Petriu E.M., Georganas N.D., Petriu D.C., and Whalen T.E. Real-Time 2%D Head Pose Recovery for Model-Based Video-Coding, in Proc. IMTCY2000, IEEE Instrum. Meas. Technol. Conf., pp. 601-606.Google ScholarCross Ref
- 8.Benoit, C. Synthesis and automatic recognition of audiovisual speech. IEE Colloquium (Digest). Nr. 213, Nov 28 1996. IEE, Stevenage, Engl. p l/1-1/6Google Scholar
- 9.Ezzat, T.,and Poggio, T. Visual speech synthesis by morphing visemes. International Journal of Computer Vision, vol.38, no. 1, 2000, pp.45-57, Kluwer Academic. Google ScholarDigital Library
- 10.Masuko, T., Kobayashi, T., Tamura, M., Masubuchi, J., and Tokuda, K. Text-to-visual speech synthesis based on parameter generation horn HMM. in Proc. 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 98, vol.6, pp.3745-3748.Google Scholar
- 11.Faruquie, T.A., Neti, C., Rajput, N., Subramaniam, L.V., and Verma, A. Translingual visual speech synthesis. In Proc. 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Latest Advances in the Fast Changing World of Multimedia , vol.2, pp. 1089-92.Google ScholarCross Ref
- 12.Bregler, C., Covell, M., and Slaney, M. Video Rewrite: driving visual speech with audio. Computer Graphics Proceedings, SIGGRAPH 97. ACM. 1997, pp.353-60. Google ScholarDigital Library
- 13.McAllister, D., Rodman, F., Bitzer, R.D., Freeman, D.L., and Andrew, S. Speaker independence in automated lipsync for audio-video communication Computer Networks & Isdn Systems. Vol. 30, no. 20-21, 1998. p 1975-1980 Google ScholarDigital Library
- 14.Morishima, S. Real-time voice driven facial animation system in Proc. 1999 IEEE Intl. Conf. Systems, Man and Cybernetics. Vol. 6, pp. VI-59 - VI-63Google Scholar
- 15.Guiard-Marigny, T., Tsingos, N., Adjoudani, A., Benoit, C., and Gascuel, M-P. 3D models of the lips for realistic speech animation. In Proc. IEEE Computer Animation '96. 41996, pp.80-89. Los Alamitos, CA, USA. Google ScholarDigital Library
Recommendations
Lip syncing method for realistic expressive 3D face model
Lip synchronization of 3D face model is now being used in a multitude of important fields. It brings a more human, social and dramatic reality to computer games, films and interactive multimedia, and is growing in use and importance. High level of ...
Animation realism affects perceived character appeal of a self-virtual face
MIG '15: Proceedings of the 8th ACM SIGGRAPH Conference on Motion in GamesAppearance and animation realism of virtual characters in games, movies or other VR applications has been shown to affect audiences levels of acceptance and engagement with these characters. However, when a virtual character is representing us in VR ...
Interactive Augmented Live Virtual Reality Streaming: A Health Care Application
ICMHI '18: Proceedings of the 2nd International Conference on Medical and Health InformaticsVirtual Reality (VR) technology has been around for decades; however, we have probably only begun to realize the practical applications until recent years. With increase of computing power, decrease of cost and physical dimension, a new class of ...
Comments