skip to main content
10.1145/1067170.1067173acmconferencesArticle/Chapter ViewAbstractPublication PagesmobisysConference Proceedingsconference-collections
Article

LiveMail: personalized avatars for mobile entertainment

Published: 06 June 2005 Publication History

Abstract

LiveMail is a prototype system that allows mobile subscribers to communicate using personalized 3D face models created from images taken by their phone cameras. The user takes a snapshot of someone's face - a friend, famous person, themselves, even a pet - using the mobile phone's camera. After a quick manipulation on the phone, a 3D model of that face is created and can be animated simply by typing in some text. Speech and appropriate animation of the face are created automatically by speech synthesis. Animations can be sent to others as real 3D animated messages or as short videos in MMS. They can be used as fun messages, greeting cards etc. The system is based on a client/server communication model. The clients are mobile devices or web clients so messages can be created, sent and received on the mobile phone or on a web page. The client has a user interface that allows the user to input a facial image and place a simple mask on it to mark the main features. The client then sends this data to a server that builds a personalized face model. The client also provides an interface that lets the user request the creation of animated messages using speech synthesis. It is planned to have several versions of the client: Symbian, midlet-based, web-based, wap-based, etc. The server is responsible for sending messages adjusted to the capabilities of the receiving platform. The server, Symbian client, midlet-based client and the web client have been implemented as prototypes. We present the system architecture and the experience gained building LiveMail.

References

[1]
F. I. Parke, K. Waters, Computer Facial animation, A. K. Peters Ltd, 1996., ISBN 1-56881-014-8
[2]
Igor S. Pandzic, Robert Forschheimer (editors), MPEG-4 Facial Animation - The standard, implementations and applications, John Wiley & Sons, 2002, ISBN 0-470-84465-5.
[3]
M. Escher, I. S. Pandzic, N. Magnenat-Thalmann, Facial Deformations for MPEG-4, Proc. Computer Animation 98, Philadelphia, USA, pp. 138--145, IEEE Computer Society Press, 1998.
[4]
F. Lavagetto, R. Pockaj, The Facial Animation Engine: towards a high-level interface for the design of MPEG-4 compliant animated faces, IEEE Trans. on Circuits and Systems for Video Technology, Vol. 9, No. 2, March 1999.
[5]
ISO/IEC 14496 - MPEG-4 International Standard, Moving Picture Experts Group, http://www.chiariglione.org/mpeg/standards/mpeg4/mpeg-4.htm
[6]
3D Arts, DieselEngine SDK, http://www.3darts.fi/mobile/de.htm
[7]
T. Fuchs, J. Haber, H.-P. Seidel, MIMIC - A Language for Specifying Facial Animations, Proceedings of WSCG 2004, 2-6 Feb 2004, pp. 71--78.
[8]
Z. Liu, Z. Zhang, C. Jacobs, M. Cohen, Rapid Modeling of Animated Faces From Video, In Proceedings of The Third International Conference on Visual Computing (Visual 2000), pp 58--67, September 2000, Mexico City
[9]
H. Gupta, A. Roy-Chowdhury, R. Chellappa, Contour based 3D Face Modeling From A Monocular Video, British Machine Vision Conference, 2004.
[10]
Pelachaud, C., Badler, N., and Steedman, M., Generating Facial Expressions for Speech, Cognitive, Science, 20(1), pp. 1--46, 1996.
[11]
Igor S. Pandzic, Jörgen Ahlberg, Mariusz Wzorek, Piotr Rudol, Miran Mosmondor, Faces Everywhere: Towards Ubiquitous Production and Delivery of Face Animation, Proceedings of the 2nd International Conference on Mobile and Ubiquitous Multimedia, Norrkoping, Sweden, 2003
[12]
Igor S. Pandzic, Life on the Web, Software Focus Journal, John Wiley & Sons, 2001, 2(2):52--59.
[13]
P. Hong, Z. Wen, T. S. Huang, Real-time speech driven Face Animation, in I. S. Pandzic, R. Forchheimer, Editors, MPEG-4 Facial Animation - The Standard, Implementation and Applications, John Wiley & Sons Ltd, 2002.
[14]
W. Lee, N. Magnenat-Thalmann, Fast Head Modeling for Animation, Journal Image and Vision Computing, Volume 18, Number 4, pp. 355--364, Elsevier, March, 2000
[15]
Igor S. Pandzic, Facial Motion Cloning, Graphical Models journal.

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
MobiSys '05: Proceedings of the 3rd international conference on Mobile systems, applications, and services
June 2005
278 pages
ISBN:1931971315
DOI:10.1145/1067170
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 June 2005

Permissions

Request permissions for this article.

Check for updates

Qualifiers

  • Article

Conference

MobiSys05
Sponsor:

Acceptance Rates

Overall Acceptance Rate 274 of 1,679 submissions, 16%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)3
  • Downloads (Last 6 weeks)0
Reflects downloads up to 17 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2013)The impact of avatar realism and anonymity on effective communication via mobile devicesComputers in Human Behavior10.1016/j.chb.2012.10.01029:3(1169-1181)Online publication date: 1-May-2013
  • (2011)Status and trends of mobile-health applications for iOS devicesJournal of Systems and Software10.1016/j.jss.2011.06.04984:11(2022-2033)Online publication date: 1-Nov-2011
  • (2010)Multiplatform 3-D GraphicsIEEE Vehicular Technology Magazine10.1109/MVT.2010.9361685:1(24-30)Online publication date: Mar-2010
  • (2008)Communicators' Perceptions of Social Presence as a Function of Avatar Realism in Small Display Mobile Communication DevicesProceedings of the Proceedings of the 41st Annual Hawaii International Conference on System Sciences10.1109/HICSS.2008.95Online publication date: 7-Jan-2008
  • (2008)Preserving avatar genuineness in different display mediaMobile Networks and Applications10.1007/s11036-008-0094-913:6(627-634)Online publication date: 1-Dec-2008
  • (2006)The Effect of Avatar Realism on Users' Sense of Social Presence in Emotionally Engaged Mobile-Phone CommunicationProceedings of the Seventh IEEE Workshop on Mobile Computing Systems & Applications10.1109/WMCSA.2006.28(29-30)Online publication date: 6-Apr-2006
  • (2006)3D Visualization on mobile devicesTelecommunications Systems10.1007/s11235-006-9137-332:2-3(181-191)Online publication date: 1-Jul-2006
  • (2005)Developing applications for internet telephony: A case study on the use of web services for conferencing in SIP networksInternational Journal of Web Information Systems10.1108/174400805800000901:3(147-160)Online publication date: 1-Aug-2005

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media