skip to main content
10.1145/1101616.1101668acmconferencesArticle/Chapter ViewAbstractPublication PagesvrstConference Proceedingsconference-collections
Article

Automatic generation of personalized human avatars from multi-view video

Published: 07 November 2005 Publication History

Abstract

In multi-user virtual environments real-world people interact via digital avatars. In order to make the step from the real world onto the virtual stage convincing the digital equivalent of the user has to be personalized. It should reflect the shape and proportions, the kinematic properties, as well as the textural appearance of its real-world equivalent. In this paper, we present a novel spatio-temporal approach to create a personalized avatar from multi-view video data of a moving person. The avatar's geometry is generated by shape-adapting a template human body model. Its surface texture is assembled from multi-view video frames showing arbitrary different body poses. consistent surface texture for the model is generated using multi-view video frames from different camera views and different body poses. With our proposed method photo-realistic human avatars can be robustly generated.

References

[1]
R. Byrd, P. Lu, J. Nocedal, and C. Zhu. A limited memory algorithm for bound constrained optimi- zation. SIAM J. Sci. Comp., 16(5):1190--1208, 1995.
[2]
J. Carranza, C. Theobalt, M. A. Magnor, and H.-P. Seidel. Free-viewpoint video of human actors. ACM Trans. Graph., 22(3):569--577, 2003.
[3]
E. de Aguiar, C. Theobalt, M. Magnor, H. Theisel, and H.-P. Seidel. Marker-free model reconstruction and motion tracking from 3d voxel data. Proc. IEEE Pacific Graphics 2003, Seoul, South Korea, pages 101--110, Oct. 2004.
[4]
A. Hilton, D. Beresford, T. Gentils, R. Smith, and W. Sun. Virtual people: Capturing human models to populate virtual worlds. In CA '99: Proceedings of the Computer Animation, page 174, Washington, DC, USA, 1999. IEEE Computer Society.
[5]
I. A. Kakadiaris and D. Metaxas. 3d human body model acquisition from multiple views. In ICCV '95: Proceedings of the Fifth International Conference on Computer Vision, page 618, Washington, DC, USA, 1995. IEEE Computer Society.
[6]
T. Kanade, P. Rander, and P. Narayanan. Virtualized reality: Constructing virtual worlds from real scenes. IEEE Multimedia, Immersive Telepresence, 4(1):34--47, January 1997.
[7]
W.-S. Lee, J. Gu, and N. Magnenat-Thalmann. Generating animatable 3{D virtual humans from photographs. In M. Gross and F. R. A. Hopgood, editors,Computer Graphics Forum (Eurographics 2000), volume 19(3), 2000.
[8]
W. Matusik, C. Buehler, R. Raskar, S. Gortler, and L. McMillan. Image-based visual hulls. In Proceedings of {ACM {SIGGRAPH 00, pages 369--374, 2000.
[9]
S. Moezzi, L.-C. Tai, and P. Gerard. Virtual view generation for 3d digital video. IEEE MultiMedia, 4(1):18--26, 1997.
[10]
R. P. N. A. P. Fua, A. Gruen and D. Thalmann. Human body modeling and motion analysis from video sequences. In Proc. Int. Symp. on Real-Time Imaging and Dynamic Analysis, 1998.
[11]
S. Paquette. 3d scanning in apparel design and human engineering. IEEE Comput. Graph. Appl., 16(5):11--15, 1996.

Cited By

View all
  • (2024)The EXPERIENCE Project: Automatic virtualization of “extended personal reality” through biomedical signal processing and explainable artificial intelligence [Applications Corner]IEEE Signal Processing Magazine10.1109/MSP.2023.334443041:1(60-66)Online publication date: Jan-2024
  • (2023)Understanding Antecedents That Affect Customer Evaluations of Head-Mounted Display VR Devices through Text Mining and Deep Neural NetworkJournal of Theoretical and Applied Electronic Commerce Research10.3390/jtaer1803006318:3(1238-1256)Online publication date: 10-Jul-2023
  • (2021)Dynamic Appearance Modelling from Minimal Cameras2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)10.1109/CVPRW53098.2021.00195(1760-1769)Online publication date: Jun-2021
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
VRST '05: Proceedings of the ACM symposium on Virtual reality software and technology
November 2005
270 pages
ISBN:1595930981
DOI:10.1145/1101616
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 November 2005

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. avatar creation
  2. shape deformation
  3. texturing
  4. virtual reality

Qualifiers

  • Article

Conference

VRST05

Acceptance Rates

Overall Acceptance Rate 66 of 254 submissions, 26%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)12
  • Downloads (Last 6 weeks)3
Reflects downloads up to 13 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)The EXPERIENCE Project: Automatic virtualization of “extended personal reality” through biomedical signal processing and explainable artificial intelligence [Applications Corner]IEEE Signal Processing Magazine10.1109/MSP.2023.334443041:1(60-66)Online publication date: Jan-2024
  • (2023)Understanding Antecedents That Affect Customer Evaluations of Head-Mounted Display VR Devices through Text Mining and Deep Neural NetworkJournal of Theoretical and Applied Electronic Commerce Research10.3390/jtaer1803006318:3(1238-1256)Online publication date: 10-Jul-2023
  • (2021)Dynamic Appearance Modelling from Minimal Cameras2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)10.1109/CVPRW53098.2021.00195(1760-1769)Online publication date: Jun-2021
  • (2020)Can I help you? Preferences of young adults for the age, gender and ethnicity of a Virtual Support Person based on individual differences including personality and psychological stateProceedings of the Australasian Computer Science Week Multiconference10.1145/3373017.3373065(1-10)Online publication date: 4-Feb-2020
  • (2020)Me vs. Super(wo)man: Effects of Customization and Identification in a VR ExergameProceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376661(1-17)Online publication date: 21-Apr-2020
  • (2020)Reconstructing 3D Human Avatars from Monocular ImagesReal VR – Immersive Digital Reality10.1007/978-3-030-41816-8_8(188-218)Online publication date: 3-Mar-2020
  • (2019)Learning to Reconstruct People in Clothing From a Single RGB Camera2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR.2019.00127(1175-1186)Online publication date: Jun-2019
  • (2019)Semantic audio content-based music recommendation and visualization based on user preference examplesInformation Processing and Management: an International Journal10.1016/j.ipm.2012.06.00449:1(13-33)Online publication date: 22-Nov-2019
  • (2018)Creating Personalized AvatarsDigital Hampi: Preserving Indian Cultural Heritage10.1007/978-981-10-5738-0_17(283-298)Online publication date: 1-Apr-2018
  • (2017)Towards Accurate Marker-Less Human Shape and Pose Estimation over Time2017 International Conference on 3D Vision (3DV)10.1109/3DV.2017.00055(421-430)Online publication date: Oct-2017
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media