research-article

BodyAvatar: creating freeform 3D avatars using first-person body gestures

Authors:

Nobuyuki Umetani,

Takaaki Shiratori,

Xiang CaoAuthors Info & Claims

UIST '13: Proceedings of the 26th annual ACM symposium on User interface software and technology

Pages 387 - 396

https://doi.org/10.1145/2501988.2502015

Published: 08 October 2013 Publication History

Abstract

BodyAvatar is a Kinect-based interactive system that allows users without professional skills to create freeform 3D avatars using body gestures. Unlike existing gesture-based 3D modeling tools, BodyAvatar centers around a first-person "you're the avatar" metaphor, where the user treats their own body as a physical proxy of the virtual avatar. Based on an intuitive body-centric mapping, the user performs gestures to their own body as if wanting to modify it, which in turn results in corresponding modifications to the avatar. BodyAvatar provides an intuitive, immersive, and playful creation experience for the user. We present a formative study that leads to the design of BodyAvatar, the system's interactions and underlying algorithms, and results from initial user trials.

Supplementary Material

suppl.mov (uist226.mp4)

Supplemental video

Download
92.79 MB

References

[1]

Bae, S-H, Balakrishnan, R., Singh, K. (2008). ILoveSketch: as-natural-as-possible sketching system for creating 3D curve models. UIST. p. 151--160.

Digital Library

[2]

Baran, I., Popovic, J. (2007). Automatic rigging and animation of 3D characters. SIGGRAPH.

Digital Library

[3]

Bloomenthal, J. (1988). Polygonization of implicit surfaces. Computer Aided Geometric Design, 5(4), p.341--355.

Digital Library

[4]

Chen, J., Izadi, S., Fitzgibbon, A. (2012). KinÊtre: animating the world with the human body. UIST, p. 435--444.

Digital Library

[5]

Follmer, S., Ishii, H. (2012). KidCAD: digitally remixing toys through tangible tools. CHI. p. 2401--2410.

Digital Library

[6]

Holz, C., Wilson, A.D. (2011). Data miming: inferring spatial object descriptions from human gesture. CHI, p. 811--820.

Digital Library

[7]

Igarashi, T., Matsuoka, S., Tanaka, H. (1999). Teddy: a sketching interface for 3D freeform design. SIGGRAPH, p.409--416.

Digital Library

[8]

Kelley, J. F. (1984). An iterative design methodology for user-friendly natural language office information applications. Transactions on Office Information Systems, 2(1), p. 26--4

Digital Library

[9]

Keskin, C., Kirac, F., Kara, Y.E., Akarun, L. (2012). Hand pose estimation and hand shape classification using multi-layered randomized decision forests. ECCV. p. 852--863.

Digital Library

[10]

Lewis, J. P., Cordner, M., Fong, N. (2000). Pose space deformations: a unified approach to shape interpolation and skeleton-driven deformation. SIGGRAPH. p. 165--172.

Digital Library

[11]

McDonnell, K., Qin, H., & Wlodarczyk, R. (2001). Virtual clay: A real-time sculpting system with haptic toolkits. I3D. p. 179--190.

Digital Library

[12]

Nishimura, H., Hirai, M., Kawai, T., Kawata, T., Shirakawa, I., Omura, K. (1985). Object modeling by distribution function and a method of image generation. Electronics Communications Conference, p. 718--725.

[13]

Nishino, H., Utsumiya, K., & Korida, K. (1998). 3D object modeling using spatial and pictographic gestures. VRST. p. 51--58.

Digital Library

[14]

Rossignac, J., et al. (2003). Finger sculpting with digital clay: 3D shape input and output through a computer-controlled real surface. Shape Modeling International. p. 229--234.

Digital Library

[15]

Schkolne, S., Pruett, M., & Schroeder, P. (2001). Surface drawing: creating organic 3D shapes with the hand and tangible tools. CHI. p. 261--268.

Digital Library

[16]

Schmidt, R., Wyvill, B., Sousa, M. C., Jorge, J.A. (2005). ShapeShop: sketch-based solid modeling with blobTrees. Eurographics Workshop on Sketch-Based Interfaces and Modeling. p. 53--62.

[17]

Sheng, J., Balakrishnan, R., Singh, K. (2006). An interface for 3D sculpting via physical proxy. GRAPHITE. p. 213--220.

Digital Library

[18]

Shin, H.J., Lee, J., Shin, S.Y., Gleicher, M. (2001). Computer puppetry: an importance-based approach. Trans. on Graphics. 20(2), p. 67--94.

Digital Library

[19]

Song, P., Goh, W.B., Hutama, W., Fu, C., Liu, X. (2012). A handle bar metaphor for virtual object manipulation with mid-air interaction. CHI. p. 1297--1306.

Digital Library

[20]

Zeleznik, R.C., Herndon, K., & Hughes, J. (1996). SKETCH: an interface for sketching 3D scenes. SIGGRAPH. p. 163--170.

Digital Library

Cited By

Li BYuan LYan ZLiu QShen YWang Z(2024)AniCraft: Crafting Everyday Objects as Physical Proxies for Prototyping 3D Character Animation in Mixed RealityProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676325(1-14)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676325
Zhou QLedo DFitzmaurice GAnderson F(2024)TimeTunnel: Integrating Spatial and Temporal Motion Editing for Character Animation in Virtual RealityProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641927(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3641927
Hagen MCruzes DJaccheri LFails J(2024)Evaluating digital creativity support for childrenInternational Journal of Child-Computer Interaction10.1016/j.ijcci.2023.10060338:COnline publication date: 27-Feb-2024
https://dl.acm.org/doi/10.1016/j.ijcci.2023.100603
Show More Cited By

Index Terms

BodyAvatar: creating freeform 3D avatars using first-person body gestures
1. Human-centered computing

Recommendations

Streaming VR Games to the Broad Audience: A Comparison of the First-Person and Third-Person Perspectives
CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems

The spectatorship experience for virtual reality (VR) games differs strongly from its non-VR precursor. When watching non-VR games on platforms such as Twitch, spectators just see what the player sees, as the physical interaction is mostly unimportant ...
On generating realistic avatars: dress in your own style

The use of 3D avatars is becoming more frequent with the development of computer technology and the internet. To meet users' requirements, some software or programs have allowed users to customize the avatar. However, users are only able to customize ...
Anticipatory Gaze Shifts during Navigation in a Naturalistic Virtual Environment
CHI PLAY '15: Proceedings of the 2015 Annual Symposium on Computer-Human Interaction in Play

In the real world, coupled eye and head movements are used by humans and other animals to orient their gaze toward objects or scenes of interest. In virtual environments a mouse is often used as a proxy for head movements, orienting the camera towards a ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

UIST '13: Proceedings of the 26th annual ACM symposium on User interface software and technology

October 2013

558 pages

ISBN:9781450322683

DOI:10.1145/2501988

General Chairs:
Shahram Izadi
Microsoft Research, UK
,
Aaron Quigley
University of St Andrews, UK
,
Program Chairs:
Ivan Poupyrev
Disney Research, USA
,
Takeo Igarashi
The University of Tokyo, Japan

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 October 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

UIST'13

Sponsor:

UIST'13: The 26th Annual ACM Symposium on User Interface Software and Technology

October 8 - 11, 2013

St. Andrews, Scotland, United Kingdom

Acceptance Rates

UIST '13 Paper Acceptance Rate 62 of 317 submissions, 20%;

Overall Acceptance Rate 561 of 2,567 submissions, 22%

Upcoming Conference

UIST '25

Sponsor:
sigchi
sigchi

The 38th Annual ACM Symposium on User Interface Software and Technology

September 28 - October 1, 2025

Busan , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

30
Total Citations
View Citations
977
Total Downloads

Downloads (Last 12 months)52
Downloads (Last 6 weeks)5

Reflects downloads up to 28 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Li BYuan LYan ZLiu QShen YWang Z(2024)AniCraft: Crafting Everyday Objects as Physical Proxies for Prototyping 3D Character Animation in Mixed RealityProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676325(1-14)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676325
Zhou QLedo DFitzmaurice GAnderson F(2024)TimeTunnel: Integrating Spatial and Temporal Motion Editing for Character Animation in Virtual RealityProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641927(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3641927
Hagen MCruzes DJaccheri LFails J(2024)Evaluating digital creativity support for childrenInternational Journal of Child-Computer Interaction10.1016/j.ijcci.2023.10060338:COnline publication date: 27-Feb-2024
https://dl.acm.org/doi/10.1016/j.ijcci.2023.100603
Hung CChang RChen HLiang CChan LChen B(2022)Puppeteer: Exploring Intuitive Hand Gestures and Upper-Body Postures for Manipulating Human Avatar ActionsProceedings of the 28th ACM Symposium on Virtual Reality Software and Technology10.1145/3562939.3565609(1-11)Online publication date: 29-Nov-2022
https://dl.acm.org/doi/10.1145/3562939.3565609
Chung JHe SAdar E(2021)The Intersection of Users, Roles, Interactions, and Technologies in Creativity Support ToolsProceedings of the 2021 ACM Designing Interactive Systems Conference10.1145/3461778.3462050(1817-1833)Online publication date: 28-Jun-2021
https://dl.acm.org/doi/10.1145/3461778.3462050
Wang DWang LZhang ZWang DZhu HGao YFan XTian FKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)“Brilliant AI Doctor” in Rural Clinics: Challenges in AI-Powered Clinical Decision Support System DeploymentProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445432(1-18)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445432
Chen MLau M(2021)A Motion‐guided Interface for Modeling 3D Multi‐functional FurnitureComputer Graphics Forum10.1111/cgf.1441640:7(229-240)Online publication date: 27-Nov-2021
https://doi.org/10.1111/cgf.14416
Xie HXie DMiyata K(2021)Body2Particles: Designing Particle Systems Using Body GesturesEntertainment Computing – ICEC 202010.1007/978-3-030-65736-9_40(445-458)Online publication date: 5-Jan-2021
https://doi.org/10.1007/978-3-030-65736-9_40
Wang TQian XHe FHu XHuo KCao YRamani KIqbal SMacLean KChevalier FMueller S(2020)CAPturAR: An Augmented Reality Tool for Authoring Human-Involved Context-Aware ApplicationsProceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology10.1145/3379337.3415815(328-341)Online publication date: 20-Oct-2020
https://dl.acm.org/doi/10.1145/3379337.3415815
Remy CMacDonald Vermeulen LFrich JBiskjaer MDalsgaard PWakkary RAndersen KOdom WDesjardins APetersen M(2020)Evaluating Creativity Support Tools in HCI ResearchProceedings of the 2020 ACM Designing Interactive Systems Conference10.1145/3357236.3395474(457-476)Online publication date: 3-Jul-2020
https://dl.acm.org/doi/10.1145/3357236.3395474
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten