poster

Virtual headcam: pan/tilt mirror-based facial performance tracking

Authors:

Paul DebevecAuthors Info & Claims

SIGGRAPH '15: ACM SIGGRAPH 2015 Posters

Article No.: 94, Page 1

https://doi.org/10.1145/2787626.2792625

Published: 31 July 2015 Publication History

Get Access

Abstract

High-end facial performance capture solutions typically use head-mounted camera systems which provide one or more close-up video streams of each actor's performance. These provide clear views of each actor's performance, but can be bulky, uncomfortable, get in the way of sight lines, and prevent actors from getting close to each other. To address this, we propose a virtual head-mounted camera system: an array of cameras placed around around the performance capture volume which automatically track zoomed-in, sharply focussed, high-resolution views of the each actor's face from a multitude of directions. The resulting imagery can be used in conjunction with body motion capture data to derive nuanced facial performances without head-mounted cameras.

Reference

[1]

Okumura, K., Oku, H., and Ishikawa, M. 2011. High-speed gaze controller for millisecond-order pan/tilt camera. In Robotics and Automation (ICRA), 2011 IEEE International Conference on, 6186--6191.

Google Scholar

Index Terms

Virtual headcam: pan/tilt mirror-based facial performance tracking
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision problems
        Tracking
      2. Computer vision tasks
        Scene understanding
  2. Computer graphics

Recommendations

Virtual Environments: A hybrid tracking method for surgical augmented reality

Camera pose estimation is one of the most important, but also one of the most challenging tasks in augmented reality. Without a highly accurate estimation of the position and orientation of the digital video camera, it is impossible to render a ...
Virtual Reality in Brazil: Multi-camera calibration based on an invariant pattern

In this paper we present a method for the calibration of multiple cameras based on the extraction and use of the physical characteristics of a one-dimensional invariant pattern which is defined by four collinear markers. The advantages of this kind of ...
Virtual video camera: image-based viewpoint navigation through space and time
SIGGRAPH '09: SIGGRAPH '09: Posters

We present an image-based rendering system to viewpoint-navigate through space and time of complex real-world, dynamic scenes. Our approach accepts unsynchronized, uncalibrated multi-video footage as input. Inexpensive, consumer-grade camcorders suffice ...

Comments

Information & Contributors

Information

Published In

SIGGRAPH '15: ACM SIGGRAPH 2015 Posters

July 2015

95 pages

ISBN:9781450336321

DOI:10.1145/2787626

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 31 July 2015

Check for updates

Qualifiers

Poster

Funding Sources

Army Research Office

Conference

SIGGRAPH '15

Sponsor:

SIGGRAPH

SIGGRAPH '15: Special Interest Group on Computer Graphics and Interactive Techniques Conference

August 9 - 13, 2015

California, Los Angeles

Acceptance Rates

Overall Acceptance Rate 1,822 of 8,601 submissions, 21%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

0
Total Citations
118
Total Downloads

Downloads (Last 12 months)5
Downloads (Last 6 weeks)0

Reflects downloads up to 28 Feb 2025

Other Metrics

View Author Metrics

Citations

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

Reference

Index Terms

Recommendations

Virtual Environments: A hybrid tracking method for surgical augmented reality

Virtual Reality in Brazil: Multi-camera calibration based on an invariant pattern

Virtual video camera: image-based viewpoint navigation through space and time

Comments

Information

Published In

Sponsors

Publisher

Publication History

Check for updates

Qualifiers

Funding Sources

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations