Multicamera fusion for shape estimation and visibility analysis of unknown deforming objects

Evgeny Nuger; Beno Benhabib

doi:10.1117/1.JEI.25.4.041009

9 June 2016 Multicamera fusion for shape estimation and visibility analysis of unknown deforming objects

Evgeny Nuger, Beno Benhabib

Author Affiliations +

Journal of Electronic Imaging, Vol. 25, Issue 4, 041009 (June 2016). https://doi.org/10.1117/1.JEI.25.4.041009

Abstract

A method is proposed for fused three-dimensional (3-D) shape estimation and visibility analysis of an unknown, markerless, deforming object through a multicamera vision system. Complete shape estimation is defined herein as the process of 3-D reconstruction of a model through fusion of stereo triangulation data and a visual hull. The differing accuracies of both methods rely on the number and placement of the cameras. Stereo triangulation yields a high-density, high-accuracy reconstruction of a surface patch from a small surface area, while a visual hull yields a complete, low-detail volumetric approximation of the object. The resultant complete 3-D model is, then, temporally projected based on the tracked object’s deformation, yielding a robust deformed shape prediction. Visibility and uncertainty analyses, on the projected model, estimate the expected accuracy of reconstruction at the next sampling instant. In contrast to common techniques that rely on a priori known models and identities of static objects, our method is distinct in its direct application to unknown, markerless, deforming objects, where the object model and identity are unknown to the system. Extensive simulations and comparisons, some of which are presented herein, thoroughly demonstrate the proposed method and its benefits over individual reconstruction techniques.

Citation Download Citation

Evgeny Nuger and Beno Benhabib "Multicamera fusion for shape estimation and visibility analysis of unknown deforming objects," Journal of Electronic Imaging 25(4), 041009 (9 June 2016). https://doi.org/10.1117/1.JEI.25.4.041009

Published: 9 June 2016

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available