Multi-view 3D reconstruction: a scene-based, visual hull guided, multi-stereovision framework

This paper proposes a novel stereovision framework for multi-view 3D reconstruction relying on inputs of both several sets of multi-baseline views and a visual hull [3]. The pipeline is illustrated in figure 1. Our Contributions of this paper are threefold: (i) improvement of our multi-baseline stereovision method [2] by VH guidance, (ii) carving VH from stereovision surface and (iii) merging differently carved volumes. Our approach builds on a previously proposed framework [2] for multi-baseline stereo-vision which provides upon the Disparity Space (DS) introduced by [5], a materiality map expressing the probability for 3D sample points to lie on a visible surface. Our acquisition system [4] composed of the cameras which are scattered around the observed scene in order to build the VH, with several groups laid as multi-scopic units dedicated to multi-baseline stereovision. Multi-scopic units are composed of aligned and evenly distributed cameras.