Authors:
Toru Kurihara
1
and
Shigeru Ando
2
Affiliations:
1
Kochi University of Technology, Japan
;
2
University of Tokyo, Japan
Keyword(s):
Material Perception, VFX, Normal Vector Map, Photometric Stereo.
Related
Ontology
Subjects/Areas/Topics:
Applications and Services
;
Computer Vision, Visualization and Computer Graphics
;
Entertainment Imaging Applications
;
Image Enhancement and Restoration
;
Image Formation and Preprocessing
Abstract:
In this paper, we propose real-time reflectance transformation system using correlation image sensor and four LEDs. The reflectance transformation system changes object appearance into different materials one and displays it in the monitor. We have developed real-time surface orientation imager to add specular component according to captured normal vector map for reflectance transformation. Surface orientation of the object is encoded into amplitude and phase of the reflected light intensity by using phase shifted blinking LEDs, The correlation image sensor, provided by us, demodulates those amplitude and phase in each pixel during exposure time. Therefore, the surface orientation is captured by single frame, which can be applied to moving object. We developed reflectance transformation system using surface orientation captured by our real-time surface orientation imager. We demonstrated that the system provides relighting and changing reflectance property in real-time.