We developed a space-sharing content viewing system based on the assumption that augmented reality (AR) glasses will be used extensively in the future. Our vision is to assist people in remote locations to enjoy AR and virtual reality programs together. To realize this, we developed a system that can display life-size persons virtually and communicate with them in real-time. In this study, we used the system for another application: for creating a television program that allows family members in remote locations to meet again virtually. Communication with three-dimensional (3D) figures demonstrated the possibility of creating new programs, such as family interactions. However, a technical problem was observed pertaining to the inability to obtain depth data for black-colored hair with infrared signals used for 3D measuring. Accordingly, herein we combined two different sensors, namely the time-of-flight (ToF) and stereoscopic vision with infrared projection, to capture 3D images without missing parts, thereby capitalizing on both the accuracy of ToF and stability of stereoscopic vision. The evaluation results showed that the proposed method filled in 70% of the initial holes in the depth data and provided depth to 90% of the color pixels in the area around the face.