Robot-assisted 3D digital reconstruction of heritage artifacts: area similarity approach

This paper aims to propose a system to acquire images automatically for digital reconstruction of heritage artifacts using a six-degree of freedom industrial manipulator.

A virtual environment is created using Robot Studio® software to integrate the trajectory and differential motion of the robot manipulator and the motion of camera while acquiring images. A new area similarity matrix method is proposed to reduce the number of images required for digital reconstruction using Autodesk Recap® software. Real-time experiments have been performed using objects such as minion, ultimaker robot and cube. Evaluation of the digital reconstruction is conducted using the contour area matching method.

The number of images required for reconstruction based on area similarity matrix method is reduced to 63 per cent when compared with the random selection method. Quality parameters such as surface area, volume, number of defect holes, vertices and faces are enhanced for the proposed method.

Digital reconstruction of large-sized heritage artifacts cannot be performed in this setup. But this can be overcome by fixing the manipulator on a mobile platform or overhead crane. This paper does not discuss the reconstruction of partially damaged heritage artifacts, which could be accomplished based on deep learning techniques.

Using this approach, off-the-shelf heritage artifacts and large-scale objects can be reconstructed digitally with a minimum number of images and without compromising the quality of original models.

To the best of the authors’ knowledge, area similarity-based approach in 3D digital reconstruction by coupling the kinematics of an industrial manipulator and camera is proposed for the first time. A fully automated digital reconstruction technology to preserve valuable heritage artifacts has been developed. It also highlights the space constraints of the industrial manipulator in digital reconstruction.