Loading [a11y]/accessibility-menu.js
Reconstructing Spatial Aspects of Motion by Image-to-Path Deep Neural Networks | IEEE Journals & Magazine | IEEE Xplore

Reconstructing Spatial Aspects of Motion by Image-to-Path Deep Neural Networks


Abstract:

The choice of an appropriate representation is important when reconstructing motion from images. In this letter we propose a new type of deep neural network (DNN) that ma...Show More

Abstract:

The choice of an appropriate representation is important when reconstructing motion from images. In this letter we propose a new type of deep neural network (DNN) that maps images to spatial paths represented by a recently introduced motion representation called arc-length dynamic movement primitive (AL-DMP). This representation separates the spatial from temporal aspects of motion and is therefore suitable for processing data that do not contain temporal information. We propose a physically meaningful loss function for training of AL-DMPs, which improves the performance of the trained DNN, and derive its gradients, which are needed to apply the backpropagation algorithm. Moreover, the proposed DNN architecture supports the processing of variable-size input images and images with cluttered background. The developed approach was applied to the reproduction of handwritten digits from single images that do not contain temporal aspects of motion. Our experiments also show that the proposed network can be applied to input images of sizes that are different from the size of training images. Finally, the proposed approach was successfully applied for reproducing real handwritten digits with a humanoid robot.
Published in: IEEE Robotics and Automation Letters ( Volume: 6, Issue: 1, January 2021)
Page(s): 255 - 262
Date of Publication: 23 November 2020

ISSN Information:

Funding Agency:


Contact IEEE to Subscribe

References

References is not available for this document.