Loading [a11y]/accessibility-menu.js
Simultaneous Hand-Eye and Target Estimation By 2D-3D Generative Point Alignment | IEEE Journals & Magazine | IEEE Xplore

Simultaneous Hand-Eye and Target Estimation By 2D-3D Generative Point Alignment


Abstract:

Hand-eye calibration aims to relate what the camera sees to where the robot moves, which is crucial for vision-guided robot systems and has received much attention in the...Show More

Abstract:

Hand-eye calibration aims to relate what the camera sees to where the robot moves, which is crucial for vision-guided robot systems and has received much attention in the robotics community. The classical hand-eye calibration flow estimates camera extrinsic poses first, then uses homogeneous pose alignment to solve the hand-eye calibration problem. Since this two-step procedure is trivial and prone to error propagation, point-alignment-based hand-eye calibration is currently gaining popularity. The point alignment approach is promising but still immature, as evidenced by the lack of a unified formulation for different calibration targets, the requirement of pose for initialization, and the reliance on an optimization solver and its numerical differentiation. These issues are addressed item by item in this article. We first formulate the hand-eye calibrations for multi-point, single-point, and patterned targets via 2D-3D generative point alignment. Then, we propose a generic initialization on a single-point sequence covering all the above target cases. Following that, we infer the analytical Jacobian matrix in detail and develop the sparsity for the pose-perturbation refinement. Finally, both numerical simulations and real-world experiments are provided to verify that our approach is more accurate, efficient, and robust than state-of-the-art methods. The codes and datasets are open-source and can be found at https://github.com/MatthewJin001/GPA-HEC. Note to Practitioners—Vision-guided robots have been widely deployed in flexible automation, and only through hand-eye information can visual perception be used to guide robotic movement. However, the classical hand-eye calibration methods perform the hand-eye parameter estimation with beforehand camera poses, which is time-consuming and prone to error propagation. This work investigates one-step hand-eye calibrations based on direct point alignment. We provide simultaneous hand-eye and target estimation methods for multi...
Published in: IEEE Transactions on Automation Science and Engineering ( Volume: 21, Issue: 4, October 2024)
Page(s): 7413 - 7426
Date of Publication: 18 December 2023

ISSN Information:

Funding Agency:


Contact IEEE to Subscribe

References

References is not available for this document.