research-article

DeReEs: Real-Time Registration of RGBD Images Using Image-Based Feature Detection And Robust 3D Correspondence Estimation and Refinement

Authors:

Afsaneh Rafighi,

Oscar Meruvia-PastorAuthors Info & Claims

IVCNZ '14: Proceedings of the 29th International Conference on Image and Vision Computing New Zealand

Pages 136 - 141

https://doi.org/10.1145/2683405.2683447

Published: 19 November 2014 Publication History

Abstract

We present DeReEs, a real-time RGBD registration algorithm for the scenario where multiple RGBD images of the same scene are obtained from depth-sensing cameras placed at different viewpoints, with partial overlaps between their views. DeReEs (Detection, Rejection and Estimation) is a combination of 2D image-based feature detection algorithms, a RANSAC based false correspondence rejection and a rigid 3D transformation estimation. DeReEs performs global registration not only in real-time, but also supports large transformation distances for both translations and rotations. DeReEs is designed as part of a virtual/augmented reality solution for a remote 3D collaboration system that does not require initial setup and allows users to freely move the cameras during use. We present comparisons of DeReEs with other common registration algorithms. Our results suggest that DeReEs provides better speed and accuracy especially in scenes with partial overlapping.

References

[1]

Derees - supplementary materials: Data-sets and ground truth. http://tiny.cc/derees. Accessed: 2014-07-09.

[2]

K. Arun, T. Huang, and S. Blostein. Least-squares fitting of two 3-d point sets. Pattern Analysis and Machine Intelligence, IEEE Transactions on, PAMI-9(5):698--700, Sept 1987.

Digital Library

[3]

C. Audras, A. Comport, M. Meilland, and P. Rives. Real-time dense rgb-d localisation and mapping. Australian Conference on Robotics and Automation, 2011.

[4]

H. Bay, T. Tuytelaars, and L. V. Gool. Surf: Speeded up robust features. In In ECCV, pages 404--417, 2006.

Digital Library

[5]

P. Besl and N. D. McKay. A method for registration of 3-d shapes. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 14(2):239--256, Feb 1992.

Digital Library

[6]

P. Biber and W. Strasser. The normal distributions transform: a new approach to laser scan matching. In Intelligent Robots and Systems, 2003. (IROS 2003). Proceedings. 2003 IEEE/RSJ International Conference on, volume 3, pages 2743--2748 vol.3, Oct 2003.

[7]

J. Biswas and M. Veloso. Depth camera based indoor mobile robot localization and navigation. In IEEE International Conference on Robotics and Automation (ICRA), pages 1697--1702, May 2012.

[8]

G. Bradski. Opencv. Dr. Dobb's Journal of Software Tools, 2000.

[9]

Y. Chen and G. Medioni. Object modeling by registration of multiple range images. In Proceedings. IEEE International Conference on Robotics and Automation, pages 2724--2729 vol.3, Apr 1991.

[10]

S. Druon, M.-J. Aldon, and A. Crosnier. Color constrained icp for registration of large unstructured 3d color data sets. In Information Acquisition, 2006 IEEE International Conference on, pages 249--255, Aug 2006.

[11]

M. A. Fischler and R. C. Bolles. Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM, 24(6):381--395, June 1981.

Digital Library

[12]

P. Henry, M. Krainin, E. Herbst, X. Ren, and D. Fox. Rgb-d mapping: Using depth cameras for dense 3d modeling of indoor environments. In In the 12th International Symposium on Experimental Robotics (ISER. Citeseer, 2010.

[13]

D. Huber. Automatic 3d modeling using range images obtained from unknown viewpoints. In 3-D Digital Imaging and Modeling, 2001. Proceedings. Third International Conference on, pages 153--160, 2001.

[14]

T. Jost and H. Hugli. A multi-resolution icp with heuristic closest point search for fast and robust 3d registration of range images. In Proceedings. Fourth International Conference on 3-D Digital Imaging and Modeling, pages 427--433, Oct 2003.

[15]

G. Kurillo, R. Bajcsy, K. Nahrsted, and O. Kreylos. Immersive 3d environment for remote collaboration and training of physical activities. In Virtual Reality Conference, 2008. VR '08. IEEE, pages 269--270, March 2008.

[16]

D. G. Lowe. Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision, 60:91--110, 2004.

Digital Library

[17]

M. Magnusson. The Three-Dimensional Normal-Distributions Transform --- an Efficient Representation for Registration, Surface Analysis, and Loop Detection. PhD thesis, Ã&Udblac;rebro University, Dec. 2009. Ã&Udblac;rebro Studies in Technology 36.

[18]

M. Magnusson, A. Lilienthal, and T. Duckett. Scan registration for autonomous mining vehicles using 3d-ndt. Journal of Field Robotics, pages 803--827, 2007.

Digital Library

[19]

E. Rublee, V. Rabaud, K. Konolige, and G. Bradski. Orb: An efficient alternative to sift or surf. In Computer Vision (ICCV), 2011 IEEE International Conference on, pages 2564--2571, Nov 2011.

Digital Library

[20]

S. Rusinkiewicz and M. Levoy. Efficient variants of the icp algorithm. In 3-D Digital Imaging and Modeling, 2001. Proceedings. Third International Conference on, pages 145--152, 2001.

[21]

S. Seifi, A. Rafighi, and O. Meruvia-Pastor. Real-time registration of highly variant color + depth image pairs. In Poster Proceedings of the Graphics Interface Conference, 2014.

[22]

G. Turk and M. Levoy. Zippered polygon meshes from range images. In Proceedings of the 21st Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH '94, pages 311--318, New York, NY, USA, 1994. ACM.

Digital Library

[23]

T. Whelan, H. Johannsson, M. Kaess, J. Leonard, and J. McDonald. Robust real-time visual odometry for dense rgb-d mapping. In Robotics and Automation (ICRA), 2013 IEEE International Conference on, pages 5724--5731, May 2013.

Cited By

Soleimani VMirmehdi MDamen DHannuna SCamplani M(2016)3D Data Acquisition and Registration Using Two Opposing Kinects2016 Fourth International Conference on 3D Vision (3DV)10.1109/3DV.2016.21(128-137)Online publication date: Oct-2016
https://doi.org/10.1109/3DV.2016.21
Javan Hemmat HBondarev Ede With P(2016)R $$^{3}$$ P: Real-time RGB-D Registration PipelineAdvanced Concepts for Intelligent Vision Systems10.1007/978-3-319-48680-2_34(385-397)Online publication date: 21-Oct-2016
https://doi.org/10.1007/978-3-319-48680-2_34
Rafighi ASeifi SMeruvia-Pastor O(2015)Automatic and adaptable registration of live RGBD video streamsProceedings of the 8th ACM SIGGRAPH Conference on Motion in Games10.1145/2822013.2822027(243-250)Online publication date: 16-Nov-2015
https://dl.acm.org/doi/10.1145/2822013.2822027
Show More Cited By

Index Terms

DeReEs: Real-Time Registration of RGBD Images Using Image-Based Feature Detection And Robust 3D Correspondence Estimation and Refinement
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision problems
        Reconstruction
  2. Computer graphics
    1. Image manipulation
      1. Image processing

Recommendations

Self-calibration of omnidirectional multi-cameras including synchronization and rolling shutter

Deal with consumer 360 cameras and spherical cameras without a privileged direction.Initialize the time offsets and intrinsic parameters using monocular structure-from-motion.Start multi-camera structure-from-motion with central and global shutter ...
Tracking persons using a network of RGBD cameras
PETRA '14: Proceedings of the 7th International Conference on PErvasive Technologies Related to Assistive Environments

A computer vision system that employs an RGBD camera network to track multiple humans is presented. The acquired views are used to volumetrically and photometrically reconstruct and track the humans robustly and in real time. Given the frequent and ...
3D reconstruction framework via combining one 3D scanner and multiple stereo trackers

This paper presents a novel 3D reconstruction framework of large objects, where we adopt one 3D scanner to reconstruct partial sections of large objects, and employ multiple stereo trackers to extend reconstruction range. Both the 3D scanner and stereo ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

IVCNZ '14: Proceedings of the 29th International Conference on Image and Vision Computing New Zealand

November 2014

298 pages

ISBN:9781450331845

DOI:10.1145/2683405

Co-chairs:
John Perrone,
Michael Mayo,
Anthony Blake,
General Chair:
Michael J. Cree,
Publications Chair:
Lee Streeter

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

In-Cooperation

The University of Waikato

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 November 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

Research and Development Corporation of Newfoundland and Labrador

Conference

IVCNZ '14

IVCNZ '14: The 29th International Conference on Image and Vision Computing New Zealand

November 19 - 21, 2014

Hamilton, New Zealand

Acceptance Rates

IVCNZ '14 Paper Acceptance Rate 55 of 74 submissions, 74%;

Overall Acceptance Rate 55 of 74 submissions, 74%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
186
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)0

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Soleimani VMirmehdi MDamen DHannuna SCamplani M(2016)3D Data Acquisition and Registration Using Two Opposing Kinects2016 Fourth International Conference on 3D Vision (3DV)10.1109/3DV.2016.21(128-137)Online publication date: Oct-2016
https://doi.org/10.1109/3DV.2016.21
Javan Hemmat HBondarev Ede With P(2016)R $$^{3}$$ P: Real-time RGB-D Registration PipelineAdvanced Concepts for Intelligent Vision Systems10.1007/978-3-319-48680-2_34(385-397)Online publication date: 21-Oct-2016
https://doi.org/10.1007/978-3-319-48680-2_34
Rafighi ASeifi SMeruvia-Pastor O(2015)Automatic and adaptable registration of live RGBD video streamsProceedings of the 8th ACM SIGGRAPH Conference on Motion in Games10.1145/2822013.2822027(243-250)Online publication date: 16-Nov-2015
https://dl.acm.org/doi/10.1145/2822013.2822027
Rafighi ASeifi SMeruvia-Pastor O(2015)Continuous and automatic registration of live RGBD video streams with partial overlapping viewsACM SIGGRAPH 2015 Posters10.1145/2787626.2792640(1-1)Online publication date: 31-Jul-2015
https://dl.acm.org/doi/10.1145/2787626.2792640

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten