Skip to main content
SpringerLink
Log in

CAD-based Pose Estimation Design for Random Bin Picking using a RGB-D Camera

  • Published:
Journal of Intelligent & Robotic Systems Aims and scope Submit manuscript

Abstract

This paper presents a CAD-based six-degrees-of-freedom (6-DoF) pose estimation design for random bin picking for multiple objects. A virtual camera generates a point cloud database for the objects using their 3D CAD models. To reduce the computational time of 3D pose estimation, a voxel grid filter reduces the number of points for the 3D cloud of the objects. A voting scheme is used for object recognition and to estimate the 6-DoF pose for different objects. An outlier filter filters out badly matching poses so that the robot arm always picks up the upper object in the bin, which increases the success rate. In a computer simulation using a synthetic scene, the average recognition rate is 97.81 % for three different objects with various poses. A series of experiments have been conducted to validate the proposed method using a Kuka robot arm. The average recognition rate for three objects is 92.39 % and the picking success rate is 89.67 %.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Bradski, G., Kaehler, A.: Learning openCV: Computer Vision with the openCV Library O’Reilly Media (2008)

  2. Quigley, M., Gerkey, B., Conley, K., Faust, J., Foote, T., Leibs, J., Berger, E., Wheeler, R., Ng, A.: ROS: an Open-Source Robot Operating System Proc. ICRA Workshop Open Source Software, pp. 1–6 (2009)

  3. Rusu, R.B.: Cousins, S.: 3D is Here: Point Cloud Library (PCL) Proc. 2011 IEEE International Conference on Robotics and Automation, pp. 1–4 (2011)

  4. Choi, C., Christensen, H.I.: Real-Time 3D Model-based Tracking Using Edge and Keypoint Features for Robotic Manipulation Proc. IEEE International Conference on Robotics and Automation, pp. 4048–4055 (2010)

  5. Ulrich, M., Wiedemann, C., Steger, C.: CAD-Based Recognition of 3D Objects in Monocular Images Proc. IEEE International Conference on Robotics and Automation, pp. 1191–1198 (2009)

  6. Borotschnig, H., Paletta, L., Prantl, M., Pinz, A.: Appearance-based active object recognition. Image Vis. Comput. 18(9), 715–727 (2000)

    Article  MATH  Google Scholar 

  7. Wohlkinger, W., Vincze, M.: Ensemble of Shape Functions for 3D Object Classification Proc. IEEE International Conference on Robotics and Biomimetics, pp. 2987–2992 (2011)

  8. Rusu, R.B., Bradski, G., Thibaux, R., Hsu, J.: Fast 3D Recognition and Pose Using the Viewpoint Feature Histogram Proc. The 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 2155–2162 (2010)

  9. Aldoma, A., Vincze, M., Blodow, N., Gossow, D., Gedikli, S., Rusu, R.B., Bradski, G.: CAD-Model Recognition and 6DOF Pose Estimation Using 3D Cues Proc. 2011 IEEE International Conference on Computer Vision Workshops, pp. 585–592 (2011)

  10. Aldoma, A., Tombari, F., Stefano, L.D., Vincze, M.: A Global Hypothesis Verification Framework for 3D Object Recognition in Clutter. IEEE Trans. Pattern Anal. Mach. Intell. 38(7), 1383–1396 (2016)

    Article  Google Scholar 

  11. Akizuki, S., Hashimoto, M.: High-Speed and Reliable Object Recognition Using Distinctive 3-D Vector-Pairs in a Range Image Proc. 2012 International Symposium on Optomechatronic Technologies, pp. 1–6 (2012)

  12. Choi, C., Christensen, H.: I.: 3D Pose Estimation of Daily Objects Using an RGB-D Camera Proc. 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 3342–3349 (2012)

  13. Drost, B., Ulrich, M., Navab, N., Ilic, S.: Model Globally, Match Locally: Efficient and Robust 3D Object Recognition Proc. 2010 IEEE International Conference on Computer Vision and Pattern Recognition, pp. 998–1005 (2010)

  14. Choi, C., Taguchi, Y., Tuzel, O., Liu, M.Y., Ramalingam, S.: Voting-Based Pose Estimation for Robotic Assembly Using a 3D Sensor Proc. 2012 IEEE International Conference on Robotics and Automation, pp. 1724–1731 (2012)

  15. Skotheim, Ø., Lind, M., Ystgaard, P., Fjerdingen, S.A.: A Flexible 3D Object Localization System for Industrial Part Handling Proc. 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 3326–3333 (2012)

  16. Menon, A., Cohen, B., Likhachev, M.: Motion Planning for Smooth Pickup of Moving Objects Proc. 2014 IEEE International Conference on Robotics and Automation, pp. 453–460 (2014)

  17. Atanasov, N., Sankaran, B., Ny, J.L., Pappas, G.J., Daniilidis, K.: Nonmyopic view planning for active object classification and pose estimation. IEEE Trans. Robot. 30(5), 1078–1090 (2014)

    Article  Google Scholar 

  18. Eidenberger, R., Scharinger, J.: Active Perception and Scene Modeling by Planning with Probabilistic 6D Object Poses Proc. The 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 1036–1043 (2010)

  19. Jiang, S.Y., Chang, N.Y.C., Wu, C.C., Wu, C.H., Song, K.T.: Error Analysis and Experiments of 3D Reconstruction Using a RGB-D Sensor Proc. IEEE International Conference on Automation Science and Engineering, pp. 1020–1025 (2014)

  20. Besl, P.J., McKay, N.D.: A method for registration of 3D shapes. IEEE Trans. Pattern Anal. Mach. Intell. 14(2), 239–256 (1992)

    Article  Google Scholar 

  21. Squizzato, S.: Robot bin picking: 3D pose retrieval based on Point Cloud Library University of Padova (2012)

Download references

Author information

Authors and Affiliations

  1. Institute of Electrical Control Engineering, College of Electrical and Computer Engineering, National Chiao Tung University, 1001 Ta Hsueh Road, Hsinchu, Taiwan, 30010, Republic of China

    Kai-Tai Song, Cheng-Hei Wu & Sin-Yi Jiang

Authors
  1. Kai-Tai Song
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Cheng-Hei Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sin-Yi Jiang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Kai-Tai Song.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Song, KT., Wu, CH. & Jiang, SY. CAD-based Pose Estimation Design for Random Bin Picking using a RGB-D Camera. J Intell Robot Syst 87, 455–470 (2017). https://doi.org/10.1007/s10846-017-0501-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10846-017-0501-1

Keywords

Search

Navigation