Skip to main content

Advertisement

Springer Nature Link
Log in

Automated detection of euro pallet loads by interpreting PMD camera depth images

  • Original Paper
  • Published:
Logistics Research

Abstract

In this study, a novel approach for the detection of parcel loading positions on a pallet is presented. This approach was realized as a substantial change in comparison with traditional system design of contour detection in de-palletizing processes. Complex 3D-vision systems, costly laser scanners or throughput decreasing local sensor solutions integrated in grippers are substituted by a low-cost photonic mixing device (PMD) camera. By combining PMD technology and a predetermined model of loading situations, stored during assembling the pallet, this approach can compensate for the drawbacks of each respective system. An essential part of the approach are computer-graphics methods specific to the given problem to both detect the deviation between the nominal and the actual loading position and if necessary an automated correction of the packaging scheme. From an economic point of view, this approach can decrease the costs of mandatory contour checking in automated de-palletizing processes.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18

Similar content being viewed by others

References

  1. ABB (2010) ABB TrueView—Vision Systeme (Applikationsausrüstung). http://www.abb.de. Last visited 2012-01-15

  2. Almaaitah A, Ali K, Hassanein HS, Ibnkahla M (2010) 3d passive tag localization schemes for indoor rfid applications. In: IEEE international conference on communications (ICC), pp 1–5

  3. Athalye A, Savic V, Bolic M, Djuric P (2011) A radio frequency identification system for accurate indoor localization. In: IEEE international conference on acoustics, speech and signal processing (ICASSP), pp 1777–1780

  4. Bechteler T, Yenigün H (2003) 2-D localization and identification based on SAW ID-tags at 2.5 GHz. IEEE Trans Microwave Theory Techniques LNCS 51(5):1584–1590

    Article  Google Scholar 

  5. Besl P, McKay H (1992) A method for registration of 3-D shapes. In: IEEE transactions on pattern analysis and machine intelligence, pp 239–256

  6. Binar Elektronik AB (2010) SensActive—Bin picking. http://www.sensactive.com/index-de.htm. Last visited 2012-07-06

  7. BMBF (2012) 02PB3101, Verbundprojekt Generisches Entladesystem (GENESYS). Tech. rep

  8. Boehnke K (2007) Object localization in range data for robotic bin picking. In: Automation science and engineering, 2007. CASE 2007. IEEE international conference on, pp 572–577

  9. Boughorbel F, Zhang Y, Kang S, Chidanbaran U, Abidi B, Koschan A, Abidi M (2003) Laser ranging and video imaging for bin picking. Assembl Autom 23:53–59

    Article  Google Scholar 

  10. Bouzakis A, Weigelt S, Overmeyer L (2010) RFID-assistierte Stückguterfassung und -handling anhand eines kognitiven Robotersystems. Logist J Proc 6(1):1–11

    Google Scholar 

  11. Buchholz D, Winkelbach S, Wahl FM (2010) RANSAM for industrial bin-picking. In: ISR/ROBOTIK. VDE Verlag, pp 1–6

  12. Choi J, Lee H, Lee SC, Lee DH (2011) Reducing localization ambiguity of immobile passive UHF RFID tagged physical objects. In: Ubiquitous robots and ambient intelligence (URAI), 2011 8th international conference on, pp 35–40

  13. Choi JS, Lee H, Engels D, Elmasri R (2012) Passive UHF RFID-based localization using detection of tag interference on smart shelf. IEEE Trans Syst Man Cybern Part C Appl Rev 42(2):268–275

    Article  Google Scholar 

  14. Corban M (2006) “Sehende” Roboter setzen sich durch. FM—Das Logistik Magazin 22–25

  15. David HA, Hartley HO, Pearson ES (1954) The distribution of the ratio, in a single normal sample, of range to standard deviation. In: Biometrika 41:482–493. Oxford University Press, Oxford

  16. De Meyer A (1998) Manufacturing operations in Europe: where do we go next? Eur Manag J 16(3):262–271

    Article  Google Scholar 

  17. Echelmeyer W, Kirchheim A, Wellbrock E (2008) Robotics-logistics: challenges for automation of logistic processes. Autom Logist 1–3:2099–2103

    Google Scholar 

  18. FANUC (2012) iRVISION. http://www.fanucrobotics.de. Last visited 2012-07-06

  19. ischler MA, Bolles RC (1981) Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun ACM 24(6):381–395

    Article  MathSciNet  Google Scholar 

  20. Foix S, Alenya G, Torras C (2011) Lock-in time-of-flight (ToF) cameras: a survey. Sens J IEEE 11(9):1917–1926

    Article  Google Scholar 

  21. Fuchs S, Haddadin S, Keller M, Parusel S, Kolb A, Suppa M (2010) Cooperative bin-picking with time-of-flight camera and impedance controlled DLR lightweight robot III. In: IROS, pp 4862–4867

  22. Ghita O, Whelan P (2003) A bin picking system based on depth from defocus. Mach Vis Appl 13:234–244

    Article  Google Scholar 

  23. Ghobadi S, Hartmann K, Weihs W, Netramai C, Loffeld O, Roth H (2006) Detection and classification of moving objects-stereo or time-of-flight images. In: Computational intelligence and security. IEEE, Center for Sensor Systems, University of Siegen, pp 11–16

  24. Ghobadi S.e.a. (2006) Classification of 3D moving objects using support vector machines and 3D-time of flight camera. In: 3rd international conference on artificial intelligence in engineering and technology, pp 224–229

  25. Intermodalics (2012) http://www.intermodalics.eu/vision-robotics. Last visited 2012-07-04

  26. Kaiser B (2009) Bildverarbeitung für ein generisches Entladesystem. Ph.D. thesis, Karlsruher Institut fr Technologie

  27. Kaiser R, Baier G (2009) Neue Lösungen zum Einsatz von Robotik bei der Handhabung konplexer Güter. In: Roboter in der Intralogistik, pp 91–105. Fraunhofer IPA Technologieforum F 191

  28. Katsoulas D, Kosmopoulos D (2001) An efficient depalletizing system based on 2D range imagery. Robot Autom 1:305–312

    Google Scholar 

  29. Keysystech (2012) Robotvision. http://www.keysystech.de/de/html/robotvision.html. Last visited 2012-01-15

  30. Kolb A, Barth E, Koch R, Larsen R (2009) Time-of-flight sensors on computer graphics. In: Proceedings of Eurographics (State-of-the-Art Report)

  31. Kuka-Robotics (2012) Depalletizing and palletizing of banana cartons. http://www.kuka-robotics.com/germany/de/solutions/solutions_search/L_R162_Depalletizing_and_palletizing_of_banana_cartons.htm. Last visited 2012-07-04

  32. Kuka-Robotics (2012) Palettieren von Molkereiprodukten. http://www.kukarobotics.com. Last visited 2012-01-15

  33. Kuka-Robotics (2010) KUKA.PalletTech. http://www.kuka-robotics.com. Last visited 2012-01-15

  34. Linde H (2006) On aspects of indoor localisation. Ph.D. thesis, Technical University Dortmund

  35. Lindner M, Kolb A (2007) Calibration of the intensity-related distance error of the PMD TOF-Camera. In: SPIE: intelligent robots and computer vision XXV, vol 6764, pp 6764–35

  36. Mamaev I, Safronov K, Tchouchenkov I, Wörn H (2008) Real-time framework for bin-picking problem using advantages of PMD-technology. In: Proceedings of the 10th international workshop on computer science and information technologies (CSIT’2008)

  37. Mojix (2009) Mojix EPC compliant real-time location system. http://www.mojix.com/products/documents/RTLS_brochure.pdf. Last visited 2012-01-15

  38. Motoman (2012) http://www.motoman.com/products/vision/. Last visited 2012-07-04

  39. Ni L, Liu Y, Lau Y, Patil A (2003) LANDMARC: indoor location sensing using active RFID. In: Proceedings of the first IEEE international conference on pervasive computing and communications, pp 407–415

  40. Nilsson P (2010) 3d-vision guided robotics for material handling. In: 41st international symposium on and 6th German conference on robotics (ROBOTIK), pp 1–7

  41. Oh JK, Baek K, Kim D, Lee S (2009) Development of structured light based bin picking system using primitive models. In: IEEE international symposium on assembly and manufacturing (ISAM), pp 46–52

  42. Packaging P (2012) RDC-MX. http://www.pearsonpkg.com/products/showProduct/RDC-MX. Last visited 2012-07-04

  43. Parlak S, Marsic I (2011) Non-intrusive localization of passive rfid tagged objects in an indoor workplace. In: RFID-technologies and applications (RFID-TA), 2011 IEEE international conference on, pp 181–187

  44. Pires JN, Paulo S (2003) High efficient robotic de-palletizing system for the non-flat ceramic industry. Robot Autom 3:3529–3534

    Google Scholar 

  45. Pochyly A, Kubela T, Kozak M, Cihak P (2010) Robotic vision for bin-picking applications of various objects. In: Robotics (ISR), 2010 41st international symposium on and 2010 6th German conference on robotics (ROBOTIK), pp 1–5

  46. Prasse C, Skibinski S, Weichert F, Stenzel J, Müller H, ten Hompel M (2011) Concept of automated load detection for de-palletizing using depth images and RFID data. In: IEEE international conference on control systems, computing and engineering (ICCSCE 2011)

  47. Ringbeck T, Hagebeuker B (2006) Mehrdimensionale Objekterfassung mittels PMD-Sensorik. Sensor Magazin 2:40–42

    Google Scholar 

  48. Rinza P, Schmitz H (1977) Nutzwert-Kosten-Analys. VDI-Verlag, Düsseldorf

  49. Rusinkiewicz S, Levoy M (2001) Efficient variants of the ICP algorithm. In: Third international conference on 3D digital imaging and modeling (3DIM)

  50. Ruske KD, Kauschke P, Reuter J, von der Gracht H, Gnatzy T, Darkow IL (2010) Transportation & logistics 2030—volume 3: emerging markets new hubs, new spokes, new industry leaders? Tech. rep., SMI (Supply Chain Management Institute) and Price Waterhouse Cooper

  51. Safronov K, Tchouchenkov I, Wörn H (2008) Hierarchical iterative object recognition method for a PMD-sensor supplied bin-picking system. In: 8th Asia-Pacific conference on control and measurement (APCCM 2008), Harbin, China, pp 80–84

  52. Sample A, Macomber C, Jiang LT, Smith J (2012) Optical localization of passive UHF RFID tags with integrated LEDs. In: IEEE international conference on RFID, pp 116–123

  53. Scholz-Reiter B, Thamer H, Uriarte C (2011) An approach for 3D object recognition of universal goods. Int J Comput 5(2):218–225

    Google Scholar 

  54. Schuh G, Wemhöner N, Friedrich C (2006) Scenario-based lifecycle analysis of manufacturing systems. CIRP J Manuf Syst 35(2):129–135

    Google Scholar 

  55. Sinnerbrink R (2008) Effizienzsteigerung in der Logistik—Neue 3D-Kamera optimiert Erkennungssicherheit und Geschwindigkeit. Inspect 4:43–46

    Google Scholar 

  56. Universal Robotics (2012) Random-box-mover. http://www.universalrobotics.com/random-box-mover. Last visited 2012-07-03

  57. Uriarte C, Scholz-Reiter B, Ramanandan S, Kraus D (2011) Modeling distance nonlinearity in tof cameras and correction based on integration time offsets. In: CIARP, pp 214–222

  58. VDI (1998) VDI 2225 Blatt 3; design engineering methodics—engineering design at optimum cost—valuation of costs. Verein Deutscher Ingenieure

  59. VDMA (2012) VDMA Forum Intralogistik erwartet für 2011 Umsatzplus von neun Prozent. http://www.vdma.org. Last visited 2012-01-15

  60. VMT-Vision (2012) Depalletizing and palletizing with VMT D/P. http://vmt-vision-technology.com/575/Griff-in-die-Kiste.html. Last visited 2012-07-06

  61. Zhang B, Skaar S (2009) Robotic de-palletizing using uncalibrated vision and 3D laser-assisted image analysis. Intell Robots Syst 10–15:3820–3825

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science VII, Technical University Dortmund, Dortmund, Germany

    F. Weichert & B. Rudak

  2. Fraunhofer Institute for Material Flow and Logistics, Dortmund, Germany

    S. Skibinski, J. Stenzel, C. Prasse & A. Kamagaew

  3. Chair for Materials Handling and Warehousing, Technical University Dortmund, Dortmund, Germany

    M. ten Hompel

Authors
  1. F. Weichert
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. S. Skibinski
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. J. Stenzel
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. C. Prasse
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. A. Kamagaew
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. B. Rudak
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. M. ten Hompel
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to F. Weichert.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Weichert, F., Skibinski, S., Stenzel, J. et al. Automated detection of euro pallet loads by interpreting PMD camera depth images. Logist. Res. 6, 99–118 (2013). https://doi.org/10.1007/s12159-012-0095-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12159-012-0095-8

Keywords

Search

Navigation