Skip to main content

Advertisement

SpringerLink
Log in

Object-shape recognition and 3D reconstruction from tactile sensor images

  • Original Article
  • Published:
Medical & Biological Engineering & Computing Aims and scope Submit manuscript

Abstract

This article presents a novel approach of edged and edgeless object-shape recognition and 3D reconstruction from gradient-based analysis of tactile images. We recognize an object’s shape by visualizing a surface topology in our mind while grasping the object in our palm and also taking help from our past experience of exploring similar kind of objects. The proposed hybrid recognition strategy works in similar way in two stages. In the first stage, conventional object-shape recognition using linear support vector machine classifier is performed where regional descriptors features have been extracted from the tactile image. A 3D shape reconstruction is also performed depending upon the edged or edgeless objects classified from the tactile images. In the second stage, the hybrid recognition scheme utilizes the feature set comprising both the previously obtained regional descriptors features and some gradient-related information from the reconstructed object-shape image for the final recognition in corresponding four classes of objects viz. planar, one-edged object, two-edged object and cylindrical objects. The hybrid strategy achieves 97.62 % classification accuracy, while the conventional recognition scheme reaches only to 92.60 %. Moreover, the proposed algorithm has been proved to be less noise prone and more statistically robust.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  1. Alpaydin E (2004) Linear discrimination. Introduction to machine learning, 1st edn. MIT Press, Cambridge, pp 197–228

    Google Scholar 

  2. Argall BD, Billard AG (2010) A survey of tactile human-robot interactions. Rob Auton Syst 58(10):1159–1176

    Article  Google Scholar 

  3. Bierbaum A, Gubarev I, Dillmann R (2008) Robust shape recovery for sparse contact location and normal data from haptic exploration. In: IEEE/RSJ international conference on intelligent robots and systems (IROS 2008). IEEE, Nice, pp 3200–3205

  4. Chia-Ping C, Chu-Song C, Yi-Ping H (2009) Pixel-based correspondence, and shape reconstruction for moving objects. In: Proceedings IEEE 12th international conference on computer vision workshops (ICCV workshops). IEEE, Kyoto, pp 1962–1969

  5. Dahiya RS, Metta G, Valle M, Sandini G (2010) Tactile sensing: from humans to humanoids. IEEE Trans Rob 26:1–20

    Article  Google Scholar 

  6. Dietterich TG (1998) Approximate statistical test for comparing supervised classification learning algorithms. J Neural Comput 10(7):1895–1924

    Article  Google Scholar 

  7. Duda RO, Hart PE, Stork DG (2012) Unsupervised learning and clustering. In: Pattern classification. Wiley, New York, pp 517–600

  8. Gonzalez RC, Woods RE, Eddins SL (2012) Digital image processing using MATLAB, 4th edn. Tata McGraw Hill, LLC, USA, pp 551–614

    Google Scholar 

  9. Graupe D (2007) Principles of artificial neural networks, 2nd edn. Advanced series on circuits and systems, vol 6. World Scientific, Denver, MA

  10. Ballesteros S, Heller MA (2008) Haptic object identification. In: Grunwald M (ed) Human haptic perception. Basics and Applications. Birkhauser Basel, Birkhauser Verlag AG, pp 207–222

    Chapter  Google Scholar 

  11. Hayward V, Astley OR, Cruz-Hernandez M, Grant D, Robles-De-La-Torre G (2004) Haptic interfaces and devices. J Sens Rev 24:16–29

    Article  Google Scholar 

  12. Heidemann G, Schopfer M (2004) Dynamic tactile sensing for object identification. In: Proceedings of IEEE international conference on robotics and automation (ICRA ‘04), vol 1. IEEE, New Orleans, LA, pp 813–818

  13. Jain AK, Murty MN, Flynn PJ (1999) Data clustering: a review. ACM Comput Surv, N. Y., U. S. A. 31(3):264–323

    Article  Google Scholar 

  14. Khasnobish A, Jati A, Singh G, Bhattacharyya S, Konar A, Tibarewala DN, Kim E, Nagar AK (2012) Object-shape recognition from tactile images using a feed-forward neural network. In: Proceedings IEEE international joint conference on neural networks (IJCNN 2012). IEEE, Brisbane, QLD, pp 1–8

  15. Meier M, Schopfer M, Haschke R, Ritter H (2011) A probabilistic approach to tactile shape reconstruction. IEEE Trans Rob 27:630–635

    Article  Google Scholar 

  16. Mitchell T (1997) Instance based learning. In: Machine learning. McGraw Hill, New York, pp 239–258

  17. Murphy OJ (1990) Nearest neighbor pattern classification perceptrons. In: Proceedings of the IEEE, vol 78. IEEE, pp 1595–1598

  18. Nakamoto H, Fukui W, Kobayashi F, Kojima F, Imamura N, Shirasawa H (2009) Shape classification based on tactile information by universal robot hand. In: 35th annual conference of IEEE on industrial electronics (IECON ‘09). IEEE, Porto, pp 2360–2365

  19. Okamura AM, Turner ML, Cutkosky MR (1997) Haptic exploration of objects with rolling and sliding. In: Proceedings of the IEEE international conference on robotics and automation, vol 3. IEEE, Albuquerque, NM, pp 2485–2490

  20. Pezzementi Z, Plaku E, Reyda C, Hager GD (2011) Tactile-object recognition from appearance information. IEEE Trans Rob 27:473–487

    Article  Google Scholar 

  21. Romano JM, Hsiao K, Niemeyer G, Chitta S, Kuchenbecker KJ (2011) Human-inspired robotic grasp control with tactile sensing. IEEE Trans Rob 27:1067–1079

    Article  Google Scholar 

  22. Shimoga KB, Goldenberg AA (1996) Soft robotic fingertips part II: modeling and impedance regulation. Int J Rob Res 15(4):335–350

    Article  Google Scholar 

  23. Sigiuchi H, Watanabe S, Hasegawa Y, Nornoto M (2000) A control system for multi-fingered robotic hand with distributed touch sensor. In: 26th annual conference industrial electronics society, IECON 2000, vol 1. IEEE, Nagoya, pp 434–439

  24. Simpkins A (2013) Robotic tactile sensing: technologies and system (Dahiya RS, Valle M 2013) [on the shelf]. IEEE Robot Autom Mag 20(2):107–107

    Article  Google Scholar 

  25. Takamuku S, Fukuda A, Hosoda K (2008) Repetitive grasping with anthromorphic skin-covered hand enables robust haptic recognition. In: International conference on intelligent robots and systems (IROS 2008). IEEE, Nice, pp 3212–3217

  26. Talasaz A, Patel RV (2013) Integration of force reflection with tactile sensing for minimally invasive robotics-assisted tumor localization. IEEE Trans Haptics 6:217–228

    Article  Google Scholar 

  27. Ting Z, Hong L, Li J, Shaowei F, Jing Y (2013) Development of a flexible 3-D tactile sensor system for anthropomorphic artificial hand. IEEE Sens J 13:510–518

    Article  Google Scholar 

  28. Visell Y (2009) Tactile sensory substitution: models for enaction in HCI. J Interact Comput 21:38–53

    Article  Google Scholar 

  29. Webb AR, Copsey KD (2011) Nonlinear discriminant analysis—kernel and projection methods. In: Statistical pattern recognition, 3rd edn. Wiley, New York, pp 274–321

  30. Yamada Y, Ishiguro A, Uchikawa Y (1993) A method of 3D object reconstruction by fusing vision with touch using internal models with global and local deformations. In: Proceedings international conference on robotics and automation, vol 2. IEEE, Atlanta, GA, pp 782–787

Download references

Acknowledgments

This study has been supported by University Grants Commission (UGC), India, University with Potential for Excellence—Phase II (UPE II) in Cognitive Science, Jadavpur University and Council of Scientific and Industrial Research (CSIR), India.

Author information

Authors and Affiliations

  1. School of Bioscience and Engineering, Jadavpur University, Kolkata, India

    Anwesha Khasnobish & D. N. Tibarewala

  2. Department of Electronics and Telecommunication Engineering, Jadavpur University, Kolkata, India

    Garima Singh, Arindam Jati & Amit Konar

Authors
  1. Anwesha Khasnobish
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Garima Singh
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Arindam Jati
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Amit Konar
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. D. N. Tibarewala
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Anwesha Khasnobish.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Khasnobish, A., Singh, G., Jati, A. et al. Object-shape recognition and 3D reconstruction from tactile sensor images. Med Biol Eng Comput 52, 353–362 (2014). https://doi.org/10.1007/s11517-014-1142-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11517-014-1142-1

Keywords

Search

Navigation