Abstract
Deformability and texture are two unique object characteristics which are essential for appropriate surface recognition by tactile exploration. Tactile sensation is required to be incorporated in artificial arms for rehabilitative and other human–computer interface applications to achieve efficient and human-like manoeuvring. To accomplish the same, surface recognition by tactile data analysis is one of the prerequisites. The aim of this work is to develop effective technique for identification of various surfaces based on deformability and texture by analysing tactile images which are obtained during dynamic exploration of the item by artificial arms whose gripper is fitted with tactile sensors. Tactile data have been acquired, while human beings as well as a robot hand fitted with tactile sensors explored the objects. The tactile images are pre-processed, and relevant features are extracted from the tactile images. These features are provided as input to the variants of support vector machine (SVM), linear discriminant analysis and k-nearest neighbour (kNN) for classification. Based on deformability, six household surfaces are recognized from their corresponding tactile images. Moreover, based on texture five surfaces of daily use are classified. The method adopted in the former two cases has also been applied for deformability- and texture-based recognition of four biomembranes, i.e. membranes prepared from biomaterials which can be used for various applications such as drug delivery and implants. Linear SVM performed best for recognizing surface deformability with an accuracy of 83 % in 82.60 ms, whereas kNN classifier recognizes surfaces of daily use having different textures with an accuracy of 89 % in 54.25 ms and SVM with radial basis function kernel recognizes biomembranes with an accuracy of 78 % in 53.35 ms. The classifiers are observed to generalize well on the unseen test datasets with very high performance to achieve efficient material recognition based on its deformability and texture.
Similar content being viewed by others
References
Bhattacharjee T, Rehg JM, Kemp CC (2012) Haptic classification and recognition of objects using a tactile sensing forearm. In: IEEE/RSJ international conference on intelligent robots and systems (IROS), pp 4090–4097
Cavalin P, Oliveira LS, Koerich AL, Britto AS (2006) Wood defect detection using grayscale images and an optimized feature set. In: 32nd IEEE annual conference on industrial electronics (IECON), pp 3408–3412
Chai HY, Wee LK, Swee TT, Salleh SH, Ariff AK (2011) Gray-level co-occurrence matrix bone fracture detection. Am J Appl Sci 8(1):26–32. doi:10.3844/ajassp.2011.26.32
Coronel R, Spaan J, Voigt H (2011) Engineering and ethical constraints. Med Biol Eng Comput 49:1–2
Dallaire P, Giguère P, Émond D, Chaib-Draa B (2014) Autonomous tactile perception: a combined improved sensing and Bayesian nonparametric approach. Robot Auton Syst 62(4):422–435
Darvish B, Najarian S, Shirzad E, Khodambashi R (2009) A novel tactile force probe for tissue stiffness classification. Am J Appl Sci 6(3):512–517. doi:10.3844/ajas.2009.512.517
De Boissieu F, Godin C, Guilhamat B, David D, Serviere C, Baudois D (2009) Tactile texture recognition with a 3-axial force MEMS integrated artificial finger. Robotics: science and systems. MIT Press, Cambridge
Demšar J (2006) Statistical comparisons of classifiers over multiple data sets. J Mach Learn Res 7:1–30
Ding W, Yuan J (2008) Spike sorting based on multi-class support vector machine with superposition resolution. Med Biol Eng Comput 46:139–145
Drimus A, Kootstra G, Bilberg A, Kragic D (2014) Design of a flexible tactile sensor for classification of rigid and deformable objects. Robot Auton Syst 62:3–15
Eltaib MEH, Hewit JR (2003) Tactile sensing technology for minimal access surgery—a review. Mechatronics 13(10):1163–1177. doi:10.1016/S0957-4158(03)00048-5
Garcia N, Sabater-Navarro JM, Gugliemeli E, Casals A (2011) Trends in rehabilitation robotics. Med Biol Eng Comput 49:1089–1091
Gonzalez RC, Woods RE, Eddins SL (2002) Image enhancement in the spatial domain. Digital image processing, 2nd edn. Prentice Hall, Upper Saddle River, pp 75–146
Gonzalez RC, Woods RE, Eddins SL (2002) Representation and description. Digital image processing, 2nd edn. Prentice Hall, Upper Saddle River, pp 643–692
Guo Y, Hastie T, Tibshirani R (2007) Regularized linear discriminant analysis and its application in microarrays. Biostatistics 8(1):86–100. doi:10.1093/biostatistics/kxj035
Honeycutt CE, Plotnick R (2008) Image analysis techniques and gray-level co-occurrence matrices (GLCM) for calculating bioturbation indices and characterizing biogenic sedimentary structures. Comput Geosci 34(11):1461–1472. doi:10.1016/j.cageo.2008.01.006
Jamali N, Sammut C (2010) Material classification by tactile sensing using surface textures. In: IEEE international conference on robotics and automation (ICRA), pp 2336–2341
Jamali N, Sammut C (2011) Majority voting: material classification by tactile sensing using surface texture. IEEE Trans Robot 27(3):508–521. doi:10.1109/TRO.2011.2127110
Khasnobish A, Singh G, Jati A, Konar A, Tibarewala DN (2014) Object-shape recognition and 3D reconstruction from tactile sensor images. Med Biol Eng Comput 52:353–362
Kim SH, Engel J, Liu C, Jones DL (2005) Texture classification using a polymer-based MEMS tactile sensor. J Micromech Microeng 15(5):912–920. doi:10.1088/0960-1317/15/5/003
Lam HK, Ekong U, Liu H, Xiao B, Araujo H, Ling SH, Chan KY (2014) A study of neural network based classifiers for material classification. Neurocomputing 144:367–377
Lieberman MD, Cunningham WA (2009) Type I and Type II error concerns in fMRI research: re-balancing the scale. Soc Cogn Affect Neurosci 4(4):423–428. doi:10.1093/scan/nsp052
Maheu V, Frappier J, Archambault PS, Routhier F (2011) Evaluation of the JACO robotic arm: Clinico-economic study for powered wheelchair users with upper-extremity disabilities. In: IEEE international conference on rehabilitation and robotics (ICORR), Zurich, pp 1–5. doi:10.1109/ICORR.2011.5975397
Nazeer KA, Sebastian MP (2009) Improving the accuracy and efficiency of the k-means clustering algorithm. In: Proceedings of the world congress on engineering, vol 1, pp 1–3
Pal M, Khasnobish A, Konar A, Tibarewala DN, Janarthanan R (2014) Performance enhancement of object shape classification by coupling tactile sensing with EEG. In: Proceedings IEEE international conference on electronics, communication and instrumentation (ICECI), pp 1–4
Peng H, Long F, Ding C (2005) Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy. IEEE Trans Pattern Anal Mach Intell 27(8):1226–1238
Setua DK, Awasthi R, Kumar S, Prasad M, Agarwal K (2010) Scanning electron microscopy of natural rubber surfaces: quantitative statistical and spectral texture analysis using digital image processing. In: Mendes-Vilas A, Diaz J (eds) Microscopy: science technology application and education. Formatex Research Centre, Spain, pp 1642–1652
Shawe-Taylor J, Cristianini N (2004) Kernel methods for pattern analysis. Cambridge University Press, Cambridge. doi:10.1017/CBO9780511809682
Theodoridis S (2008) Koutroumbas K (2008) Pattern recognition, 4th edn. Academic Press, MA, USA
Tsochantaridis I, Hofmann T, Joachims T, Altun Y (2004) Support vector machine learning for interdependent and structured output spaces. In: ACM proceedings of the 21st international conference on machine learning, pp 823–830. doi:10.1145/1015330.1015341
Vidaurre C, Scherer R, Cabeza R, Schlögl A, Pfurtscheller G (2007) Study of discriminant analysis applied to motor imagery bipolar data. Med Biol Eng Comput 45:61–68
Ye J, Janardan R, Park CH, Park H (2004) An optimization criterion for generalized discriminant analysis on undersampled problems. IEEE Trans Pattern Anal Mach Intell 26(8):982–994. doi:10.1109/TPAMI.2004.37
Yuan P, Gao X, Allison B, Wang Y, Bin G, Gao S (2013) A study of the existing problems of estimating the information transfer rate in online brain–computer interfaces. J Neural Eng 10(2):1–11. doi:10.1088/1741-2560/10/2/026014
Acknowledgments
This study has been supported by University Grants Commission (UGC), India; University with Potential for Excellence Program (UGC-UPE) (Phase II) in Cognitive Science, Jadavpur University; and Council of Scientific and Industrial Research (CSIR), India.
Author information
Authors and Affiliations
Corresponding author
Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
About this article
Cite this article
Khasnobish, A., Pal, M., Tibarewala, D.N. et al. Texture- and deformability-based surface recognition by tactile image analysis. Med Biol Eng Comput 54, 1269–1283 (2016). https://doi.org/10.1007/s11517-016-1464-2
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11517-016-1464-2