Skip to main content

Advertisement

Springer Nature Link
Log in

A technique to match highly similar 3D objects with an application to biomedical security

  • 1176: Artificial Intelligence and Deep Learning for Biomedical Application
  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Biometric technologies such as the face, fingerprint, and iris recognition have important utility in biomedical and healthcare applications. The use of biometrics in these applications ensures that critical medical information and access to secure premises and medical instruments is given only to authorized persons. In the past, the 2D face has been reliably used as biometrics in biomedical and healthcare applications. Though it provides remarkable performance in normal scenarios, the performance deteriorates in the presence of poor illumination, pose variations, and occlusions. These challenges are overcome by 3D face biometrics, where 3D face data (which provides complete geometric information of the face) is used in place of 2D face images. In this work, we develop a generic technique for matching of highly similar 3D objects and demonstrate its use in 3D face biometrics. The proposed technique combines the object classification utility from PointNet with One-Shot Learning from Siamese Network that converts the multi-class classification problem to a binary classification problem. We also propose a novel data augmentation technique that uses sub-sampling from the existing 3D data to increase the size and variability of the data, which is otherwise limited. Experimental results show that the proposed technique is considerably fast and accurate in the matching of highly similar 3D objects such as 3D human faces. It is also found to be highly efficient in terms of time and space and hence can be employed in designing real-time security solutions for biomedical, healthcare, and several applications in other fields.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  1. Asif U, Bennamoun M, Sohel FA (2018) A multi-modal, discriminative and spatially invariant cnn for rgb-d object labeling. IEEE Trans Pattern Anal Mach Intell 40(9):2051–2065

    Article  Google Scholar 

  2. Aubry M, Schlickewei U, Cremers D (2011) The wave kernel signature: a quantum mechanical approach to shape analysis. In: Proceedings of the 2011 IEEE international conference on computer vision workshops (ICCV workshops), pp 1626–1633

  3. Braeger S, Foroosh H (2018) Curvature augmented deep learning for 3d object recognition. In: Proceedings of the 2018 25th IEEE international conference on image processing (ICIP), pp 3648–3652

  4. Bronstein AM, Bronstein MM, Guibas LJ, Ovsjanikov M (2011) Shape google: geometric words and 554 expressions for invariant shape retrieval. ACM Trans Graph 30(1):1–20. https://doi.org/10.1145/1899404.1899405

    Article  Google Scholar 

  5. Bronstein MM, Kokkinos I (2010) Scale-invariant heat kernel signatures for non-rigid shape recognition. In: Proceedings of the 2010 IEEE computer society conference on computer vision and pattern recognition, pp 1704–1711

  6. Caglayan A, Can AB (2017) 3D convolutional object recognition using volumetric representations of depth data. In: Proceedings of the 2017 fifteenth IAPR international conference on machine vision applications (MVA), pp 125–128

  7. Chang KI, Bowyer KW, Flynn PJ (2003) Face recognition using 2d and 3d facial data. In: Proceedings of the ACM workshop on multimodal user authentication, pp 25–32

  8. Chetverikov D, Stepanov D, Krsek P (2005) Robust euclidean alignment of 3d point sets: the trimmed iterative closest point algorithm. Image Vis Comput 23(3):299–309

    Article  Google Scholar 

  9. Elaraby AF, Hamdy A, Rehan M (2018) A kinect-based 3d object detection and recognition system with enhanced depth estimation algorithm. In: Proceedings of the 2018 IEEE 9th annual information technology, electronics and mobile communication conference (IEMCON), pp 247–252

  10. Flynn PJ, Bowyer KW, Phillips PJ (2003) Assessment of time dependency in face recognition: an initial study. In: Proceedings of the audio- and video-based biometric person authentication, pp 44–51

  11. Funkhouser T, Shilane P (2006) Partial matching of 3d shapes with priority-driven search. In: SGP ’06: proceedings of the fourth eurographics symposium on geometry processing, pp 131–142

  12. Ganapathi II, Prakash S, Dave IR, Joshi P, Ali SS, Shrivastava AM (2018) Ear recognition in 3d using 2d curvilinear features. IET Biometrics 7(6):519–529

    Article  Google Scholar 

  13. Gomez-Donoso F, Garcia-Garcia A, Garcia-Rodriguez J, Orts-Escolano S, Cazorla M (2017) Lonchanet: a sliced-based cnn architecture for real-time 3d object recognition. In: Proceedings of the 2017 international joint conference on neural networks (IJCNN), pp 412–418

  14. Gordon GG (1991) Face recognition based on depth maps and surface curvature. In: Proceedings of SPIE - the international society for optical engineering, pp 234–247

  15. Graham B (2013) Sparse arrays of signatures for online character recognition. arXiv:1308.0371

  16. Guo K, Zou D, Chen X (2015) 3D mesh labeling via deep convolutional neural networks. ACM Trans Graph 35(1):3:1–3:12

    Article  Google Scholar 

  17. Hayale W, Negi P, Mahoor M (2019) Facial expression recognition using deep siamese neural networks with a supervised loss function. In: Proceedings of the 2019 14th IEEE international conference on automatic face gesture recognition (FG 2019), pp 1–7

  18. He M, Li B, Chen H (2017) Multi-scale 3d deep convolutional neural network for hyperspectral image classification. In: Proceedings of the 2017 IEEE international conference on image processing (ICIP), pp 3904–3908

  19. Hu H, Shah SAA, Bennamoun M, Molton M (2017) 2D and 3d face recognition using convolutional neural network. In: Proceedings of the TENCON 2017 - 2017 IEEE Region 10 conference, pp 133–132

  20. Ioannidou A, Chatzilari E, Nikolopoulos S, Kompatsiaris I (2017) Deep learning advances in computer vision with 3d data: a survey. ACM Comput Surv 50(2):20:1–20:38

    Google Scholar 

  21. Joshi JC, Gupta A, Tiwari K, Gupta KK (2018) Scanned to digital face images matching with siamese network. In: Proceedings of the 2018 3rd international conference and workshops on recent advances and innovations in engineering (ICRAIE), pp 1–6

  22. Kim D, Hernandez M, Choi J, Medioni G (2017) Deep 3d face identification. In: Proceedings of the 2017 IEEE international joint conference on biometrics (IJCB), pp 133–142

  23. Lai K, Samoil S, Yanushkevich SN, Collaud G (2016) Biometrics for biomedical applications. Springer International Publishing, Cham, pp 143–161

    Google Scholar 

  24. Lei Y, Guo Y, Hayat M, Bennamoun M, Zhou X (2016) A two-phase weighted collaborative representation for 3d partial face recognition with single sample. Pattern Recogn 52:218–237

    Article  Google Scholar 

  25. Li H, Huang D, Morvan JM, Wang Y, Chen L (2015) Towards 3d face recognition in the real: a registration-free approach using fine-grained matching of 3d keypoint descriptors. Int J Comput Vis 113(2):128–142

    Article  MathSciNet  Google Scholar 

  26. Li S, Feng H (2019) Eeg signal classification method based on feature priority analysis and cnn. In: Proceedings of the 2019 international conference on communications, information system and computer engineering (CISCE), pp 403–406

  27. Luo J, Hu F, Wang R (2019) 3D face recognition based on deep learning. In: Proceedings of the 2019 IEEE international conference on mechatronics and automation (ICMA), pp 1576–1581

  28. Maturana D, Scherer SA (2015) Voxnet: a 3d convolutional neural network for real-time object recognition. In: Proceedings of the 2015 IEEE/RSJ international conference on intelligent robots and systems (IROS), pp 922–928

  29. Neves J, Proença H (2019) A leopard cannot change its spots: improving face recognition using 3d-based caricatures. IEEE Transactions on Information Forensics and Security 14(1):151–161

    Article  Google Scholar 

  30. Osada R, Funkhouser T, Chazelle B, Dobkin D (2001) Matching 3d models with shape distributions. In: Proceedings international conference on shape modeling and applications, pp 154–166

  31. Patil H, Kothari A, Bhurchandi K (2015) 3-D face recognition: features, databases, algorithms and challenges. Artif Intell Rev 44:393–441

    Article  Google Scholar 

  32. Qi CR, Su H, Mo K, Guibas LJ (2016) Pointnet: deep learning on point sets for 3d classification and segmentation. In: Proceedings of the 2017 IEEE conference on computer vision and pattern recognition (CVPR), pp 77–85

  33. Qi CR, Su H, Nießner M, Dai A, Yan M, Guibas LJ (2016) Volumetric and multi-view cnns for object classification on 3d data. In: Proceedings of the 2016 IEEE conference on computer vision and pattern recognition (CVPR), pp 5648–5656

  34. Rusu RB, Blodow N, Beetz M (2009) Fast point feature histograms (fpfh) for 3d registration. In: Proceedings of the 2009 IEEE international conference on robotics and automation, pp 3212–3217

  35. Sales DO, Amaro J, Osório FS (2017) 3D shape descriptor for objects recognition. In: Proceedings of the 2017 Latin American robotics symposium (LARS) and 2017 Brazilian symposium on robotics (SBR), pp 1–6

  36. Savran A, Alyuz N, Dibeklioglu H, Celiktutan O, Gokberk B, Sankur B, Akarun L (2008) Bosphorus database for 3d face analysis. In: Proceedings of the workshop on biometrics and identity management, pp 47–56

  37. Taertulakarn S, Pintavirooj C, Tosranon P, Hamamoto K (2016) The preliminary investigation of ear recognition using hybrid technique. In: Proceedings of the 2016 9th biomedical engineering international conference (BMEiCON), pp 1–4

  38. Tanaka HT, Ikeda M, Chiaki H (1998) Curvature-based face surface recognition using spherical correlation. principal directions for curved object recognition. In: Proceedings of the third IEEE international conference on automatic face and gesture recognition, pp 372–377

  39. Terada T, Chen Y, Kimura R (2018) 3D facial landmark detection using deep convolutional neural networks. In: Proceedings of the 2018 14th international conference on natural computation, fuzzy systems and knowledge discovery (ICNC-FSKD), pp 390–393

  40. Wu H, Xu Z, Zhang J, Yan W, Ma X (2017) Face recognition based on convolution siamese networks. In: Proceedings of the 2017 10th international congress on image and signal processing, biomedical engineering and informatics (CISP-BMEI), pp 1–5

  41. Wu Z, Song S, Khosla A, Yu F, Zhang L, Tang X, Xiao J (2015) 3D shapenets: a deep representation for volumetric shapes. In: Proceedings of the 2015 IEEE conference on computer vision and pattern recognition (CVPR), pp 1912–1920

  42. Xu K, Wang X, Hu Z, Zhang Z (2019) 3D face recognition based on twin neural network combining deep map and texture. In: Proceedings of the 2019 IEEE 19th international conference on communication technology (ICCT), pp 1665–1668

  43. Yun W, Lee J, Lee J, Kim J (2017) Object recognition and pose estimation for modular manipulation system: overview and initial results. In: Proceedings of the 2017 14th international conference on ubiquitous robots and ambient intelligence (URAI), pp 198–201

  44. Zhang Y, Lu Z, Xue J, Liao Q (2019) A new rotation-invariant deep network for 3d object recognition. In: Proceedings of the 2019 IEEE international conference on multimedia and expo (ICME), pp 1606–1611

  45. Zhang Y, Shang K, Wang J, Li N, Zhang MM (2018) Patch strategy for deep face recognition. IET Image Process 12(6):819–825

    Article  Google Scholar 

  46. Zulqarnain Gilani S, Mian A (2018) Learning from millions of 3d scans for large-scale 3d face recognition. In: Proceedings of the 2018 IEEE/CVF conference on computer vision and pattern recognition, pp 1896–1905

Download references

Acknowledgments

This research is supported by the Visvesvaraya Young Faculty Research Fellowship grant received by Surya Prakash from the Ministry of Electronics and Information Technology, Government of India, under the “Visvesvaraya Ph.D. Scheme for Electronics and IT.”

Author information

Authors and Affiliations

  1. Discipline of Computer Science and Engineering, Indian Institute of Technology Indore, Indore, Madhya Pradesh, India

    Akhilesh Mohan Srivastava, Arushi Jain, Priyanka Rotte & Surya Prakash

  2. Department of Computer Science and Engineering, Indian Institute of Information Technology Design and Manufacturing, Kancheepuram, Tamil Nadu, India

    Umarani Jayaraman

Authors
  1. Akhilesh Mohan Srivastava
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Arushi Jain
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Priyanka Rotte
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Surya Prakash
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Umarani Jayaraman
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Surya Prakash.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Srivastava, A.M., Jain, A., Rotte, P. et al. A technique to match highly similar 3D objects with an application to biomedical security. Multimed Tools Appl 81, 13159–13178 (2022). https://doi.org/10.1007/s11042-020-10161-8

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-020-10161-8

Keywords