Skip to main content

Advertisement

Log in

Triangular Mesh and Neural Network for Object Search Based Cluster Centre Descriptor

  • Original Research
  • Published:
SN Computer Science Aims and scope Submit manuscript

Abstract

Since 3D models and printing have become more and more widespread, 3D object recognition has gained appeal. It might be challenging to locate the needed object in a large database of 3D objects of different kinds. Several methods have been put forth in the past to effectively identify and detect 3D objects based on their shape data. These techniques describe 3D objects in a high-dimensional feature plane either by using geometric shape features or by creating a 3D shape model from a 2D shape model. One of the disadvantages of 3D descriptors is that their high memory requirements make recognition speed a major difficulty. We provide a unique 3D object search method based on 3D object identification to get around the problem. The process reads the 3D vertices from a CAD file, samples the triangular meshes from below, locates the center of each triangle, and then projects the points onto the front and top views of the YZ and XY planes, respectively, in two dimensions. Ten clusters are formed from the points in each plane, and the feature descriptor for the three-dimensional object is derived from the cluster centers. The shape is indexed using this description. In order to extract the descriptor from CAD files, the system looks for objects in a designated directory. A feed-forward neural network is then used to classify the descriptor. We demonstrate that the proposed method outperforms the existing shape descriptor-based methods in terms of speed 139 ms, classification accuracy of 98.3%, and search time.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

References

  1. Prasad DK. Survey of the problem of object detection in real images. Int J Image Processing (IJIP). 2012;6(6):441–458.

    Google Scholar 

  2. Roberts LG. Machine Perception of Three-Dimensional Solids. Massachusetts Institute of Technology, Ph.D. Dissertation 1963.

  3. Jain AK, et al. 3D object recognition: representation and matching. Stat Comput. 2000;10:167–182.

    Article  Google Scholar 

  4. Tjan BS, Legge GE. The viewpoint complexity of an object-recognition task. Vis Res. 1998;38:2335–2350.

    Article  Google Scholar 

  5. Hoiem D et al. Representations and techniques for 3D object recognition and scene interpretation. In: Synthesis Lectures on Artificial Intelligence and Machine Learning, 2011. https://doi.org/10.1007/978-3-031-01557-1

  6. Alhamzi KM, et al. 3D object recognition based on image features: a survey. Int J Comput Inform Technol. 2014;03(03):651–60.

    Google Scholar 

  7. Buch AG, et al. Local shape feature fusion for improved matching, pose estimation and 3D object recognition. SpringerPlus 2016;5:297. https://doi.org/10.1186/s40064-016-1906-1

    Article  Google Scholar 

  8. Shah, et al. A novel feature representation for automatic 3D object recognition in cluttered scenes. Neurocomputing. 2016;205:1–15.

    Article  Google Scholar 

  9. Nahangi M, et al. Arbitrary 3D object extraction from cluttered laser scans using local features. In: 33rd International Symposium on Automation and Robotics in Construction, 2016.

  10. Buch et al. Local point pair feature histogram for accurate 3D matching. In: BMVC, 2018.

  11. More S, et al. Security assured CNN-based model for reconstruction of medical images on the internet of healthcare things. IEEE Access. 2020;8:126333–46. https://doi.org/10.1109/ACCESS.2020.3006346.

    Article  Google Scholar 

  12. Zeng, et al. Local Visual Feature Detection and Description for Non-rigid 3D Objects. IntJ Signal Process. 2016;1:114–9.

    Google Scholar 

  13. Rongrong Lu, et al. Three-dimensional object recognition using an extensible local surface descriptor. Opt Eng. 2017;56:1–13.

    Article  Google Scholar 

  14. Yang J, et al. TOLDI: an effective and robust approach for 3D local shape description. Pattern Recogn. 2017;65:175–87.

    Article  Google Scholar 

  15. Chen L-C et al. A novel surface descriptor for automated 3-D object recognition and localization. Sensors. 2019;19:1–22.

    Google Scholar 

  16. More S, Singla J. A generalized deep learning framework for automatic rheumatoid arthritis severity grading. 2021; pp. 7603–7614.

  17. Tsai C-Y, et al. Simultaneous 3D object recognition and pose estimation based on RGB-D images. IEEE Access. 2018;6:28859–69.

    Article  Google Scholar 

  18. Kehl W et al. Deep learning of local RGB-D patches for 3D object detection and 6D pose estimation. In: Computer Vision—ECCV, 2016; pp. 205–220.

  19. Furuya et al. Deep aggregation of local 3D geometric features for 3D model retrieval. In: British Machine Vision Conference, 2016; p. 1–11.

  20. Zeng et al. 3DMatch: learning local geometric descriptors from RGB-D Reconstructions. In: CVPR, 2017; p. 1802–1811.

  21. Savakar DG, Hosur R. A relative 3D scan and construction for face using meshing algorithm. Multimed Tools Appl. 2018;77:25253–73. https://doi.org/10.1007/s11042-018-5783-1.

    Article  Google Scholar 

  22. Sellamuthu S, Vaddadi SA, Venkata S, et al. AI-based recommendation model for effective decision to maximise ROI. Soft Comput. 2023. https://doi.org/10.1007/s00500-023-08731-7.

    Article  Google Scholar 

  23. Zia J. Temporal multiple moving objects recognition using shape-based descriptor matching, Thesis, Department of Electrical and Computer Engineering University of Manitoba,Winnipeg, Manitoba R3T 5V6, Canada, 2023. http://hdl.handle.net/1993/37447. Accessed 28 Jan 2024

  24. Sanklecha K, Mathur P, Narayanan PJ, Authors Info & Claims. Self-supervised 3D mesh object retrieval. In: ICVGIP '23: Proceedings of the Fourteenth Indian Conference on computer vision, graphics and image processing, pp 1–10 (2023)

  25. Sivri TT, Sahillioğlu Y. A data-centric unsupervised 3D mesh segmentation method. Vis Comput. 2024;40:2237–49. https://doi.org/10.1007/s00371-023-02913-y.

    Article  Google Scholar 

  26. More S, Singla J, Song OY, Tariq U, Malebary S. Denoising medical images using deep learning in IoT environment. Comput Mater Continua. 2021;69(3):3127–43. https://doi.org/10.32604/cmc.2021.018230.

    Article  Google Scholar 

  27. Deng H et al. PPFNet: global context aware local features for robust 3D point matching. In: CVPR, 2018; p. 195–205.

  28. Garstka J et al. Self-learning 3D object classification. In: Proceedings of the 7th International Conference on Pattern Recognition Applications and Methods (ICPRAM 2018), 2018; p. 511–519.

  29. Hassaballah M et al. Image features detection, description and matching. In: Image feature detectors and descriptors, 2016; p. 11–45.

  30. Czajewski W, et al. 3d object detection and recognition for robotic grasping based on RGB-D Images and global features. Found Comput Decis Sci. 2017;42:219–37.

    Article  Google Scholar 

  31. More S, Singla J, Abugabah A, AlZubi AA. Machine learning techniques for quantification of knee segmentation from MRI, Complexity, Hindawi, vol. 2020, p. 1–13.

  32. Fan Z et al. Object detection and sorting by using a global texture-shape 3D feature descriptor. In: Computer vision and pattern recognition, 2018; pp. 1–11.

  33. Aldoma A, et al. A global hypothesis verification framework for 3D object recognition in clutter. IEEE Trans Pattern Anal Mach Intell. 2016;38(7):1–14.

    Article  Google Scholar 

  34. More S, Singla J. Discrete-MultiResUNet: Segmentation and feature extraction model for knee MR images. J Intel Fuzzy Syst. 2021;41(2):3771–3781.

    Article  Google Scholar 

  35. Liu Z, et al. An effective 3D shape descriptor for object recognition with RGB-D sensors. Sensors. 2017;17(3):1–17.

    Article  Google Scholar 

  36. Zrira N, Hannat M, Bouyakhf EH, Ahmad Khan H. 2D/3D object recognition and categorization approaches for robotic grasping. Adv Soft Comput Mach Learn Image Process. 2018;567–593. https://doi.org/10.1007/978-3-319-63754-9_26

    Article  Google Scholar 

  37. Shen Z, et al. A hybrid 3D descriptor with global structural frames and local signatures of histograms. IEEE Access. 2018;6:39261–72.

    Article  Google Scholar 

  38. Li H, et al. Feature matching of multi-view 3d models based on hash binary encoding models based on hash binary encoding. Neural Netw World. 2017;27:95–105.

    Article  Google Scholar 

  39. Zhang Y, et al. 3D object retrieval with multi-feature collaboration and bipartite graph matching. Neurocomputing. 2016;195:40–9.

    Article  Google Scholar 

  40. More S, Singla J, Abugabah A, AlZubi AA. Machine learning techniques for quantification of knee segmentation from MRI. Complexity. 2020;2020:6613191.

    Article  Google Scholar 

  41. Li H, et al. Efficient 3D object retrieval based on compact views and hamming embedding. IEEE Access. 2018;6:31854–61.

    Article  Google Scholar 

  42. Zhu Z, et al. Deep learning representation using autoencoder for 3D shape retrieval. Neurocomputing. 2016;204:41–50.

    Article  Google Scholar 

  43. Yavartanoo M et al. SPNet: deep 3D object classification and retrieval using stereographic projection. In: Computer vision and pattern recognition, 2019.

  44. Yu T, et al. Multi-view harmonized bilinear network for 3D object recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018; p. 186–194.

  45. Guo H, et al. Multi-view 3D object retrieval with deep embedding network. IEEE Trans Image Process. 2016;25(12):5526–37.

    Article  MathSciNet  Google Scholar 

  46. Qi CR et al. Volumetric and multi-view CNNs for object classification on 3D data. In: CVPR, 2016, pp. 5648–5656.

  47. Arsalan Soltani AA et al. Synthesizing 3D shapes via modeling multi-view depth maps and silhouettes with deep generative networks. In: CVPR, 2017, pp. 1511–1519.

  48. Liu P, Shao Z, Xiao T. Second-order text on feature extraction and pattern recognition of building polygon cluster using CNN network. Int J Appl Earth Observ Geo Inform. 2024;129:103794. https://doi.org/10.1016/j.jag.2024.103794. (ISSN 1569-8432).

    Article  Google Scholar 

  49. Novotni M, Klein R. 3D Zernike descriptors for content based shape retrieval. In: Proceedings of the Eighth ACM Symposium on Solid modeling and applications. ACM, 2003.

  50. Bimbo AD, Pala P. Content-based retrieval of 3D models. ACM Transa Multimed Comput Commun Appl (TOMM). 2006;2(1):20–43.

    Article  Google Scholar 

  51. Vranic D, Saupe D. 3D shape descriptor based on 3D Fourier transform. In: EURASIP. 2001.

  52. Xiang Y, Kim W, Chen W, Ji J, Choy C, Su H, Mottaghi R, Guibas L, Savarese S. ObjectNet3D: A large scale database for 3D object recognition. In: European Conference on Computer Vision (ECCV), 2016.

  53. Zhang H, et al. Secondary development of CAD software for the construction of mechanical product design system. Comput Aided Des Appl. 2023;20(S3):178–189.

    Google Scholar 

  54. Zhang L, et al. CAD-aided 3D reconstruction of intelligent manufacturing image based on time series. In: Machine learning and scientific programing in multi-sensor data processing, 2022. https://doi.org/10.1155/2022/9022563.

  55. Wang C et al. Dominant Set clustering and pooling for Multi-View 3D Object Recognition. In: BMVC, 2017.

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Pavan Mahendrakar.

Ethics declarations

Conflict of Interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hosur, R., Mahendrakar, P., Hiremath, A. et al. Triangular Mesh and Neural Network for Object Search Based Cluster Centre Descriptor. SN COMPUT. SCI. 5, 1171 (2024). https://doi.org/10.1007/s42979-024-03433-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s42979-024-03433-9

Keywords

Navigation