Abstract
Since 3D models and printing have become more and more widespread, 3D object recognition has gained appeal. It might be challenging to locate the needed object in a large database of 3D objects of different kinds. Several methods have been put forth in the past to effectively identify and detect 3D objects based on their shape data. These techniques describe 3D objects in a high-dimensional feature plane either by using geometric shape features or by creating a 3D shape model from a 2D shape model. One of the disadvantages of 3D descriptors is that their high memory requirements make recognition speed a major difficulty. We provide a unique 3D object search method based on 3D object identification to get around the problem. The process reads the 3D vertices from a CAD file, samples the triangular meshes from below, locates the center of each triangle, and then projects the points onto the front and top views of the YZ and XY planes, respectively, in two dimensions. Ten clusters are formed from the points in each plane, and the feature descriptor for the three-dimensional object is derived from the cluster centers. The shape is indexed using this description. In order to extract the descriptor from CAD files, the system looks for objects in a designated directory. A feed-forward neural network is then used to classify the descriptor. We demonstrate that the proposed method outperforms the existing shape descriptor-based methods in terms of speed 139 ms, classification accuracy of 98.3%, and search time.















Similar content being viewed by others
References
Prasad DK. Survey of the problem of object detection in real images. Int J Image Processing (IJIP). 2012;6(6):441–458.
Roberts LG. Machine Perception of Three-Dimensional Solids. Massachusetts Institute of Technology, Ph.D. Dissertation 1963.
Jain AK, et al. 3D object recognition: representation and matching. Stat Comput. 2000;10:167–182.
Tjan BS, Legge GE. The viewpoint complexity of an object-recognition task. Vis Res. 1998;38:2335–2350.
Hoiem D et al. Representations and techniques for 3D object recognition and scene interpretation. In: Synthesis Lectures on Artificial Intelligence and Machine Learning, 2011. https://doi.org/10.1007/978-3-031-01557-1
Alhamzi KM, et al. 3D object recognition based on image features: a survey. Int J Comput Inform Technol. 2014;03(03):651–60.
Buch AG, et al. Local shape feature fusion for improved matching, pose estimation and 3D object recognition. SpringerPlus 2016;5:297. https://doi.org/10.1186/s40064-016-1906-1
Shah, et al. A novel feature representation for automatic 3D object recognition in cluttered scenes. Neurocomputing. 2016;205:1–15.
Nahangi M, et al. Arbitrary 3D object extraction from cluttered laser scans using local features. In: 33rd International Symposium on Automation and Robotics in Construction, 2016.
Buch et al. Local point pair feature histogram for accurate 3D matching. In: BMVC, 2018.
More S, et al. Security assured CNN-based model for reconstruction of medical images on the internet of healthcare things. IEEE Access. 2020;8:126333–46. https://doi.org/10.1109/ACCESS.2020.3006346.
Zeng, et al. Local Visual Feature Detection and Description for Non-rigid 3D Objects. IntJ Signal Process. 2016;1:114–9.
Rongrong Lu, et al. Three-dimensional object recognition using an extensible local surface descriptor. Opt Eng. 2017;56:1–13.
Yang J, et al. TOLDI: an effective and robust approach for 3D local shape description. Pattern Recogn. 2017;65:175–87.
Chen L-C et al. A novel surface descriptor for automated 3-D object recognition and localization. Sensors. 2019;19:1–22.
More S, Singla J. A generalized deep learning framework for automatic rheumatoid arthritis severity grading. 2021; pp. 7603–7614.
Tsai C-Y, et al. Simultaneous 3D object recognition and pose estimation based on RGB-D images. IEEE Access. 2018;6:28859–69.
Kehl W et al. Deep learning of local RGB-D patches for 3D object detection and 6D pose estimation. In: Computer Vision—ECCV, 2016; pp. 205–220.
Furuya et al. Deep aggregation of local 3D geometric features for 3D model retrieval. In: British Machine Vision Conference, 2016; p. 1–11.
Zeng et al. 3DMatch: learning local geometric descriptors from RGB-D Reconstructions. In: CVPR, 2017; p. 1802–1811.
Savakar DG, Hosur R. A relative 3D scan and construction for face using meshing algorithm. Multimed Tools Appl. 2018;77:25253–73. https://doi.org/10.1007/s11042-018-5783-1.
Sellamuthu S, Vaddadi SA, Venkata S, et al. AI-based recommendation model for effective decision to maximise ROI. Soft Comput. 2023. https://doi.org/10.1007/s00500-023-08731-7.
Zia J. Temporal multiple moving objects recognition using shape-based descriptor matching, Thesis, Department of Electrical and Computer Engineering University of Manitoba,Winnipeg, Manitoba R3T 5V6, Canada, 2023. http://hdl.handle.net/1993/37447. Accessed 28 Jan 2024
Sanklecha K, Mathur P, Narayanan PJ, Authors Info & Claims. Self-supervised 3D mesh object retrieval. In: ICVGIP '23: Proceedings of the Fourteenth Indian Conference on computer vision, graphics and image processing, pp 1–10 (2023)
Sivri TT, Sahillioğlu Y. A data-centric unsupervised 3D mesh segmentation method. Vis Comput. 2024;40:2237–49. https://doi.org/10.1007/s00371-023-02913-y.
More S, Singla J, Song OY, Tariq U, Malebary S. Denoising medical images using deep learning in IoT environment. Comput Mater Continua. 2021;69(3):3127–43. https://doi.org/10.32604/cmc.2021.018230.
Deng H et al. PPFNet: global context aware local features for robust 3D point matching. In: CVPR, 2018; p. 195–205.
Garstka J et al. Self-learning 3D object classification. In: Proceedings of the 7th International Conference on Pattern Recognition Applications and Methods (ICPRAM 2018), 2018; p. 511–519.
Hassaballah M et al. Image features detection, description and matching. In: Image feature detectors and descriptors, 2016; p. 11–45.
Czajewski W, et al. 3d object detection and recognition for robotic grasping based on RGB-D Images and global features. Found Comput Decis Sci. 2017;42:219–37.
More S, Singla J, Abugabah A, AlZubi AA. Machine learning techniques for quantification of knee segmentation from MRI, Complexity, Hindawi, vol. 2020, p. 1–13.
Fan Z et al. Object detection and sorting by using a global texture-shape 3D feature descriptor. In: Computer vision and pattern recognition, 2018; pp. 1–11.
Aldoma A, et al. A global hypothesis verification framework for 3D object recognition in clutter. IEEE Trans Pattern Anal Mach Intell. 2016;38(7):1–14.
More S, Singla J. Discrete-MultiResUNet: Segmentation and feature extraction model for knee MR images. J Intel Fuzzy Syst. 2021;41(2):3771–3781.
Liu Z, et al. An effective 3D shape descriptor for object recognition with RGB-D sensors. Sensors. 2017;17(3):1–17.
Zrira N, Hannat M, Bouyakhf EH, Ahmad Khan H. 2D/3D object recognition and categorization approaches for robotic grasping. Adv Soft Comput Mach Learn Image Process. 2018;567–593. https://doi.org/10.1007/978-3-319-63754-9_26
Shen Z, et al. A hybrid 3D descriptor with global structural frames and local signatures of histograms. IEEE Access. 2018;6:39261–72.
Li H, et al. Feature matching of multi-view 3d models based on hash binary encoding models based on hash binary encoding. Neural Netw World. 2017;27:95–105.
Zhang Y, et al. 3D object retrieval with multi-feature collaboration and bipartite graph matching. Neurocomputing. 2016;195:40–9.
More S, Singla J, Abugabah A, AlZubi AA. Machine learning techniques for quantification of knee segmentation from MRI. Complexity. 2020;2020:6613191.
Li H, et al. Efficient 3D object retrieval based on compact views and hamming embedding. IEEE Access. 2018;6:31854–61.
Zhu Z, et al. Deep learning representation using autoencoder for 3D shape retrieval. Neurocomputing. 2016;204:41–50.
Yavartanoo M et al. SPNet: deep 3D object classification and retrieval using stereographic projection. In: Computer vision and pattern recognition, 2019.
Yu T, et al. Multi-view harmonized bilinear network for 3D object recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018; p. 186–194.
Guo H, et al. Multi-view 3D object retrieval with deep embedding network. IEEE Trans Image Process. 2016;25(12):5526–37.
Qi CR et al. Volumetric and multi-view CNNs for object classification on 3D data. In: CVPR, 2016, pp. 5648–5656.
Arsalan Soltani AA et al. Synthesizing 3D shapes via modeling multi-view depth maps and silhouettes with deep generative networks. In: CVPR, 2017, pp. 1511–1519.
Liu P, Shao Z, Xiao T. Second-order text on feature extraction and pattern recognition of building polygon cluster using CNN network. Int J Appl Earth Observ Geo Inform. 2024;129:103794. https://doi.org/10.1016/j.jag.2024.103794. (ISSN 1569-8432).
Novotni M, Klein R. 3D Zernike descriptors for content based shape retrieval. In: Proceedings of the Eighth ACM Symposium on Solid modeling and applications. ACM, 2003.
Bimbo AD, Pala P. Content-based retrieval of 3D models. ACM Transa Multimed Comput Commun Appl (TOMM). 2006;2(1):20–43.
Vranic D, Saupe D. 3D shape descriptor based on 3D Fourier transform. In: EURASIP. 2001.
Xiang Y, Kim W, Chen W, Ji J, Choy C, Su H, Mottaghi R, Guibas L, Savarese S. ObjectNet3D: A large scale database for 3D object recognition. In: European Conference on Computer Vision (ECCV), 2016.
Zhang H, et al. Secondary development of CAD software for the construction of mechanical product design system. Comput Aided Des Appl. 2023;20(S3):178–189.
Zhang L, et al. CAD-aided 3D reconstruction of intelligent manufacturing image based on time series. In: Machine learning and scientific programing in multi-sensor data processing, 2022. https://doi.org/10.1155/2022/9022563.
Wang C et al. Dominant Set clustering and pooling for Multi-View 3D Object Recognition. In: BMVC, 2017.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
The authors declare that they have no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Hosur, R., Mahendrakar, P., Hiremath, A. et al. Triangular Mesh and Neural Network for Object Search Based Cluster Centre Descriptor. SN COMPUT. SCI. 5, 1171 (2024). https://doi.org/10.1007/s42979-024-03433-9
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s42979-024-03433-9