Abstract
Point cloud analysis has gained significant importance across various fields, in which a pivotal and formidable aspect is the classification of point clouds. To solve this problem, most existing deep learning methods follow the two-stage framework, wherein an encoder first extracts shape features and then an MLP-based classification head categorizes objects. To improve the classification performance, prior efforts have concentrated on refining the shape feature extraction through intricate encoder designs. However, the design of classification heads has remained unexplored. In this paper, we focus on the second stage and introduce a novel classification head integrated with a Learnable Memory Bank (LMB), tailored for the classification of 3D point-cloud objects. The LMB aims to learn representative category feature vectors from training objects. Subsequently, a similarity-based feature-matching mechanism is employed to generate the predicted class logits. The proposed LMB classification head can be seamlessly integrated into existing feature extraction backbones. Empirical evaluations prove the efficacy of the proposed LMB classification head, showcasing performance on par with state-of-the-art methods.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Ben-Shabat, Y., Lindenbaum, M., Fischer, A.: 3DmFV: three-dimensional point cloud classification in real-time using convolutional neural networks. IEEE Robot. Autom. Lett. 3(4), 3145–3152 (2018)
Cheng, S., Chen, X., He, X., Liu, Z., Bai, X.: PRA-Net: point relation-aware network for 3D point cloud analysis. IEEE Trans. Image Process. 30, 4436–4448 (2021)
Goyal, A., Law, H., Liu, B., Newell, A., Deng, J.: Revisiting point cloud shape classification with a simple and effective baseline. In: International Conference on Machine Learning, pp. 3809–3820 (2021)
Guo, M.H., Cai, J.X., Liu, Z.N., Mu, T.J., Martin, R.R., Hu, S.M.: PCT: point cloud transformer. Comput. Visual Media 7, 187–199 (2021)
Hamdi, A., Giancola, S., Ghanem, B.: MVTN: multi-view transformation network for 3D shape recognition. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2021)
Li, R., Li, X., Heng, P.A., Fu, C.W.: PointAugment: an auto-augmentation framework for point cloud classification. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2020)
Li, Y., Bu, R., Sun, M., Wu, W., Di, X., Chen, B.: PointCNN: convolution on X-transformed points. In: Advances in Neural Information Processing Systems (2018)
Li, Y., Pirk, S., Su, H., Qi, C.R., Guibas, L.J.: FPNN: field probing neural networks for 3D data. In: International Conference on Neural Information Processing Systems (2016)
Li, Y., et al.: Deep learning for lidar point clouds in autonomous driving: a review. IEEE Trans. Neural Networks Learn. Syst. 32(8), 3412–3432 (2021)
Lin, C.H., Chen, J.Y., Su, P.L., Chen, C.H.: Eigen-feature analysis of weighted covariance matrices for lidar point cloud classification. ISPRS J. Photogramm. Remote. Sens. 94, 70–79 (2014)
Liu, Y., Fan, B., Meng, G., Lu, J., Xiang, S., Pan, C.: DensePoint: learning densely contextual representation for efficient point cloud processing. In: IEEE International Conference on Computer Vision (ICCV) (2019)
Liu, Y., Fan, B., Xiang, S., Pan, C.: Relation-shape convolutional neural network for point cloud analysis. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 8895–8904 (2019)
Lu, Q., Chen, C., Xie, W., Luo, Y.: PointngCNN: deep convolutional networks on 3D point clouds with neighborhood graph filters. Comput. Graph. 86, 42–51 (2020)
Ma, X., Qin, C., You, H., Ran, H., Fu, Y.: Rethinking network design and local geometry in point cloud: a simple residual MLP framework. In: International Conference on Learning Representations (ICLR) (2022)
Najafi, M., Taghavi Namin, S., Salzmann, M., Petersson, L.: Non-associative higher-order Markov networks for point cloud classification. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8693, pp. 500–515. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-10602-1_33
Qi, C.R., Su, H., Mo, K., Guibas, L.J.: PointNet: deep learning on point sets for 3D classification and segmentation. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2017)
Qi, C.R., Yi, L., Su, H., Guibas, L.J.: PointNet++: deep hierarchical feature learning on point sets in a metric space. In: Advances in Neural Information Processing Systems (2017)
Qian, G., et al.: PointNext: revisiting PointNet++ with improved training and scaling strategies. In: Advances in Neural Information Processing Systems (2022)
Qiu, S., Anwar, S., Barnes, N.: Dense-resolution network for point cloud classification and segmentation. In: Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (2021)
Qiu, S., Anwar, S., Barnes, N.: Geometric back-projection network for point cloud classification. IEEE Trans. Multimedia 24, 1943–1955 (2022)
Rusu, R.B., Marton, Z.C., Blodow, N., Dolha, M., Beetz, M.: Towards 3D point cloud based object maps for household environments. Robot. Auton. Syst. 56(11), 927–941 (2008)
Shi, W., Rajkumar, R.: Point-GNN: graph neural network for 3D object detection in a point cloud. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1711–1719 (2020)
Uy, M.A., Pham, Q.H., Hua, B.S., Nguyen, T., Yeung, S.K.: Revisiting point cloud classification: a new benchmark dataset and classification model on real-world data. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2019)
Wang, Y., Sun, Y., Liu, Z., Sarma, S.E., Bronstein, M.M., Solomon, J.M.: Dynamic graph CNN for learning on point clouds. ACM Trans. Graph. (TOG) 38, 1–12 (2019)
Wirth, F., Quehl, J., Ota, J., Stiller, C.: PointAtMe: efficient 3D point cloud labeling in virtual reality. In: IEEE Intelligent Vehicles Symposium (IV), pp. 1693–1698. IEEE (2019)
Wu, W., Qi, Z., Fuxin, L.: PointConv: deep convolutional networks on 3D point clouds. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2019)
Wu, Z., et al.: 3D ShapeNets: a deep representation for volumetric shapes. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2015)
Xiang, T., Zhang, C., Song, Y., Yu, J., Cai, W.: Walk in the Cloud: learning curves for point clouds shape analysis. In: IEEE International Conference on Computer Vision (ICCV) (2021)
Xu, M., Ding, R., Zhao, H., Qi, X.: PAConv: position adaptive convolution with dynamic kernel assembling on point clouds. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2021)
Xu, M., Zhang, J., Zhou, Z., Xu, M., Qi, X., Qiao, Y.: Learning geometry-disentangled representation for complementary understanding of 3D object point cloud. In: AAAI Conference on Artificial Intelligence (2021)
Xu, Y., Fan, T., Xu, M., Zeng, L., Qiao, Yu.: SpiderCNN: deep learning on point sets with parameterized convolutional filters. In: Ferrari, V., Hebert, M., Sminchisescu, C., Weiss, Y. (eds.) ECCV 2018. LNCS, vol. 11212, pp. 90–105. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-01237-3_6
Yan, X., Zheng, C., Li, Z., Wang, S., Cui, S.: PointASNL: robust point clouds processing using nonlocal neural networks with adaptive sampling. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2020)
Zeng, Y., et al.: RT3D: real-time 3-D vehicle detection in LiDAR point cloud for autonomous driving. IEEE Robot. Autom. Lett. 3(4), 3434–3440 (2018)
Zhang, R., Wang, L., Wang, Y., Gao, P., Li, H., Shi, J.: Parameter is not all you need: starting from non-parametric networks for 3D point cloud analysis. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2023)
Zhang, Z., Zhang, L., Tan, Y., Zhang, L., Liu, F., Zhong, R.: Joint discriminative dictionary and classifier learning for ALS point cloud classification. IEEE Trans. Geosci. Remote Sens. 56(1), 524–538 (2018)
Zhang, Z., et al.: A multilevel point-cluster-based discriminative feature for ALS point cloud classification. IEEE Trans. Geosci. Remote Sens. 54(6), 3309–3321 (2016)
Zhao, H., Jiang, L., Jia, J., Torr, P.H., Koltun, V.: Point transformer. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2021)
Zhou, Y., Tuzel, O.: VoxelNet: end-to-end learning for point cloud based 3D object detection. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 4490–4499 (2018)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Liu, L., Wang, W.Y., Cai, P. (2024). Point Cloud Classification via Learnable Memory Bank. In: Rudinac, S., et al. MultiMedia Modeling. MMM 2024. Lecture Notes in Computer Science, vol 14554. Springer, Cham. https://doi.org/10.1007/978-3-031-53305-1_17
Download citation
DOI: https://doi.org/10.1007/978-3-031-53305-1_17
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-53304-4
Online ISBN: 978-3-031-53305-1
eBook Packages: Computer ScienceComputer Science (R0)