Qi Liu
ABSTRACT
Design of point cloud shape descriptors is a challenging problem in practical applications due to the sparsity and the inscrutable distribution of the point clouds. In this paper, we propose ScatterNet, a novel 3D local feature learning approach for exploring and aggregating hypothetical scatters of the point clouds. Scatters of relational points are first organized in point cloud via guided explorations, and then propagated back to extend the capacity in representing the point-wise characteristics. We provide an practical implementation of the ScatterNet, which involves an unique scatter exploration operator and a scatter convolution operator. Our method achieves the state-of-the-art performance on several point cloud analysis tasks like classification, part segmentation and normal estimation. The source code of ScatterNet is available in supplementary materials.
Supplemental Material
- Nico Engel, Vasileios Belagiannis, and Klaus Dietmayer. 2021. Point Transformer. IEEE Access, Vol. 9, 134826--134840. https://doi.org/10.1109/ACCESS.2021.3116304Google Scholar
Cross Ref
- Hongyang Gao and Shuiwang Ji. 2019. Graph U-Nets. In International Conference on Machine Learning (ICML) (Proceedings of Machine Learning Research, Vol. 97), Kamalika Chaudhuri and Ruslan Salakhutdinov (Eds.). PMLR, 2083--2092.Google Scholar
- Meng-Hao Guo, Jun-Xiong Cai, Zheng-Ning Liu, Tai-Jiang Mu, Ralph R. Martin, and Shi-Min Hu. 2021. PCT: Point cloud transformer. Computational Visual Media, Vol. 7, 2, 187--199. https://doi.org/10.1007/s41095-021-0229-5Google ScholarCross Ref
- Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Deep Residual Learning for Image Recognition. In Computer Vision and Pattern Recognition (CVPR).Google Scholar
- Binh-Son Hua, Minh-Khoi Tran, and Sai-Kit Yeung. 2018. Pointwise Convolutional Neural Networks. In Computer Vision and Pattern Recognition (CVPR).Google Scholar
- Eric Jang, Shixiang Gu, and Ben Poole. 2016. Categorical reparameterization with gumbel-softmax. arXiv preprint arXiv:1611.01144.Google Scholar
- Mingyang Jiang, Yiran Wu, Tianqi Zhao, Zelin Zhao, and Cewu Lu. 2018. Pointsift: A sift-like network module for 3d point cloud semantic segmentation. arXiv preprint arXiv:1807.00652.Google Scholar
- Roman Klokov and Victor S. Lempitsky. 2017. Escape from Cells: Deep Kd-Networks for The Recognition of 3D Point Cloud Models. International Conference on Computer Vision (ICCV).Google Scholar
- Artem Komarichev, Zichun Zhong, and Jing Hua. 2019. A-CNN: Annularly Convolutional Neural Networks on Point Clouds. In Computer Vision and Pattern Recognition (CVPR).Google Scholar
- Huan Lei, Naveed Akhtar, and Ajmal Mian. 2019. Octree guided CNN with Spherical Kernels for 3D Point Clouds. Computer Vision and Pattern Recognition (CVPR).Google Scholar
- Jiaxin Li, Ben M Chen, and Gim Hee Lee. 2018b. SO-Net: Self-Organizing Network for Point Cloud Analysis. In Computer Vision and Pattern Recognition (CVPR).Google Scholar
- Yangyan Li, Rui Bu, Mingchao Sun, Wei Wu, Xinhan Di, and Baoquan Chen. 2018a. PointCNN: Convolution On χ-Transformed Points. In Neural Information Processing Systems (NeuIPS).Google Scholar
- Xinhai Liu, Zhizhong Han, Yu-Shen Liu, and Matthias Zwicker. 2019b. Point2sequence: Learning the shape representation of 3d point clouds with an attention-based sequence to sequence network. In AAAI Conference on Artificial Intelligence (AAAI), Vol. 33. 8778--8785.Google ScholarDigital Library
- Yongcheng Liu, Bin Fan, Shiming Xiang, and Chunhong Pan. 2019a. Relation-Shape Convolutional Neural Network for Point Cloud Analysis. In Computer Vision and Pattern Recognition (CVPR). 8895--8904.Google Scholar
- Xu Ma, Can Qin, Haoxuan You, Haoxi Ran, and Yun Fu. 2022. Rethinking Network Design and Local Geometry in Point Cloud: A Simple Residual MLP Framework. In International Conference on Learning Representations (ICLR).Google Scholar
- Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, et al. 2019. Pytorch: An imperative style, high-performance deep learning library. Neural Information Processing Systems (NeuIPS), Vol. 32.Google Scholar
- Charles R Qi, Hao Su, Kaichun Mo, and Leonidas J Guibas. 2016. PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation. Computer Vision and Pattern Recognition (CVPR).Google Scholar
- Charles R Qi, Li Yi, Hao Su, and Leonidas J Guibas. 2017. PointNet: Deep Hierarchical Feature Learning on Point Sets in a Metric Space. Neural Information Processing Systems (NeuIPS).Google Scholar
- Matthew Rahtz. 2008. The Humble Gumbel Distribution. http://amid.fish/humble-gumbel/.Google Scholar
- Yiru Shen, Chen Feng, Yaoqing Yang, and Dong Tian. 2018. Mining Point Cloud Local Structures by Kernel Correlation and Graph Pooling. In Computer Vision and Pattern Recognition (CVPR).Google Scholar
- Hang Su, Varun Jampani, Deqing Sun, Subhransu Maji, Evangelos Kalogerakis, Ming-Hsuan Yang, and Jan Kautz. 2018. SPLATNet: Sparse Lattice Networks for Point Cloud Processing. In Computer Vision and Pattern Recognition (CVPR). 2530--2539.Google Scholar
- Hugues Thomas, Charles R. Qi, Jean-Emmanuel Deschaud, Beatriz Marcotegui, Francc ois Goulette, and Leonidas J. Guibas. 2019. KPConv: Flexible and Deformable Convolution for Point Clouds. International Conference on Computer Vision (ICCV).Google Scholar
- Yue Wang, Yongbin Sun, Ziwei Liu, Sanjay E. Sarma, Michael M. Bronstein, and Justin M. Solomon. 2019. Dynamic Graph CNN for Learning on Point Clouds. ACM Transactions on Graphics (TOG).Google ScholarDigital Library
- Z. Wu, S. Song, A. Khosla, F. Yu, L. Zhang, X. Tang, and J. Xiao. 2015. 3D ShapeNets: A Deep Representation for Volumetric Shapes. In 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Google Scholar
- Tiange Xiang, Chaoyi Zhang, Yang Song, Jianhui Yu, and Weidong Cai. 2021. Walk in the Cloud: Learning Curves for Point Clouds Shape Analysis. In International Conference on Computer Vision (ICCV).Google Scholar
- Saining Xie, Sainan Liu, Zeyu Chen, and Zhuowen Tu. 2018. Attentional ShapeContextNet for Point Cloud Recognition. In Computer Vision and Pattern Recognition (CVPR).Google Scholar
- Mutian Xu, Runyu Ding, Hengshuang Zhao, and Xiaojuan Qi. 2021. PAConv: Position Adaptive Convolution with Dynamic Kernel Assembling on Point Clouds. In Computer Vision and Pattern Recognition (CVPR).Google Scholar
- Qiangeng Xu, Xudong Sun, Cho-Ying Wu, Panqu Wang, and Ulrich Neumann. 2020. Grid-gcn for fast and scalable point cloud learning. In Computer Vision and Pattern Recognition (CVPR). 5661--5670.Google Scholar
- Yifan Xu, Tianqi Fan, Mingye Xu, Long Zeng, and Yu Qiao. 2018. Spidercnn: Deep learning on point sets with parameterized convolutional filters. In European Conference on Computer Vision (ECCV). 87--102.Google ScholarCross Ref
- Xu Yan, Chaoda Zheng, Zhen Li, Sheng Wang, and Shuguang Cui. 2020. Pointasnl: Robust point clouds processing using nonlocal neural networks with adaptive sampling. In Computer Vision and Pattern Recognition (CVPR). 5589--5598.Google Scholar
- Jiancheng Yang, Qiang Zhang, Bingbing Ni, Linguo Li, Jinxian Liu, Mengdie Zhou, and Qi Tian. 2019. Modeling point clouds with self-attention and gumbel subset sampling. In Computer Vision and Pattern Recognition (CVPR). 3323--3332.Google Scholar
- Li Yi, Vladimir G Kim, Duygu Ceylan, I-Chao Shen, Mengyan Yan, Hao Su, Cewu Lu, Qixing Huang, Alla Sheffer, and Leonidas Guibas. 2016. A scalable active framework for region annotation in 3d shape collections. ACM Transactions on Graphics (ToG), Vol. 35, 6 (2016), 1--12.Google ScholarDigital Library
- Zhiyuan Zhang, Binh-Son Hua, and Sai-Kit Yeung. 2019. ShellNet: Efficient Point Cloud Convolutional Neural Networks using Concentric Shells Statistics. In International Conference on Computer Vision (ICCV).Google ScholarCross Ref
- Hengshuang Zhao, Li Jiang, Chi-Wing Fu, and Jiaya Jia. 2019. Pointweb: Enhancing local neighborhood features for point cloud processing. In Computer Vision and Pattern Recognition (CVPR). 5565--5573.Google Scholar
- Hengshuang Zhao, Li Jiang, Jiaya Jia, Philip Torr, and Vladlen Koltun. 2021. Point Transformer. International Conference on Computer Vision (ICCV).Google Scholar
Index Terms
- ScatterNet: Point Cloud Learning via Scatters
Recommendations
OpenPointCloud-V2: A Deep Learning Based Open-Source Algorithm Library of Point Cloud Processing
APCCPA '22: Proceedings of the 1st International Workshop on Advances in Point Cloud Compression, Processing and AnalysisPoint cloud processing is a very significant research field, as 3D point cloud plays a vital part in visual applications. Considering that there is no work to uniformly arrange the point cloud processing, we build a deep learning based open-source ...
Secure Constructing Bluetooth Scatternet Based on BTCP
IAS '09: Proceedings of the 2009 Fifth International Conference on Information Assurance and Security - Volume 02A Bluetooth ad hoc network can be formed by interconnecting piconets. The security of the process of Bluetooth scatternet formation is a major factor to guarantee the applications of Bluetooth network. Through the analysis of the characteristics of ...
CloudNavi: Toward Ubiquitous Indoor Navigation Service with 3D Point Clouds
The rapid development of mobile computing has prompted indoor navigation to be one of the most attractive and promising applications. Conventional designs of indoor navigation systems depend on either infrastructures or indoor floor maps. This article ...
Comments