Tingting Li
ABSTRACT
The applications of 3D mesh, such as computer vision, molecular biology, and medical imaging, have received sufficient attention recently. Polygonal meshes are a significant raw representation of 3D shapes thanks to their compactness and flexibility. Though extensive research efforts are concentrating on how to represent 3D shapes well based on voxels and point clouds, there is little effort on meshes due to their irregularity. To tackle the challenge, we propose a new mesh representation called Heat Diffusion Mesh (HDM) in this paper. It represents meshes that are in non-Euclidean domains as a space-time signal by heat diffusion. Experiments of mesh classification and segmentation show the effectiveness of the proposed mesh representation.
- Abhishek Badki, Orazio Gallo, Jan Kautz, and Pradeep Sen. 2020. Meshlet Priors for 3D Mesh Reconstruction. In 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2020, Seattle, WA, USA, June 13-19, 2020. IEEE, 2846–2855. https://doi.org/10.1109/CVPR42600.2020.00292Google Scholar
Cross Ref
- Alexander M. Bronstein, Michael M. Bronstein, Leonidas J. Guibas, and Maks Ovsjanikov. 2011. Shape google: Geometric words and expressions for invariant shape retrieval. ACM Trans. Graph. 30, 1 (2011), 1:1–1:20. https://doi.org/10.1145/1899404.1899405Google ScholarDigital Library
- Danielle Ezuz, Justin Solomon, Vladimir G. Kim, and Mirela Ben-Chen. 2017. GWCNN: A Metric Alignment Layer for Deep Shape Analysis. Comput. Graph. Forum 36, 5 (2017), 49–57. https://doi.org/10.1111/cgf.13244Google ScholarDigital Library
- Yi Fang, Jin Xie, Guoxian Dai, Meng Wang, Fan Zhu, Tiantian Xu, and Edward K. Wong. 2015. 3D deep shape descriptor. In IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015, Boston, MA, USA, June 7-12, 2015. IEEE Computer Society, 2319–2328. https://doi.org/10.1109/CVPR.2015.7298845Google ScholarCross Ref
- Yutong Feng, Yifan Feng, Haoxuan You, Xibin Zhao, and Yue Gao. 2019. MeshNet: Mesh Neural Network for 3D Shape Representation. In The Thirty-Third AAAI Conference on Artificial Intelligence, AAAI 2019, The Thirty-First Innovative Applications of Artificial Intelligence Conference, IAAI 2019, The Ninth AAAI Symposium on Educational Advances in Artificial Intelligence, EAAI 2019, Honolulu, Hawaii, USA, January 27 - February 1, 2019. AAAI Press, 8279–8286. https://doi.org/10.1609/aaai.v33i01.33018279Google ScholarDigital Library
- Niv Haim, Nimrod Segol, Heli Ben-Hamu, Haggai Maron, and Yaron Lipman. 2019. Surface Networks via General Covers. In 2019 IEEE/CVF International Conference on Computer Vision, ICCV 2019, Seoul, Korea (South), October 27 - November 2, 2019. IEEE, 632–641. https://doi.org/10.1109/ICCV.2019.00072Google ScholarCross Ref
- Rana Hanocka, Amir Hertz, Noa Fish, Raja Giryes, Shachar Fleishman, and Daniel Cohen-Or. 2019. MeshCNN: a network with an edge. ACM Trans. Graph. 38, 4 (2019), 90:1–90:12. https://doi.org/10.1145/3306346.3322959Google ScholarDigital Library
- Ran Ben Izhak, Alon Lahav, and Ayellet Tal. 2022. AttWalk: Attentive Cross-Walks for Deep Mesh Analysis. In 2022 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV). 2937–2946. https://doi.org/10.1109/WACV51458.2022.00299Google ScholarCross Ref
- Yangyan Li, Rui Bu, Mingchao Sun, and Baoquan Chen. 2018. PointCNN. CoRR abs/1801.07791(2018). arXiv:1801.07791http://arxiv.org/abs/1801.07791Google Scholar
- Zhouhui Lian, Afzal Godil, Benjamin Bustos, Mohamed Daoudi, Jeroen Hermans, Shun Kawamura, Yukinori Kurita, Guillaume Lavoué, Hien Van Nguyen, Ryutarou Ohbuchi, Yuki Ohkita, Yuya Ohishi, Fatih Porikli, Martin Reuter, Ivan Sipiran, Dirk Smeets, Paul Suetens, Hedi Tabia, and Dirk Vandermeulen. 2011. SHREC ’11 Track: Shape Retrieval on Non-rigid 3D Watertight Meshes. In 4th Eurographics Workshop on 3D Object Retrieval, 3DOR@Eurographics 2011, Llandudno, UK, April 10, 2011, Hamid Laga, Tobias Schreck, Alfredo Ferreira, Afzal Godil, Ioannis Pratikakis, and Remco C. Veltkamp (Eds.). Eurographics Association, 79–88. https://doi.org/10.2312/3DOR/3DOR11/079-088Google ScholarCross Ref
- Haggai Maron, Meirav Galun, Noam Aigerman, Miri Trope, Nadav Dym, Ersin Yumer, Vladimir G. Kim, and Yaron Lipman. 2017. Convolutional neural networks on surfaces via seamless toric covers. ACM Trans. Graph. 36, 4 (2017), 71:1–71:10. https://doi.org/10.1145/3072959.3073616Google ScholarDigital Library
- Jonathan Masci, Davide Boscaini, Michael M. Bronstein, and Pierre Vandergheynst. 2015. Geodesic Convolutional Neural Networks on Riemannian Manifolds. In 2015 IEEE International Conference on Computer Vision Workshop, ICCV Workshops 2015, Santiago, Chile, December 7-13, 2015. IEEE Computer Society, 832–840. https://doi.org/10.1109/ICCVW.2015.112Google ScholarDigital Library
- Thomas W. Mitchel, Vladimir G. Kim, and Michael Kazhdan. 2021. Field Convolutions for Surface CNNs. In 2021 IEEE/CVF International Conference on Computer Vision (ICCV). 9981–9991. https://doi.org/10.1109/ICCV48922.2021.00985Google ScholarCross Ref
- Adrien Poulenard and Maks Ovsjanikov. 2018. Multi-directional geodesic neural networks via equivariant convolution. ACM Trans. Graph. 37, 6 (2018), 236:1–236:14. https://doi.org/10.1145/3272127.3275102Google ScholarDigital Library
- Charles Ruizhongtai Qi, Hao Su, Kaichun Mo, and Leonidas J. Guibas. 2017. PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation. In 2017 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017, Honolulu, HI, USA, July 21-26, 2017. IEEE Computer Society, 77–85. https://doi.org/10.1109/CVPR.2017.16Google ScholarCross Ref
- Charles Ruizhongtai Qi, Li Yi, Hao Su, and Leonidas J. Guibas. 2017. PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space. In Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, December 4-9, 2017, Long Beach, CA, USA, Isabelle Guyon, Ulrike von Luxburg, Samy Bengio, Hanna M. Wallach, Rob Fergus, S. V. N. Vishwanathan, and Roman Garnett (Eds.). 5099–5108. http://papers.nips.cc/paper/7095-pointnet-deep-hierarchical-feature-learning-on-point-sets-in-a-metric-spaceGoogle Scholar
- Haozhe Qi, Chen Feng, Zhiguo Cao, Feng Zhao, and Yang Xiao. 2020. P2B: Point-to-Box Network for 3D Object Tracking in Point Clouds. In 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2020, Seattle, WA, USA, June 13-19, 2020. IEEE, 6328–6337. https://doi.org/10.1109/CVPR42600.2020.00636Google ScholarCross Ref
- Gernot Riegler, Ali Osman Ulusoy, and Andreas Geiger. 2017. OctNet: Learning Deep 3D Representations at High Resolutions. In 2017 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017, Honolulu, HI, USA, July 21-26, 2017. IEEE Computer Society, 6620–6629. https://doi.org/10.1109/CVPR.2017.701Google ScholarCross Ref
- Weichao Shen, Yunde Jia, and Yuwei Wu. 2019. 3D Shape Reconstruction From Images in the Frequency Domain. In IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2019, Long Beach, CA, USA, June 16-20, 2019. Computer Vision Foundation / IEEE, 4471–4479. https://doi.org/10.1109/CVPR.2019.00460Google ScholarCross Ref
- Ayan Sinha, Jing Bai, and Karthik Ramani. 2016. Deep Learning 3D Shape Surfaces Using Geometry Images. In Computer Vision - ECCV 2016 - 14th European Conference, Amsterdam, The Netherlands, October 11-14, 2016, Proceedings, Part VI(Lecture Notes in Computer Science, Vol. 9910), Bastian Leibe, Jiri Matas, Nicu Sebe, and Max Welling (Eds.). Springer, 223–240. https://doi.org/10.1007/978-3-319-46466-4_14Google ScholarCross Ref
- Yunhai Wang, Shmulik Asafi, Oliver van Kaick, Hao Zhang, Daniel Cohen-Or, and Baoquan Chen. 2012. Active co-analysis of a set of shapes. ACM Trans. Graph. 31, 6 (2012), 165:1–165:10. https://doi.org/10.1145/2366145.2366184Google ScholarDigital Library
- Yue Wang, Yongbin Sun, Ziwei Liu, Sanjay E. Sarma, Michael M. Bronstein, and Justin M. Solomon. 2019. Dynamic Graph CNN for Learning on Point Clouds. ACM Trans. Graph. 38, 5 (2019), 146:1–146:12. https://doi.org/10.1145/3326362Google ScholarDigital Library
- Ruben Wiersma, Elmar Eisemann, and Klaus Hildebrandt. 2020. CNNs on surfaces using rotation-equivariant features. ACM Trans. Graph. 39, 4 (2020), 92. https://doi.org/10.1145/3386569.3392437Google ScholarDigital Library
- Zhirong Wu, Shuran Song, Aditya Khosla, Fisher Yu, Linguang Zhang, Xiaoou Tang, and Jianxiong Xiao. 2015. 3D ShapeNets: A deep representation for volumetric shapes. In IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015, Boston, MA, USA, June 7-12, 2015. IEEE Computer Society, 1912–1920. https://doi.org/10.1109/CVPR.2015.7298801Google ScholarCross Ref
- Jin Xie, Guoxian Dai, Fan Zhu, and Yi Fang. 2017. Learning Barycentric Representations of 3D Shapes for Sketch-Based 3D Shape Retrieval. In 2017 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017, Honolulu, HI, USA, July 21-26, 2017. IEEE Computer Society, 3615–3623. https://doi.org/10.1109/CVPR.2017.385Google ScholarCross Ref
- Ruixuan Yu, Jian Sun, and Huibin Li. 2020. Second-Order Spectral Transform Block for 3D Shape Classification and Retrieval. IEEE Trans. Image Process. 29 (2020), 4530–4543. https://doi.org/10.1109/TIP.2020.2967579Google ScholarCross Ref
Index Terms
- HDM: Heat Diffusion Mesh for Mesh Representation
Recommendations
Mesh simplification algorithm based on n-edge mesh collapse
ICAT'06: Proceedings of the 16th international conference on Advances in Artificial Reality and Tele-ExistenceThis paper presents a method for dividing the triangle mesh into n-edge mesh and puts forward a new mesh simplification algorithm based on n-edge mesh collapse. An n-edge mesh can be in the form of an edge, a triangle or a quadrangle, it depends on the ...
Quadrilateral mesh simplification
We introduce a simplification algorithm for meshes composed of quadrilateral elements. It is reminiscent of edge-collapse based methods for triangle meshes, but takes a novel approach to the challenging problem of maintaining the quadrilateral ...
Skeleton extraction by mesh contraction
Extraction of curve-skeletons is a fundamental problem with many applications in computer graphics and visualization. In this paper, we present a simple and robust skeleton extraction method based on mesh contraction. The method works directly on the ...
Comments