Xi Wang
ABSTRACT
With the advances in cardiovascular imaging technologies in recent years, 4D (3D+time) patient-specific modeling of the heart has attracted many research interests. Computational modeling approaches such as Computational Fluid Dynamics (CFD) and Finite Element (FE) have been increasingly used to quantitatively diagnose and predict cardiovascular diseases. In these methods, the geometrical reconstruction of the heart anatomy is usually an indispensable step. This work presents a robust method for reconstructing time-varying subdivision surfaces from the segmentation masks of cardiac images. We first reconstruct a 3D mesh for the first time step by iteratively fitting an initial mesh based on error and tension terms. Each subsequent time step uses the model from its previous time step as the control mesh for subdivision surface fitting. This method preserves the 1-to-1 vertex correspondence between meshes in different time steps and allows us to control the mesh quality (i.e. resolution, smoothness, and accuracy). Furthermore, in contrast to contour-based algorithms, our method can handle non-trivial topological changes such as holes and tunnels. The method has been tested on 3D and 4D datasets of different modalities (i.e. CT and MRI), resolutions, and chambers. For creating visually appealing results, we show that synthetic textures can be mapped to the 4D reconstruction due to the vertex correspondence. We also quantitatively evaluate the reconstructed 3D meshes in terms of mesh quality and conformity to the data.
- Troy Alderson, Ali Mahdavi-Amiri, and Faramarz Samavati. 2016. Multiresolution on spherical curves. Graphical Models 86(2016), 13 – 24. https://doi.org/10.1016/j.gmod.2016.05.002Google Scholar
Digital Library
- Kathleen D. Ang, Faramarz F. Samavati, Samin Sabokrohiyeh, Julio Garcia, and Mohammed S. Elbaz. 2019. Physicalizing cardiac blood flow data via 3D printing. Computers & Graphics 85(2019), 42–54. https://doi.org/10.1016/j.cag.2019.09.004Google ScholarDigital Library
- Franz Aurenhammer, Rolf Klein, and Der-Tsai Lee. 2013. Voronoi Diagrams and Delaunay Triangulations (1st ed.). World Scientific Publishing Co., Inc., USA.Google Scholar
- F. Bernardini, J. Mittleman, H. Rushmeier, C. Silva, and G. Taubin. 1999. The ball-pivoting algorithm for surface reconstruction. IEEE Transactions on Visualization and Computer Graphics 5, 4(1999), 349–359. https://doi.org/10.1109/2945.817351Google ScholarDigital Library
- Federico Canè, Benedict Verhegghe, Matthieu Beule, Philippe Bertrand, Rob van der Geest, Patrick Segers, and Gianluca De Santis. 2018. From 4D Medical Images (CT, MRI, and Ultrasound) to 4D Structured Mesh Models of the Left Ventricular Endocardium for Patient-Specific Simulations. BioMed Research International 2018 (01 2018), 1–14. https://doi.org/10.1155/2018/7030718Google Scholar
- J. C. Carr, R. K. Beatson, J. B. Cherrie, T. J. Mitchell, W. R. Fright, B. C. McCallum, and T. R. Evans. 2001. Reconstruction and Representation of 3D Objects with Radial Basis Functions. In Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques(SIGGRAPH ’01). Association for Computing Machinery, New York, NY, USA, 67–76. https://doi.org/10.1145/383259.383266Google ScholarDigital Library
- Chen Chen, Chen Qin, Huaqi Qiu, Giacomo Tarroni, Jinming Duan, Wenjia Bai, and Daniel Rueckert. 2020. Deep Learning for Cardiac Image Segmentation: A Review. Frontiers in Cardiovascular Medicine 7 (2020), 25. https://doi.org/10.3389/fcvm.2020.00025Google ScholarCross Ref
- Tony DeRose, Michael Kass, and Tien Truong. 1998. Subdivision Surfaces in Character Animation. In Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques(SIGGRAPH ’98). Association for Computing Machinery, New York, NY, USA, 85–94. https://doi.org/10.1145/280814.280826Google ScholarDigital Library
- Mathieu Desbrun, Mark Meyer, Peter Schröder, and Alan H. Barr. 1999. Implicit Fairing of Irregular Meshes Using Diffusion and Curvature Flow. In Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques(SIGGRAPH ’99). ACM Press/Addison-Wesley Publishing Co., USA, 317–324. https://doi.org/10.1145/311535.311576Google ScholarDigital Library
- Alejandro Frangi, W.J. Niessen, and Max Viergever. 2001. Three-dimensional modeling for functional analysis of cardiac images: A review. IEEE transactions on medical imaging 20 (02 2001), 2–25. https://doi.org/10.1109/42.906421Google ScholarCross Ref
- Mingchen Gao, Junzhou Huang, Shaoting Zhang, Zhen Qian, Szilard Voros, Dimitris Metaxas, and Leon Axel. 2011. 4D Cardiac Reconstruction Using High Resolution CT Images. In Functional Imaging and Modeling of the Heart, Dimitris N. Metaxas and Leon Axel (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 153–160.Google Scholar
- Michael Garland and Paul S. Heckbert. 1997. Surface Simplification Using Quadric Error Metrics. In Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques(SIGGRAPH ’97). ACM Press/Addison-Wesley Publishing Co., USA, 209–216. https://doi.org/10.1145/258734.258849Google ScholarDigital Library
- Richard Gray and Pras Pathmanathan. 2018. Patient-Specific Cardiovascular Computational Modeling: Diversity of Personalization and Challenges. Journal of cardiovascular translational research 11 (04 2018), 80–88. https://doi.org/10.1007/s12265-018-9792-2Google Scholar
- Hugues Hoppe. 1996. Progressive Meshes. In Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques(SIGGRAPH ’96). Association for Computing Machinery, New York, NY, USA, 99–108. https://doi.org/10.1145/237170.237216Google ScholarDigital Library
- A. Khatamian and Hamid Arabnia. 2016. Survey on 3D Surface Reconstruction. Journal of Information Processing Systems 12 (01 2016), 338–357. https://doi.org/10.3745/JIPS.01.0010Google Scholar
- Gaoyang Li, Haoran Wang, Mingzi Zhang, Simon Tupin, Aike Qiao, Youjun Liu, Makoto Ohta, and Hitomi Anzai. 2021. Prediction of 3D Cardiovascular hemodynamics before and after coronary artery bypass surgery via deep learning. Communications Biology 4 (01 2021). https://doi.org/10.1038/s42003-020-01638-1Google Scholar
- Chi Lim, Yi Su, Si Yeo, Gillian Ng, Vinh-Tan Nguyen, Liang Zhong, Ru San Tan, Kian Keong Poh, and Ping Chai. 2014. Automatic 4D Reconstruction of Patient-Specific Cardiac Mesh with 1-to-1 Vertex Correspondence from Segmented Contours Lines. PloS one 9 (04 2014), e93747. https://doi.org/10.1371/journal.pone.0093747Google Scholar
- Charles T. Loop. 1987. Smooth Subdivision Surfaces Based on Triangles. Master’s thesis. Department of Mathematics, University of Utah.Google Scholar
- William E. Lorensen and Harvey E. Cline. 1987. Marching Cubes: A High Resolution 3D Surface Construction Algorithm. SIGGRAPH Comput. Graph. 21, 4 (Aug. 1987), 163–169. https://doi.org/10.1145/37402.37422Google ScholarDigital Library
- A. Nasri, W. Bou Karam, and F. Samavati. 2009. Sketch-Based Subdivision Models. In Proceedings of the 6th Eurographics Symposium on Sketch-Based Interfaces and Modeling (New Orleans, Louisiana) (SBIM ’09). Association for Computing Machinery, New York, NY, USA, 53–60. https://doi.org/10.1145/1572741.1572751Google ScholarDigital Library
- Luke Olsen, Faramarz Samavati, and Richard Bartels. 2007. Multiresolution for curves and surfaces based on constraining wavelets. Computers & Graphics 31 (06 2007), 449–462. https://doi.org/10.1016/j.cag.2007.01.033Google ScholarDigital Library
- Alberto Redaelli and Emiliano Votta. 2020. Cardiovascular patient-specific modeling: Where are we now and what does the future look like?APL Bioengineering 4 (12 2020), 040401. https://doi.org/10.1063/5.0031452Google Scholar
- Javad Sadeghi and Faramarz Samavati. 2009. Technical Section: Smooth reverse subdivision. Computers and Graphics 33 (06 2009), 217–225. https://doi.org/10.1016/j.cag.2009.03.012Google ScholarDigital Library
- Javad Sadeghi and Faramarz F. Samavati. 2011. Smooth Reverse Loop and Catmull-Clark Subdivision. Graph. Models 73, 5 (Sept. 2011), 202–217. https://doi.org/10.1016/j.gmod.2011.03.004Google ScholarDigital Library
- Faramarz Samavati, Nezam Mahdavi-Amiri, and Richard Bartels. 2000. Multiresolution Surfaces Having Arbitrary Topologies by a Reverse Doo Subdivision Method. Computer Graphics Forum 21 (07 2000). https://doi.org/10.1111/1467-8659.00572Google Scholar
- Catalina Tobon-Gomez, Arjan J. Geers, Jochen Peters, Jürgen Weese, Karen Pinto, Rashed Karim, Mohammed Ammar, Abdelaziz Daoudi, Jan Margeta, Zulma Sandoval, Birgit Stender, Yefeng Zheng, Maria A. Zuluaga, Julian Betancur, Nicholas Ayache, Mohammed Amine Chikh, Jean-Louis Dillenseger, B. Michael Kelm, Saïd Mahmoudi, Sébastien Ourselin, Alexander Schlaefer, Tobias Schaeffter, Reza Razavi, and Kawal S. Rhode. 2015. Benchmark for Algorithms Segmenting the Left Atrium From 3D CT and MRI Datasets. IEEE Transactions on Medical Imaging 34, 7 (2015), 1460–1473. https://doi.org/10.1109/TMI.2015.2398818Google ScholarCross Ref
- Benjamin Villard, Vicente Grau, and Ernesto Zacur. 2018. Surface Mesh Reconstruction from Cardiac MRI Contours. Journal of Imaging 4 (01 2018), 16. https://doi.org/10.3390/jimaging4010016Google Scholar
- Oskar Škrinjar and Arnaud Bistoquet. 2009. Generation of Myocardial Wall Surface Meshes from Segmented MRI. Journal of Biomedical Imaging 2009, Article 23 (Jan. 2009), 10 pages. https://doi.org/10.1155/2009/313517Google Scholar
- Min Wan, Wei Huang, Jun-Mei Zhang, Xiaodan Zhao, Ru San Tan, Xiaofeng Wan, and Liang Zhong. 2015. Variational Reconstruction of Left Cardiac Structure from CMR Images. PLOS ONE 10, 12 (12 2015), 1–17. https://doi.org/10.1371/journal.pone.0145570Google Scholar
- Xiaoxu Wang, Viorel Mihalef, Zhen Qian, Szilard Voros, and Dimitris Metaxas. 2012. 3D cardiac motion reconstruction from CT data and tagged MRI. In 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE, San Diego, California, 4083–4086. https://doi.org/10.1109/EMBC.2012.6346864Google ScholarCross Ref
- Shaoting Zhang, Xiaoxu Wang, Dimitris Metaxas, Ting Chen, and Leon Axel. 2009. LV surface reconstruction from sparse tMRI using Laplacian Surface Deformation and Optimization. In 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro. IEEE, Boston, MA, 698–701. https://doi.org/10.1109/ISBI.2009.5193143Google ScholarCross Ref
Recommendations
Subdivision Surface Fitting Using QEM-Based Mesh Simplification and Reconstruction of Approximated B-Spline Surfaces
PG '00: Proceedings of the 8th Pacific Conference on Computer Graphics and ApplicationsWe present a general method for automatically reconstructing a network of B-spline patches based on the Doo-Sabin subdivision surface. This method consists of two parts, surface fitting and surface construction. In surface fitting, mesh simplification ...
√2 Subdivision for quadrilateral meshes
This paper presents a $\sqrt2$ subdivision scheme for quadrilateral meshes that can be regarded as an extension of a 4-8 subdivision with new subdivision rules and improved capability and performance. The proposed scheme adopts a so-called $\sqrt2$ ...
Surface modeling with ternary interpolating subdivision
In this paper, a new interpolatory subdivision scheme, called ternary interpolating subdivision, for quadrilateral meshes with arbitrary topology is presented. It can be used to deal with not only extraordinary faces but also extraordinary vertices in ...
Comments