Abstract
In this paper, we consider the dense correspondence of volumetric images and propose a convolutional network-based descriptor learning framework using the functional map representation. Our main observation is that the correspondence-steered descriptor learning improves dense volumetric mapping compared with the hand-crafted descriptors. We present an unsupervised way to find the optimal network parameters by aligning volumetric probe functions and the enforcement of invertible coupled maps. The proposed framework takes the one-channel volume as input and outputs the multi-channel volumetric descriptors using the cascaded convolutional operators, which are faster than the conventional descriptor computations. We follow the deep functional map framework and represent the dense correspondence by the low-dimensional spectral mapping for the functional transfer and dense correspondence using the linear algebra. We demonstrate that by using the correspondence-steered deep descriptor learning, the quality of both the dense correspondence and attribute transfer are improved in the extensive experiments.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Achanta, R., et al.: SLIC superpixels compared to state-of-the-art superpixel methods. IEEE Trans. PAMI 34(11), 2274–2282 (2012)
Allaire, S., et al.: Full orientation invariance and improved feature selectivity of 3D sift with application to medical image analysis. In: IEEE CVPR Workshops, pp. 1–8 (2008)
Çiçek, Ö., Abdulkadir, A., Lienkamp, S.S., Brox, T., Ronneberger, O.: 3D U-Net: learning dense volumetric segmentation from sparse annotation. In: Ourselin, S., Joskowicz, L., Sabuncu, M.R., Unal, G., Wells, W. (eds.) MICCAI 2016. LNCS, vol. 9901, pp. 424–432. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46723-8_49
Daenzer, S., et al.: VolHOG: a volumetric object recognition approach based on bivariate histograms of oriented gradients for vertebra detection in cervical spine MRI. Med. Phys. 41(8Part1), 082305 (2014)
Heinrich, M.P., et al.: MIND: modality independent neighbourhood descriptor for multi-modal deformable registration. Med. Image Anal. 16(7), 1423–1435 (2012)
Heinrich, M.P., Jenkinson, M., Papież, B.W., Brady, S.M., Schnabel, J.A.: Towards realtime multimodal fusion for image-guided interventions using self-similarities. In: Mori, K., Sakuma, I., Sato, Y., Barillot, C., Navab, N. (eds.) MICCAI 2013. LNCS, vol. 8149, pp. 187–194. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-40811-3_24
Kanavati, F., et al.: Supervoxel classification forests for estimating pairwise image correspondences. Pattern Recogn. 63, 561–569 (2017)
Litany, O., Remez, T., Rodolà, E., Bronstein, A., Bronstein, M.: Deep functional maps: structured prediction for dense shape correspondence. In: ICCV 2017, pp. 5659–5667 (2017)
Lombaert, H., Arcaro, M., Ayache, N.: Brain transfer: spectral analysis of cortical surfaces and functional maps. In: Ourselin, S., Alexander, D.C., Westin, C.-F., Cardoso, M.J. (eds.) IPMI 2015. LNCS, vol. 9123, pp. 474–487. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-19992-4_37
Ovsjanikov, M., Ben-Chen, M., Solomon, J., Butscher, A., Guibas, L.: Functional maps: a flexible representation of maps between shapes. ACM Trans. Graph. 31(4), 30 (2012)
Pei, Y., Ma, G., Chen, G., Zhang, X., Xu, T., Zha, H.: Superimposition of cone-beam computed tomography images by joint embedding. IEEE Trans. BME 64(6), 1218–1227 (2017)
Vincent, P., Larochelle, H., Lajoie, I., Bengio, Y., Manzagol, P.A.: Stacked denoising autoencoders: learning useful representations in a deep network with a local denoising criterion. J. Mach. Learn. Res. 11(12), 3371–3408 (2010)
Wang, F., Huang, Q., Guibas, L.J.: Image co-segmentation via consistent functional maps. In: ICCV, pp. 849–856 (2013)
Zhang, Y., Pei, Y., Guo, Y., Ma, G., Xu, T., Zha, H.: Consistent correspondence of cone-beam CT images using volume functional maps. In: Frangi, A.F., Schnabel, J.A., Davatzikos, C., Alberola-López, C., Fichtinger, G. (eds.) MICCAI 2018. LNCS, vol. 11070, pp. 801–809. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-00928-1_90
Acknowledgement
This work was supported by NSFC 61876008, 61272342.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Sun, D. et al. (2019). Correspondence-Steered Volumetric Descriptor Learning Using Deep Functional Maps. In: Suk, HI., Liu, M., Yan, P., Lian, C. (eds) Machine Learning in Medical Imaging. MLMI 2019. Lecture Notes in Computer Science(), vol 11861. Springer, Cham. https://doi.org/10.1007/978-3-030-32692-0_29
Download citation
DOI: https://doi.org/10.1007/978-3-030-32692-0_29
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-32691-3
Online ISBN: 978-3-030-32692-0
eBook Packages: Computer ScienceComputer Science (R0)