Jiyun Li
ABSTRACT
Mammography image usually contains two views in different orientations---Cranial Caudal (CC) and Mediolateral Oblique (MLO). In clinical decision making, the location of the lesions on the CC and MLO views are usually different. And the shape of breast varies greatly among patients, therefore, two views are necessary for evaluating the information in a comprehensively manner. In this paper, we propose an unsupervised registration algorithm based on CC and MLO views of mammography, which learns the deformation function through a Convolutional Neural Network (CNN). This function maps the input image to the corresponding deformation field and generates an image with the same shape as the template image after deformation, so that the doctor can better observe the two views. According to the radiologist's assessment, our work can contribute to medical image analysis and processing while providing novel guidance in learning-based registration and its applications.
- Guo Q, Shao J, Ruiz V F. Characterization and classification of tumor lesions using computerized fractal-based texture analysis and support vector machines in digital mammograms[J]. International journal of computer assisted radiology and surgery, 2009, 4(1): 11.Google Scholar
Cross Ref
- Wei J, Chan H P, Sahiner B, et al. Computer-aided detection of breast masses on mammograms: Dual system approach with two-view analysis[J]. Medical physics, 2009, 36(10): 4451--4460.Google Scholar
- Alom M Z, Taha T M, Yakopcic C, et al. The history began from alexnet: A comprehensive survey on deep learning approaches[J]. arXiv preprint arXiv:1803.01164, 2018.Google Scholar
- Roux M. Automatic registration of SPOT images and digitized maps[C]//Proceedings of 3rd IEEE International Conference on Image Processing. IEEE, 1996, 2: 625--628.Google Scholar
- Flusser J, Suk T. A moment-based approach to registration of images with affine geometric distortion[J]. IEEE transactions on Geoscience and remote sensing, 1994, 32(2): 382--387.Google ScholarCross Ref
- Moss S, Hancock E R. Multiple line-template matching with the EM algorithm[J]. Pattern Recognition Letters, 1997, 18(11-13): 1283--1292.Google ScholarDigital Library
- Wang W H, Chen Y C. Image registration by control points pairing using the invariant properties of line segments[J]. Pattern Recognition Letters, 1997, 18(3): 269--281.Google ScholarDigital Library
- Noble J A. Finding corners[J]. Image and vision computing, 1988, 6(2): 121--128.Google Scholar
- Althof R J, Wind M G J, Dobbins J T. A rapid and automatic image registration algorithm with subpixel accuracy[J]. IEEE transactions on medical imaging, 1997, 16(3): 308--316.Google Scholar
- Berthilsson R. Affine correlation[C]//Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No. 98EX170). IEEE, 1998, 2: 1458--1460.Google Scholar
- Ritter N, Owens R, Cooper J, et al. Registration of stereo and temporal images of the retina[J]. IEEE Transactions on medical imaging, 1999, 18(5): 404--418.Google ScholarCross Ref
- KalatehJari E H, Hosseini M M, Gharahbagh A A. Image Registration Based On a Novel Enhanced Scale Invariant Geometrical Feature[J]. International Journal of Machine Learning and Computing, 2012, 2(5): 667.Google ScholarCross Ref
- DeTone D, Malisiewicz T, Rabinovich A. Deep image homography estimation[J]. arXiv preprint arXiv:1606.03798, 2016.Google Scholar
- Miao S, Wang Z J, Liao R. A CNN regression approach for real-time 2D/3D registration[J]. IEEE transactions on medical imaging, 2016, 35(5): 1352--1363.Google ScholarCross Ref
- Miao S, Wang Z J, Zheng Y, et al. Real-time 2D/3D registration via CNN regression[C]//2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI). IEEE, 2016: 1430--1434.Google Scholar
- Cao X, Yang J, Zhang J, et al. Deformable image registration based on similarity-steered CNN regression[C]//International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer, Cham, 2017: 300--308.Google Scholar
- Yang X, Kwitt R, Styner M, et al. Quicksilver: Fast predictive image registration-a deep learning approach[J]. NeuroImage, 2017, 158: 378--396.Google ScholarCross Ref
- Krebs J, Mansi T, Delingette H, et al. Robust non-rigid registration through agent-based action learning[C]//International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer, Cham, 2017: 344--352.Google Scholar
- Sokooti H, De Vos B, Berendsen F, et al. Nonrigid image registration using multi-scale 3D convolutional neural networks[C]//International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer, Cham, 2017: 232--239.Google Scholar
- Nguyen T, Chen S W, Shivakumar S S, et al. Unsupervised deep homography: A fast and robust homography estimation model[J]. IEEE Robotics and Automation Letters, 2018, 3(3): 2346--2353.Google ScholarCross Ref
- Balakrishnan G, Zhao A, Sabuncu M R, et al. VoxelMorph: a learning framework for deformable medical image registration[J]. IEEE transactions on medical imaging, 2019, 38(8): 1788--1800.Google Scholar
- Isola P, Zhu J Y, Zhou T, et al. Image-to-image translation with conditional adversarial networks[C]//Proceedings of the IEEE conference on computer vision and pattern recognition. 2017: 1125--1134.Google Scholar
- Ronneberger O, Fischer P, Brox T. U-net: Convolutional networks for biomedical image segmentation[C]//International Conference on Medical image computing and computer-assisted intervention. Springer, Cham, 2015: 234--241.Google Scholar
- Moreira I C, Amaral I, Domingues I, et al. Inbreast: toward a full-field digital mammographic database[J]. Academic radiology, 2012, 19(2): 236--248.Google ScholarCross Ref
- Avants B B, Epstein C L, Grossman M, et al. Symmetric diffeomorphic image registration with cross-correlation: evaluating automated labeling of elderly and neurodegenerative brain[J]. Medical image analysis, 2008, 12(1): 26--41.Google Scholar
- Avants B B, Tustison N J, Song G, et al. A reproducible evaluation of ANTs similarity metric performance in brain image registration[J]. Neuroimage, 2011, 54(3): 2033--2044.Google ScholarCross Ref
- Rueckert D, Sonoda L I, Hayes C, et al. Nonrigid registration using free-form deformations: application to breast MR images[J]. IEEE transactions on medical imaging, 1999, 18(8): 712--721.Google Scholar
- Klein S, Staring M, Murphy K, et al. Elastix: a toolbox for intensity-based medical image registration[J]. IEEE transactions on medical imaging, 2009, 29(1): 196--205.Google Scholar
Index Terms
- Mammography Registration for Unsupervised Learning Based on CC and MLO Views
Recommendations
Segmentation technique for detecting suspect masses in dense breast digitized images as a tool for mammography CAD schemes
SAC '08: Proceedings of the 2008 ACM symposium on Applied computingBreast cancer is one of the most important cause to mortality rate among women. Computer-Aided Detection (CAD) schemes have been developed as a tool in detecting early breast cancer. This can be an important tool in mammography since previous studies ...
Identification of the skin-air interface in CC- and MLO-view mammograms via computational intelligence techniques
ACM-SE '12: Proceedings of the 50th Annual Southeast Regional ConferenceIdentification of the skin-air interface is a challenging, yet essential task in mammographic image analysis. Two strategies for determining this boundary are presented in this study. The stroma edge is initially located using a K-clustered self-...
Computer-aided detection and diagnosis of breast cancer with mammography: recent advances
Breast cancer is the second-most common and leading cause of cancer death among women. It has become a major health issue in the world over the past 50 years, and its incidence has increased in recent years. Early detection is an effective way to ...
Comments