Maha Yaghi
ABSTRACT
Computer-aided diagnosis systems are increasingly used in the detection and segmentation of abnormalities in medical imaging. However, in many borderline cases, radiologists and physicians need to analyze the images to confirm the diagnosis. This paper proposes a novel analysis system for visualizing the output of 3D segmented abnormalities and the associated computer diagnoses. We use motion trackers to localize the user's viewing device and estimate its 3D orientation. We then use this tracking data to slice the segmented and labeled volume showing the abnormalities in real-time. The user can switch between the labeled and raw views to analyze the abnormalities’ boundaries. To test our visualization, we use our brain tumor segmentation pipeline using MRI scans to produce a labeled image and slice and visualize the tumor from all angles. Our system has a low latency of 0.01 seconds and can identify the viewing device's 3D location and orientation within a maximum of 0.2 cm and 2 degrees of error, respectively. The accuracy of our system depends on the segmentation pipeline. Our proposed system is also useful for medical training and as a visual feedback tool for computer-aided system's researchers and developers.
- "Worldwide cancer statistics”, Cancer Research UK," https://www.cancerresearchuk.org/health-professional/cancer-statistics/worldwide-cancer. [Accessed: 14- Dec2018].Google Scholar
- T. Kohi, L. von Essen, G. Masika, M. Gottvall and J. Dol, "Cancer-related concerns and needs among young adults and children on cancer treatment in Tanzania: a qualitative study", BMC Cancer, vol. 19, no. 1, 2019.Google Scholar
- "”Cancer”, Who.int," https://www.who.int/news-room/fact-sheets/detail/cancer. [Accessed:14- Dec- 2018].Google Scholar
- W. Wired. ""Why Early Detection Is the Best Way to Beat Cancer"," https://www.wired.com/2008/12/ff-cancer/. [Accessed: 14- Dec- 2018.Google Scholar
- D. Shahbazi-Gahrouei, P. M. Khaniabadi, B. M. Khaniabadi, and S. Shahbazi-Gahrouei, “Medical imaging modalities using nanoprobes for cancer diagnosis: A literature review on recent findings,” Journal of research in medical sciences: the official journal of Isfahan University of Medical Sciences, vol. 24, 2019.Google Scholar
- A. R. M. Al-shamasneh, and U. H. B. Obaidellah, “Artificial intelligence techniques for cancer detection and classification: review study,” European Scientific Journal, vol. 13, no. 3, pp. 342-370, 2017.Google ScholarCross Ref
- S. Nakajima, H. Atsumi, A. H. Bhalerao, F. A. Jolesz, R. Kikinis, T. Yoshimine, T. M. Moriarty, and P. E. Stieg, “Computer-assisted surgical planning for cerebrovascular neurosurgery,” Neurosurgery, vol. 41, no. 2, pp. 403-410, 1997.Google ScholarCross Ref
- L. Sunwoo, Y. J. Kim, S. H. Choi, K.-G. Kim, J. H. Kang, Y. Kang, Y. J. Bae, R.-E. Yoo, J. Kim, and K. J. Lee, “Computer-aided detection of brain metastasis on 3D MR imaging: Observer performance study,” PLoS One, vol. 12, no. 6, pp. e0178265, 2017.Google ScholarCross Ref
- Shin Nakajima, M.D., Hideki Atsumi, M.D., Abhir H. Bhalerao, Ph.D., Ferenc A. Jolesz, M.D., Ron Kikinis, M.D., Toshiki Yoshimine, M.D., Ph.D., Thomas M. Moriarty, M.D., Ph.D., Philip E. Stieg, Ph.D., M.D. Computer-assisted Surgical Planning for Cerebrovascular NeurosurgeryGoogle Scholar
- Cline HE, Lorensen WE, Souza SP, Jolesz FA, Kikinis R, Gerig G, Kennedy TE: 3D surface rendered MR images of the brain and its vasculature. Technical Note J Comput Assist Tomogr15:344-351, 1991.Google ScholarCross Ref
- Wells W, Kikinis R, Grimson W, Jolesz F: Adaptive segmentation of MRI data. IEEE Trans Med Imaging 15:429-442, 1996.Google ScholarCross Ref
- Sunwoo, L., Kim, Y. J., Choi, S. H., Kim, K., Kang, J. H., Kang, Y., . . . Kim, J. H. (2017, June 08). Computer-aided detection of brain metastasis on 3D MR imaging: Observer performance study. Retrieved from https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5464563/Google Scholar
- Z. Fan, Y. Weng, G. Chen, and H. Liao, “3D interactive surgical visualization system using mobile spatial information acquisition and autostereoscopic display,” Journal of biomedical informatics, vol. 71, pp. 154-164, 2017.Google ScholarCross Ref
- M. A. de Souza, A. A. C. Paz, I. J. Sanches, P. Nohama, and H. R. Gamba, "3D thermal medical image visualization tool: integration between MRI and thermographic images." pp. 5583-5586.Google Scholar
- Z. Qingsong, K. C. Keong, N. W. Sing, and C. Yintao, "MRI head segmentation for object based volume visualization." pp. 361-366.Google Scholar
- F. Ting, K. Sim, and Y. Lee, "Three-dimensional model reconstruction using surface interpolation with the interfacing of Hermite surface for breast cancer MRI imaging system." pp. 1-5.Google Scholar
- F. Yang, W. Zuo, K. Wang, and H. Zhang, "3D cardiac MRI data visualization based on volume data preprocessing and transfer function design." pp. 717-720.Google Scholar
- Z. Zheng, and X. Mei, "MRI Head space-based segmentation for Object Based Volume Visualization." pp. 691-694.Google Scholar
- T. Tawara, and K. Ono, "A framework for volume segmentation and visualization using augmented reality." pp. 121-122.Google Scholar
- A. M. Andrew, “Multiple view geometry in computer vision,” Kybernetes, 2001.Google ScholarCross Ref
- D. F. DeMenthon, and L. S. Davis, “Model-based object pose in 25 lines of code,” International journal of computer vision, vol. 15, no. 1-2, pp. 123-141, 1995.Google Scholar
- "MATLAB - MathWorks.," https://www.mathworks.com/products/matlab.html [Accessed 20 Jun. 2019].Google Scholar
- M. Maciejewski, "Evaluation of the SteamVR Motion Tracking System with a Custom-Made Tracker", Applied Sciences, vol. 11, no. 14, p. 6390, 2021.Google ScholarCross Ref
- "Exploring Slices from a 3-Dimensional MRI Data Set- MATLAB & Simulink Example", Mathworks.com, 2021. [Online]. Available: https://www.mathworks.com/help/images/exploring-slices-from-a-3-dimensional-mri-data-set.html.Google Scholar
- Slicer.org. "3D Slicer," https://www.slicer.org/ [Accessed 20 Jun. 2019].Google Scholar
- U. Technologies. "Unity," https://unity.com/.Google Scholar
- G. Wheeler, S. Deng, N. Toussaint, K. Pushparajah, J. A. Schnabel, J. M. Simpson, and A. Gomez, “Virtual interaction and visualisation of 3D medical imaging data with VTK and Unity,” Healthcare technology letters, vol. 5, no. 5, pp. 148-153, 2018.Google ScholarCross Ref
- ""VIVE — VIVE Virtual Reality System", vive.com," https://www.vive.com/us/product/vive-virtual-reality-system/.Google Scholar
- D. C. Niehorster, L. Li, and M. Lappe, “The accuracy and precision of position and orientation tracking in the HTC vive virtual reality system for scientific research,” i-Perception, vol. 8, no. 3, pp. 2041669517708205, 2017.Google Scholar
- D. Niehorster, L. Li and M. Lappe, "The Accuracy and Precision of Position and Orientation Tracking in the HTC Vive Virtual Reality System for Scientific Research", i-Perception, vol. 8, no. 3, p. 204166951770820, 2017.Google Scholar
Index Terms
- Motion Tracked 3D Visualization System for Segmented ROI in Medical Imaging
Recommendations
Computer-aided hepatocellular carcinoma detection on the hepatobiliary phase of gadoxetic acid-enhanced magnetic resonance imaging using a convolutional neural network: Feasibility evaluation with multi-sequence data
Highlights- We developed computer-aided detection (CAD) for hepatocellular carcinoma (HCC) on the hepatobiliary phase (HBP) of gadoxetic acid-enhanced magnetic resonance ...
ABSTRACT Background and ObjectivesDiagnosis of hepatocellular carcinoma (HCC) on liver MRI needs analysis of multi-sequence images. However, developing computer-aided detection (CAD) for every single sequence requires considerable ...
A Preoperative 3D Computer-Aided Diagnosis System for Lung Tumor
ICGEC '11: Proceedings of the 2011 Fifth International Conference on Genetic and Evolutionary ComputingIn recent years, the clinical treatment of computed tomography (CT) has become an important tool in medical imaging. Usually, we can integrate the computer-aided diagnosis (CAD) system to provide the physician the more reliable vision for preoperative ...
Lung Cancer Detection on CT Images by Using Image Processing
ICCS '12: Proceedings of the 2012 International Conference on Computing SciencesLung cancer seems to be the common cause of death among people throughout the world. Early detection of lung cancer can increase the chance of survival among people. The overall 5-year survival rate for lung cancer patients increases from 14 to 49% if ...
Comments