Serial slice image segmentation of digital human based on adaptive geometric active contour tracking

https://doi.org/10.1016/j.compbiomed.2013.03.001Get rights and content

Abstract

Segmentation is one of the crucial problems for the digital human research, as currently digital human datasets are manually segmented by experts with anatomy knowledge. Due to the thin slice thickness of digital human data, the static slices can be regarded as a sequence of temporal deformation of the same slice. This gives light to the method of object contour tracking for the segmentation task for the digital human data. In this paper, we present an adaptive geometric active contour tracking method, based on a feature image of object contour, to segment tissues in digital human data. The feature image is constructed according to the matching degree of object contour points, image variance and gradient, and statistical models of the object and background colors. Utilizing the characteristics of the feature image, the traditional edge-based geometric active contour model is improved to adaptively evolve curve in any direction instead of the single direction. Experimental results demonstrate that the proposed method is robust to automatically handle the topological changes, and is effective for the segmentation of digital human data.

Introduction

The digital human is important to promote the medical research and the understanding of human being. The Visible Human Project (VHP) was firstly run by the U.S. National Library of Medicine to build a data set of cross-sectional photographs of the human body, including magnetic resonance (MR) images, computed tomography (CT) images, and anatomical images. In addition, the Chinese Visible Human (CVH) and Visible Korean Human (VKH) were also released to represent different populations of the world.

As one of the critical problems of the digital human research, image segmentation is the foundation of many operations, such as three-dimensional (3D) visualization and image measurement. Although a great deal of literature [1], [2], [3] on medical image segmentation are available, only a small number of methods have been proposed for digital human dataset segmentation, such as color similarity based methods [4], [5], [6], [7], Voronoi diagram based method [8], hybrid method [9] and image analogy based method [10]. In RGB feature space, an interactive ellipsoidal classification was presented by Schiemann et al. [4], while the detailed segmentation for a complete 3D anatomical atlas is still necessary. The user's contextual and interpretive knowledge in [5] were utilized in the segmentation and visualization of volumetric data sets. In addition, a spatial/symbolic model of inner organs [6] and a CVH brain image segmentation method [7] were also presented mainly depending on color information of tissues. Due to the non-uniform lighting between digital human slices and the complex composing of color information of tissues, the segmentation precision of color similarity based methods [4], [5], [6], [7] will be influenced. The basic idea of the Voronoi diagram based method [8] is repeatedly to partition and classify an image based on Voronoi diagrams and experimental classification statistics, respectively. Imielinska et al. [9] segmented internal organs by integrating deformable model and region-based segmentation method. In the interactive segmentation process of Voronoi diagram based method [8] and hybrid method [9], human–computer interaction is needed during each iteration, because seeds should be added to the interior of object regions. The image analogy based method [10] required supervised training data, which can only automatically segment neighboring four slices. Therefore, at present the digital human data is mainly segmented by hand or with software, such as Photoshop software [11] and VOXEL-MAN software [12], [13], [14]. In order to improve the automatic level of digital human segmentation, this paper proposes an object tracking based method.

Since digital human datasets contain thin slices (0.1–1 mm for CVH [15]) and most of tissues are soft, the level of continuity between consecutive slices is high. The continuity is taken as the deformation of temporal sequential images on an identical slice, so the serial slices of digital human can be segmented with the geometric active contour tracking method. A parametric active contour model [16], proposed for object tracking, was applied to brain stem segmentation of Chinese visible human datasets. Since the parametric active contour model tackles the segmentation problem by considering an object boundary as a single and connected structure, the previous model cannot segment several objects simultaneously or the objects with topological changes. In addition, the matching degree image was constructed according to the information of object contour points and image gradient, without region statistical information.

To overcome the deficiencies of the model [16], we propose an adaptive geometric active contour model for the segmentation of digital human data in this paper. The construction of the feature image is improved by incorporating the region statistical information into the matching degree image. The feature image means a transformed image generated with image features, such as color and gradient. To the best of our knowledge, there is no previous work about geometric active contour tracking into the digital human segmentation. Fig. 1 shows the flow chart of our method. The main contributions of this paper are: (1) the geometric active contour tracking is firstly used for the segmentation of digital human data; (2) a novel construction of the feature image is presented by improving the matching degree image and incorporating the color models of the object and background colors. In addition, the traditional edge-based geometric active contour model is improved to adaptively evolve the curve in any direction, not in the traditional single direction (inward or outward). The proposed model builds considerably on the previous model [16], and extends and improves the model. By comparing with the model [16], the new model is more robust (such as Fig. 13, Fig. 14) and can handle the topological changes automatically (such as Fig. 8, Fig. 10).

Section snippets

Generation of feature image

Due to the thin slice thickness of digital human data, for most tissues the displacement between two consecutive slices is not too large. Therefore, the searching region of object contour points was restricted to a band along the contour, which can reduce the computing time and improve the tracking precision. The level set method was firstly presented by Osher et al. [17] in 1988. Then the narrow band level set methods [18], [19] was proposed to reduce computational complexity. The radius of

Object contour evolution based on adaptive geometric active contour model

The geometric active contour models were simultaneously proposed by Caselles et al. [23] and by Malladi et al. [24]. These models are based on the theory of curve evolution and geometric flows, and implemented using the level-sets based numerical algorithm. The basic idea of geometric active contour model is to make planar curve movement track change into three-dimensional curved surface movement track, which has the mainly merit that it can handle the change of topological structure easily.

Experimental studies

The proposed method was evaluated from the time complexity and the segmentation accuracy.

Results and analysis

In this section, the algorithm performance and segmentation accuracy of our method are given. To demonstrate the necessity and importance of the proposed method, a qualitative comparison is given in two parts: (1) topological change and (2) adaptive evolution and region statistical constraint. The segmentation results of another two tissues and the limitation of the proposed method are also simply introduced.

Conclusions

Since the slices of digital human data have thin thickness and most tissues have fine continuous deformation between consecutive slices, it is appropriate to use the method of geometric active contour tracking for the digital human segmentation. In order to improve the robustness of the constructed feature image, the region statistical constraint is used with GMM. We extend the edge-based geometric active contour model to make the active contour adaptively evolve in any direction (instead of a

Acknowledgment

The authors sincerely thank the reviewers whose valuable comments have improved this paper, the Chinese University of Hong Kong and the Third Military Medical University for providing the processed Chinese visible human datasets, and doctoral student Jiajing Xu for comments on the manuscript. This work was supported by the National Science Foundation of China under Grant no. 60805003, Qing Lan Project and NUST Research Funding under Grant no. 2011ZDJH26.

Qiang chen received B.Sc. degree in computer science and Ph.D. degree in Pattern Recognition and Intelligence System from Nanjing University of Science and Technology, China, in 2002 and 2007, respectively. He is an associate professor with the School of Computer Science and Engineering at the Nanjing University of Science and Technology. He is also a postdoctoral fellow in the school of medicine, Stanford University. His main research topics are image segmentation, object tracking, image

References (32)

  • V. Grau et al.

    Improved watershed transform for medical image segmentation using prior information

    IEEE Trans. Med. Imaging

    (2004)
  • S. Senger

    Visualizing and segmenting large volumetric data sets

    IEEE Comp. Gr. Appl.

    (1999)
  • Y.J. Chen et al.

    Chinese visible human brain image segmentation

    Congr. Image Signal Process.

    (2008)
  • C. Imielinska et al.

    Semi-automated color segmentation of anatomical tissue

    Computerized Med. Imaging Gr.

    (2000)
  • C. Imielinska, D. Metaxas, J. Udupa, Y.P. Jin, T. Cheng, Hybrid segmentation of the visible human data, in: Proceeding...
  • J.B. Lackey, M.D. Colagrosso, Supervised segmentation of visible human data with image analogies, in: Proceedings of...
  • Cited by (2)

    Qiang chen received B.Sc. degree in computer science and Ph.D. degree in Pattern Recognition and Intelligence System from Nanjing University of Science and Technology, China, in 2002 and 2007, respectively. He is an associate professor with the School of Computer Science and Engineering at the Nanjing University of Science and Technology. He is also a postdoctoral fellow in the school of medicine, Stanford University. His main research topics are image segmentation, object tracking, image denoising, and image restoration.

    Quan-sen Sun received his Ph.D. degree in pattern recognition and intelligence system from Nanjing University of Science and Technology (NUST), China, in 2006. He is a professor in the School of Computer Science and Engineering at NUST. He visited the Department of Computer Science and Engineering, The Chinese University of Hong Kong in 2004 and 2005, respectively. His current interests include pattern recognition, image processing, computer vision and data fusion.

    De-shen Xia received B.Sc. degree in Radiology of Nanjing Institute of Technology, China, in 1963, and Ph.D. degree in the Faculty of Science of Rouen University, France, in 1988. Currently, he is a Professor in the Faculty of Computer Science and Technology, Nanjin University of Science and Technology (NJUST), Nanjing, China, Honorary Professor in ESIC/ELEC, Rouen, France and Research member in Computer Graphics Lab of CNRS, France. He is also Director of Image Recognition Lab in Nanjing University of Science and Technology, China. He is the direction member of National Remote Sensing Federation, China, and the direction member of Micro-Computer Application Association of Province Jiangsu, China. His research interests include image processing, analysis, and recognition, remote sensing, medical imaging and mathematics in imaging.

    View full text