Abstract
We present a novel method for cutting out 3D volumetric structures based on simple strokes that are drawn directly on volume rendered images. The freehand strokes roughly mark out objects of interest and background. Our system then automatically segments the regions of interest and refines their boundaries in the rendered image. These 2D segmentation results provide constraints for 3D segmentation in the volume dataset. The objects of interest are then efficiently cut out from the volume via a combination of our novel two-pass graph cuts algorithm and the pre-computed over-segmentation. Our method improves traditional, fully automatic segmentation by involving human users in the process, yet minimizing user input and providing timely feedback. Our experiments show that our method extracts volumetric structures precisely and efficiently while requiring little skill or effort from the user.
Similar content being viewed by others
Explore related subjects
Discover the latest articles and news from researchers in related subjects, suggested using machine learning.References
Agarwala, A., Hertzmann, A., Salesin, D.H., Seitz, S.M.: Keyframe-based tracking for rotoscoping and animation. ACM Trans. Graph. 23(3), 584–591 (2004)
Boykov, Y., Jolly, M.P.: Interactive graph cuts for optimal boundary and region segmentation of objects in N-D images. In: International Conference on Computer Vision (ICCV ’01), vol. I, pp. 105–112 (2001)
Boykov, Y., Kolmogorov, V.: An experimental comparison of min-cut/max-flow algorithms for energy minimization in vision. IEEE Trans. Pattern Anal. Machine Interll. 26(9), 1124–1137 (2004)
Fairfield, J.: Toboggan contrast enhancement for contrast segmentation. In: 10th IEEE International Conference on Pattern Recognition, vol. I, pp. 712–716 (1990)
Fujishiro, I., Azuma, T., Takeshima, Y.: Automating transfer function design for comprehensible volume rendering based on 3D field topology analysis. In: Proceedings of IEEE Visualization, pp. 367–470 (1999)
Greig, D., Porteous, B., Seheult, A.: Exact map estimation for binary images. J. Roy. Stat. Soc. B. 51, 271–279 (1989)
Hadwiger, M., Berger, C., Hauser, H.: High quality two-level volume rendering of segmented data sets on consumer graphics hardware. In: Proceedings of IEEE Visualization, pp. 301–308 (2003)
Hastreiter, P., Ertl, T.: Fast and interactive 3D-segmentation of medical volume data. In: Computer Graphics International, Visualization Minisymposium, pp. 78–85 (1998)
Hauser, H., Mroz, L., Bischi, G.I., Gröller, M.E.: Two-level volume rendering. IEEE Trans. Visual. Comput. Graph. 7(3), 242–252 (2001)
He, T., Hong, L., Kaufman, A., Pfister, H.: Generation of transfer functions using stochastic search techniques. In: Proceedings of IEEE Visualization, pp. 227–234 (1997)
Huang, R., Ma, K.L.: RGVis: Region growing based visualization techniques for volume visualization. In: Proceedings of Pacific Graphics Conference, pp. 335–333 (2003)
Incorp., A.S.: Adobe photoshop user guide (2002)
Kniss, J., Kindlmann, G., Hansen, C.: Multidimensional transfer functions for interactive volume rendering. IEEE Trans. Visual. Comput. Graph. 8(3), 270–285 (2002)
Li, Y., Sun, J., Tang, C.K., Shum, H.Y.: Lazy snapping. ACM Trans. Graph. 23(3), 303–308 (2004)
Marks, J., Andalman, B., Beardsley, P.: Design galleries: A general approach to setting parameters for computer graphics and animation. SIGGRAPH ’97 pp. 389–400 (1997)
McGuffin, M.J., Tancau, L., Balakrishnan, R.: Using deformations for browsing volumetric data. In: Proceedings of IEEE Visualization, pp. 401–408 (2003)
Mortensen, E.N.: Vision-assisted image editing. Computer Graphics 33(4), 55–57 (1999)
Mortensen, E.N., Barrett, W.A.: Intelligent scissors for image composition. In: Computer Graphics (SIGGRAPH ‘95), pp. 191–198 (1995)
Mortensen, E.N., Barrett, W.A.: Toboggan-based intelligent scissors with a four parameter edge model. In: Proceedings of the IEEE Computer Vision and Pattern Recognition (CVPR ’99), vol. 2, pp. 452–458 (1999)
Mortensen, E.N., Reese, L.J., Barrett, W.A.: Intelligent selection tools. In: Proceedings of the IEEE Computer Vision and Pattern Recognition (CVPR ’00), vol. 2, pp. 776–777 (2000)
Owada, S., Nielsen, F., Igarashi, T.: Volume catcher. In: Proceedings of the 2005 Symposium on Interactive 3D Graphics and Games (I3D ’05), pp. 111–116 (2005)
Reese, L.: Intelligent paint: Region-based interactive image segmentation. Master thesis, Department of Computer Science, Brigham Young University, Provo, UT (1999)
Rother, C., Kolmogorov, V., Blake, A.: “GrabCut”: interactive foreground extraction using iterated graph cuts. ACM Trans. Graph. 23(3), 309–314 (2004)
Takahashi, S., Takeshima, Y., Fujishiro, I.: Topological volume skeletonization and its application to transfer function design. Graph. Models 66(1), 24–49 (2004)
Tan, K.H., Ahuja, N.: Selecting objects with freehand sketches. In: Proceedings IEEE International Conference on Computer Vision (ICCV ’01), vol. 1, pp. 337–344 (2001)
Tzeng, F.Y., Lum, E., Ma, K.L.: A novel interface for higher-dimensional classification of volume data. In: Proceedings of IEEE Visualization, pp. 505–512 (2003)
Tzeng, F.Y., Ma, K.L.: A cluster-space visual interface for arbitrary dimensional classification of volume data. In: Proceedings of Joint IEEE/EG Symposium on Visualization (VisSym ’04), pp. 17–24 (2004)
Viola, I., Kanitsar, A., Gröller, M.E.: Importance-driven volume rendering. In: Proceedings of IEEE Visualization, pp. 139–145 (2004)
Wang, J., Bhat, P., Colburn, A., Agrawala, M., Cohen, M.F.: Interactive video cutout. ACM Trans. Graph. 24(3), 585–594 (2005)
Yao, X., Hung, Y.P.: Fast image segmentation by sliding in the derivative terrain. In: SPIE Proc. Intelligent Robots and Computer Vision X: Algorithms and Techniques, vol. 1607, pp. 369–379 (1991)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Yuan, X., Zhang, N., Nguyen, M. et al. Volume cutout. Visual Comput 21, 745–754 (2005). https://doi.org/10.1007/s00371-005-0330-2
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00371-005-0330-2