Skip to main content
Log in

Explicit design of transfer functions for volume-rendered images by combining histograms, thumbnails, and sketch-based interaction

The Visual Computer Aims and scope Submit manuscript

Abstract

Visual quality of volume rendering for medical imagery strongly depends on the underlying transfer function. Conventional Windows–Icons–Menus–Pointer interfaces typically refer the user to browse a lengthy catalog of predefined transfer functions or to pain-staking refine the transfer function by clicking and dragging several independent handles. To turn the standard design process less difficult and tedious, this paper proposes novel interactions on a sketch-based interface that supports the design of 1D transfer functions via touch gestures to directly control voxel opacity and easily assign colors. User can select different types of transfer function shapes including ramp function, free hand curve drawing, and slider bars similar to those of a mixing table. An assorted array of thumbnails provides an overview of the data when editing the transfer function. User performance is evaluated by comparing the time and effort necessary to complete a number of tests with sketch-based and conventional interfaces. Users were able to more rapidly explore and understand volume data using the sketch-based interface, as the number of design iterations necessary to obtain a desirable transfer function was reduced. In addition, informal evaluation sessions carried out with professionals (two senior radiologists, a general surgeon and two scientific illustrators) provided valuable feedback on how suitable the sketch-based interface is for illustration, patient communication and medical education.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  1. Arens, S., Domik, G.: A survey of transfer functions suitable for volume rendering. In: Proceedings of the 8th IEEE/EG International Conference on Volume Graphics, pp. 77–83. Eurographics Association (2010)

  2. Brix, T., Scherzinger, A., Völker, A., Hinrichs, K.: Interactive position-dependent customization of transfer function classification parameters in volume rendering. In: Proceedings of the Eurographics Workshop on Visual Computing for Biology and Medicine, pp. 83–92 (2015)

  3. Chevalier, F., Dragicevic, P., Hurter, C.: Histomages: fully synchronized views for image editing. In: Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology, UIST’12, pp. 281–286 (2012)

  4. Corcoran, A., Redmond, N., Dingliana, J.: Perceptual enhancement of two-level volume rendering. Comput. Graph. 34, 388–397 (2010)

    Article  Google Scholar 

  5. Dolnicar, S., Grün, B., Leisch, F.: Quick, simple and reliable: forced binary survey questions. Int. J. Mark. Res. 53, 231 (2011)

    Article  Google Scholar 

  6. Freiman, M., Joskowicz, L., Lischinski, D., Sosna, J.: A feature-based transfer function for liver visualization. Int. J. CARS 2(1), 125–126 (2007)

    Google Scholar 

  7. Guo, H., Mao, N., Yuan, X.: WYSIWYG (what you see is what you get) volume visualization. IEEE Trans. Visual. Comput. Graph. 17(12), 2106–2114 (2011)

    Article  Google Scholar 

  8. Guo, H., Yuan, X.: Local WYSIWYG volume visualization. In: Visualization Symposium (PacificVis), IEEE Pacific, pp. 65–72 (2013)

  9. Higuera, F. V., Sauber, N., Tomandl, B., Nimsky, C., Greiner, G., Hastreiter, P.: Automatic adjustment of bidimensional transfer functions for direct volume visualization of intracranial aneurysms. In Medical Imaging 2004, pp. 275–284. International Society for Optics and Photonics (2004)

  10. Hurter, C., Taylor, R., Carpendale, S., Telea, A.: Color tunneling: interactive exploration and selection in volumetric datasets. In: IEEE Pacific Visualization Symposium (PacificVis), IEEE Pacific, pp. 225–232 (2014)

  11. Ip, C.Y., Varshney, A., JaJa, J.: Hierarchical exploration of volumes using multilevel segmentation of the intensity-gradient histograms. IEEE Trans. Visua. Comput. Graph. 18(12), 2355–2363 (2012)

    Article  Google Scholar 

  12. Isenberg, T.: Position paper: touch interaction in scientific visualization. In: Proceedings of the Workshop on Data Exploration on Interactive Surfaces (DEXIS 2011, November 13, 2011, Kobe, Japan), pp. 24–27. INRIA (2011)

  13. Jönsson, D., Falk, M., Ynnerman, A.: Intuitive exploration of volumetric data using dynamic galleries. IEEE Trans. Visual. Comput. Graph. 22(1), 896–905 (2016)

    Article  Google Scholar 

  14. Kindlmann, G.: Transfer functions in direct volume rendering: design, interface, interaction. In: Course Notes of ACM SIGGRAPH, vol. 3 (2002)

  15. Kniss, J., Kindlmann, G., Hansen, C.: Interactive volume rendering using multi-dimensional transfer functions and direct manipulation widgets. In: Proceedings of the Conference on Visualization’01, pp. 255–262. IEEE Computer Society (2001)

  16. Konig, A., Gröller, E.: Mastering transfer function specification by using volumePro technology. In: Proceedings of Computer Graphics’01, vol. 17, pp. 279–286 (2001)

  17. Latulipe, C.: A Symmetric Interaction Model for Bimanual Input. University of Waterloo, Waterloo (2006)

    Google Scholar 

  18. Li, L., Peng, H., Chen, X., Cheng, J., Gao, D.: Visualization of boundaries in volumetric data sets through a what material you pick is what boundary you see approach. Comput. Methods Programs Biomed. 126, 76–88 (2016)

    Article  Google Scholar 

  19. Liu, B., Wuensche, B., Ropinski, T.: Visualization by example-a constructive visual component-based interface for direct volume rendering. In: International Conference on Computer Graphics Theory and Applications, 17–21 May, Angers, France, pp. 254–259 (2010)

  20. Lundström, C., Ynnerman, A., Ljung, P., Persson, A., Knutsson, H.: The alpha-histogram: using spatial coherence to enhance histograms and transfer function design. In: Proceedings Eurographics/IEEE-VGTC Symp, Visualization (EuroVis) (2006)

  21. Marks, J., Andalman, B., Beardsley, P. A., Freeman, W., Gibson, S., Hodgins, J., Kang, T., Mirtich, B., Pfister, H., Ruml, W., Ryall, K., Seims, J., Shieber, S.: Design galleries: a general approach to setting parameters for computer graphics and animation. In: Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH ’97), pp. 389–400 (1997)

  22. Praßni, J. S., Ropinski, T., Hinrichs, K.: Efficient boundary detection and transfer function generation in direct volume rendering. In: 14th International Fall Workshop on Vision, Modeling, and Visualization (VMV 2009), November 16-18, 2009, Braunschweig, Germany, pp. 285–294 (2009)

  23. Praßni, J. S., Ropinski, T., Mensmann, J., Hinrichs, K.: Shape-based transfer functions for volume visualization. In: Visualization Symposium (PacificVis), IEEE Pacific, pp. 9–16 (2010)

  24. Roettger, S., Bauer, M., Stamminger, M.: Spatialized transfer functions. EuroVis, pp. 271–278 (2005)

  25. Ropinski, T., Praßni, J., Steinicke, F., Hinrichs, K.: Stroke-based transfer function design. In: Proceedings of the Fifth Eurographics/IEEE VGTC Conference on Point-Based Graphics, August 10–11, 2008, Los Angeles, CA, pp. 41–48 (2008)

  26. Sereda, P., Bartroli, A.V., Serlie, I.W.O., Gerritsen, F.A.: Visualization of boundaries in volumetric data sets using LH histograms. IEEE Trans. Visual. Comput. Graph. 12(2), 208–218 (2006)

    Article  Google Scholar 

  27. Wiebel, A., Vos, F.M., Foerster, D., Hege, H.C.: WYSIWYP: what you see is what you pick. IEEE Trans. Visual. Comput. Graph. 18(12), 2236–2244 (2012)

    Article  Google Scholar 

  28. Wu, Y., Qu, H.: Interactive transfer function design based on editing direct volume rendered images. IEEE Trans. Visual. Comput. Graph. 13(5), 1027–1040 (2007)

    Article  Google Scholar 

Download references

Acknowledgements

All authors are thankful for the financial support given by Portuguese Foundation for Science and Technology (FCT). In particular, the first author thanks for the postdoctoral grant SFRH/BPD/97449/2013. This work was also partially supported by national funds through FCT with reference UID/CEC/50021/2013 and IT-MEDEX PTDC/EEI-SII/6038/2014.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Daniel Simões Lopes.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (mp4 33168 KB)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lopes, D.S., Parreira, P.F., Mendes, A.R. et al. Explicit design of transfer functions for volume-rendered images by combining histograms, thumbnails, and sketch-based interaction. Vis Comput 34, 1713–1723 (2018). https://doi.org/10.1007/s00371-017-1448-8

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00371-017-1448-8

Keywords

Navigation