research-article

Slice WIM: a multi-surface, multi-touch interface for overview+detail exploration of volume datasets in virtual reality

Authors:

Nicholas Malbraaten,

Iman Borazjani,

Fotis Sotiropoulos,

Daniel F. KeefeAuthors Info & Claims

I3D '11: Symposium on Interactive 3D Graphics and Games

Pages 191 - 198

https://doi.org/10.1145/1944745.1944777

Published: 18 February 2011 Publication History

Abstract

We present Slice WIM, a method for overview+detail visualization of volume datasets that explores the potential of new interfaces made possible by a virtual reality (VR) environment made of two display surfaces: an interactive multi-touch table, and a stereoscopic display wall. Slice WIM displays a miniature version of the 3D dataset within a head-tracked stereoscopic view such that it appears to float directly above the multi-touch table. Multi-touch gestures on the table are then used to navigate through the dataset and to set slices (cutting planes) through the data. Leveraging the unique table+wall hardware setup, horizontal slices through the data are projected (like a shadow) down onto the table surface, providing a useful 2D data overview to complement the 3D views as well as a data context for interpreting 2D multi-touch gestures made on the table. We demonstrate several strategies for interacting with 2D "shadow slices" on the table surface as a method for controlling the WIM and exploring volumetric datasets. Applications of the interface to explore two different volume datasets are presented, and design decisions and limitations are discussed along with feedback from both casual users and domain scientists.

Supplementary Material

M4V File (p191-coffey.m4v)

Download
72.82 MB

References

[1]

Baldonado, M. Q. W., Woodruff, A., and Kuchinsky, A. 2000. Guidelines for using multiple views in information visualization. In Proceedings of the working conference on Advanced visual interfaces, ACM, Palermo, Italy, 110--119.

Digital Library

[2]

Baudisch, P., Good, N., and Stewart, P. 2001. Focus plus context screens: combining display technology with visualization techniques. In Proceedings of the 14th annual ACM symposium on User interface software and technology, ACM, Orlando, Florida, 31--40.

Digital Library

[3]

Baudisch, P., Good, N., Bellotti, V., and Schraedley, P. 2002. Keeping things in context: A comparative evaluation of focus plus context screens, overviews, and zooming. 259--266.

Digital Library

[4]

Benko, H., and Feiner, S. 2007. Balloon selection: A MultiFinger technique for accurate Low-Fatigue 3D selection. In IEEE Symposium on 3D User Interfaces, 2007. 3DUI '07.

[5]

Bryson, S. 1996. Virtual reality in scientific visualization. Communications of the ACM 39, 5, 62--71.

Digital Library

[6]

Butkiewicz, T., Dou, W., Wartell, Z., Ribarsky, W., and Chang, R. 2008. Multi-Focused geospatial analysis using probes. IEEE Transactions on Visualization and Computer Graphics 14, 6, 1165--1172.

Digital Library

[7]

Cockburn, A., Karlson, A., and Bederson, B. B. 2008. A review of overview+detail, zooming, and focus+context interfaces. ACM Computing Surveys (CSUR) 41, 1, 1--31.

Digital Library

[8]

Coffey, D., Korsakov, F., and Keefe, D. F. 2010. Low cost VR meets low cost multi-touch. In Proceedings of International Symposium on Visual Computing, 351--360.

Digital Library

[9]

Everts, M. H., Bekker, H., Roerdink, J. B., and Isenberg, T. 2009. Depth-Dependent halos: Illustrative rendering of dense line data. IEEE Transactions on Visualization and Computer Graphics 15, 6, 1299--1306.

Digital Library

[10]

Flider, M. J., and Bailey, B. P. 2004. An evaluation of techniques for controlling focus+context screens. In Proceedings of Graphics Interface 2004, Canadian Human-Computer Communications Society, London, Ontario, Canada, 135--144.

Digital Library

[11]

Grossman, T., and Balakrishnan, R. 2006. The design and evaluation of selection techniques for 3D volumetric displays. In Proceedings of the 19th annual ACM symposium on User interface software and technology, ACM, Montreux, Switzerland, 3--12.

Digital Library

[12]

Hachet, M., and Guitton, P. 2002. The interaction table: a new input device designed for interaction in immersive large display environments. In Proceedings of the workshop on Virtual environments 2002, Eurographics Association, Barcelona, Spain, 189--196.

Digital Library

[13]

Han, J. Y. 2005. Low-cost multi-touch sensing through frustrated total internal reflection. In Proceedings of the 18th annual ACM symposium on User interface software and technology, ACM, Seattle, WA, USA, 115--118.

Digital Library

[14]

Hentschel, B., Tedjo, I., Probst, M., Wolter, M., Behr, M., Bischof, C., and Kuhlen, T. 2008. Interactive blood damage analysis for ventricular assist devices. IEEE Transactions on Visualization and Computer Graphics 14, 6, 1515--1522.

Digital Library

[15]

Herndon, K. P., Zeleznik, R. C., Robbins, D. C., Conner, D. B., Snibbe, S. S., and Dam, A. V. 1992. Interactive shadows. 1--6.

Digital Library

[16]

Hornecker, E., Marshall, P., Dalton, N. S., and Rogers, Y. 2008. Collaboration and interference: awareness with mice or touch input. In Proceedings of the 2008 ACM conference on Computer supported cooperative work, ACM, San Diego, CA, USA, 167--176.

Digital Library

[17]

John, M. S., Cowen, M. B., Smallman, H. S., and Oonk, H. M. 2001. The use of 2D and 3D displays for shape-understanding versus relative-position tasks. Human Factors 43, 1, 79--98.

[18]

Keefe, D. F., Sotiropoulos, F., Interrante, V., Runesha, B. H., Coffey, D., Staker, M., Lin, C., Sun, Y., Boraznani, I., Rowe, N., and Erdman, A. 2010. A process for design, verification, validation, and manufacture of medical devices using immersive VR environments. ASME Journal of Medical Devices 4, 4, 045002--6.

[19]

Kin, K., Agrawala, M., and DeRose, T. 2009. Determining the benefits of direct-touch, bimanual, and multifinger input on a multitouch workstation. In Proceedings of Graphics Interface 2009, Canadian Information Processing Society, Kelowna, British Columbia, Canada, 119--124.

Digital Library

[20]

Kruger, W., Bohn, C., Frhlich, B., Schth, H., Strauss, W., and Wesche, G. 1994. The responsive workbench. IEEE Computer Graphics AND Applications 14, 12--15.

Digital Library

[21]

LaViola, J. J. J., Feliz, D. A., Keefe, D. F., and Zeleznik, R. C. 2001. Hands-free multi-scale navigation in virtual environments. In Proceedings of the 2001 symposium on Interactive 3D graphics, ACM, 9--15.

Digital Library

[22]

Li, Y., Fu, C.-W., and Hanson, A. 2006. Scalable wim: Effective exploration in large-scale astrophysical environments. IEEE Transactions on Visualization and Computer Graphics 12, 1005--1012.

Digital Library

[23]

Pausch, R., Burnette, T., Brockway, D., and Weiblen, M. E. 1995. Navigation and locomotion in virtual worlds via flight into hand-held miniatures. In Proceedings of the 22nd annual conference on Computer graphics and interactive techniques, ACM, 399--400.

Digital Library

[24]

Piringer, H., Kosara, R., and Hauser, H. 2004. Interactive Focus+Context visualization with linked 2D/3D scatterplots. In Proceedings of the Second International Conference on Coordinated \& Multiple Views in Exploratory Visualization, IEEE Computer Society, 49--60.

Digital Library

[25]

Robles-De-La-Torre, G. 2006. The importance of the sense of touch in virtual and real environments. IEEE MultiMedia 13, 3, 24--30.

Digital Library

[26]

Simon, H. A., Ge, L., Borazjani, I., Sotiropoulos, F., and Yoganathan, A. P. 2010. Simulation of the three-dimensional hinge flow fields of a bileaflet mechanical heart valve under aortic conditions. Annals of Biomedical Engineering 38, 3 (Mar.), 841--853.

[27]

Sobel, J. S., Forsberg, A. S., Laidlaw, D. H., Zeleznik, R. C., Keefe, D. F., Pivkin, I., Karniadakis, G. E., Richardson, P., and Swartz, S. 2004. Particle flurries: synoptic 3D pulsatile flow visualization. IEEE Computer Graphics and Applications 24, 2 (Apr.), 76--85.

Digital Library

[28]

Spindler, M., Stellmach, S., and Dachselt, R. 2009. PaperLens: advanced magic lens interaction above the tabletop. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces, ACM, Banff, Alberta, Canada, 69--76.

Digital Library

[29]

Stoakley, R., Conway, M. J., and Pausch, R. 1995. Virtual reality on a WIM: interactive worlds in miniature. In Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Press/Addison-Wesley Publishing Co., Denver, Colorado, United States, 265--272.

Digital Library

[30]

Tory, M., Kirkpatrick, A. E., Atkins, M. S., and Moller, T. 2006. Visualization task performance with 2D, 3D, and combination displays. IEEE Transactions on Visualization and Computer Graphics 12, 1, 2--13.

Digital Library

[31]

Trueba, R., Andujar, C., and Argelaguet, F. 2009. Complexity and occlusion management for the World-in-Miniature metaphor. In Smart Graphics. 155--166.

Digital Library

[32]

Valkov, D., Steinicke, F., Bruder, G., Hinrichs, K., Schoning, J., Daiber, F., and Kruger, A. 2010. Touching floating objects in projection-based virtual reality environments. In VSBHSDK10, Eurographics.

Digital Library

[33]

Wigdor, D., Shen, C., Forlines, C., and Balakrishnan, R. 2006. Table-centric interactive spaces for real-time collaboration. In Proceedings of the working conference on Advanced visual interfaces, ACM, Venezia, Italy, 103--107.

Digital Library

[34]

Wingrave, C. A., Haciahmetoglu, Y., and Bowman, D. A. 2006. Overcoming world in miniature limitations by a scaled and scrolling WIM. In Proceedings of the IEEE conference on Virtual Reality, IEEE Computer Society, 11--16.

Digital Library

[35]

Yu, L., Svetachov, P., Isenberg, P., Everts, M. H., and Isenberg, T. 2010. FI3D: Direct-Touch interaction for the exploration of 3D scientific visualization spaces. IEEE Transactions on Visualization and Computer Graphics 16(6), November/December 2010, 1613--1622.

Digital Library

Cited By

Huang XYin MXia ZXiao R(2024)VirtualNexus: Enhancing 360-Degree Video AR/VR Collaboration with Environment Cutouts and Virtual ReplicasProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676377(1-12)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676377
Friedl‐Knirsch JPointecker FPfistermüller SStach CAnthes CRoth D(2024)A Systematic Literature Review of User Evaluation in Immersive AnalyticsComputer Graphics Forum10.1111/cgf.1511143:3Online publication date: 10-Jun-2024
https://doi.org/10.1111/cgf.15111
Brument HLautenbach TPodkosova I(2024)Spatial Awareness and User Preferences During Group Locomotion in Virtual Reality: A Study with Four-User Groups2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)10.1109/VRW62533.2024.00078(403-409)Online publication date: 16-Mar-2024
https://doi.org/10.1109/VRW62533.2024.00078
Show More Cited By

Index Terms

Slice WIM: a multi-surface, multi-touch interface for overview+detail exploration of volume datasets in virtual reality

Recommendations

WIM: Fast Locomotion in Virtual Reality with Spatial Orientation Gain & without Motion Sickness
MUM '18: Proceedings of the 17th International Conference on Mobile and Ubiquitous Multimedia

For locomotion in Virtual Reality (VR), different approaches exist. While continuously moving across the ground through walking techniques or controller input is considered to be most similar compared to the way we move through physical space, this ...
Virtual reality on a WIM: interactive worlds in miniature
CHI '95: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Interactive Slice WIM: Navigating and Interrogating Volume Data Sets Using a Multisurface, Multitouch VR Interface

We present Interactive Slice World-in-Miniature (WIM), a framework for navigating and interrogating volumetric data sets using an interface enabled by a virtual reality environment made of two display surfaces: an interactive multitouch table, and a ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

I3D '11: Symposium on Interactive 3D Graphics and Games

February 2011

207 pages

ISBN:9781450305655

DOI:10.1145/1944745

General Chairs:
Michael Garland
NVIDIA Research
,
Rui Wang
University of Massachusetts

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 February 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article

Funding Sources

National Institutes of Health

Conference

I3D '11

Sponsor:

SIGGRAPH

I3D '11: Symposium on Interactive 3D Graphics and Games

February 18 - 20, 2011

California, San Francisco

Acceptance Rates

I3D '11 Paper Acceptance Rate 24 of 64 submissions, 38%;

Overall Acceptance Rate 148 of 485 submissions, 31%

Upcoming Conference

I3D '25

Sponsor:
siggraph

Symposium on Interactive 3D Graphics and Games

May 7 - 9, 2025

Jersey City , NJ , USA

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

39
Total Citations
View Citations
1,074
Total Downloads

Downloads (Last 12 months)42
Downloads (Last 6 weeks)3

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Huang XYin MXia ZXiao R(2024)VirtualNexus: Enhancing 360-Degree Video AR/VR Collaboration with Environment Cutouts and Virtual ReplicasProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676377(1-12)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676377
Friedl‐Knirsch JPointecker FPfistermüller SStach CAnthes CRoth D(2024)A Systematic Literature Review of User Evaluation in Immersive AnalyticsComputer Graphics Forum10.1111/cgf.1511143:3Online publication date: 10-Jun-2024
https://doi.org/10.1111/cgf.15111
Brument HLautenbach TPodkosova I(2024)Spatial Awareness and User Preferences During Group Locomotion in Virtual Reality: A Study with Four-User Groups2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)10.1109/VRW62533.2024.00078(403-409)Online publication date: 16-Mar-2024
https://doi.org/10.1109/VRW62533.2024.00078
Assor AProuzeau AHachet MDragicevic P(2024)Handling Non-Visible Referents in Situated VisualizationsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.332736130:1(1336-1346)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1109/TVCG.2023.3327361
Xiao YLiu L(2024)User-Defined Interactions for Visual Data Exploration With the Combination of Smartwatch and Large DisplayIEEE Access10.1109/ACCESS.2024.340487612(78657-78679)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3404876
Kellmann APostema Mde Keijser JSvetachov PWilson Rvan Enckevort ESwertz M(2024)Visualization and exploration of linked data using virtual realityDatabase10.1093/database/baae0082024Online publication date: 23-Feb-2024
https://doi.org/10.1093/database/baae008
Yu KEck UPankratz FLazarovici MWilhelm DNavab N(2022)Duplicated Reality for Co-located Augmented Reality CollaborationIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.315052028:5(2190-2200)Online publication date: May-2022
https://doi.org/10.1109/TVCG.2022.3150520
Zhao LCao NHe SLiang HYu L(2022)L-WiM: Collaborative Exploration in Immersive Environments2022 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)10.1109/ISMAR-Adjunct57072.2022.00031(118-123)Online publication date: Oct-2022
https://doi.org/10.1109/ISMAR-Adjunct57072.2022.00031
Herman BOmdal MZeller SRichter CSamsel FAbram GKeefe D(2021)Multi-Touch Querying on Data Physicalizations in Immersive ARProceedings of the ACM on Human-Computer Interaction10.1145/34885425:ISS(1-20)Online publication date: 5-Nov-2021
https://dl.acm.org/doi/10.1145/3488542
Danyluk KEns BJenny BWillett WKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)A Design Space Exploration of Worlds in MiniatureProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445098(1-15)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445098
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten