research-article

Improving Interaction in HMD-Based Vehicle Simulators through Real Time Object Reconstruction

Authors:

Michael Bottone,

Kyle JohnsenAuthors Info & Claims

SUI '16: Proceedings of the 2016 Symposium on Spatial User Interaction

Pages 111 - 120

https://doi.org/10.1145/2983310.2985761

Published: 15 October 2016 Publication History

Abstract

Bringing real objects into the virtual world has been shown to increase usability and presence in virtual reality applications. This paper presents a system to generate a real time virtual reconstruction of real world user interface elements for use in a head mounted display based driving simulator. Our system uses sensor fusion algorithms to combine data from depth and color cameras to generate an accurate, detailed, and fast rendering of the user's hands while using the simulator. We tested our system and show in our results that the inclusion of the participants real hands, the wheel, and the shifter in the virtual environment increases the immersion, presence, and usability of the simulation. Our system can also be used to bring other real objects into the virtual world, especially when accuracy, detail, and real time updates are desired.

Supplementary Material

MP4 File (p111-bottone.mp4)

Download
255.28 MB

References

[1]

CMG. http://www.cmgl.ca. Accessed: 2016-07-01.

[2]

Hover vr interface kit. https://github.com/aestheticinteractive/Hover-VR-InterfaceKit. Accessed: 2016-07-01.

[3]

Middlevr for Unity. http://www.middlevr.com/middlevr-forunity. Accessed: 2016-07-01.

[4]

Schlumberger petrel. http://www.software.slb.com/products/petrel. Accessed: 2016-07-01.

[5]

R. Cossé. Basics of reservoir engineering: oil and gas field development techniques. Editions Technip, 1993.

[6]

F. M. de Carvalho, E. V. Brazil, R. G. Marroquim, M. C. Sousa, and A. Oliveira. Interactive cutaways of oil reservoirs. Graphical Models, 84:1--=14, 2016.

Digital Library

[7]

D. Denney et al. 3d visualization: A common language for the drilling and subsurface communities. Journal of petroleum technology, 57(04):80--=83, 2005.

[8]

D. R. Fenik, A. Nouri, and C. Deutsch. Ranking realizations for sagd performance predictions. Published report http://www. ccgalberta.com/ccgresources/report11/2009--204 ranking realizations for sagd. pdf, 2009.

[9]

R. Graves, J. Turley, B. Macon, et al. Educating for leadership, management and teamwork. In SPE Annual Technical Conference and Exhibition. Society of Petroleum Engineers, 1995

[10]

J. Harris, J. Young, N. Sultanum, P. Lapides, E. Sharlin, and M. C. Sousa. Designing snakey: a tangible user interface supporting well path planning. In Interact 2011.

Digital Library

[11]

K. Hird, O. Dubrule, et al. Quantification of reservoir connectivity for reservoir description applications. SPE Reservoir Evaluation & Engineering, 1(01):12--=17, 1998.

[12]

J. Hovadik and D. Larue. Stratigraphic and structural connectivity. Geological Society, London, Special Publications, 347(1):219--=242, 2010.

[13]

J. Hovadik and D. Larue. Predicting waterflood behavior by simulating earth models with no or limited dynamic data: From model ranking to simulating a billion-cell model. 2011.

[14]

J. M. Hovadik and D. K. Larue. Static characterizations of reservoirs: refining the concepts of connectivity and continuity. Petroleum Geoscience, 13(3):195--=211, 2007.

[15]

H. Ishii and B. Ullmer. Tangible bits: towards seamless interfaces between people, bits and atoms. In Proceedings of the ACM SIGCHI Conference on Human factors in computing systems, pages 234--=241. ACM, 1997.

Digital Library

[16]

G. L. Kinsland and C. W. Borst. Visualization and interpretation of geologic data in 3d virtual reality. Interpretation, 3(3):SX13--=SX20, 2015.

[17]

D. K. Larue and J. Hovadik. Connectivity of channelized reservoirs: a modelling approach. Petroleum Geoscience, 12(4):291--=308, 2006.

[18]

E. M. Lidal, T. Langeland, C. Giertsen, J. Grimsgaard, and R. Helland. A decade of increased oil recovery in virtual reality. IEEE Computer Graphics and Applications, 27(6):94--=97, 2007.

Digital Library

[19]

K. Gruchalla. Immersive well-path editing: investigating the added value of immersion. In Virtual Reality, 2004. Proceedings. IEEE, pages 157--=164. IEEE, 2004.

Digital Library

[20]

E. D. Ragan, R. Kopper, P. Schuchardt, and D. A. Bowman. Studying the effects of stereo, head tracking, and field of regard on a small-scale spatial judgment task. IEEE Transactions on Visualization and Computer Graphics, 19(5):886--=896, 2013.

Digital Library

[21]

M. Sharifi, M. Kelkar, A. Bahar, T. Slettebo, et al. Dynamic ranking of multiple realizations by use of the fast-marching method. SPE Journal, 19(06):1--=069, 2014.

[22]

S. Somanath. Exploring tabletops as an interaction medium in the context of reservoir engineering. Master's thesis, University of Calgary, Citeseer, 2012.

[23]

S. Somanath, A. Rocha, H. Hamdi, E. Sharlin, and M. C. Sousa. Reservoirbench: An interactive educational reservoir engineering workbench. In Human-Computer Interaction, pages 340--=348. Springer, 2015.

[24]

N. Sultanum, E. Sharlin, M. C. Sousa, D. N. Miranda-Filho, and R. Eastick. Touching the depths: introducing tabletop interaction to reservoir engineering. In ACM International Conference on Interactive Tabletops and Surfaces, pages 105--=108. ACM, 2010.

Digital Library

[25]

N. Sultanum, S. Somanath, E. Sharlin, and M. C. Sousa. Point it, split it, peel it, view it: techniques for interactive reservoir visualization on tabletops. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces, pages 192--=201. ACM, 2011.

Digital Library

[26]

C. Ware and G. Franck. Evaluating stereo and motion cues for visualizing information nets in three dimensions. ACM Transactions on Graphics (TOG), 15(2):121--=140, 1999.

Digital Library

Cited By

Pettersson IKarlsson MGhiurau FHarrison SBardzell SNeustaedter CTatar D(2019)Virtually the Same Experience?Proceedings of the 2019 on Designing Interactive Systems Conference10.1145/3322276.3322288(463-473)Online publication date: 18-Jun-2019
https://dl.acm.org/doi/10.1145/3322276.3322288
Herrera-Luna IRechy-Ramirez ERios-Figueroa HMarin-Hernandez A(2019)Sensor Fusion Used in Applications for Hand Rehabilitation: A Systematic ReviewIEEE Sensors Journal10.1109/JSEN.2019.289708319:10(3581-3592)Online publication date: 15-May-2019
https://doi.org/10.1109/JSEN.2019.2897083
Born FMasuch M(2018)Increasing Presence in a Mixed Reality Application by Integrating a Real Time Tracked Full Body RepresentationAdvances in Computer Entertainment Technology10.1007/978-3-319-76270-8_4(46-60)Online publication date: 21-Feb-2018
https://doi.org/10.1007/978-3-319-76270-8_4

Index Terms

Improving Interaction in HMD-Based Vehicle Simulators through Real Time Object Reconstruction
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods
      1. Usability testing
    2. Interaction paradigms
      1. Virtual reality

Recommendations

Integration of a Precise Indoor Position Tracking Algorithm with an HMD-Based Virtual Reality System
ImmersiveMe '14: Proceedings of the 2nd ACM International Workshop on Immersive Media Experiences

In this paper, we present a new system for a highly immersive virtual reality experience utilizing head-mounted displays (HMDs) with accurate indoor-position tracking abilities. The system is designed to have six degrees of freedom in the virtual world, ...
Effects of dynamic field-of-view restriction on cybersickness and presence in HMD-based virtual reality
Abstract
The phenomenon of cybersickness is currently hindering the mass market adoption of head-mounted display (HMD) virtual reality (VR) technologies. This study examined the effects of dynamic field-of-view (FOV) restriction on the cybersickness ...
Real virtuality: a step change from virtual reality
SCCG '09: Proceedings of the 25th Spring Conference on Computer Graphics

Humans perceive the world with all five senses: visuals, audio, smell, touch and taste. Crossmodal effects, i.e. the interaction of the senses, can have a major influence on how environments are being perceived, even to the extent that large amounts of ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SUI '16: Proceedings of the 2016 Symposium on Spatial User Interaction

October 2016

236 pages

ISBN:9781450340687

DOI:10.1145/2983310

General Chair:
Christian Sandor
Nara Institute of Science and Technology, Japan
,
Program Chairs:
Robert Teather
Carleton University, Canada
,
Evan Suma
University of Southern California, USA
,
Kyle Johnsen
University Of Georgia, USA

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques
SIGCHI: ACM Special Interest Group on Computer-Human Interaction
VRSJ SIG-MR: Virtual Reality Society of Japan, Special Interest Group on Mixed Reality

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 October 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

SUI '16

Sponsor:

SIGGRAPH
SIGCHI
VRSJ SIG-MR

SUI '16: Symposium on Spatial User Interaction

October 15 - 16, 2016

Tokyo, Japan

Acceptance Rates

SUI '16 Paper Acceptance Rate 20 of 77 submissions, 26%;

Overall Acceptance Rate 86 of 279 submissions, 31%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
263
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)0

Reflects downloads up to 07 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Pettersson IKarlsson MGhiurau FHarrison SBardzell SNeustaedter CTatar D(2019)Virtually the Same Experience?Proceedings of the 2019 on Designing Interactive Systems Conference10.1145/3322276.3322288(463-473)Online publication date: 18-Jun-2019
https://dl.acm.org/doi/10.1145/3322276.3322288
Herrera-Luna IRechy-Ramirez ERios-Figueroa HMarin-Hernandez A(2019)Sensor Fusion Used in Applications for Hand Rehabilitation: A Systematic ReviewIEEE Sensors Journal10.1109/JSEN.2019.289708319:10(3581-3592)Online publication date: 15-May-2019
https://doi.org/10.1109/JSEN.2019.2897083
Born FMasuch M(2018)Increasing Presence in a Mixed Reality Application by Integrating a Real Time Tracked Full Body RepresentationAdvances in Computer Entertainment Technology10.1007/978-3-319-76270-8_4(46-60)Online publication date: 21-Feb-2018
https://doi.org/10.1007/978-3-319-76270-8_4

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten