abstract

A Method of Estimating the Object of Interest from 3D Object and User’s Gesture in VR

Authors:

Youn-Hee GilAuthors Info & Claims

VRST '22: Proceedings of the 28th ACM Symposium on Virtual Reality Software and Technology

Article No.: 37, Pages 1 - 2

https://doi.org/10.1145/3562939.3565652

Published: 29 November 2022 Publication History

Get Access

Abstract

In VR, gaze information is useful for directly or indirectly analyzing a user’s interest. However, there are inconveniences in using the eye tracking in the VR device. To overcome the drawback, we propose a method of estimating an object of interest from user’s gesture instead of eye tracking. LightGBM model is trained by using distance and angle-based features that are extracted from 3d information of the object and the position and rotation of the VR device. We compared accuracy of each feature for VR device combinations and found out that it is more efficient to use all devices instead of individual devices and to use angle-based feature instead of distance-based feature with accuracy of 79.36%.

References

[1]

Zheng Chin, Zhuo Zhang, Chuanchu Wang, and Kai Ang. 2021. An Affective Interaction System using Virtual Reality and Brain-Computer Interface, Vol. 2021. 6183–6186. https://doi.org/10.1109/EMBC46164.2021.9630045

Crossref

Google Scholar

[2]

Sungjin Hong, Heesook Shin, Younhee Gil, and Junghee Jo. 2021. Analyzing Visual Attention of People with Intellectual Disabilities during Virtual Reality-Based Job Training. Electronics 10 (07 2021), 1652. https://doi.org/10.3390/electronics10141652

Crossref

Google Scholar

[3]

Runze Mao, Guoyuan Li, Hans Hildre, and Houxiang Zhang. 2019. Analysis and Evaluation of Eye Behavior for Marine Operation Training - A Pilot Study. Journal of Eye Movement Research 12 (12 2019). https://doi.org/10.16910/jemr.12.3.6

Crossref

Google Scholar

[4]

Denis Tomè, Thiemo Alldieck, Patrick Peluse, Gerard Pons-Moll, Lourdes Agapito, Hernán Badino, and Fernando De la Torre. 2020. SelfPose: 3D Egocentric Pose Estimation from a Headset Mounted Camera. CoRR abs/2011.01519(2020). arXiv:2011.01519https://arxiv.org/abs/2011.01519

Google Scholar

Index Terms

A Method of Estimating the Object of Interest from 3D Object and User’s Gesture in VR
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction techniques
      1. Gestural input

Recommendations

User-friendly 3D object manipulation gesture using kinect
VRCAI '13: Proceedings of the 12th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and Its Applications in Industry

With the rapid development and wide spread of the virtual reality technology, we can easily find VR systems in various places such as school, library and home. Translation and rotation, the most frequently used gestures for manipulating objects in the ...
Grasping 3D Objects With Virtual Hand in VR Environment
VRCAI '22: Proceedings of the 18th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry

Virtual hands are typically hidden after grasping an object in Virtual Reality (VR) environments in existing virtual hand grasping works, which significantly impact user experience. In this paper, we build a real-time, flexible, robust and natural ...
Object manipulation based on the head manipulation space in VR
Abstract
Object manipulation is fundamental in virtual and augmented reality, where efficiency and accuracy are crucial. However, repetitive object manipulation tasks using the hands can lead to arm fatigue, and in some scenarios, hands may not be ...
Graphical abstract

Display Omitted
Highlights
- We construct the comfortable zone for head movement firstly.
- For the first time, we propose an object manipulation method with adaptive gain based on head movement.
- Our method is feasible in terms of task completion efficiency and ...

Comments

Information & Contributors

Information

Published In

VRST '22: Proceedings of the 28th ACM Symposium on Virtual Reality Software and Technology

November 2022

466 pages

ISBN:9781450398893

DOI:10.1145/3562939

Editors:
Takafumi Koike
Hosei University, Japan
,
Naoya Koizumi
The University of Electro-Communications, Japan
,
Gerd Bruder
University of Central Florida, USA
,
Daniel Roth
Friedrich-Alexander-Universität Erlangen-Nürnberg, Germany
,
Kazuki Takashima
Tohoku University, Japan
,
Takefumi Hiraki
University of Tsukuba, Japan
,
Yuki Ban
The University of Tokyo, Japan
,
Michal Piovarci
Institute of Science and Technology Austria, Austria

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 November 2022

Check for updates

Author Tags

Qualifiers

Abstract
Research
Refereed limited

Funding Sources

Electronics and Telecommunications Research Institute

Conference

VRST '22

Sponsor:

VRST '22: 28th ACM Symposium on Virtual Reality Software and Technology

November 29 - December 1, 2022

Tsukuba, Japan

Acceptance Rates

Overall Acceptance Rate 66 of 254 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

0
Total Citations
128
Total Downloads

Downloads (Last 12 months)26
Downloads (Last 6 weeks)1

Reflects downloads up to 27 Feb 2025

Other Metrics

View Author Metrics

Citations

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Abstract

References

Index Terms

Recommendations

User-friendly 3D object manipulation gesture using kinect

Grasping 3D Objects With Virtual Hand in VR Environment

Object manipulation based on the head manipulation space in VR

Comments

Information

Published In

Sponsors

Publisher

Publication History

Check for updates

Author Tags

Qualifiers

Funding Sources

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Login options

Full Access

View options

PDF

eReader

HTML Format

Share

Share this Publication link

Share on social media

Affiliations