research-article

Touching the Sphere: Leveraging Joint-Centered Kinespheres for Spatial User Interaction

Authors:

Frank SteinickeAuthors Info & Claims

SUI '16: Proceedings of the 2016 Symposium on Spatial User Interaction

Pages 13 - 22

https://doi.org/10.1145/2983310.2985753

Published: 15 October 2016 Publication History

Abstract

Designing spatial user interfaces for virtual reality (VR) applications that are intuitive, comfortable and easy to use while at the same time providing high task performance is a challenging task. This challenge is even harder to solve since perception and action in immersive virtual environments differ significantly from the real world, causing natural user interfaces to elicit a dissociation of perceptual and motor space as well as levels of discomfort and fatigue unknown in the real world. In this paper, we present and evaluate the novel method to leverage joint-centered kinespheres for interactive spatial applications. We introduce kinespheres within arm's reach that envelope the reachable space for each joint such as shoulder, elbow or wrist, thus defining 3D interactive volumes with the boundaries given by 2D manifolds. We present a Fitts' Law experiment in which we evaluated the spatial touch performance on the inside and on the boundary of the main joint-centered kinespheres. Moreover, we present a confirmatory experiment in which we compared joint-centered interaction with traditional spatial head-centered menus. Finally, we discuss the advantages and limitations of placing interactive graphical elements relative to joint positions and, in particular, on the boundaries of kinespheres.

Supplementary Material

suppl.mov (suifp0152-file3.mp4)

Supplemental video

Download
73.13 MB

MP4 File (p13-lubos.mp4)

Download
307.51 MB

References

[1]

F. Argelaguet and C. Andujar. A survey of 3D object selection techniques for virtual environments. Computers & Graphics, 37(3):121--136, 2013.

Digital Library

[2]

O. J. Ariza Nunez, P. Lubos, and F. Steinicke. Hapring: A wearable haptic device for 3D interaction. In S. Diefenbach, N. Henze, and M. Pielot, editors, Proc. of Mensch und Computer, pages 421--424. De Gruyter Oldenbourg, 2015.

[3]

R. Balakrishnan and I. S. MacKenzie. Performance differences in the fingers, wrist, and forearm in computer input control. In Proc. of ACM CHI, CHI '97, pages 303--310. ACM, 1997.

Digital Library

[4]

G. Borg. Psychophysical bases of perceived exertion. Medicine and science in sports and exercise, 14(5):377, 1982.

[5]

D. Bowman. Interaction Techniques for Common Tasks in Immersive Virtual Environments: Design, Evaluation, and Application. PhD thesis, Georgia Institute of Technology, 1999.

Digital Library

[6]

D. Bowman and L. Hodges. An Evaluation of Techniques for Grabbing and Manipulating Remote Objects in Immersive Virtual Environments. In ACM SIGGRAPH i3D, pages 35--38, 1997.

Digital Library

[7]

J. Brooke et al. Sus-a quick and dirty usability scale. Usability evaluation in industry, 189(194):4--7, 1996.

[8]

G. Bruder, F. Steinicke, and W. Stuerzlinger. Effects of visual conflicts on 3D selection task performance in stereoscopic display environments. In Proc. of IEEE 3DUI, pages 115--118, 2013.

[9]

G. Bruder, F. Steinicke, and W. Stuerzlinger. Touching the Void Revisited: Analyses of Touch Behavior On and Above Tabletop Surfaces. Proc. of INTERACT, 8117:278--296, 2013.

[10]

S. Card, J. Mackinlay, and G. Robertson. A morphological analysis of the design space of input devices. ACM Transactions on Information Systems (TOIS), 9(2):99--122, 1991.

Digital Library

[11]

L.-W. Chan, H.-S. Kao, M. Y. Chen, M.-S. Lee, J. Hsu, and Y.-P. Hung. Touching the void: Direct-touch interaction for intangible displays. In Proc. of ACM CHI, pages 2625--2634, 2010.

Digital Library

[12]

J. Djajadiningrat. Cubby: what you see is where you act. Interlacing the display and manipulation spaces. PhD thesis, Industrial Design Engineering, Delft University of Technology, 1998.

[13]

A. Dvorkin, R. Kenyon, and E. Keshner. Reaching within a dynamic virtual environment. Journal of NeuroEngineering and Rehabilitation, 4(23), 2007.

[14]

B. M. Ens, R. Finnegan, and P. P. Irani. The Personal Cockpit: A Spatial Interface for Effective Task Switching on Head-worn Displays. In Proc. of ACM CHI, CHI '14, pages 3171--3180. ACM, 2014.

Digital Library

[15]

P. Fitts. The Information Capacity of the Human Motor System in Controlling the Amplitude of Movement. Journal of Experimental Psychology: General, 47(6):381--391, 1954.

[16]

D. Gerber and D. Bechmann. The Spin Menu: A Menu System for Virtual Environments. In Proc. of IEEE VR, VR '05, pages 271--272. IEEE Computer Society, 2005.

Digital Library

[17]

T. Grossman and R. Balakrishnan. The design and evaluation of selection techniques for 3d volumetric displays. In Proc. of ACM UIST, pages 3--12, 2006.

Digital Library

[18]

D. Guinness, A. Jude, G. Poor, and A. Dover. Models for rested touchless gestural interaction. In Proc. of ACM SUI, pages 34--43, 2015.

Digital Library

[19]

T. Ha and W. Woo. An empirical evaluation of virtual hand techniques for 3d object manipulation in a tangible augmented reality environment. In Proc. of IEEE 3DUI, pages 91--98, 2010.

Digital Library

[20]

S. G. Hart. NASA-task load index (NASA-TLX) 20 years later. In Proc. of Human Factors and Ergonomics Society Annual Meeting, pages 904--908, 2006.

[21]

International Organization for Standardization. ISO/DIS 9241--9 Ergonomic requirements for office work with visual display terminals (VDTs) - Part 9: Requirements for non-keyboard input devices, 2000.

[22]

A. Jude, G. Poor, and D. Guinness. Personal Space: User Defined Gesture Space for GUI Interaction. In Proc. of ACM CHI, pages 1615--1620, 2014.

Digital Library

[23]

R. Kennedy, N. Lane, K. Berbaum, and M. Lilienthal. Simulator Sickness Questionnaire: An Enhanced Method for Quantifying Simulator Sickness. The International Journal of Aviation Psychology, 3(3):203--220, 1993.

[24]

R. Kopper, D. A. Bowman, M. G. Silva, and R. P. McMahan. A human motor behavior model for distal pointing tasks. International Journal of Human-Computer Studies (IJHCS), 68(10):603--615, 2010.

Digital Library

[25]

D. Lemmerman and J. LaViola Jr. Effects of Interaction-Display Offset on User Performance in Surround screen virtual environments. In Proc. of IEEE VR, pages 303--304, 2007.

[26]

F. C. Y. Li, D. Dearman, and K. N. Truong. Virtual Shelves: Interactions with Orientation Aware Devices. In Proc. of ACM UIST, UIST '09, pages 125--128. ACM, 2009.

Digital Library

[27]

G. Liu, R. Chua, and J. T. Enns. Attention for perception and action: task interference for action planning, but not for online control. Experimental Brain Research, 185:709--717, 2008.

[28]

J. Loomis and J. Knapp. Visual Perception of Egocentric Distance in Real and Virtual Environments. In L. Hettinger and M. Haas, editors, Virtual and Adaptive Environments, pages 21--46. Erlbaum, 2003.

[29]

P. Lubos, G. Bruder, and F. Steinicke. Analysis of Direct Selection in Head-Mounted Display Environments. In Proc. of IEEE 3DUI, pages 1--8, 2014.

[30]

P. Lubos, G. Bruder, and F. Steinicke. Influence of Comfort on 3D Selection Task Performance in Immersive Desktop Setups. Journal of Virtual Reality and Broadcasting (JVRB), 12(2), 2015.

[31]

C. MacKenzie, R. Marteniuka, C. Dugasa, D. Liskea, and B. Eickmeiera. Three-dimensional movement trajectories in Fitts' task: Implications for control. The Quarterly Journal of Experimental Psychology A, 34(4):629--647, 1987.

[32]

I. MacKenzie and P. Isokoski. Fitts throughput and the speed-accuracy tradeoff. In Proc. of ACM CHI, pages 1633--1636, 2008.

Digital Library

[33]

S. Mann. Intelligent Image Processing. John Wiley and Sons, 2001.

Digital Library

[34]

J. McLester and P. S. Pierre. Applied Biomechanics: Concepts and Connections. Cengage Learning, 2007.

[35]

M. Mine, F. B. Jr, and C. Sequin. Moving Objects in Space: Exploiting Proprioception in Virtual-Environment interaction. In Proc. of ACM SIGGRAPH, pages 19--26, 1997.

Digital Library

[36]

A. Murata and H. Iwase. Extending Fitts' Law to a three-dimensional pointing task. Human Movement Science, 20:791--805, 2001.

[37]

I. Poupyrev, M. Billinghurst, S. Weghorst, and T. Ichikawa. The Go-Go Interaction Technique: Non-Linear Mapping for Direct Manipulation in VR. In Proc. of ACM UIST, pages 79--80, 1996.

Digital Library

[38]

I. Poupyrev, S. Weghorst, M. Billinghurst, and T. Ichikawa. A framework and testbed for studying manipulation techniques for immersive vr. In Proc. of ACM VRST, pages 21--28, 1997.

Digital Library

[39]

M. Sanders and E. McCormick. Human Factors in Engineering and Design. McGRAW-HILL Book Company, 1987.

[40]

G. Shoemaker, T. Tsukitani, Y. Kitamura, and K. S. Booth. Two-Part Models Capture the Impact of Gain on Pointing Performance. ACM Trans. Comput.-Hum. Interact., 19(4):28:1--28:34, Dec. 2012.

Digital Library

[41]

J. A. Thomson. Is continuous visual monitoring necessary in visually guided locomotion? Journal Experimental Psychology Human Perception Performance, 9(3):427--443, 1983.

[42]

M. Usoh, E. Catena, S. Arman, and M. Slater. Using Presence Questionaires in Reality. Presence: Teleoperators & Virtual Environments, 9(5):497--503, 1999.

Digital Library

[43]

Y. Wang and C. MacKenzie. Effects of orientation disparity between haptic and graphic displays of objects in virtual environments. Proc. of INTERACT, 99:391--398, 1999.

[44]

P. Willemsen, M. Colton, S. Creem-Regehr, and W. Thompson. The Effects of Head-Mounted Display Mechanical Properties and Field-of-View on Distance Judgments in Virtual Environments. ACM Transactions on Applied Perception (TAP), 2(6):1--14, 2009.

Digital Library

[45]

P. Willemsen, A. Gooch, W. Thompson, and S. Creem-Regehr. Effects of Stereo Viewing Conditions on Distance Perception in Virtual Environments. Presence: Teleoperators & Virtual Environments, 17(1):91--101, 2008.

Digital Library

[46]

C. Wingrave and D. Bowman. Baseline factors for raycasting selection. In Proc. of HCI International, pages 1--10, 2005.

Cited By

Zhang RZhou X(2025)BeyondDeskVR: an extended virtual hand interaction system in virtual realityBehaviour & Information Technology10.1080/0144929X.2025.2469669(1-22)Online publication date: 26-Feb-2025
https://doi.org/10.1080/0144929X.2025.2469669
Faleel SSodhi RIrani P(2024)Comparison of Unencumbered Interaction Technique for Head-Mounted DisplaysProceedings of the ACM on Human-Computer Interaction10.1145/36981468:ISS(500-516)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698146
Bashar MBatmaz A(2024)Virtual Task Environments Factors Explored in 3D Selection StudiesProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670983(1-16)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670983
Show More Cited By

Index Terms

Touching the Sphere: Leveraging Joint-Centered Kinespheres for Spatial User Interaction
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
      1. Virtual reality
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Graphical user interfaces
  2. Interaction design
    1. Interaction design process and methods
      1. User interface design
    2. Interaction design theory, concepts and paradigms

Recommendations

Stepping off a ledge in an HMD-based immersive virtual environment
SAP '13: Proceedings of the ACM Symposium on Applied Perception

We explore whether a gender-matched, calibrated self-avatar affects the perception of the affordance of stepping off of a ledge, or visual cliff, in an immersive virtual environment. Visual cliffs form demonstrations in many immersive virtual ...
Touching the Third Dimension
ITS '14: Proceedings of the Ninth ACM International Conference on Interactive Tabletops and Surfaces

Natural interaction offers the user a great immersive experience and research has shown that especially multi-touch is easier to learn and utilize than classic human-computer interfaces, such as the keyboard and the mouse. However, creating 3D user ...
Inducing Body-Transfer Illusions in VR by Providing Brief Phases of Visual-Tactile Stimulation
SUI '16: Proceedings of the 2016 Symposium on Spatial User Interaction

Current developments in the area of virtual reality (VR) allow numerous users to experience immersive virtual environments (VEs) in a broad range of application fields. In the same way, some research has shown novel advances in wearable devices to ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SUI '16: Proceedings of the 2016 Symposium on Spatial User Interaction

October 2016

236 pages

ISBN:9781450340687

DOI:10.1145/2983310

General Chair:
Christian Sandor
Nara Institute of Science and Technology, Japan
,
Program Chairs:
Robert Teather
Carleton University, Canada
,
Evan Suma
University of Southern California, USA
,
Kyle Johnsen
University Of Georgia, USA

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques
SIGCHI: ACM Special Interest Group on Computer-Human Interaction
VRSJ SIG-MR: Virtual Reality Society of Japan, Special Interest Group on Mixed Reality

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 October 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

SUI '16

Sponsor:

SIGGRAPH
SIGCHI
VRSJ SIG-MR

SUI '16: Symposium on Spatial User Interaction

October 15 - 16, 2016

Tokyo, Japan

Acceptance Rates

SUI '16 Paper Acceptance Rate 20 of 77 submissions, 26%;

Overall Acceptance Rate 86 of 279 submissions, 31%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

39
Total Citations
View Citations
951
Total Downloads

Downloads (Last 12 months)107
Downloads (Last 6 weeks)10

Reflects downloads up to 07 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Zhang RZhou X(2025)BeyondDeskVR: an extended virtual hand interaction system in virtual realityBehaviour & Information Technology10.1080/0144929X.2025.2469669(1-22)Online publication date: 26-Feb-2025
https://doi.org/10.1080/0144929X.2025.2469669
Faleel SSodhi RIrani P(2024)Comparison of Unencumbered Interaction Technique for Head-Mounted DisplaysProceedings of the ACM on Human-Computer Interaction10.1145/36981468:ISS(500-516)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698146
Bashar MBatmaz A(2024)Virtual Task Environments Factors Explored in 3D Selection StudiesProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670983(1-16)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670983
Li YLiu JHuang JZhang YPeng XBian YTian F(2024)Evaluating the effects of user motion and viewing mode on target selection in augmented realityInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2024.103327191:COnline publication date: 1-Nov-2024
https://dl.acm.org/doi/10.1016/j.ijhcs.2024.103327
Gabel JSchmidt SAriza OSteinicke F(2023)Redirecting Rays: Evaluation of Assistive Raycasting Techniques in Virtual RealityProceedings of the 29th ACM Symposium on Virtual Reality Software and Technology10.1145/3611659.3615716(1-11)Online publication date: 9-Oct-2023
https://dl.acm.org/doi/10.1145/3611659.3615716
Willms JLetter MMarchandise EWolf K(2023)Pull Outperforms Push as Vibrotactile Wristband Feedback for Mid-Air Gesture GuidanceProceedings of Mensch und Computer 202310.1145/3603555.3603579(138-148)Online publication date: 3-Sep-2023
https://dl.acm.org/doi/10.1145/3603555.3603579
Niyazov AEns BSatriadi KMellado NBarthe LDwyer TSerrano M(2023)User-Driven Constraints for Layout Optimisation in Augmented RealityProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580873(1-16)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580873
Qiu TZhou XLi H(2023)A Comparative Study of Various 3D Interface Layout Experiments Based on Virtual Hand Interaction2023 IEEE International Conference on Industrial Engineering and Engineering Management (IEEM)10.1109/IEEM58616.2023.10406984(0682-0686)Online publication date: 18-Dec-2023
https://doi.org/10.1109/IEEM58616.2023.10406984
Woodworth JBorst C(2023)Pointing in the third-person: an exploration of human motion and visual pointing aids for 3D virtual mirrorsVirtual Reality10.1007/s10055-023-00796-x27:3(2099-2116)Online publication date: 13-Apr-2023
https://doi.org/10.1007/s10055-023-00796-x
Lou XZhao QShi YHansen P(2022)Arm Posture Changes and Influences on Hand Controller Interaction Evaluation in Virtual RealityApplied Sciences10.3390/app1205258512:5(2585)Online publication date: 2-Mar-2022
https://doi.org/10.3390/app12052585
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten