skip to main content
10.1145/3313831.3376194acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

Dynamics of Aimed Mid-air Movements

Published: 23 April 2020 Publication History

Abstract

Mid-air arm movements are ubiquitous in VR, AR, and gestural interfaces. While mouse movements have received some attention, the dynamics of mid-air movements are understudied in HCI. In this paper we present an exploratory analysis of the dynamics of aimed mid-air movements. We explore the 3rd order lag (3OL) and existing 2nd order lag (2OL) models for modeling these dynamics. For a majority of movements the 3OL model captures mid-air dynamics better, in particular acceleration. The models can effectively predict the complete time series of position, velocity and acceleration of aimed movements given an initial state and a target using three (2OL) or four (3OL) free parameters.

Supplementary Material

ZIP File (pn1757aux.zip)
Auxiliary materials are position, velocity and acceleration profiles, phase portraits and Hooke plots for all 3 dimensions and all trials of the dataset with 16 participants.
MP4 File (a67-bachynskyi-presentation.mp4)

References

[1]
William Abend, Emilio Bizzi, and Pietro Morasso. 1982. Human arm trajectory formation. Brain: a journal of neurology 105, Pt 2 (1982), 331--348.
[2]
Stanislav Aranovskiy, Rosane Ushirobira, Denis Efimov, and Géry Casiez. 2016. Modeling pointing tasks in mouse-based human-computer interactions. In Decision and Control (CDC), 2016 IEEE 55th Conference on. IEEE, 6595--6600.
[3]
Christopher G Atkeson and John M Hollerbach. 1985. Kinematic features of unrestrained vertical arm movements. Journal of Neuroscience 5, 9 (1985), 2318--2330.
[4]
Myroslav Bachynskyi, Antti Oulasvirta, Gregorio Palmas, and Tino Weinkauf. 2014. Is motion capture-based biomechanical simulation valid for HCI studies?: Study and implications. In Proc. CHI. ACM, 3215--3224.
[5]
Myroslav Bachynskyi, Gregorio Palmas, Antti Oulasvirta, and Tino Weinkauf. 2015. Informing the Design of Novel Input Methods with Muscle Coactivation Clustering. ACM Trans. Comput.-Hum. Interact. 21, 6, Article 30 (Jan. 2015), 25 pages.
[6]
Jean Blouin, Normand Teasdale, Chantal Bard, and Michelle Fleury. 1993. Directional control of rapid arm movements: The role of the kinetic visual feedback system. Canadian Journal of Experimental Psychology/Revue canadienne de psychologie expérimentale 47, 4 (1993), 678.
[7]
Otmar Bock. 1990. Load compensation in human goal-directed arm movements. Behavioural Brain Research 41, 3 (1990), 167 -- 177.
[8]
Reinoud J. Bootsma, Laure Fernandez, and Denis Mottet. 2004. Behind Fitts' law: kinematic patterns in goal-directed movements. International Journal of Human-Computer Studies 61, 6 (2004), 811--821.
[9]
Daniel Bullock and Stephen Grossberg. 1988. Neural dynamics of planned arm movements: emergent invariants and speed-accuracy properties during trajectory formation. Psychological review 95, 1 (1988), 49.
[10]
Richard G. Costello. 1968. The surge model of the well-trained human operator in simple manual control. IEEE Transactions on Man--Machine Systems 9, 1 (1968).
[11]
ERFW Crossman. 1957. The speed and accuracy of simple hand movements. The nature and acquisition of industrial skills (1957).
[12]
E. R. F. W. Crossman and P. J. Goodeve. 1983. Feedback control of hand-movement and Fitts' law. The Quarterly Journal of Experimental Psychology 35, 2 (1983), 251--278.
[13]
Menashe Dornay, Yoji Uno, Mitsuo Kawato, and Ryoji Suzuki. 1996. Minimum muscle-tension change trajectories predicted by using a 17-muscle model of the monkey's arm. Journal of motor behavior 28, 2 (1996), 83--100.
[14]
Paul M. Fitts. 1954. The information capacity of the human motor system in controlling the amplitude of movement. Journal of Experimental Psychology 47, 6 (1954), 381--391.
[15]
Tamar Flash and Neville Hogan. 1985. The Coordination of Arm Movements: An Experimentally Confirmed Mathematical Model. Journal of neuroscience 5 (1985), 1688--1703.
[16]
Tamar Flash, Yaron Meirovitch, and Avi Barliya. 2013. Models of human movement: Trajectory planning and inverse kinematics studies. Robotics and Autonomous Systems 61, 4 (2013), 330 -- 339. Models and Technologies for Multi-modal Skill Training.
[17]
Tovi Grossman and Ravin Balakrishnan. 2004. Pointing at Trivariate Targets in 3D Environments. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '04). Association for Computing Machinery, New York, NY, USA, 447--454.
[18]
Yves Guiard. 1993. On Fitts's and Hooke's laws: Simple harmonic movement in upper-limb cyclical aiming. Acta psychologica 82, 1 (1993), 139--159.
[19]
Christopher M Harris and Daniel M Wolpert. 1998. Signal-dependent noise determines motor planning. Nature 394, 6695 (1998), 780.
[20]
Neville Hogan and Tamar Flash. 1987. Moving gracefully: quantitative theories of motor coordination. Trends in Neurosciences 10, 4 (1987), 170 -- 174.
[21]
J. M. Hollerbach, S. P. Moore, and C. G. Atkeson. 1987. Workspace Effect in Arm Movement Kinematics Derived by Joint Interpolation. Springer US, Boston, MA, 197--208.
[22]
C.I. Howarth, W.D.A. Beggs, and J.M. Bowden. 1971. The relationship between speed and accuracy of movement aimed at a target. Acta Psychologica 35, 3 (1971), 207 -- 218.
[23]
Richard J. Jagacinski and John M. Flach. 2003. Control Theory for Humans: Quantitative approaches to modeling performance. Lawrence Erlbaum, Mahwah, New Jersey.
[24]
Mitsuo Kawato. 1988. Adaptation and learning in control of voluntary movement by the central nervous system. Advanced Robotics 3, 3 (1988), 229--249.
[25]
Francesco Lacquaniti, Carlo Terzuolo, and Paolo Viviani. 1983. The law relating the kinematic and figural aspects of drawing movements. Acta Psychologica 54, 1 (1983), 115 -- 130.
[26]
I Scott MacKenzie. 1992. Fitts' law as a research and design tool in human-computer interaction. Human-Computer Interaction 7, 1 (1992), 91--139.
[27]
Duane T. McRuer and Henry R. Jex. 1967. A review of quasi-linear pilot models. IEEE Trans. on Human Factors in Electronics 8, 3 (1967), 231--249.
[28]
David E. Meyer, J. E. Keith Smith, Sylvan Kornblum, Richard A. Abrams, and Charles. E. Wright. 1990. Speed-accuracy trade-offs in aimed movements: Toward a theory of rapid voluntary action. M. Jeannerod (Ed.), Attention and Performance XIII (1990), 173--226.
[29]
Denis Mottet and Reinoud J. Bootsma. 1999. The dynamics of goal-directed rhythmical aiming. Biological cybernetics 80, 4 (1999), 235--245.
[30]
Jörg Müller, Antti Oulasvirta, and Roderick Murray-Smith. 2017. Control Theoretic Models of Pointing. ACM Trans. Comput.-Hum. Interact. 24, 4, Article 27 (Aug. 2017), 36 pages.
[31]
K. M. Newell, L. G. Carlton, Seonjin Kim, and Chung-Hee Chung. 1993. Space-Time Accuracy of Rapid Movements. Journal of Motor Behavior 25, 1 (1993), 8--20. 12730037.
[32]
Rieko Osu, Yoji Uno, Yasuharu Koike, and Mitsuo Kawato. 1997. Possible explanations for trajectory curvature in multijoint arm movements. Journal of Experimental Psychology: Human Perception and Performance 23, 3 (1997), 890.
[33]
Rejean Plamondon. 1998. A kinematic theory of rapid human movements: Part III. Kinetic outcomes. Biological Cybernetics 78, 2 (1998), 133--145.
[34]
Réjean Plamondon and Adel M Alimi. 1997. Speed/accuracy trade-offs in target-directed movements. Behavioral and brain sciences 20, 02 (1997), 279--303.
[35]
Réjean Plamondon and Moussa Djioua. 2006. A multi-level representation paradigm for handwriting stroke generation. Human Movement Science 25, 4 (2006), 586 -- 607. Advances in Graphonomics: Studies on Fine Motor Control, Its Development and Disorders.
[36]
Frank E. Pollick and Gensel Ishimura. 1996. The Three-Dimensional Curvature of Straight-Ahead Movements. Journal of Motor Behavior 28, 3 (1996), 271--279. 12529209.
[37]
Stefan Schaal and Dagmar Sternad. 2001. Origins and violations of the 2/3 power law in rhythmic three-dimensional arm movements. Experimental brain research 136, 1 (2001), 60--72.
[38]
Richard A. Schmidt and Timothy D. Lee. 2005. Motor Control and Learning. Human Kinetics.
[39]
Thomas B. Sheridan and William R. Ferrell. 1974. Man-machine Systems: Information, Control, and Decision Models of Human Performance. M.I.T. Press, Cambridge, USA.
[40]
R.W. Soukoreff and I.S. MacKenzie. 2004. Towards a standard for pointing device evaluation, perspectives on 27 years of Fitts' law research in HCI. IJHCS 61, 6 (2004), 751--789. Fitts' Law 50 Years Later: Applications and Contributions from Human-Computer Interaction.
[41]
Emanuel Todorov. 2004. Optimality principles in sensorimotor control. Nature neuroscience 7, 9 (2004), 907.
[42]
Emanuel Todorov and Michael I Jordan. 2002. Optimal feedback control as a theory of motor coordination. Nature neuroscience 5, 11 (2002), 1226.
[43]
Emanuel Todorov and Weiwei Li. 2003. Optimal control methods suitable for biomechanical systems. In Proceedings of the 25th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (IEEE Cat. No. 03CH37439), Vol. 2. IEEE, 1758--1761.
[44]
Emanuel Todorov, Weiwei Li, and Xiuchuan Pan. 2005. From task parameters to motor synergies: A hierarchical framework for approximately optimal control of redundant manipulators. Journal of Robotic Systems 22, 11 (2005), 691--710.
[45]
Francisco J. Valero-Cuevas, Madhusudhan Venkadesan, and Emanuel Todorov. 2009. Structured Variability of Muscle Activations Supports the Minimal Intervention Principle of Motor Control. Journal of Neurophysiology 102, 1 (2009), 59--68. 19369362.
[46]
Paolo Viviani and Tamar Flash. 1995. Minimum-Jerk, Two-Thirds Power Law, and Isochrony: Converging Approaches to Movement Planning. Journal of Experimental Psychology: Human Perception and Performance 21, 1 (1995), 32--53.
[47]
P. Viviani and C. Terzuolo. 1982. Trajectory determines movement dynamics. Neuroscience 7, 2 (1982), 431 -- 437.
[48]
A.T. Welford, A.H. Norris, and N.W. Shock. 1969. Speed and accuracy of movement and their changes with age. Acta Psychologica 30 (1969), 3 -- 15.
[49]
Daniel M Wolpert. 1997. Computational approaches to motor control. Trends in cognitive sciences 1, 6 (1997), 209--216.
[50]
Daniel M Wolpert and Zoubin Ghahramani. 2000. Computational principles of movement neuroscience. Nature neuroscience 3, 11s (2000), 1212.

Cited By

View all
  • (2023)Aircraft Cockpit Interaction in Virtual Reality with Visual, Auditive, and Vibrotactile FeedbackProceedings of the ACM on Human-Computer Interaction10.1145/36264817:ISS(420-443)Online publication date: 1-Nov-2023
  • (2023)Proxemic Cursor Interactions for Touchless Widget ControlProceedings of the 2023 ACM Symposium on Spatial User Interaction10.1145/3607822.3614525(1-12)Online publication date: 13-Oct-2023
  • (2023)Simulating Interaction Movements via Model Predictive ControlACM Transactions on Computer-Human Interaction10.1145/357701630:3(1-50)Online publication date: 12-Jun-2023
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems
April 2020
10688 pages
ISBN:9781450367080
DOI:10.1145/3313831
This work is licensed under a Creative Commons Attribution International 4.0 License.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 April 2020

Check for updates

Author Tags

  1. aimed movements
  2. control theory
  3. mid-air movements
  4. movement dynamics

Qualifiers

  • Research-article

Conference

CHI '20
Sponsor:

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025
ACM CHI Conference on Human Factors in Computing Systems
April 26 - May 1, 2025
Yokohama , Japan

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)73
  • Downloads (Last 6 weeks)2
Reflects downloads up to 20 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2023)Aircraft Cockpit Interaction in Virtual Reality with Visual, Auditive, and Vibrotactile FeedbackProceedings of the ACM on Human-Computer Interaction10.1145/36264817:ISS(420-443)Online publication date: 1-Nov-2023
  • (2023)Proxemic Cursor Interactions for Touchless Widget ControlProceedings of the 2023 ACM Symposium on Spatial User Interaction10.1145/3607822.3614525(1-12)Online publication date: 13-Oct-2023
  • (2023)Simulating Interaction Movements via Model Predictive ControlACM Transactions on Computer-Human Interaction10.1145/357701630:3(1-50)Online publication date: 12-Jun-2023
  • (2023)Tailor Twist: Assessing Rotational Mid-Air Interactions for Augmented RealityProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581461(1-14)Online publication date: 19-Apr-2023
  • (2023)Sensorimotor Simulation of Redirected Reaching using Stochastic Optimal Feedback ControlProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580767(1-17)Online publication date: 19-Apr-2023
  • (2023)Examining the Fine Motor Control Ability of Linear Hand Movement in Virtual Reality2023 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR55154.2023.00058(427-437)Online publication date: Mar-2023
  • (2022)A Model Predictive Control Approach for Reach Redirection in Virtual RealityProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501907(1-15)Online publication date: 29-Apr-2022
  • (2021)So Predictable! Continuous 3D Hand Trajectory Prediction in Virtual RealityThe 34th Annual ACM Symposium on User Interface Software and Technology10.1145/3472749.3474753(332-343)Online publication date: 10-Oct-2021
  • (2021)A Simulation Model of Intermittently Controlled Point-and-Click BehaviourProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445514(1-17)Online publication date: 6-May-2021

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media