research-article

Hotspotizer: end-user authoring of mid-air gestural interactions

Authors:

Mehmet Aydın Baytaş,

Oğuzhan ÖzcanAuthors Info & Claims

NordiCHI '14: Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational

Pages 677 - 686

https://doi.org/10.1145/2639189.2639255

Published: 26 October 2014 Publication History

Abstract

Drawing from a user-centered design process and guidelines derived from the literature, we developed a paradigm based on space discretization for declaratively authoring mid-air gestures and implemented it in Hotspotizer, an end-to-end toolkit for mapping custom gestures to keyboard commands. Our implementation empowers diverse user populations -- including end-users without domain expertise -- to develop custom gestural interfaces within minutes, for use with arbitrary applications.

References

[1]

Ashbrook, D., and Starner, T. MAGIC: A Motion Gesture Design Tool. In Proc. CHI 2010 (2010), 2159--2168.

Digital Library

[2]

Baytaş, M. A., Yemez, Y., and Özcan, O. User Interface Paradigms for Visually Authoring Mid-Air Gestures: A Survey and a Provocation. In Proc. EGMI 2014 (2014).

[3]

Hartmann, B., Abdulla, L., Mittal, M., and Klemmer, S. R. Authoring Sensor-based Interactions by Demonstration with Direct Manipulation and Pattern Recognition. In Proc. CHI 2007 (2007), 145--154.

Digital Library

[4]

Hoste, L., De Rooms, B., and Signer, B. Declarative Gesture Spotting Using Inferred and Refined Control Points. In Proc. ICPRAM 2013 (2013), 144--150.

[5]

Hoste, L., and Signer, B. Criteria, Challenges and Opportunities for Gesture Programming Languages. In Proc. EGMI 2014 (2014).

[6]

Hughes, D. Microsoft Kinect shifts 10 million units, game sales remain poor. http://www.huliq.com/10177/microsoft-kinect-shifts-10-million-units-game-sales-remain-poor, 2011. Accessed: 2014-07-08.

[7]

Hutchins, E. L., Hollan, J. D., and Norman, D. A. Direct Manipulation Interfaces. Human Computer Interaction 1, 4 (1985), 311--338.

Digital Library

[8]

Kim, J.-W., and Nam, T.-J. EventHurdle: Supporting Designers' Exploratory Interaction Prototyping with Gesture-based Sensors. In Proc. CHI 2013 (2013), 267--276.

Digital Library

[9]

Kin, K., Hartmann, B., DeRose, T., and Agrawala, M. Proton++: A Customizable Declarative Multitouch Framework. In Proc. UIST 2012 (2012), 477--486.

Digital Library

[10]

Ko, A. J., Abraham, R., Beckwith, L., Blackwell, A., Burnett, M., Erwig, M., Scaffidi, C., Lawrance, J., Lieberman, H., Myers, B., Rosson, M. B., Rothermel, G., Shaw, M., and Wiedenbeck, S. The State of the Art in End-user Software Engineering. ACM Computing Surveys 43, 3 (2011), 21:1--21:44.

Digital Library

[11]

Lieberman, H., Paternò, F., Klann, M., and Wulf, V. End-User Development: An Emerging Paradigm. In End User Development, H. Lieberman, F. Paternò, and V. Wulf, Eds., vol. 9. Springer Netherlands, 2006, 1--8.

Digital Library

[12]

Long, A. C., Landay, J. A., and Rowe, L. A. "Those Look Similar!" Issues in Automating Gesture Design Advice. In Proc. PUI 2001 (2001), 1--5.

Digital Library

[13]

Lü, H., and Li, Y. Gesture Studio: Authoring Multi-touch Interactions Through Demonstration and Declaration. In Proc. CHI 2013 (2013), 257--266.

Digital Library

[14]

Marquardt, Z., Beira, J. a., Em, N., Paiva, I., and Kox, S. Super Mirror: A Kinect Interface for Ballet Dancers. In Proc. CHI 2012 (2012), 1619--1624.

Digital Library

[15]

Norman, D. A. Cognitive Engineering. In User Centered System Design, D. A. Norman and S. W. Draper, Eds. CRC Press, 1896, ch. 3, 31--61.

[16]

Norman, D. A. Things that make us smart: Defending human attributes in the age of the machine. Basic Books, 1993.

Digital Library

[17]

Oliver, A., Kang, S., Wünsche, B. C., and MacDonald, B. Using the Kinect As a Navigation Sensor for Mobile Robotics. In Proc. IVCNZ 2012 (2012), 509--514.

Digital Library

[18]

Olsen, Jr., D. R. Evaluating User Interface Systems Research. In Proc. UIST 2007 (2007), 251--258.

Digital Library

[19]

Panger, G. Kinect in the Kitchen: Testing Depth Camera Interactions in Practical Home Environments. In CHI EA 2012 (2012), 1985--1990.

Digital Library

[20]

Raghuraman, S., Venkatraman, K., Wang, Z., Wu, J., Clements, J., Lotfian, R., Prabhakaran, B., Guo, X., Jafari, R., and Nahrstedt, K. Immersive Multiplayer Tennis with Microsoft Kinect and Body Sensor Networks. In Proc. MM 2012 (2012), 1481--1484.

Digital Library

[21]

Rodrigues, D. G., Grenader, E., Nos, F. d. S., Dall'Agnol, M. d. S., Hansen, T. E., and Weibel, N. MotionDraw: A Tool for Enhancing Art and Performance Using Kinect. In CHI EA 2013 (2013), 1197--1202.

Digital Library

[22]

Rubine, D. Specifying Gestures by Example. In Proc. SIGGRAPH 1991 (1991), 329--337.

Digital Library

[23]

Shoemaker, G., Tsukitani, T., Kitamura, Y., and Booth, K. S. Body-Centric Interaction Techniques for Very Large Wall Displays. In Proc. NordiCHI 2010 (2010), 463--472.

Digital Library

[24]

Stein, S. Kinect, 2011: Where art thou, motion? http://www.cnet.com/news/kinect-2011-where-art-thou-motion/, 2011. Accessed: 2014-07-08.

[25]

Suma, E. A., Krum, D. M., Lange, B., Koenig, S., Rizzo, A., and Bolas, M. Adapting user interfaces for gestural interaction with the flexible action and articulated skeleton toolkit. Computers & Graphics 37, 3 (2013), 193--201.

Digital Library

[26]

Tang, J. K. T., and Igarashi, T. CUBOD: A Customized Body Gesture Design Tool for End Users. In Proc. BCS-HCI 2013 (2013), 5:1--5:10.

Digital Library

[27]

Villaroman, N., Rowe, D., and Swan, B. Teaching Natural User Interaction Using OpenNI and the Microsoft Kinect Sensor. In Proc. SIGITE 2011 (2011), 227--232.

Digital Library

[28]

Wilson, A. D. Sensor- and Recognition-Based Input for Interaction. In The Human-Computer Interaction Handbook, J. A. Jacko, Ed. CRC Press, 2012, ch. 7, 133--156.

[29]

Yin, S. Microsoft Kinect Holds World Record for 'Fastest-Selling' Device. http://www.pcmag.com/article2/0,2817,2381724,00.asp, 2011. Accessed: 2014-07-08.

Cited By

Xia HGlueck MAnnett MWang MWigdor D(2022)Iteratively Designing Gesture Vocabularies: A Survey and Analysis of Best Practices in the HCI LiteratureACM Transactions on Computer-Human Interaction10.1145/350353729:4(1-54)Online publication date: 5-May-2022
https://dl.acm.org/doi/10.1145/3503537
Bufano RCostagliola GDe Rosa MFuccella V(2021) PolyRec Gesture Design Tool : A tool for fast prototyping of gesture‐based mobile applications Software: Practice and Experience10.1002/spe.302452:2(594-618)Online publication date: 13-Sep-2021
https://doi.org/10.1002/spe.3024
Baytas MFunk MLjungblad SGarcia JLa Delfa JMueller FBernhaupt RMueller FVerweij DAndres JMcGrenere JCockburn AAvellino IGoguey ABjørn PZhao SSamson BKocielnik R(2020)iHDI 2020: Interdisciplinary Workshop on Human-Drone InteractionExtended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3334480.3375149(1-8)Online publication date: 25-Apr-2020
https://dl.acm.org/doi/10.1145/3334480.3375149
Show More Cited By

Index Terms

Hotspotizer: end-user authoring of mid-air gestural interactions
1. Human-centered computing
  1. Human computer interaction (HCI)
2. Software and its engineering
  1. Software creation and management
    1. Designing software
      1. Software implementation planning
        Software design techniques
    2. Software development process management

Recommendations

Touch+Finger: Extending Touch-based User Interface Capabilities with "Idle" Finger Gestures in the Air
UIST '18: Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology

In this paper, we present Touch+Finger, a new interaction technique that augments touch input with multi-finger gestures for rich and expressive interaction. The main idea is that while one finger is engaged in a touch event, a user can leverage the ...
BackHand: Sensing Hand Gestures via Back of the Hand
UIST '15: Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology

In this paper, we explore using the back of hands for sensing hand gestures, which interferes less than glove-based approaches and provides better recognition than sensing at wrists and forearms. Our prototype, BackHand, uses an array of strain gauge ...
T(ether): spatially-aware handhelds, gestures and proprioception for multi-user 3D modeling and animation
SUI '14: Proceedings of the 2nd ACM symposium on Spatial user interaction

T(ether) is a spatially-aware display system for multi-user, collaborative manipulation and animation of virtual 3D objects. The handheld display acts as a window into virtual reality, providing users with a perspective view of 3D data. T(ether) tracks ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

NordiCHI '14: Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational

October 2014

361 pages

ISBN:9781450325424

DOI:10.1145/2639189

General Chairs:
Virpi Roto,
Jonna Häkkilä,
Program Chairs:
Kaisa Väänänen-Vainio-Mattila,
Oskar Juhlin,
Publications Chairs:
Thomas Olsson,
Ebba Hvannberg

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

In-Cooperation

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 October 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

NordiCHI '14

NordiCHI '14: The 8th Nordic Conference on Human-Computer Interaction

October 26 - 30, 2014

Helsinki, Finland

Acceptance Rates

NordiCHI '14 Paper Acceptance Rate 89 of 361 submissions, 25%;

Overall Acceptance Rate 379 of 1,572 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
298
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)1

Reflects downloads up to 03 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Xia HGlueck MAnnett MWang MWigdor D(2022)Iteratively Designing Gesture Vocabularies: A Survey and Analysis of Best Practices in the HCI LiteratureACM Transactions on Computer-Human Interaction10.1145/350353729:4(1-54)Online publication date: 5-May-2022
https://dl.acm.org/doi/10.1145/3503537
Bufano RCostagliola GDe Rosa MFuccella V(2021) PolyRec Gesture Design Tool : A tool for fast prototyping of gesture‐based mobile applications Software: Practice and Experience10.1002/spe.302452:2(594-618)Online publication date: 13-Sep-2021
https://doi.org/10.1002/spe.3024
Baytas MFunk MLjungblad SGarcia JLa Delfa JMueller FBernhaupt RMueller FVerweij DAndres JMcGrenere JCockburn AAvellino IGoguey ABjørn PZhao SSamson BKocielnik R(2020)iHDI 2020: Interdisciplinary Workshop on Human-Drone InteractionExtended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3334480.3375149(1-8)Online publication date: 25-Apr-2020
https://dl.acm.org/doi/10.1145/3334480.3375149
Baytas MÇay DZhang YObaid MYantaç AFjeld MBrewster SFitzpatrick GCox AKostakos V(2019)The Design of Social DronesProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300480(1-13)Online publication date: 2-May-2019
https://dl.acm.org/doi/10.1145/3290605.3300480
Santos MVillela M(2019)Characterizing End-User Development Solutions: A Systematic Literature ReviewHuman-Computer Interaction. Perspectives on Design10.1007/978-3-030-22646-6_14(194-209)Online publication date: 27-Jun-2019
https://doi.org/10.1007/978-3-030-22646-6_14
Kim JKim HNam TKaye JDruin ALampe CMorris DHourcade J(2016)M.GestureProceedings of the 2016 CHI Conference on Human Factors in Computing Systems10.1145/2858036.2858358(2307-2318)Online publication date: 7-May-2016
https://dl.acm.org/doi/10.1145/2858036.2858358

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten