skip to main content
10.1145/1979742.1979527acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
abstract

The future of natural user interfaces

Published: 07 May 2011 Publication History

Abstract

This SIG is a forum to advance an integrated approach to multi-modal Natural User Interfaces. Up until now the research and design of NUI interfaces for various modalities (speech, touch, gesture) has proceeded independently. We propose having an integrated discussion with both academics and practitioners to stimulate the exchange of knowledge about the various modalities and how they might be fruitfully combined, and identifying key areas of future research and design that make the case for multi-modal NUIs. The goal is to not only create a vision of synthetic applications of NUI by connecting researchers but to also discuss ways to make the vision a reality.

References

[1]
Azuma, Ronald T. A Survey of Augmented Reality. Presence: Teleoperators and Virtual Environments 6, 4 (August 1997), 355 -- 385. Earlier version appeared in Course Notes #9: Developing Advanced Virtual Reality Applications, ACM SIGGRAPH (Los Angeles, CA, 6-11 August 1995), 20--1 to 20--38.
[2]
Gong, Y. Speech recognition in noisy environments: a survey. Speech Commun. 16, 3 (Apr. 1995), 261--291
[3]
Hofmeester, K. and Wixon, D. Using metaphors to create a natural user interface for microsoft surface. In Proceedings of the 28th of the international Conference Extended Abstracts on Human Factors in Computing Systems (Atlanta, Georgia, USA, April 10 - 15, 2010). CHI EA '10. ACM, New York, NY, 4629--4644.
[4]
LaViola, J. J. A Survey of Hand Posture and Gesture Recognition Techniques and Technology. Technical Report. UMI Order Number: CS-99-11., Brown University.
[5]
Oviatt, S., Cohen, P., Wu, L., Vergo, J., Duncan, L., Suhm, B., Bers, J., Holzman, T., Winograd, T., Landay, J., Larson, J., and Ferro, D. 2000. Designing the user interface for multimodal speech and pen-based gesture applications: state-of-the-art systems and future research directions. Hum.-Comput. Interact. 15, 4 (Dec. 2000), 263--322.
[6]
Watson, Richard. 'A Survey of Gesture Recognition Techniques'. Trinity College Dublin, Department of Computer Science, TCD-CS-1993-11, 1993, pp31
[7]
Yankelovich, N., Levow, G., and Marx, M. Designing SpeechActs: issues in speech user interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Denver, Colorado, United States, May 07 - 11, 1995). I. R. Katz, R. Mack, L. Marks, M. B. Rosson, and J. Nielsen, Eds. Conference on Human Factors in Computing Systems. ACM Press/Addison-Wesley Publishing Co., New York, NY, 369--376.

Cited By

View all
  • (2025)The Merging of Worlds and … of ImmersionNext Generation Internet10.1007/978-3-658-46424-0_3(25-77)Online publication date: 8-Jan-2025
  • (2024)NivTA: Towards a Naturally Interactable Edu-Metaverse Teaching Assistant for CAVE2024 IEEE International Conference on Metaverse Computing, Networking, and Applications (MetaCom)10.1109/MetaCom62920.2024.00023(57-64)Online publication date: 12-Aug-2024
  • (2024)Das Verschmelzen von Welten und … versenNext Generation Internet10.1007/978-3-658-43029-0_3(27-86)Online publication date: 2-Feb-2024
  • Show More Cited By

Index Terms

  1. The future of natural user interfaces

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CHI EA '11: CHI '11 Extended Abstracts on Human Factors in Computing Systems
    May 2011
    2554 pages
    ISBN:9781450302685
    DOI:10.1145/1979742

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 07 May 2011

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. 3D
    2. NUI
    3. augmented reality
    4. gesture
    5. multimodal interface
    6. natural user interface
    7. speech
    8. touch

    Qualifiers

    • Abstract

    Conference

    CHI '11
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

    Upcoming Conference

    CHI 2025
    ACM CHI Conference on Human Factors in Computing Systems
    April 26 - May 1, 2025
    Yokohama , Japan

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)55
    • Downloads (Last 6 weeks)9
    Reflects downloads up to 13 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2025)The Merging of Worlds and … of ImmersionNext Generation Internet10.1007/978-3-658-46424-0_3(25-77)Online publication date: 8-Jan-2025
    • (2024)NivTA: Towards a Naturally Interactable Edu-Metaverse Teaching Assistant for CAVE2024 IEEE International Conference on Metaverse Computing, Networking, and Applications (MetaCom)10.1109/MetaCom62920.2024.00023(57-64)Online publication date: 12-Aug-2024
    • (2024)Das Verschmelzen von Welten und … versenNext Generation Internet10.1007/978-3-658-43029-0_3(27-86)Online publication date: 2-Feb-2024
    • (2023)User Experience of a Serious Game for Physical Rehabilitation Using Wearable Motion Capture TechnologyIEEE Access10.1109/ACCESS.2023.332094711(108407-108417)Online publication date: 2023
    • (2022)Holistic Multimodal Interaction and DesignHCI International 2022 - Late Breaking Papers. Design, User Experience and Interaction10.1007/978-3-031-17615-9_2(18-33)Online publication date: 5-Oct-2022
    • (2022)Designing Functional Prototypes Combining BCI and AR for Home AutomationVirtual Reality and Mixed Reality10.1007/978-3-031-16234-3_1(3-21)Online publication date: 14-Sep-2022
    • (2022)Human-Technology Interaction in the Context of Industry 4.0: Current Trends and ChallengesHuman-Technology Interaction10.1007/978-3-030-99235-4_1(1-14)Online publication date: 14-Dec-2022
    • (2021)Emerging ExG-based NUI Inputs in Extended Realities: A Bottom-up SurveyACM Transactions on Interactive Intelligent Systems10.1145/345795011:2(1-49)Online publication date: 21-Jul-2021
    • (2021)Sensor-Based Gamified Rehabilitation Therapy to Enhance and Manage Human Physical KinematicsAdvances in Materials Research10.1007/978-981-15-8319-3_105(1059-1068)Online publication date: 5-Feb-2021
    • (2020)System for identifying pests and diseases in soybean crop through natural languageProceedings of the 19th Brazilian Symposium on Human Factors in Computing Systems10.1145/3424953.3426540(1-6)Online publication date: 26-Oct-2020
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media