skip to main content
10.1145/3170427.3186603acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
abstract

Draw & Dance: Voice-controlled AR Assistant

Published: 20 April 2018 Publication History

Abstract

We introduce an Augmented Reality (AR) assistant that reacts to your voice, music and sound. The user can draw and place stick figures in the environment that will dance to the music and respond to specific commands. The stick figure characters can also augment a Google Home by taking its place on top of the speaker and moving in response to the rhythm of the music. They will also change their accessories and clothing depending on the genre of the music, play instruments or change their dancing style. We explore how voice UI may benefit from a visual component that re-enforces a mental model for otherwise structureless interactions. The lack of a visual representation of voice assistants can make the adoption and learning curve slower. Our system can help to discover capabilities of a physical tethered device that otherwise would be imperceptible. We present the first system that embodies a voice-controlled speaker using an AR smart avatar.

Supplemental Material

MP4 File - suppl.mov
Supplemental video

Index Terms

  1. Draw & Dance: Voice-controlled AR Assistant

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CHI EA '18: Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems
    April 2018
    3155 pages
    ISBN:9781450356213
    DOI:10.1145/3170427
    Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 20 April 2018

    Check for updates

    Author Tags

    1. augmented reality
    2. dance
    3. interactive
    4. iot
    5. music
    6. smart avatars
    7. voice ui

    Qualifiers

    • Abstract

    Conference

    CHI '18
    Sponsor:

    Acceptance Rates

    CHI EA '18 Paper Acceptance Rate 1,208 of 3,955 submissions, 31%;
    Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

    Upcoming Conference

    CHI 2025
    ACM CHI Conference on Human Factors in Computing Systems
    April 26 - May 1, 2025
    Yokohama , Japan

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 479
      Total Downloads
    • Downloads (Last 12 months)8
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 14 Feb 2025

    Other Metrics

    Citations

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media