skip to main content
10.1145/3202667.3202684acmotherconferencesArticle/Chapter ViewAbstractPublication Pageschinese-chiConference Proceedingsconference-collections
poster

See Your Voice: An Interactive Device of Speech Visualisations for Users with Poor Hearing

Published: 21 April 2018 Publication History

Abstract

We design an interactive and artistic device of speech visualisations particularly for users with hearing disorders: See your voice. This device regards speech inputs and visual outputs as an interactive medium, in which musical and speech visualisations are visual feedback. The addition of the musical visualisation module makes images more interesting. Starting from features of hearing disorders and current entertainment manners of hearing-impaired people, we design the initial model of the new media interactive device based on sound and image feedback, according to the attraction of pictures and images to such people. In addition, we develop a set of application programs for this device, which enables it to demonstrate the sound information we obtained in a real-time manner. Finally, we build some scenes for practising this device and explore its subsequent expansion and upgrading plans after conducting many experimental tests.

References

[1]
Dor Abrahamson. 2014. Building educational activities for understanding. Int. J. of Child-Computer Interaction 2, 1: 1--16.
[2]
Chonan H, Kondo F, Hara Y, et al. A Questionnaire Survey of Communication of Individuals with Hearing Impairment whose Hearing Loss in Childhood was Under 90 dBHL{J}. Japan Journal of Logopedics & Phoniatrics, 2011, 52(4):336--347.
[3]
Egusa, Ryohei, et al. "Preparatory development of acollaborative / interactive learning game using bodily movements for deaf children." The, International Conference on Interaction Design and Children ACM, 2016:649--653.
[4]
Guerra S S. Extraction and visualization acoustic contour of the voice signal, its use as a method for the implementation and rehabilitation of voice and speech{J}. Journal of the Acoustical Society of America, 2002, 112(5):2303.
[5]
Hashimi, Sama'A Al. "The role of paralinguistic voice- control of interactive media in augmenting awareness of voice characteristics in the hearing-impaired." CHI '07 Extended Abstracts on Human Factors in Computing Systems ACM, 2007:2153--2158.
[6]
Nakamoto T, Saruta Y, Shigeo S. The kannon system - the visualization system of speech signals{C}// Signal and Image Processing. DBLP, 2001:213--218.
[7]
stefan sciberras, ritienne grima. "maltese children with a hearing impairment: analysis of the current situation and its impact on the quality of life of parents." malta journal of health sciences, 2015.

Index Terms

  1. See Your Voice: An Interactive Device of Speech Visualisations for Users with Poor Hearing

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    ChineseCHI '18: Proceedings of the Sixth International Symposium of Chinese CHI
    April 2018
    172 pages
    ISBN:9781450365086
    DOI:10.1145/3202667
    Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

    In-Cooperation

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 21 April 2018

    Check for updates

    Author Tags

    1. Interactive device
    2. Musical visualisation

    Qualifiers

    • Poster
    • Research
    • Refereed limited

    Conference

    ChineseCHI '18

    Acceptance Rates

    Overall Acceptance Rate 17 of 40 submissions, 43%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 127
      Total Downloads
    • Downloads (Last 12 months)9
    • Downloads (Last 6 weeks)3
    Reflects downloads up to 20 Jan 2025

    Other Metrics

    Citations

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media