skip to main content
10.1145/3411109.3411134acmotherconferencesArticle/Chapter ViewAbstractPublication PagesamConference Proceedingsconference-collections
research-article

Perception of spatial data properties in an immersive multi-layered auditory environment

Published: 16 September 2020 Publication History

Abstract

We present a study of spatial sonification of multidimensional data using a spatial mask and an immersive high-density loudspeaker array. The study participants are asked to identify edges and perceived center of 2D shapes projected across the perimeter of an exocentric environment. The results show that the phase modulation technique results in less accurate user responses than the amplitude modulation or combined modulation techniques. No significant differences are found between stationary and mobile-user scenarios when comparing the angular miss distances of the perceived center of sonified shapes, but significant differences are identified in locating their left and top edges. Further research is warranted to determine why properties of some shapes are easier to pinpoint than others, and how sonification may be improved to minimize such discrepancies.

References

[1]
[n.d.]. Scientific publications based on use of The vOICe. https://www.seeingwithsound.com/literature.htm.
[2]
Carryl L Baldwin and Jennifer F May. 2011. Loudness interacts with semantics in auditory warnings to impact rear-end collisions. Transportation research part F: traffic psychology and behaviour 14, 1 (2011), 36--42.
[3]
Douglas Bates, Martin Mächler, Ben Bolker, and Steve Walker. 2014. Fitting linear mixed-effects models using lme4. arXiv preprint arXiv:1406.5823 (2014).
[4]
Mark Billinghurst and Hirokazu Kato. 1999. Collaborative mixed reality. In Proceedings of the First International Symposium on Mixed Reality. 261--284.
[5]
Ivica Ico Bukvic. 2010. Perception And Interpretation Of Concurrent Aural Shapes Using Dream Interface. Ann Arbor, MI: Michigan Publishing, University of Michigan Library.
[6]
Ivica Ico Bukvic. 2016. Introducing D4: An Interactive 3D Audio Rapid Prototyping and Transportable Rendering Environment Using High Density Loudspeaker Arrays. Ann Arbor, MI: Michigan Publishing, University of Michigan Library.
[7]
Ivica Ico Bukvic, Gregory Earle, Disha Sardana, and Woohun Joo. 2019. Studies in spatial aural perception: establishing foundations for immersive sonification. Georgia Institute of Technology.
[8]
Ivica Ico Bukvic, Denis Gracanin, and Francis KH Quek. 2008. Investigating Artistic potential of the Dream Interface: the Aural Painting. In ICMC.
[9]
Ellen C Haas and Judy Edworthy. 1996. Designing urgency into auditory warnings using pitch, speed and loudness. Computing & Control Engineering Journal 7, 4 (1996), 193--198.
[10]
Jared Halpern. 2019. Introduction to Unity. In Developing 2D Games with Unity. Springer, 13--30.
[11]
Hesham M Kamel, Patrick Roth, and Rashmi Sinha. 2001. Graphics and user's exploration via simple sonics (GUESS): providing interrelational representation of objects in a non-visual environment. Georgia Institute of Technology.
[12]
Howard Levene. 1961. Robust tests for equality of variances. Contributions to probability and statistics. Essays in honor of Harold Hotelling (1961), 279--292.
[13]
Eric Lyon, Terence Caulkins, Denis Blount, Ivica Ico Bukvic, Charles Nichols, Michael Roan, and Tanner Upthegrove. 2016. Genesis of the cube: The design and deployment of an hdla-based performance and research facility. Computer Music Journal 40, 4 (2016), 62--78.
[14]
Tooba Nasir. 2009. Geo-sonf: Spatial sonification of contour maps. In 2009 IEEE International Workshop on Haptic Audio visual Environments and Games. IEEE, 141--146.
[15]
Tooba Nasir and Jonathan C Roberts. 2007. Sonification of spatial data. Georgia Institute of Technology.
[16]
Miller Puckette. 2002. Max at seventeen. Computer Music Journal 26, 4 (2002), 31--43.
[17]
Ronald M Ruff and Etienne Perret. 1976. Auditory spatial pattern perception aided by visual choices. Psychological Research 38, 4 (1976), 369--377.
[18]
Ronald M Ruff and Etienne Perret. 1982. Spatial mapping of two-dimensional sound patterns presented sequentially. Perceptual and motor skills 55, 1 (1982), 155--163.
[19]
Disha Sardana, Woohun Joo, Ivica Ico Bukvic, and Gregory Earle. 2019. Introducing Locus: a NIME for Immersive Exocentric Aural Environments. In Proceedings of the International Conference on New Interfaces for Musical Expression. Federal University of Rio Grande do Su, Porto Alegre, Brazil.
[20]
Franklin E Satterthwaite. 1946. An approximate distribution of estimates of variance components. Biometrics bulletin 2, 6 (1946), 110--114.
[21]
John W Tukey. 1949. Comparing individual means in the analysis of variance. Biometrics (1949), 99--114.
[22]
Shin'ichiro Uno, Yasuo Suzuki, Takashi Watanabe, Miku Matsumoto, and Yan Wang. 2018. Sound-based image and positon recognition system: SIPReS. Georgia Institute of Technology.
[23]
Jan Żera and Arkadiusz Nagórski. 2000. Preferred levels of auditory danger signals. International Journal of Occupational Safety and Ergonomics 6, sup1 (2000), 111--117.

Cited By

View all
  • (2023)Iterative Design of an Immersive Analytics Environment Based on Frame of ReferenceVirtual, Augmented and Mixed Reality10.1007/978-3-031-35634-6_7(86-100)Online publication date: 9-Jul-2023

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
AM '20: Proceedings of the 15th International Audio Mostly Conference
September 2020
281 pages
ISBN:9781450375634
DOI:10.1145/3411109
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 September 2020

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. data sonification
  2. immersive environments
  3. perception
  4. spatial audio

Qualifiers

  • Research-article

Conference

AM'20
AM'20: Audio Mostly 2020
September 15 - 17, 2020
Graz, Austria

Acceptance Rates

AM '20 Paper Acceptance Rate 29 of 47 submissions, 62%;
Overall Acceptance Rate 177 of 275 submissions, 64%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)1
  • Downloads (Last 6 weeks)0
Reflects downloads up to 20 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2023)Iterative Design of an Immersive Analytics Environment Based on Frame of ReferenceVirtual, Augmented and Mixed Reality10.1007/978-3-031-35634-6_7(86-100)Online publication date: 9-Jul-2023

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media