Randomized psychoacoustic model for mobile, panoramic, heritage-viewing applications
Pages 315 - 322
Abstract
In preservation of heritage, lately there has been a phenomenal growth in digital audio preservation. A well-preserved virtual heritage does not include only the visual images of the heritage sites, but should ideally include also the audio surroundings of the heritage site that are incorporated into the virtual heritage applications as a whole. An acoustical heritage comprises the audio elements which surround the heritage sites. Psychoacoustic heritage is the extra significant psychological audio characteristic that adds to the surroundings of the heritage sites.
In this paper, a randomized psychoacoustic model is proposed in 360° panoramic view on mobile platform. User interaction using multi-gesture tap is vital in delivering the psychoacoustic effects to the user. The contribution and the novelty of this research is in proposing and deploying a new psychoacoustic model mainly for the environment of 360° panoramic view in virtual heritage. In the proposed model, audio interaction design includes the changes in acoustical characteristics such as amplitude, frequency as well as the velocity within the various balanced panorama's azimuthal zones. Simulations have been carried out on a model of the Town Hall, one of the UNESCO heritage sites in George Town, Penang, Malaysia. The experimental data sets are also collected and have been found to produce promising psychoacoustic effects in panoramic view.
References
[1]
Carillo E., Kadobayashi R., Chikanma M., Shimojo S., Rodriguez-Echavarria K., Arnold D.: Making history alive and interactive: designing an iPhone app to present the summer war of Osaka Byobu. In 16th Int. Conf. on Virtual Systems and Multimedia (VSMM) (20--23 Oct. 2010), pp. 365--368.
[2]
Casella P., Paiva A.: (2003) Mediating action and background music. In Lecture Notes in Computer Science (2003), Vol. 2897/2003, pp. 94--101.
[3]
Clemens G., Sanahuja F., Beaugeant C.: Audio-enhanced panoramic image capturing and rendering on mobile devices. In IEEE Int. Conf. on Multimedia and Expo (ICME) (2005), pp. 988--991.
[4]
Fry D. B.: The Physics of Speech, Syndics of the Cambridge University Press (March 30 1979)
[5]
Hulusic V., Harvey C., Debattista K., Tsingos N., Walker S., Howard D., Chalmers A.: (2012) Acoustic rendering and auditory-visual cross-modal perception and interaction, Computer Graphics Forum (February 2012), Vol. 31, Issue 1, pp. 102--131.
[6]
Ebling M.: Family connections. In IEEE Pervasive Computing (2010), July-September 2010, pp. 4--5.
[7]
Ekman, I., Ermi L., Lahti J., Nummela J., Lankoski P., Mayra F.: Designing sound for a pervasive mobile game. In Proc. of ACM SIGCHI Int. Conf. on Advances in Computer Entertainment Technology (2005), pp. 110--116.
[8]
El-Khateeb A. A., Refat M.: Sounds from the past, the acoustics of Sultan Hassan Mosque and Madrassa. In Building Acoustics 14, 2 (2007), pp. 109--132.
[9]
Karabiber Z.: A new approach to an ancient subject: CAHRISMA project. In Proc. of the 7th Int. Congress on Sound and Vibration, Garmisch-Partekirchen, Germany: Int. Institute of Acoustics and Vibration (2000), pp. 1661--1668.
[10]
Krome T., Erdol N.: An exploration of sampling phenomena using the iPhone. In Digital Signal Processing Workshop and 5th IEEE Signal Processsing Education Workshop (2009), pp. 416--418.
[11]
Lim C. K., Tan K. L., Talib A. Z.: A low-cost method for generating panoramic views for a mobile virtual heritage application. In E. Ariwa and E. El-Qawasmeh (Eds.): DEIS 2011, Springer-Verlag Berlin Heidelberg CCIS 194 (2011), pp. 501--512, 2011.
[12]
Lim C. K., Tan K. L., Talib A. Z.: Acoustical heritage for virtual tourism on mobile platform. In Proc. of Int. Conf. on e-Education, Entertainment and e-Management (ICEEE) (December 27--29 2011), Jakarta, Indonesia, pp. 273--276.
[13]
Lim C. K., Tan K. L., Talib A. Z.: Low-cost methods for generating panoramic view for a mobile virtual heritage application and its application to the heritage zone of George Town Malaysia. In Int. Journal of E-Entrepreneurship and Innovation IJEEI 2 (2011), Issue 4, pp. 58--73.
[14]
Luz F. C., Jorge R. P., Bila V.: Robosonic: Randomness-based manipulation of sounds assisted by robots. In Proc. of the 3rd Intelligent Technologies for Interactive Entertainment, INTETAIN, Amsterdam, Netherlands, LNICST 9 (June 2009), pp. 143--152.
[15]
Papagiannakis G., Foni A., Magnenat-Thalmann N.: Real-time recreated ceremonies in VR restituted cultural heritage sites. In CIPA XIXth Int. Symposium (2003), pp. 235--240.
[16]
Parati L., Gade A. C., Pompoli R., Rindel J. H.: Acoustical improvement of a historical opera house using room simulations. In Proc. of XIXth Int. Symposium CIPA (2003), Antalya, Turkey, pp. 231--234.
[17]
Paterson N., Naliuka K., Jensen S. K., Carrigy T., Haahr M.: (2010) Design, Implementation and Evaluation of Audio for a Location Aware Augmented Reality Game, Proc. of 3rd Int. Conf. on Fun and Games, New York, USA, pp.149--156.
[18]
Perry T.: Ge Wang: The iPhone's music man. In IEEE Spectrum 46 (2009), Issue 9, September 2009, pp. 24.
[19]
Reatti E., Tronchin L., Deinca V. T.: Advanced techniques for the determination of sound spatialisation in italian opera theatres. In 9th WSEAS Int. Conf. on Acoustics and Music: Theory & Applications (AMTA) (June 24--26 2008), Bucharest, Romania, pp. 133--137.
[20]
Rindel J. H.: Preserving the acoustical heritage of historical buildings. In 4th European Congress on Acoustics, Forum Acusticum 2005, 91/51, Article No. 4940, (29 August -- 2 September 2005), S. Hirzel, Verlag, Hungary, p. 137.
[21]
Robinson D., Hawksford M.: Psychoacoustic models and non-linear human hearing. In Proc. of the 109th Convention of the Audio Engineering Society (September 2000), Los Angeles, pp. 5228--5242.
[22]
Yuksel Z., Erdogan S., Ayangil R., Unver R., Binan C., Can C.: (2005) Audio-visual conservation and restitution of the antic theatres in virtual environment: ERATO research project, In MEGANON 1 (December 2005), Issue 1, pp. 1--8
Index Terms
- Randomized psychoacoustic model for mobile, panoramic, heritage-viewing applications
Recommendations
A Frequency Domain Nonlinearity for Stereo Echo Cancellation
This letter proposes a novel nonlinear distortion for the unique identification of receiving room impulses in stereo acoustic echo cancellation when applying the frequency-domain adaptive filtering technique. This nonlinear distortion is effective in ...
Evaluation of psychoacoustic sound parameters for sonification
ICMI '17: Proceedings of the 19th ACM International Conference on Multimodal InteractionSonification designers have little theory or experimental evidence to guide the design of data-to-sound mappings. Many mappings use acoustic representations of data values which do not correspond with the listener's perception of how that data value ...
A Combined Psychoacoustic Approach for Stereo Acoustic Echo Cancellation
Acoustic echo cancelers (AECs) are used in teleconferencing systems to reduce undesired echoes originating from coupling between the loudspeaker and the microphone. Better performance in terms of sound localization can be achieved only by using ...
Comments
Information & Contributors
Information
Published In
December 2012
355 pages
ISBN:9781450318259
DOI:10.1145/2407516
- Conference Chairs:
- Daniel Thalmann,
- Enhua Wu,
- Zhigeng Pan,
- Program Chairs:
- Abdennour El Rhalibi,
- Nadia Magnenat-Thalmann,
- Matt Adcock
Copyright © 2012 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 02 December 2012
Check for updates
Author Tags
Qualifiers
- Research-article
Conference
VRCAI 2012
Sponsor:
VRCAI 2012: Virtual Reality Continuum and its Applications in Industry
December 2 - 4, 2012
Singapore, Singapore
Acceptance Rates
Overall Acceptance Rate 51 of 107 submissions, 48%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 110Total Downloads
- Downloads (Last 12 months)4
- Downloads (Last 6 weeks)0
Reflects downloads up to 27 Feb 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in