Abstract
Cognitive infocommunication channels are abstract channels which use a combination of sensory substitution and sensorimotor extension to convey structured information via any number of sensory modalities. Our goal is to develop engineering systems which are capable of using cognitive infocommunication channels in order to convey feedback information in novel and meaningful ways. Such applications could help reduce the cognitive load experienced by the user on the one hand, and help alleviate the undesirable effects of hidden parameters on the other. We describe the main challenge behind the development of cognitive infocommunication channels as a two-part problem which consists of the design of a synthesis algorithm and the design of a parameter-generating function for the synthesis algorithm. We use formal concept algebra to describe the kinds of synthesis algorithms which are capable of reflecting realistic forms of interaction between the user and the information which is to be communicated. Using this model, we describe an application example in which auditory signals are used to convey information on tactile percepts. Through an experimental evaluation of the application, we demonstrate that our approach can be used successfully for the design of cognitive infocommunication channels.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Arno, P., Vanlierde, A., Streel, E., Wanet-Defalque, M.C., Sanabria-Bohorquez, S., Veraart, C.: Auditory substitution of vision: pattern recognition by the blind. Applied Cognitive Psychology 15(5), 509–519 (2001)
Auvray, M., Myin, E.: Perception with compensatory devices: from sensory substitution to sensorimotor extension. Cognitive Science 33, 1036–1058 (2009)
Auvray, M., Philipona, D., O’Regan, J., Spence, C.: The perception of space and form recognition in a simulated environment: The case of minimalist sensory-substitution. Perception 36, 1736–1751 (2007)
Barnard, M.: Graphic Design as Communication. Taylor and Francis Group, Routledge (2005)
Barrass, S.: Auditory information design. PhD thesis, Australian National University (1997)
Blattner, M., Sumikawa, D., Greenberg, R.: Earcons and icons: Their structure and common design principles. Human Computer Interaction 4(1), 11–44 (1989)
Brewster, S.: Providing a structured method for integrating non-speech audio into human-computer interfaces. PhD thesis, University of York (1994)
Csapó, A., Baranyi, P.: An interaction-based model for auditory subsitution of tactile percepts. In: IEEE International Conference on Intelligent Engineering Systems, INES (2010)
Fletcher, H., Munson, W.: Loudness, its definition, measurement and calculation. Journal of the Acoustical Society of America 5, 82–108 (1933)
Ganter, B., Wille, R.: Formal Concept Analysis. Springer, Germany (1999)
Gaver, W.: Auditory icons: Using sound in computer interfaces. Human Computer Interaction 2(2), 167–177 (1986)
Gaver, W.: The sonicfinder: An interface that uses auditory icons. Human Computer Interaction 4(1), 67–94 (1989)
Glasberg, B., Moore, B.: Derivation of auditory filter shapes from notched-noise data. Hearing Research 46, 103–138 (1990)
Hollins, M., Risner, S.: Evidence for the duplex theory of tactile texture perception. Perceptual Psychophysics 62, 695–705 (2000)
Lathauwer, L.D., Moor, B.D., Vandewalle, J.: A multi linear singular value decomposition. SIAM Journal on Matrix Analysis and Applications 21(4), 1253–1278 (2000)
Massimino, M.: Sensory substitution for force feedback in space teleoperation. PhD thesis, MIT, Dept. of Mechanical Engineering (1992)
Moore, B., Glasberg, B.: A revision of Zwicker’s loudness model. Acta Acustica 82, 335–345 (1996)
Bach-y-Rita, P.: Tactile sensory substitution studies. Annals of New York Academic Sciences 1013, 83–91 (2004)
Bach-y-Rita, P., Tyler, P., Kaczmarek, K.: Seeing with the brain. International Journal of Human-Computer Interaction 15(2), 285–295 (2003)
Robinson, D., Dadson, R.: Threshold of hearing and equal-loudness relations for pure tones, and the loudness function. Journal of the Acoustical Society of America 29, 1284–1288 (1957)
Schmorrow, D.: Foundations of Augmented Cogntition. Lawrence Erlbaum Associates, Mahwah (2005)
Schmorrow, D., Kruse, A.: Augmented cognition. In: Bainbridge, W. (ed.) Berkshire Encyclopedia of Human-Computer Interaction, pp. 54–59. Berskshire Publishing Group (2004)
Wang, Y.: On concept algebra: A denotational mathematical structure for knowledge and software modeling. International Journal of Cognitive Informatics and Natural Intelligence 2(2), 1–19 (2008)
Yoshioka, T., Bensmaia, S., Craig, J., Hsiao, S.: Texture perception through direct and indirect touch: an analysis of perceptual space for tactile textures in two modes of exploration. Somatosensory and Motor Research 24(1-2), 53–70 (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Csapó, Á., Baranyi, P. (2012). A Conceptual Framework for the Design of Audio Based Cognitive Infocommunication Channels. In: Fodor, J., Klempous, R., Suárez Araujo, C.P. (eds) Recent Advances in Intelligent Engineering Systems. Studies in Computational Intelligence, vol 378. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-23229-9_12
Download citation
DOI: https://doi.org/10.1007/978-3-642-23229-9_12
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-23228-2
Online ISBN: 978-3-642-23229-9
eBook Packages: EngineeringEngineering (R0)