Abstract
Sequences of visual and haptic exploration were obtained on surfaces of different curvature from human subjects. We then extracted regions of interest (ROI) from the data as a function of number of times a subject fixated on a certain location on object and amount of time spent on such each location. Simple models like a plane, cone, cylinder, paraboloid, hyperboloid, ellipsoid, simple-saddle and a monkey-saddle were generated. Gaussian curvature representation of each point on all the surfaces was pre-computed. The surfaces have been previously tested for haptic and visual realism and distinctness by human subjects in a separate experiment. Both visual and haptic rendering were subsequently used for exploration by human subjects to study whether there is a similarity between the visual ROI and haptic ROIs. Additionally, we wanted to see if there is a correlation between curvature values and the ROIs thus obtained. A multiple regression model was further developed to see if this data can be used to predict the visual exploration path using haptic curvature saliency measures.
Chapter PDF
References
Ballard, D.H.: Cortical connections and parallel processing: Structure and function. In: Arbib, M.A., Hanson, A.R. (eds.) Vision, brain, and cooperative computation, pp. 563–621. MIT Press, Cambridge (1986)
Brown, J.M., Weisstein, N., May, J.G.: Visual search for simple volumetric shapes. Perception and Psychophysics 51(4), 42–48 (1992)
Cheal, M., Lyon, D.: Attention in visual search: Multiple search classes. Perception and Psychophysics 52(2), 113–138 (1992)
Ernst, M.O., Banks, M.S.: Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415(6870), 429–433 (2002)
Itti, L., Koch, C., Neibur, E.: A model of saliency-based visual attention for rapid scene analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence 20(11), 1254–1259 (1998)
Jenmalm, P., Birznieks, I.I., Goodwin, A., Johansson, R.: Differential responses in populations of fingertip tactile afferents to objects’ surface curvatures. Acta. Physiologica Scandinavica A24, 181
Mesulam, M.-M.: From sensation to cognition. Brain 121, 1013–1052 (1998)
Ouerhani, N., Hugli, H.: Computing visual attention from scene depth. In: Paper presented at the 15th International Conference on Pattern Recognition (2000)
Pashler, H. (ed.): Attention. University College London Press, London (1998)
Posner, M.I., Dehaene, S.: Attentional networks. Trends in Neuroscience 17, 75–79 (1994)
Riggs, L.A.: Curvature as a feature of pattern vision. Science 181, 1070–1072 (1973)
Spence, C., Driver, J. (eds.): Crossmodal space and crossmodal attention. Oxford University Press Inc., USA (2004)
Sridaran, A., Hansford, D., Kahol, K., Panchanathan, S.: Surface interrogation methods for haptic rendering of virtual objects. Paper presented at the World Haptics 2007, Tsukuba, Japan (March 22-24, 2007)
Sun, J., Perona, P.: Preattentive perception of elementary three dimensional shapes. Invest. Ophtalmol. Vis. Sci. 41(Supplement), 1083 (1993)
Tsotsos, J.K.: Analyzing vision at the complexity level. Brain and Behavioral Sciences 13, 423 (1990)
Tsotsos, J.K.: Computaional resources do constrain behavior. Brain and Behavioral Sciences 13, 506 (1991)
Wolfe, J.: Visual search. In: Pashler, H. (ed.) Attention, University College London Press, London, UK (1998)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Tripathi, P., Kahol, K., Sridaran, A., Panchanathan, S. (2007). A Model for Visio-Haptic Attention for Efficient Resource Allocation in Multimodal Environments. In: Schmorrow, D.D., Reeves, L.M. (eds) Foundations of Augmented Cognition. FAC 2007. Lecture Notes in Computer Science(), vol 4565. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-73216-7_37
Download citation
DOI: https://doi.org/10.1007/978-3-540-73216-7_37
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-73215-0
Online ISBN: 978-3-540-73216-7
eBook Packages: Computer ScienceComputer Science (R0)