Abstract
This study has as a central focus the role that pre-linguistic non- verbal information plays in the construction of meaning. More specifically this study explores the role that mental representations - triggered by exposure to “visual sentences” - play on the understanding of written sentences describing them. Ninety-four university graduate and undergraduate students participated in this experimental study characterized by wo modalities (plausible vs. implausible) and four different conditions allowing for the matching up of each visual sentence (Image) with the written sentence (Text) describing it (or not). The results, which are meant to measure (1) the length of time that each participant took to decide whether or not the written sentence described the visual one, and (2) the number of errors that occurred during this decision making process, show that the length of time was shorter when both the visual and the written sentence were plausible. More errors occurred when the written text describing the visual sentence was implausible.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Jackendoff, R.: An Argument on the Composition of Conceptual Structures. In: Theoretical Issues in Natural Language Processing, July 25-27, vol. 2, University of Illinois at Urbana-Champaign (1978)
Pasolini, P.P.: Emirismo Eretico. Saggi Ed. Garzanti (1972); Colin, M.: Structures Syntaxiques du Message Filmique. Documents de Travail. Centro Internazionale di Semiotica e di Linguistica, Univesità di Urbino (Settembre-Ottobre 1985)
Rastier, F.: Sémantique interprétative. PUF, Paris (1987)
Ferretti, T.R., McRae, K., Hatherell, A.: Integrating Verbs, Situation Schemas, and Thematic Role Concepts. Journal of Memory and Language 44, 516–547 (2001)
Cordier, F., Pariollaud, F.: From the choice of the patients for a transitive verb to its polysemy. Current Psychology Letters 21(1) (2007)
Kupersberg, G., Caplan, D., Sitnikova, T.: Neural Correlates of processing syntactic, semantic, and thematic relationships in sentences. Language and cognitive processes 21(5), 489–530 (2006)
McRae, K., Spivey-Knowlton, M.J., Tanenhaus, M.K.: Modeling the influente of thematic fit (and other constraints) in on-line sentence comprehension. Journal of Memory and Language 38, 283–312 (1998)
Le Ny, J.-F.: La sémantique des verbes et la représentation des situations. Syntaxe 1 Sémantique – Sémantique du lexique verbal 2 (2000)
Visetti, Y.-M.: La place de l’action dans les linguistiques cognitives. Texto, 1mars (1998)
Rosenthal, V.: Perception comme anticipation: vie perceptive et microgenèse. In: Sock, R., Vaxelaire, B. (eds.) L’Anticipation à l’horizon du Présent, pp. 13–32. Mardaga, Liège (Collection Psychologie et Sciences Humaines) (2004)
Valette, M.: Linguistique énonciative et cognitives françaises. Ed. Honoré Champion, Paris (2006)
Barsalou, L.W.: Perceptual symbol systems. Behavioral and Brain Sciences 22, 577–660 (1999)
Zwaan, R.A., Radvansky, G.A.: Situation Models in Language Comprehension and Memory. Psychological Bulletin 123(2), 167–185 (1998)
Glenberg, A.M., Robertson, D.A.: Symbol Grounding and Meaning: A Comparison of High Dimensional and Embodied Theories of Meaning. Journal of Memory and Language 43, 379–401 (2000)
Varela, F.: L’inscription corporelle de l’esprit. Seuil, Paris (1993)
Zlatev, J.: Intersubjectivity, Mimetic Schemas and the Emergente of Language. Intellectica 2-3, 123-151, 46–48 (2007)
Bergen, B.K., Chang, N.: Embodied Construction Grammar in Simulation-Based Language Understanding. In: Östman, J.O., Fried, M. (eds.) Construction Grammar(s): Cognitive and Cross-Language Dimensions, John Benjamin (2003)
Gibson, J.J., Gibson, E.J.: Perceptual learning: Differentiation or enrichment? Psychological Review 62, 32–41 (1955)
Zwaan, R.A., Taylor, L.J.: Seeing, Acting, Understanding: Motor Resonance in Language Comprehension. Journal of Experimental Psychology: General 135(1), 1–11 (2006)
Bonin, P., Peerman, R., Malardier, N., Meot, A., Clalard, M.: A new set of 299 pictures for psycholinguistic studies: French norms for name agreement, image agreement. Journal of Behavior Research Methods, Instruments1 Computers 35(1), 158–167 (2003)
Alario, F.-X., Ferrand, L.: A set of 400 pictures standardized for French: Norms for name agreement, image agreement, familiarity, visual complexity, image variability and age of acquisition. Journal of Beahvior, Research, Methods, Instruments & Computers 31, 531–552 (1999)
Thompson, C.K.: Neural Corelates of Verb Argument Structure Processing. Journal of Cognitive Neuroscience 19(11), 1753–1767 (2007)
Pariollaud, F., Cordier, F., Granjou, L., Ros, C.: (à paraître) Une base de données en sémantique du verbe: SEMASIT. Psychologie Française
Madden, C.J., Therriault, D.J.: Verb aspect and perceptual simulations. The Quarterly Journal of Experimental Psychology, 1–10 (2009)
Taylor, L.J., Zwaan, R.A.: Action in Cognition: The Case of Language. In: Language and Cognition: A journal of Language and Cognitive Science, available on the web
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Volpe, R. (2011). Representing Meaning in Mind: When Predicate Argument Structures Meet Mental Representations. In: Esposito, A., Esposito, A.M., Martone, R., Müller, V.C., Scarpetta, G. (eds) Toward Autonomous, Adaptive, and Context-Aware Multimodal Interfaces. Theoretical and Practical Issues. Lecture Notes in Computer Science, vol 6456. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-18184-9_15
Download citation
DOI: https://doi.org/10.1007/978-3-642-18184-9_15
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-18183-2
Online ISBN: 978-3-642-18184-9
eBook Packages: Computer ScienceComputer Science (R0)