Skip to main content
Springer Nature Link
Log in

Mental Simulation of Implied Orientation Information in Chinese Sentences

  • Conference paper
  • First Online:
Emerging Technologies for Education (SETE 2023)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 14606))

Included in the following conference series:

  • 384 Accesses

Abstract

The traditional theory amodal symbol system was challenged by Barsalou’s Perceptual Symbol System theory. The Perceptual Symbol System theory indicates that perceptual symbols will be mentally simulated and automatically activated in the human brain in the process of language comprehension. Based on this theory, many empirical studies have provided evidence for mental simulation during language comprehension. However, object orientation, a critical part of perceptual information, has received less attention compared to other visual object attributes such as shape, color, and size. Furthermore, most studies in this field focused on English and other Indo-European languages, and the less research focused on Chinese to demonstrate the effectiveness of mental simulation. Therefore, the current paper aims to explore the mental simulation of object orientation information and its relationship with mental imagery in Chinese sentence comprehension. The classic sentence-picture recognition task was employed in the present research. Results showed that participants’ responses were more accurate and faster in the match condition than in the mismatch condition and in the vertical direction task than in the horizontal direction task. Additionally, the results of the Vividness of Visual Imagery Questionnaire showed no significant correlation between mental simulation and mental imagery. Therefore, it can be concluded that in the process of Chinese sentence comprehension, the human brain activates the perceptual symbol of the object orientation information and conducts corresponding mental simulation. The findings agree with the Perceptual Symbol System theory and provide further empirical evidence for the mental simulation of sentence comprehension and embodied cognition.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Newell, A., Simon, H.A.: Computer science as empirical inquiry: symbols and search. Commun. ACM 19(3), 205–211 (1976)

    Article  MathSciNet  Google Scholar 

  2. Barsalou, L.W.: Perceptual symbol systems. Behavioral & Brain Sciences 22(4), 577–609 (1999)

    Article  Google Scholar 

  3. Harnad, S.: The symbol grounding problem. Physica D 42(1–3), 335–346 (1990)

    Article  Google Scholar 

  4. Guan, Q.: A new interpretation of embodied cognition for language understanding: psychological simulation as a means of language comprehension. Psychol. Sci. 28(5), 1252–1256 (2007)

    Google Scholar 

  5. Stanfield, R.A., Zwaan, R.A.: The effect of implied orientation derived from verbal context on picture recognition. Psychol. Sci. 12, 153–156 (2001)

    Article  Google Scholar 

  6. Kozhevnikov, M., Kosslyn, S., Shephard, J.: Spatial versus object visualizers: A new characterization of visual cognitive style. Mem. Cognit. 33(4), 710–726 (2005)

    Article  Google Scholar 

  7. Blajenkova, O., Kozhevnikov, M., Mote, M.A.: Object-spatial imagery: A new self-report imagery questionnaire. Wiley 20(2), 239–263 (2006)

    Google Scholar 

  8. Zwaan, R., Yaxley, R.: Lateralization of object-shape information in semantic processing. Cognition 94(2), 35–43 (2004)

    Article  Google Scholar 

  9. Sato, M., Bergen, B.K.: Does implicit grammatical person influence perspective in mental simulation? J. Med. Syst. 28(28), 321–333 (2009)

    Google Scholar 

  10. Zwaan, R.A., Pecher, D.: Revisiting mental simulation in language comprehension: six replication attempts. PLoS ONE 7(12), e51382 (2012)

    Article  Google Scholar 

  11. Li, Y., Wang, R., Mo, L.: The impact of implied object shape information on picture recognition. Psychol. Sci. 28(3), 588–590 (2005)

    Google Scholar 

  12. Chang, X., Ling, X.: The influence of sentence features on object shape representation in language comprehension. Northwest. Normal Univ. J. Soc. Sci. Ed. 3, 138–144 (2017)

    Google Scholar 

  13. De Koning, B.B., Wassenburg, S.I., Bos, L.T., Van Dijk, S.M.: Mental simulation of four visual object properties: similarities and differences as assessed by the sentence-picture verification task. Theor. Exp. Plant Physiol. 29(4), 420–432 (2017)

    Google Scholar 

  14. Zhang, P., Lu, Z.: The psychological representation of color information in sentence comprehension. Acta Psychol. Sin. 45(4), 406–415 (2013)

    Article  MathSciNet  Google Scholar 

  15. Rommers, J., Meyer, A.S., Huettig, F.: Object shape and orientation do not routinely influence performance during language processing. Psychol. Sci. 24(11), 2218–2225 (2013)

    Article  Google Scholar 

  16. Bos, L.T., De Koning, B.B., Van Wesel, F., Boonstra, A.M., Van Dijk, S.M.: What can measures of text comprehension tell us about creative text production? Read. Writ. 28, 829–849 (2015)

    Article  Google Scholar 

  17. Borst, G., Kosslyn, S.M.: Visual mental imagery and visual perception: Structural equivalence revealed by scanning processes. Mem. Cognit. 36(4), 849–862 (2008)

    Article  Google Scholar 

  18. Bergen, B. K. (2007). Experimental methods for simulation semantics. Methods in Cognitive Linguistics, 277–301

    Google Scholar 

  19. Vermeulen, N., Corneille, O., Niedenthal, P.M.: Sensory load incurs conceptual processing costs. Cognition 109(2), 287–294 (2008)

    Article  Google Scholar 

  20. Pecher, D., Zeelenberg, R., Barsalou, L.W.: Verifying different-modality properties for concepts produces switching costs. Psychol. Sci. 14(2), 119–124 (2003)

    Article  Google Scholar 

  21. Wu, C.Y., Ho, M.H.R., Chen, S.H.A.: A meta-analysis of fMRI studies on Chinese orthographic, phonological, and semantic processing. Neuroimage 63(1), 381–391 (2012)

    Article  Google Scholar 

  22. Connell, L.: Representing object color in language comprehension. Cognition 102(3), 476–485 (2007)

    Article  MathSciNet  Google Scholar 

  23. Kaschak, M.P., et al.: Perception of motion affects language processing. Psychol. Sci. 94(3), B79–B89 (2005)

    Google Scholar 

  24. Kaschak, M.P., Zwaan, R.A., Aveyard, M., Yaxley, R.H.: Perception of auditory motion affects language processing. Cogn. Sci. 30(4), 733–744 (2006)

    Article  Google Scholar 

  25. Koster, D., Cadierno, T., Chiarandini, M.: Mental simulation of object orientation and size: A conceptual replication with second language learners. J. Eur. Second Lang. Assoc. 2(1), 38–48 (2018)

    Article  Google Scholar 

  26. Hayakawa, S., Keysar, B.: Using a foreign language reduces mental imagery. Cognition: Int. J. Cogn. Psychol. 173, 8–15 (2018)

    Google Scholar 

  27. Schacter, D.L., Addis, D.R.: Remembering the past to imagine the future: A cognitive neuroscience perspective. Mil. Psychol. 21(1), S108–S112 (2009)

    Article  Google Scholar 

  28. Baddeley, A.D., Andrade, J.: Working memory and the vividness of imagery. J. Exp. Psychol. Gen. 129(1), 126–145 (2000)

    Article  Google Scholar 

  29. Baba, S., Joel, H.: The impact of anticipating satisfaction on consumer choice. Journal of Consumer Research 27(2), 202–216 (2000)

    Article  Google Scholar 

  30. Wheeler, K.B., Greenspan, S.L.: Non-native language processing engages mental imagery. In Proceedings of the Annual Meeting of the Cognitive Science Society 28, 882–887 (2006)

    Google Scholar 

  31. Morrow, D.G., Greenspan, S.L., Bower, G.H.: Accessibility and situation models in narrative comprehension. J. Mem. Lang. 26(2), 165–187 (1987)

    Article  Google Scholar 

  32. Pecher, D., van Dantzig, S., Schifferstein, H.N.J.: Concepts are not represented by conscious imagery. Psychon. Bull. Rev. 16(5), 914–919 (2009)

    Article  Google Scholar 

  33. Rouw, R., Kosslyn, S.M., Hamel, R.: Detecting high-level and low-level properties in visual images and visual percepts. Cognition 63, 209–226 (1997)

    Article  Google Scholar 

  34. Laws, K.R.: Category-specific naming and modality-specific imagery. In 12th Annual Meeting on Tennet –Theoretical and Experimental (pp. 418–420) (2002)

    Google Scholar 

  35. Marks, D.F.: Visual imagery differences in the recall of pictures. Br. J. Psychol. 64(1), 17–24 (2011)

    Article  Google Scholar 

Download references

Funding

Funded by Youth Project of Liaoning Province Social Science Planning Fund (L18CYY001).

Author information

Authors and Affiliations

  1. School of Foreign Languages, Hangzhou City University, Hangzhou, China

    Huili Wang & Yang Fu

  2. School of Foreign Languages, Dalian University of Technology, Dalian, China

    Wei Li & Beixian Gu

  3. Department of English Teaching, Shenyang Normal University, Shenyang, China

    Xin Chang

  4. School of Education Sciences, Shenyang Normal University, Shenyang, China

    Wei Liu

Authors
  1. Huili Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Wei Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Beixian Gu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yang Fu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Xin Chang
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Wei Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Wei Liu .

Editor information

Editors and Affiliations

  1. Comenius University, Bratislava, Slovakia

    Zuzana Kubincová

  2. South China Normal University, Guangzhou, China

    Tianyong Hao

  3. University of Salerno, Fisciano, Italy

    Nicola Capuano

  4. Sapienza University of Rome, Rome, Italy

    Marco Temperini

  5. Guangdong University of Foreign Studies, Guangzhou, China

    Shili Ge

  6. Chaohu University, Hefei, China

    Yuanyuan Mu

  7. LUMSA University, Rome, Italy

    Paolo Fantozzi

  8. Zhejiang University, Hangzhou, China

    Jing Yang

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Wang, H., Li, W., Gu, B., Fu, Y., Chang, X., Liu, W. (2024). Mental Simulation of Implied Orientation Information in Chinese Sentences. In: Kubincová, Z., et al. Emerging Technologies for Education. SETE 2023. Lecture Notes in Computer Science, vol 14606. Springer, Singapore. https://doi.org/10.1007/978-981-97-4243-1_15

Download citation

  • DOI: https://doi.org/10.1007/978-981-97-4243-1_15

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-97-4242-4

  • Online ISBN: 978-981-97-4243-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics