Abstract
It has long been observed that certain words induce multiple synesthetic colors, a phenomenon that has remained largely unexplored. We report here on the distinct synesthetic colors two synesthetes experienced with closed sets of concepts (digits, weekdays, months). For example, Saturday was associated with green, like other word starting with s; however, Saturday also had its specific color (red). Auditory priming and Visual Color Stroop tasks were used to understand the cognitive mechanisms supporting the distinct synesthetic colors. Results revealed that processing of word segments and whole words was specifically involved in each type of synesthetic colors. However, these mechanisms differed between participants, as they could relate either to orthography (and written words) or phonology (and spoken words). Further differences concerned the word representations, which varied as to whether or not they encoded serial positions. In addition to clarifying the cognitive mechanisms underlying the distinct synesthetic colors, our results offer some clues for understanding the neurocognitive underpinnings of a rather common form of synesthesia.
Notes
The hypothesis that VS’s synesthesia involved print-to-sound transcoding mechanisms could also be tested with letter clusters mapping onto single phonemes (wr → /r/as in wrinkle; ph → /f/as in photo). Because these mechanisms operate without lexical support, the sounds of individual letters (/w/and/r/with wrinkle;/p/and/f/with photo) are derived in addition to the correct sounds corresponding to letter clusters. Consequently, letters and letter clusters would both contribute to the synesthetic colors. Results from VS’s color assignment were consistent with this prediction. We selected 13 word triplets like wrinkle-ringlet-welcome, for which we obtained synesthetic colors following the procedure described in the Case Description section. Synesthetic colors were also obtained for pairs of randomly selected words sharing no common letters in initial positions (e.g., crumble-studio). As shown by Euclidean distances, synesthetic colors were more similar between wrinkle-ringlet (56.6) and between wrinkle-welcome (22.1) than between crumble-studio (78.9; ps > .0001). These results suggest that letter clusters and individual letters could both affect synesthetic colors, as anticipated by the hypothesis that sound-to-print transcoding mechanisms were at play in VS’s synesthesia.
We controlled the effect of color-associated printed words to ensure that VB was sensitive to semantic effects in the Visual Color Stroop Task at 0 SOA. We tested seven words strongly associated with a color (ash-gray, blood-red, chocolate-brown, grass-green, lemon-yellow, sky-blue, and tar-black). Each word was paired seven times with its associated color (sky-blue) and 7 times with another color (sky-green). The finding of a sizable facilitation of 39 ms (648 vs. 687 ms; F(1, 82) = 4.6, p < .05, η2 = .04) showed that VS could access aspects of the meaning related to colors with written words at 0 SOA.
In this respect, it was indicative that pale colors were chosen for items at the beginning of sequences (1, Monday, January) when VS selected word colors. This pattern, also observed with other synesthetes (Mills et al., 1999), might appear especially with word colors that, as we found with VS, were associated with sequences. Furthermore, it is perhaps not coincidental that associations with color names (B → blue) and associations found early in childhood (I, O → white; Spector and Maurer 2011) appeared when VS assigned segment colors. It is in fact segment colors that should be related to phonemes and the earliest multimodal associations.
References
Anderson JE, Holcomb PJ (1995) Auditory and visual semantic priming using different stimulus onset asynchronies: an event-related brain potential study. Psychophysiology 32:177–190
Baron-Cohen S, Wyke MA, Binnie C (1987) Hearing words and seeing colours: an experimental investigation of a case of synaesthesia. Perception 16:761
Baron-Cohen S, Harrison J, Goldstein LH, Wyke MA (1993) Coloured speech perception: is synaesthesia what happens when modularity breaks down? Perception 22:419–426
Beeli G, Esslen M, Jäncke L (2007) Frequency correlates in grapheme-color synaesthesia. Psychol Sci 18:788–792
Beeli G, Esslen M, Jäncke L (2008) Time course of neural activity correlated with colored-hearing synesthesia. Cereb Cortex 35:379–385
Binder JR, Desai RH, Graves WW, Conant LL (2009) Where is the semantic system? A critical review and meta-analysis of 120 functional neuroimaging studies. Cereb Cortex 19:2767–2796
Binet A, Philippe J (1892) Étude sur un nouveau cas d’audition colorée. Revue Philosophique 33:461–464
Bleuler E, Lehmann K (1881) Zwangmässige Lichtempfindungen durch Schall und verwandte Erscheinungen. Fuesverlag, Leipzig
Brang D, Hubbard EM, Huang M, Ramachandran VS (2010) Magnetoencephalography reveals early activation of V4 in grapheme-color synesthesia. NeuroImage 53:268–274
Brang D, Kanai S, Ramachandran VS, Coulson S (2011) Contextual priming in grapheme-color synesthetes and yoked controls: 400 ms in the life of a synesthete. J Cogn Neurosci 23:1681–1696
Carreiras M, Ferrand L, Grainger J, Perea M (2005) Sequential effects of masked phonological priming. Psychol Sci 16:585–589
Cohen L, Dehaene S, Naccache L, Lehéricy S, Dehaene-Lambertz G, Hénaff M, Michel F (2000) The visual word form area: spatial and temporal characterization of an initial stage of reading in normal and posterior split-brain patients. Brain 123:291–307
Coltheart M, Rastle K, Perry C, Langdon R, Ziegler J (2001) DRC: a dual route cascaded model of visual word recognition and reading aloud. Psychol Rev 108:204–256
Cytowic RE, Wood FB (1982) Synaesthesia I: a review of major theories and their brain basis. Brain Cogn 1:23–35
Damian MF, Bowers JS (2003a) Effects of orthography on speech production in a form-preparation paradigm. J Mem Lang 49:119–132
Damian MF, Bowers JS (2003b) Locus of semantic interference in picture-word interference tasks. Psychon Bull Rev 10:111–117
Davis CJ (2010) The spatial coding model of visual word identification. Psychol Rev 117:713–758
Day S (2005) Some demographic and socio-cultural aspects of synesthesia. In: Robertson LC, Sagiv N (eds) Synesthesia: Perspectives from cognitive neuroscience. Oxford University Press, New York (NY), pp 3–10
Dehaene S, Cohen L (2011) The unique role of the visual word form in reading. Trends Cogn Sci 15:254–262
Dixon MJ, Smilek D, Cudahy C, Merikle PM (2000) Five plus two equals yellow. Nature 406:365
Dixon MJ, Smilek D, Merikle PM (2004) Not all synaesthetes are created equal: projector versus associator synaesthetes. Cogn Affect Behav Neurosci 4:335–343
Dixon MJ, Smilek D, Duffy PL, Zanna MP, Merikle PM (2006) The role of meaning in grapheme-colour synaesthesia. Cortex 42:243–252
Dovern A, Fink GR, Fromme ACB, Wohlschlager AM, Weiss PH, Riedl V (2012) Intrinsic network connectivity reflects consistency of synesthetic experiences. J Neurosci 32:7614–7621
Frost R, Ahissar M, Gottesman R, Tayeb S (2003) Are phonological effects fragile? The effect of luminance and exposure duration on form priming and phonological priming. J Mem Lang 48:346–378
Galton F (1883) Inquiries into human faculty and its development. Macmillan, London
Gebius T, Nijboer TCW, Van der Smagt MJ (2009) Multiple dimensions in bi-directional synesthesia. Eur J Neurosci 29:1703–1710
Goller AI, Otten LJ, Ward J (2008) Seeing sounds and hearing words: an event-related potential study of auditory-visual synesthesia. J Cogn Neurosci 21:1869–1881
Grainger J (1990) Word frequency and neighborhood frequency effects in lexical decision and naming. J Mem Lang 29:228–244
Grainger J, Kiyonaga K, Holcomb PJ (2006) The time course of orthographic and phonological code activation. Psychol Sci 17:1021–1026
Grainger J, Rey A, Dufau S (2008) Letter perception: from pixel to pandemonium. Trends Cogn Sci 12:381–387
Gray JA, Parslow DM, Brammer MJ, Chopping S, Vythelingum GN, Fytche DH (2006) Evidence against functionalism from neuroimaging of the alien colour effect in synaesthesia. Cortex 42:309–318
Gross VC, Neargarder S, Caldwell-Harris CL, Cronin-Golomb A (2011) Superior encoding enhances recall in color-graphemic synesthesia. Perception 40:196–208
Grossenbacher PG, Lovelace CT (2001) Mechanisms of synesthesia: cognitive and physiological constraints. Trends Cogn Sci 5:36–41
Hancock P (2013) Synesthesia, alphabet books, and fridge magnets. In: Simner J, Hubbard EM (eds) The Oxford handbook of synesthesia. Oxford University Press, Oxford
Hänggi J, Wotruba D, Jäncke L (2011) Globally altered structural brain network topology in grapheme-color synesthesia. J Neurosci 31(15):5816–5828
Harrison J (2001) Synesthesia: the strangest thing. Oxford University Press, Oxford
Hillis AE, Newhart M, Heidler J, Barker P, Herskovits E, Degaonkar M (2005) The roles of the ‘visual word form area’ in reading. Neuroimage 24:548–559
Holden ES (1885) Color and other associations. Science 6:242–243
Hubbarb EM, Piazza M, Pinel P, Dehaene S (2005) Interactions between number and space in parietal cortex. Nat Rev Neurosci 6:435–448
Hupé JM, Doja M (2014) A critical review of the neuroimaging literature on synesthesia. Front Hum Neurosci 9
Jäncke L (2013) The timing of neurophysiological events in synesthesia. In: Simner J, Hubbard E (eds) The Oxford handbook of synesthesia. Oxford University Press, Oxford
Jäncke L, Beeli G, Eulig C, Hänggi J (2009) The neuroanatomy of grapheme-color synesthesia. Eur J Neurosci 29:1287–1293
Jobard G, Crivello F, Tzourio-Mazoyer N (2003) Evaluation of the dual route theory of reading: a metanalysis of 35 neuroimaging studies. Neuroimage 20:693–712
Johnson D, Allison C, Baron-Cohen S (2013) The prevalence of synesthesia: the consistency revolution. In: Simner J, Hubbard E (eds) The Oxford handbook of synesthesia. Oxford University Press, Oxford
Jonas C, Jarick M (2013) Synesthesia, sequences, and space. In: Simner J, Hubbard EM (eds) The Oxford handbook of synesthesia. Oxford University Press, Oxford
Krohn WO (1892) Pseudo-chromesthesia, or the association of colors with words, letters and sounds. Am J Psychol 5:20–41
Kronbichler M, Klacl J, Richlan F, Schurz M, Staffen W, Ladurner G, Wimmer H (2008) On the functional neuroanatomy of visual word processing: effects of case and letter deviance. J Cogn Neurosci 21:222–229
Laeng B, Svartdal F, Oelmann H (2004) Does color synesthesia pose a paradox for early-selection theories of attention? Psychol Sci 15:277–281
Laeng B, Hugdahl K, Specht K (2011) The neural correlate of colour distances revealed with competing synaesthetic and real colours. Cortex 47:320–331
Levelt WJM, Roelofs A, Meyer AS (1999) A theory of lexical access in speech production. Behav Brain Sci 22:1–75
Lewandowsky S, Murdock BB Jr (1989) Memory for serial order. Psychol Rev 96:25–57
Lukatela G, Turvey MT (1990) Automatic and pre-lexical computation of phonology in visual word identification. Eur J Cogn Psychol 2:325–344
MacLeod CM (1991) Half a century of research on the Stroop effect: an integrative review. Psychol Bull 109:163–203
Marks LE (1975) On coloured-hearing synesthesia: cross-modal translations of sensory dimensions. Psychol Bull 82:303–331
Marslen-Wilson WD (1987) Functional parallelism in spoken word recognition. Cognition 25:71–102
Martin A (2007) The representation of object concepts in the brain. Annu Rev Psychol 58:25–45
Mattingley JB, Rich AN, Bradshaw JL (2001) Unconscious priming eliminates automatic binding of colour and alphanumeric form in synaesthesia. Nature 410:580–582
Maurer D (1997) Neonatal synesthesia: implications for the processing of speech and faces. In: Baron-Cohen S, Harrison JE (eds) Synaesthesia: classic and contemporary readings. Blackwell, Oxford
McClelland JL, Elman JL (1986) The TRACE model of speech perception. Cogn Psychol 18:1–86
McNamara TP (2005) Semantic priming: perspectives from memory and word recognition. Psychology Press, New York
McQueen I (2007) Eight questions about spoken word recognition. In: Gaskell GM (ed) The Oxford handbook of psycholinguistics. Oxford University Press, New York (NY)
Mills CB, Boteler EH, Oliver GK (1999) Digit synaesthesia: a case study using a Stroop-type test. Cogn Neuropsychol 16:181–191
Miozzo M, Caramazza A (2003) When more is less: a counterintuitive effect of distractor frequency in the picture-word interference paradigm. J Exp Psychol Gen 132:228–252
Miozzo M, Hauk O, Pulvermüller F (2014) Early parallel activation of semantics and phonology in picture naming: evidence from a multiple-linear-regression MEG Study. Cereb Cortex
Moyer RS, Landauer TK (1967) Time required for judgments of numerical inequality. Nature 215:1519–1520
Myles KM, Dixon MJ, Smilek D, Merikle PM (2003) Seeing double: the role of meaning in alphanumeric-colour synaesthesia. Brain Cogn 53:342–345
Pariyadath V, Plitt MH, Churchill SJ, Eagleman DM (2012) Why overlearned sequences are special: distinct neural networks for ordinal sequences. Front Hum Neurosci. doi:10.3389/fnhum.2012.00328
Paulesu E, Harrison J, Baron-Cohen S, Watson JDG, Goldstein L, Heather J, Frackowiak RSJ, Frith CD (1995) The physiology of coloured hearing: a PET activation study of colour-word synaesthesia. Brain 118:661–676
Perea M, Pollatsek A (1998) The effects of neighborhood frequency in reading and lexical decision. J Exp Psychol Hum Percept Perform 24:767–779
Pinel P, Piazza M, Le Bihan S, Dehaene S (2004) Distributed and overlapping cerebral representations of number, size, and luminance during comparative judgments. Neuron 41:983–993
Plaut DC, McClelland JL, Seidenberg MS, Patterson K (1996) Understanding normal and impaired word reading: computational principles in quasi-regular domains. Psychol Rev 103:56
Poeppel D, Monahan PJ (2008) Speech perception: cognitive foundations and cortical implementation. Curr Dir Psychol Sci 17:80–85
Price CJ (2012) A review and synthesis of the first 20 years of PET and fMRI studies of heard speech, spoken language and reading. NeuroImage 62:816–847
Price CJ, Devlin JT (2011) The interactive account of ventral occipitotemporal contributions to reading. Trends Cogn Sci 15:246–253
Radvansky G, Gibson BS, McNerney MW (2011) Synesthesia and memory: color congruency, von Restorff, and false memory effects. J Exp Psychol Learn Mem Cogn 37:219–229
Rapp B, Lipka K (2011) The literate brain: the relationship between spelling and reading. J Cogn Neurosci 23:1180–1197
Remez RE (2005) Perceptual organization of speech. In: Pisoni DB, Remez RE (eds) The handbook of speech perception. Basil Blackwell, Oxford
Rich AN, Bradshaw JL, Mattingley JB (2005) A systematic, large-scale study of synaesthesia: implications for the role of early experience in lexical-colour associations. Cognition 98:53–84
Rothen N, Meier B (2010) Grapheme-colour synaesthesia yields ordinary rather than extraordinary memory advantage: evidence from a group study. Memory 18:258–264
Rouw R (2013) Synesthesia, hyperconnectivity, and diffusion tensor imaging. In: Simner J, Hubbard E (eds) The Oxford handbook of synesthesia. Oxford University Press, Oxford
Rouw R, Scholte HS (2007) Increased structural connectivity in grapheme-color synesthesia. Nat Neurosci 10:792–797
Sachs GTL (1812) Historiae naturalis duorum leucaetiopum: auctoris ipsius et sororis eius. Sumptibus Bibliopolii Seideliani, Solisbaci
Sagiv N, Simner J, Collins J, Butterworth B, Ward J (2006) What is the relationship between synaesthesia and visuo-spatial number forms? Cognition 101:114–128
Shanon B (1982) Colour associates to semantic linear orders. Psychol Res 44:75–83
Simner J (2006) Beyond perception: synaesthesia as a psycholinguistic phenomenon. Trends Cogn Sci 11:24–29
Simner J, Bain AE (2013) A longitudinal study of grapheme-color synesthesia in childhood: 6/7 years to 10/11 years. Front Hum Neurosci 7
Simner J, Haywood SL (2009) Tasty non-words and neighbours: the cognitive roots of lexical-gustatory synaesthesia. Cognition 110:171–181
Simner J, Ward J, Lanz M, Jansari A, Noonan K, Glover L, Oakley DA (2005) Non-random associations of graphemes to colours in synaesthetic and non-synaesthetic populations. Cogn Neuropsychol 22:1069–1085
Simner J, Glover L, Mowat A (2006) Linguistic determinants of word colouring in grapheme-colour synaesthesia. Cortex 42:281–289
Simner J, Harrold J, Creed H, Monro L, Foulkes L (2009) Early detection of markers for synaesthesia in childhood populations. Brain 132:57–64
Smilek D, Dixon MJ, Merikle PM (2001) Synaesthetic photisms influence visual perception. J Cogn Neurosci 13:930–936
Spector F, Maurer D (2011) The colors of the alphabet: naturally-biased associations between shape and color. J Exp Psychol Hum Percept Perform 37:484–495
Tang J, Ward J, Butterworth B (2008) Number forms in the brain. J Cogn Neurosci 20:1547–1556
Tomson SN, Narayan M, Allen GI, Eagleman DM (2013) Neural networks of colored sequence synesthesia. J Neurosci 33:1498–14106
van Leeuwen TM, den Ouden HEN, Haagort P (2011) Effective connectivity determines the nature of subjective experiences in grapheme-color synesthesia. J Neurosci 31:9879–9884
Vigneau M, Beaucousin V, Herve PY, Duffau H, Crivello F, Houde O et al (2006) Meta-analyzing left hemisphere language areas: phonology, semantics, and sentence processing. Neuroimage 30:1414–1432
Vinckier F, Dehaene S, Jobert A, Dubus JP, Sigman M, Cohen L (2007) Hierarchical coding of letter strings in the ventral stream: dissecting the inner organization of the visual word-form system. Neuron 55:143–156
Vitevitch MS, Luce PA (1999) Probabilistic phonotactics and neighborhood activation in spoken recognition. J Mem Lang 40:374–408
Ward J, Simner J, Auyeung V (2005) A comparison of lexical-gustatory and grapheme-colour synaesthesia. Cogn Neuropsychol 22:28–41
Ward J, Huckstep B, Tsakanikos E (2006) Sound-color synaesthesia: to what extent does it use cross-modal mechanisms common to us all? Cortex 42:264–280
Woolen KA, Ruggiero FT (1983) Coloured-letter synaesthesia. J Ment Imag 7:83–86
Zorzi M, Houghton G, Butterworth B (1998) Two routes or one in reading aloud? A connectionist dual-process model. J Exp Psychol Hum Percept Perform 24(4):1131
Acknowledgments
We would like to thank Robert Remez and Torstein Låg for having discussed some aspects of this project with us. Most of all, our thanks go to the participants: their curiosity has really been contagious, and their insights have taught us a great deal about synesthesia.
Author information
Authors and Affiliations
Corresponding author
Additional information
Handling editor: Marta Olivetti Belardinelli, Sapienza University of Rome.
Reviewers: Aurora Rizza, Sapienza University of Rome; Lutz Jaencke, University of Zurich.
Rights and permissions
About this article
Cite this article
Miozzo, M., Laeng, B. Why Saturday could be both green and red in synesthesia. Cogn Process 17, 337–355 (2016). https://doi.org/10.1007/s10339-016-0769-2
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10339-016-0769-2