Synesthesia

Synesthesia is a perceptual phenomenon in which stimulation of one sensory or cognitive pathway leads to involuntary experiences in a second sensory or cognitive pathway.[3][4][5][6] People who report a lifelong history of such experiences are known as synesthetes. Awareness of synesthetic perceptions varies from person to person.[7]

Synesthesia
Other namesSynaesthesia[1][2]
How someone with synesthesia might perceive certain letters and numbers. Synesthetes see characters just as others do (in whichever color actually displayed) but may simultaneously perceive colors as associated with or evoked by each one.
SpecialtyPsychiatry, neurology

In one common form of synesthesia, known as grapheme-color synesthesia or color-graphemic synesthesia, letters or numbers are perceived as inherently colored.[8][9] In spatial-sequence, or number form synesthesia, numbers, months of the year, or days of the week elicit precise locations in space (for example, 1980 may be "farther away" than 1990), or may appear as a three-dimensional map (clockwise or counterclockwise).[10][11] Synesthetic associations can occur in any combination and any number of senses or cognitive pathways.[12] Little is known about how synesthesia develops. It has been suggested that synesthesia develops during childhood when children are intensively engaged with abstract concepts for the first time.[13] This hypothesis – referred to as semantic vacuum hypothesis – explains why the most common forms of synesthesia are grapheme-color, spatial sequence and number form. These are usually the first abstract concepts that educational systems require children to learn.

Difficulties have been recognized in adequately defining synesthesia.[14][15] Many different phenomena have been included in the term synesthesia ("union of the senses"), and in many cases the terminology seems to be inaccurate. A more accurate but less common term may be ideasthesia.

The earliest recorded case of synesthesia is attributed to the Oxford University academic and philosopher John Locke, who, in 1690, made a report about a blind man who said he experienced the color scarlet when he heard the sound of a trumpet.[16] However, there is disagreement as to whether Locke described an actual instance of synesthesia or was using a metaphor.[17] The first medical account came from German physician, Georg Tobias Ludwig Sachs in 1812.[17][18][19] The term is from the Ancient Greek σύν syn, "together", and αἴσθησις aisthēsis, "sensation".[16]

Types


There are two overall forms of synesthesia:

  • projective synesthesia: people who see actual colors, forms, or shapes when stimulated (the widely understood version of synesthesia).
  • associative synesthesia: people who feel a very strong and involuntary connection between the stimulus and the sense that it triggers.

For example, in chromesthesia (sound to color), a projector may hear a trumpet, and see an orange triangle in space, while an associator might hear a trumpet, and think very strongly that it sounds "orange".

Synesthesia can occur between nearly any two senses or perceptual modes, and at least one synesthete, Solomon Shereshevsky, experienced synesthesia that linked all five senses. Types of synesthesia are indicated by using the notation x → y, where x is the "inducer" or trigger experience, and y is the "concurrent" or additional experience. For example, perceiving letters and numbers (collectively called graphemes) as colored would be indicated as grapheme → color synesthesia. Similarly, when synesthetes see colors and movement as a result of hearing musical tones, it would be indicated as tone → (color, movement) synesthesia.

While nearly every logically possible combination of experiences can occur, several types are more common than others.

Grapheme-color synesthesia
From the 2009 non-fiction book Wednesday Is Indigo Blue.[5] Note this example's upside-down clock face.

In one of the most common forms of synesthesia, individual letters of the alphabet and numbers (collectively referred to as graphemes) are "shaded" or "tinged" with a color. While different individuals usually do not report the same colors for all letters and numbers, studies with large numbers of synesthetes find some commonalities across letters (e.g. A is likely to be red).[20]

Chromesthesia
Main article: Chromesthesia

Another common form of synesthesia is the association of sounds with colors. For some, everyday sounds such as doors opening, cars honking, or people talking can trigger seeing colors. For others, colors are triggered when musical notes or keys are being played. People with synesthesia related to music may also have perfect pitch because their ability to see/hear colors aids them in identifying notes or keys.[21]

The colors triggered by certain sounds, and any other synesthetic visual experiences, are referred to as photisms.

According to Richard Cytowic,[5] chromesthesia is "something like fireworks": voice, music, and assorted environmental sounds such as clattering dishes or dog barks trigger color and firework shapes that arise, move around, and then fade when the sound ends. Sound often changes the perceived hue, brightness, scintillation, and directional movement. Some individuals see music on a "screen" in front of their faces. For Deni Simon, music produces waving lines "like oscilloscope configurations – lines moving in color, often metallic with height, width and, most importantly, depth. My favorite music has lines that extend horizontally beyond the 'screen' area."

Individuals rarely agree on what color a given sound is. B flat might be orange for one person and blue for another. Composers Franz Liszt and Nikolai Rimsky-Korsakov famously disagreed on the colors of music keys.

Spatial sequence synesthesia

Those with spatial sequence synesthesia (SSS) tend to see numerical sequences as points in space. For instance, the number 1 might be farther away and the number 2 might be closer. People with SSS may have superior memories; in one study, they were able to recall past events and memories far better and in far greater detail than those without the condition. They also see months or dates in the space around them. Some people see time like a clock above and around them.[22][23]

Number form
A number form from one of Francis Galton's subjects (1881).[10] Note how the first 12 digits correspond to a clock face.

A number form is a mental map of numbers that automatically and involuntarily appears whenever someone who experiences number-forms synesthesia thinks of numbers. Number forms were first documented and named in 1881 by Francis Galton in "The Visions of Sane Persons".[24]

Auditory-tactile synesthesia

In auditory-tactile synesthesia, certain sounds can induce sensations in parts of the body. For example, someone with auditory-tactile synesthesia may experience that hearing a specific word feels like touch in one specific part of the body or may experience that certain sounds can create a sensation in the skin without being touched. It is one of the least common forms of synesthesia.[25]

Ordinal linguistic personification

Ordinal-linguistic personification (OLP, or personification for short) is a form of synesthesia in which ordered sequences, such as ordinal numbers, week-day names, months and alphabetical letters are associated with personalities or genders (Simner & Hubbard 2006). For example, the number 2 might be a young boy with a short temper, or the letter G might be a busy mother with a kind face. Although this form of synesthesia was documented as early as the 1890s (Flournoy 1893; Calkins 1893) researchers have, until recently, paid little attention to this form (see History of synesthesia research). This form of synesthesia was named as OLP in the contemporary literature by Julia Simner and colleagues [26] although it is now also widely recognised by the term "sequence-personality" synesthesia. Ordinal linguistic personification normally co-occurs with other forms of synesthesia such as grapheme-color synesthesia.

Misophonia
Main article: Misophonia

Misophonia is a neurological disorder in which negative experiences (anger, fright, hatred, disgust) are triggered by specific sounds. Richard Cytowic suggests that misophonia is related to, or perhaps a variety of, synesthesia.[27] Miren Edelstein and her colleagues have compared misophonia to synesthesia in terms of connectivity between different brain regions as well as specific symptoms. They formed the hypothesis that "a pathological distortion of connections between the auditory cortex and limbic structures could cause a form of sound-emotion synesthesia."[28]

Mirror-touch synesthesia

This is a form of synesthesia where individuals feel the same sensation that another person feels (such as touch). For instance, when such a synesthete observes someone being tapped on their shoulder, the synesthete involuntarily feels a tap on their own shoulder as well. People with this type of synesthesia have been shown to have higher empathy levels compared to the general population. This may be related to the so-called mirror neurons present in the motor areas of the brain, which have also been linked to empathy.[29]

Lexical-gustatory synesthesia
Main article: Lexical-gustatory synesthesia

This is another form of synesthesia where certain tastes are experienced when hearing words. For example, the word basketball might taste like waffles. The documentary 'Derek Tastes Of Earwax' gets its name from this phenomenon, in references to pub owner James Wannerton who experiences this particular sensation whenever he hears the name spoken.[30][31] It is estimated that 0.2% of the population has this form of synesthesia.[32]

Kinesthetic Synesthesia

One of the rarest forms of synesthesia in the world. [33] This is a combination of various different types of synesthesia, and can cause the individual to exhibit signs of being on the autistic spectrum. Features appear similar to auditory-tactile synesthesia but sensations are not isolated to individual numbers or letters but complex systems of relationships. The result is the ability to memorize and model complex relationships between numerous variables by feeling physical sensations around the kinesthetic movement of related variables. Reports include feeling sensations in the hands or feet, coupled with visualizations of shapes or objects, when analyzing mathematical equations, physical systems, or music. In another case, a sufferer described seeing interactions between physical shapes causing sensations in the feet when solving a math problem. Generally, those with this type of synesthesia can memorize and visualize complicated systems, and with a high degree of accuracy, predict the results of changes to the system. Examples include predicting the results of computer simulations in subjects such as quantum mechanics or fluid dynamics when results are not naturally intuitive. [20] [34]

Other forms

Other forms of synesthesia have been reported, but little has been done to analyze them scientifically. There are at least 80 different types of synesthesia.[35]

In August 2017 a research article in the journal Social Neuroscience reviewed studies with fMRI to determine if persons who experience Autonomous Sensory Meridian Response are experiencing a form of synesthesia. While a determination has not yet been made, there is anecdotal evidence that this may be the case, based on significant and consistent differences from the control group, in terms of functional connectivity within neural pathways. It is unclear whether this will lead to ASMR being included as a form of existing synesthesia, or if a new type will be considered.[36]

Signs and symptoms

Some synesthetes often report that they were unaware their experiences were unusual until they realized other people did not have them, while others report feeling as if they had been keeping a secret their entire lives.[37] The automatic and ineffable nature of a synesthetic experience means that the pairing may not seem out of the ordinary. This involuntary and consistent nature helps define synesthesia as a real experience. Most synesthetes report that their experiences are pleasant or neutral, although, in rare cases, synesthetes report that their experiences can lead to a degree of sensory overload.[20]

Though often stereotyped in the popular media as a medical condition or neurological aberration, many synesthetes themselves do not perceive their synesthetic experiences as a handicap. To the contrary, some report it as a gift—an additional "hidden" sense—something they would not want to miss. Most synesthetes become aware of their distinctive mode of perception in their childhood. Some have learned how to apply their ability in daily life and work. Synesthetes have used their abilities in memorization of names and telephone numbers, mental arithmetic, and more complex creative activities like producing visual art, music, and theater.[37]

Despite the commonalities which permit definition of the broad phenomenon of synesthesia, individual experiences vary in numerous ways. This variability was first noticed early in synesthesia research.[38] Some synesthetes report that vowels are more strongly colored, while for others consonants are more strongly colored.[20] Self reports, interviews, and autobiographical notes by synesthetes demonstrate a great degree of variety in types of synesthesia, intensity of synesthetic perceptions, awareness of the perceptual discrepancies between synesthetes and non-synesthetes, and the ways synesthesia is used in work, creative processes, and daily life.[37][39]

Synesthetes are very likely to participate in creative activities.[34] It has been suggested that individual development of perceptual and cognitive skills, in addition to one's cultural environment, produces the variety in awareness and practical use of synesthetic phenomena.[7][39] Synesthesia may also give a memory advantage. In one study conducted by Julia Simner of the University of Edinburgh it was found that spatial sequence synesthetes have a built-in and automatic mnemonic reference. So the non-synesthete will need to create a mnemonic device to remember a sequence (like dates in a diary), but the synesthete can simply reference their spatial visualizations.[40]

Mechanism
Regions thought to be cross-activated in grapheme-color synesthesia (green=grapheme recognition area, red=V4 color area)[41]

As of 2015 the neurological correlates of synesthesia had not been established.[42]

Dedicated regions of the brain are specialized for given functions. Increased cross-talk between regions specialized for different functions may account for the many types of synesthesia. For example, the additive experience of seeing color when looking at graphemes might be due to cross-activation of the grapheme-recognition area and the color area called V4 (see figure).[41] This is supported by the fact that grapheme-color synesthetes are able to identify the color of a grapheme in their peripheral vision even when they cannot consciously identify the shape of the grapheme.[41]

An alternative possibility is disinhibited feedback, or a reduction in the amount of inhibition along normally existing feedback pathways.[43] Normally, excitation and inhibition are balanced. However, if normal feedback were not inhibited as usual, then signals feeding back from late stages of multi-sensory processing might influence earlier stages such that tones could activate vision. Cytowic and Eagleman find support for the disinhibition idea in the so-called acquired forms[5] of synesthesia that occur in non-synesthetes under certain conditions: temporal lobe epilepsy,[44] head trauma, stroke, and brain tumors. They also note that it can likewise occur during stages of meditation, deep concentration, sensory deprivation, or with use of psychedelics such as LSD or mescaline, and even, in some cases, marijuana.[5] However, synesthetes report that common stimulants, like caffeine and cigarettes do not affect the strength of their synesthesia, nor does alcohol.[5]:137–40

A very different theoretical approach to synesthesia is that based on ideasthesia. According to this account, synesthesia is a phenomenon mediated by the extraction of the meaning of the inducing stimulus. Thus, synesthesia may be fundamentally a semantic phenomenon. Therefore, to understand neural mechanisms of synesthesia the mechanisms of semantics and the extraction of meaning need to be understood better. This is a non-trivial issue because it is not only a question of a location in the brain at which meaning is "processed" but pertains also to the question of understanding—epitomized in e.g., the Chinese room problem. Thus, the question of the neural basis of synesthesia is deeply entrenched into the general mind–body problem and the problem of the explanatory gap.[45]

Genetics
Main article: Genetics of synesthesia

The genetic mechanism of synesthesia has long been debated. Due to the prevalence of synesthesia among the first-degree relatives of synesthetes,[46] there is evidence that synesthesia might have a genetic basis, however the monozygotic twins case studies indicate there is an epigenetic component. Synesthesia might also be an oligogenic condition, with Locus heterogeneity, multiple forms of inheritance (including Mendelian in some cases), and continuous variation in gene expression. It has been found that women have a higher chance of developing Synesthesia, and in the UK, females are 8 times more likely to have it than men (reasons are unknown). When people are left handed it is inherited, and researchers have discovered that synesthetes have a higher probability of being left handed than the general population. Neuroscience

Diagnosis

Although often termed a "neurological condition," synesthesia is not listed in either the DSM-IV or the ICD since it most often does not interfere with normal daily functioning.[47] Indeed, most synesthetes report that their experiences are neutral or even pleasant.[20] Like perfect pitch, synesthesia is simply a difference in perceptual experience.

Reaction times for answers that are congruent with a synesthete's automatic colors are shorter than those whose answers are incongruent.[5]

Synesthesia Test Variations A number of tests exist for synesthesia. Each common type has a specific test. When testing for Grapheme-color synesthesia a visual test is given. The person is shown a picture that includes black letters and numbers. A synesthete will associate the letters and numbers with a specific color. An Auditory test is another way to test for Synesthesia. A sound is turned on and one will either identify it with a taste, or envision shapes. The audio test correlates with Chromesthesia (sounds with colors). Since people question whether or not Synesthesia is just tied into memory the "Retest" is given. One is given a set of objects and is asked to assign colors, tastes, personalities, or more. After a period of time, the same objects are given back to the person and are asked again to do the same job. The synesthete is able to assign the same characteristics, because that person has already made neural associations which involves a permanent solution in the brain, rather than it just being a memory that the person had to a certain object. The simplest approach is test-retest reliability over long periods of time, using stimuli of color names, color chips, or a computer-screen color picker providing 16.7 million choices. Synesthetes consistently score around 90% on reliability of associations, even with years between tests.[3] In contrast, non-synesthetes score just 30–40%, even with only a few weeks between tests and a warning that they would be retested.[3]

The automaticity of synesthetic experience. A synesthete might perceive the left panel like the panel on the right.[41]

Grapheme-color synesthetes, as a group, share significant preferences for the color of each letter (e.g. A tends to be red; O tends to be white or black; S tends to be yellow etc.)[20] Nonetheless, there is a great variety in types of synesthesia, and within each type, individuals report differing triggers for their sensations and differing intensities of experiences. This variety means that defining synesthesia in an individual is difficult, and the majority of synesthetes are completely unaware that their experiences have a name.[20]

Neurologist Richard Cytowic identifies the following diagnostic criteria for synesthesia in his first edition book. However, the criteria are different in the second book:[3][4][5]

  1. Synesthesia is involuntary and automatic.
  2. Synesthetic perceptions are spatially extended, meaning they often have a sense of "location." For example, synesthetes speak of "looking at" or "going to" a particular place to attend to the experience.
  3. Synesthetic percepts are consistent and generic (i.e. simple rather than pictorial).
  4. Synesthesia is highly memorable.
  5. Synesthesia is laden with affect.

Cytowic's early cases mainly included individuals whose synesthesia was frankly projected outside the body (e.g. on a "screen" in front of one's face). Later research showed that such stark externalization occurs in a minority of synesthetes. Refining this concept, Cytowic and Eagleman differentiated between "localizers" and "non-localizers" to distinguish those synesthetes whose perceptions have a definite sense of spatial quality from those whose perceptions do not.[5]

Prevalence

Estimates of prevalence of synesthesia have ranged widely, from 1 in 4 to 1 in 25,000 - 100,000. However, most studies have relied on synesthetes reporting themselves, introducing self-referral bias.[48] In what is cited as the most accurate prevalence study so far,[48] self-referral bias was avoided by studying 500 people recruited from the communities of Edinburgh and Glasgow Universities; it showed a prevalence of 4.4%, with 9 different variations of synesthesia.[49] This study also concluded that one common form of synesthesia—grapheme-color synesthesia (colored letters and numbers) – is found in more than one percent of the population, and this latter prevalence of graphemes-color synesthesia has since been independently verified in a sample of nearly 3,000 people in the University of Edinburgh.[50]

The most common forms of synesthesia are those that trigger colors, and the most prevalent of all is day-color.[49] Also relatively common is grapheme-color synesthesia. We can think of "prevalence" both in terms of how common is synesthesia (or different forms of synesthesia) within the population, or how common are different forms of synesthesia within synesthetes. So within synesthetes, forms of synesthesia that trigger color also appear to be the most common forms of synesthesia with a prevalence rate of 86% within synesthetes.[49] In another study, music-color is also prevalent at 18–41%. Some of the rarest are reported to be auditory-tactile, mirror-touch, and lexical-gustatory.[51]

There is research to suggest that the likelihood of having synesthesia is greater in people with autism.[52]

History

The interest in colored hearing dates back to Greek antiquity, when philosophers asked if the color (chroia, what we now call timbre) of music was a quantifiable quality.[53] Isaac Newton proposed that musical tones and color tones shared common frequencies, as did Goethe in his book Theory of Colours.[54] There is a long history of building color organs such as the clavier à lumières on which to perform colored music in concert halls.[55][55][56]

The first medical description of "colored hearing" is in an 1812 thesis by the German physician Georg Tobias Ludwig Sachs.[57][17][18] The "father of psychophysics," Gustav Fechner, reported the first empirical survey of colored letter photisms among 73 synesthetes in 1876,[58][59] followed in the 1880s by Francis Galton.[10][60][61] Carl Jung refers to "color hearing" in his Symbols of Transformation in 1912.[62]

In the early 1920s the Bauhaus teacher and musician Gertrud Grunow researched the relationships between sound, color and movement and developed a 'twelve-tone circle of colour' which was analogous with the twelve-tone music of the Austrian composer Arnold Schönberg (1874-1951).[63] She was a participant in at least one of the Congresses for Colour-Sound Research (German:Kongreß für Farbe-Ton-Forschung) held in Hamburg in the late 1920s and early 1930s.[64]

Research into synesthesia proceeded briskly in several countries, but due to the difficulties in measuring subjective experiences and the rise of behaviorism, which made the study of any subjective experience taboo, synesthesia faded into scientific oblivion between 1930 and 1980.

As the 1980s cognitive revolution made inquiry into internal subjective states respectable again, scientists returned to synesthesia. Led in the United States by Larry Marks and Richard Cytowic, and later in England by Simon Baron-Cohen and Jeffrey Gray, researchers explored the reality, consistency, and frequency of synesthetic experiences. In the late 1990s, the focus settled on grapheme → color synesthesia, one of the most common[20] and easily studied types. Psychologists and neuroscientists study synesthesia not only for its inherent appeal, but also for the insights it may give into cognitive and perceptual processes that occur in synesthetes and non-synesthetes alike. Synesthesia is now the topic of scientific books and papers, PhD theses, documentary films, and even novels.

Since the rise of the Internet in the 1990s, synesthetes began contacting one another and creating web sites devoted to the condition. These rapidly grew into international organizations such as the American Synesthesia Association, the UK Synaesthesia Association, the Belgian Synesthesia Association, the Canadian Synesthesia Association, the German Synesthesia Association, and the Netherlands Synesthesia Web Community.

Society and culture

Notable cases

As mentioned before, one of the most notable synesthetes is Solomon Shereshevsky, a newspaper reporter turned celebrated mnemonist, who was discovered by Russian neuropsychologist, Alexander Luria, to have a rare fivefold form of synesthesia.[65] Words and text were not only associated with highly vivid visuo-spatial imagery but also sound, taste, color, and sensation.[65] Shereshevsky could recount endless details of many things without form, from lists of names to decades-old conversations, but he had great difficulty grasping abstract concepts. The automatic, and nearly permanent, retention of every little detail due to synesthesia greatly inhibited Shereshevsky from understanding much of what he read or heard.[65]

Ramachandran, a neuroscientist and author, studied the case of a grapheme-color synesthete who was also color blind. While he couldn't see certain colors with his eyes, he could still "see" those colors when looking at certain letters. Because he didn't have a name for those colors, he called them "Martian colors."[66]

Art

Other notable synesthetes come particularly from artistic professions and backgrounds. Synesthetic art historically refers to multi-sensory experiments in the genres of visual music, music visualization, audiovisual art, abstract film, and intermedia.[37][67][68][69][70][71] Distinct from neuroscience, the concept of synesthesia in the arts is regarded as the simultaneous perception of multiple stimuli in one gestalt experience.[72]

Neurological synesthesia has been a source of inspiration for artists, composers, poets, novelists, and digital artists. Vladimir Nabokov writes explicitly about synesthesia in several novels. Wassily Kandinsky (a synesthete) and Piet Mondrian (not a synesthete) both experimented with image-music congruence in their paintings. Alexander Scriabin composed colored music that was deliberately contrived and based on the circle of fifths, whereas Olivier Messiaen invented a new method of composition (the modes of limited transposition) specifically to render his bi-directional sound-color synesthesia. For example, the red rocks of Bryce Canyon are depicted in his symphony Des canyons aux étoiles... ("From the Canyons to the Stars"). New art movements such as literary symbolism, non-figurative art, and visual music have profited from experiments with synesthetic perception and contributed to the public awareness of synesthetic and multi-sensory ways of perceiving.[37]

Contemporary artists with synesthesia, such as Carol Steen[73] and Marcia Smilack[74] (a photographer who waits until she gets a synesthetic response from what she sees and then takes the picture), use their synesthesia to create their artwork. Brandy Gale, a Canadian visual artist, experiences an involuntary joining or crossing of any of her senses – hearing, vision, taste, touch, smell and movement. Gale paints from life rather than from photographs and by exploring the sensory panorama of each locale attempts to capture, select, and transmit these personal experiences.[75][76][77]

David Hockney perceives music as color, shape, and configuration and uses these perceptions when painting opera stage sets (though not while creating his other artworks). Kandinsky combined four senses: color, hearing, touch, and smell.[3][5] Nabokov described his grapheme-color synesthesia at length in his autobiography, Speak, Memory, and portrayed it in some of his characters.[78] In addition to Messiaen, whose three types of complex colors are rendered explicitly in musical chord structures that he invented,[5][79] other composers who reported synesthesia include Duke Ellington,[80] Rimsky-Korsakov,[81] and Jean Sibelius.[68] Michael Torke is a contemporary example of a synesthetic composer.[68] Physicist Richard Feynman describes his colored equations in his autobiography, What Do You Care What Other People Think?[82]

Other notable synesthetes include musicians Billy Joel,[83]:89, 91 Itzhak Perlman,[83]:53 Alexander Frey, Lorde, Ida Maria,[84] Brian Chase[85][86] and Patrick Stump; inventor Nikola Tesla;[87] electronic musician Richard D. James aka Aphex Twin (who claims to be inspired by lucid dreams as well as music); and classical pianist Hélène Grimaud. Drummer Mickey Hart of The Grateful Dead wrote about his experiences with synaesthesia in his autobiography Drumming at the Edge of Magic.[88] Pharrell Williams, of the groups The Neptunes and N.E.R.D., also experiences synesthesia[89][90] and used it as the basis of the album Seeing Sounds. Singer/songwriter Marina and the Diamonds experiences music → color synesthesia and reports colored days of the week.[91]

Some artists frequently mentioned as synesthetes did not, in fact, have the neurological condition. Scriabin's 1911 Prometheus, for example, is a deliberate contrivance whose color choices are based on the circle of fifths and appear to have been taken from Madame Blavatsky.[5][92] The musical score has a separate staff marked luce whose "notes" are played on a color organ. Technical reviews appear in period volumes of Scientific American.[5] On the other hand, his older colleague Rimsky-Korsakov (who was perceived as a fairly conservative composer) was, in fact, a synesthete.[93]

French poets Arthur Rimbaud and Charles Baudelaire wrote of synesthetic experiences, but there is no evidence they were synesthetes themselves. Baudelaire's 1857 Correspondances introduced the notion that the senses can and should intermingle. Baudelaire participated in a hashish experiment by psychiatrist Jacques-Joseph Moreau and became interested in how the senses might affect each other.[37] Rimbaud later wrote Voyelles (1871), which was perhaps more important than Correspondances in popularizing synesthesia. He later boasted "J'inventais la couleur des voyelles!" (I invented the colors of the vowels!).[94]

Daniel Tammet wrote a book on his experiences with synesthesia called Born on a Blue Day.[95]

Joanne Harris, author of Chocolat, is a synesthete who says she experiences colors as scents.[96] Her novel Blueeyedboy features various aspects of synesthesia.

Ramin Djawadi, a composer best known for his work on composing the theme songs and scores for such TV series as Game of Thrones, Westworld and for the Iron Man movie, also has synesthesia. He says he tends to "associate colors with music, or music with colors."[97]

Literature

Synesthesia is sometimes used as a plot device or way of developing a character's inner life. Author and synesthete Pat Duffy describes four ways in which synesthetic characters have been used in modern fiction.[98][99]

  • Synesthesia as Romantic ideal: in which the condition illustrates the Romantic ideal of transcending one's experience of the world. Books in this category include The Gift by Vladimir Nabokov.
  • Synesthesia as pathology: in which the trait is pathological. Books in this category include The Whole World Over by Julia Glass.
  • Synesthesia as Romantic pathology: in which synesthesia is pathological but also provides an avenue to the Romantic ideal of transcending quotidian experience. Books in this category include Holly Payne’s The Sound of Blue and Anna Ferrara's The Woman Who Tried To Be Normal.
  • Synesthesia as psychological health and balance: Painting Ruby Tuesday by Jane Yardley, and A Mango-Shaped Space by Wendy Mass.

Many literary depictions of synesthesia are not accurate. Some say more about an author's interpretation of synesthesia than the phenomenon itself.

Research
Tests like this demonstrate that people do not attach sounds to visual shapes arbitrarily. When people are given a choice between the words “Bouba” and “Kiki,” the left shape is almost always called “Kiki” while the right is called “Bouba.”

Research on synesthesia raises questions about how the brain combines information from different sensory modalities, referred to as crossmodal perception or multisensory integration.

An example of this is the bouba/kiki effect. In an experiment first designed by Wolfgang Köhler, people are asked to choose which of two shapes is named bouba and which kiki. 95% to 98% of people choose kiki for the angular shape and bouba for the rounded one. Individuals on the island of Tenerife showed a similar preference between shapes called takete and maluma. Even 2.5-year-old children (too young to read) show this effect.[100] Recent research indicated that in the background of this effect may operate a form of ideasthesia.[101]

Researchers hope that the study of synesthesia will provide better understanding of consciousness and its neural correlates. In particular, synesthesia might be relevant to the philosophical problem of qualia,[6][102] given that synesthetes experience extra qualia (e.g. colored sound). An important insight for qualia research may come from the findings that synesthesia has the properties of ideasthesia,[14] which then suggest a crucial role of conceptualization processes in generating qualia.[13]

Technological applications

Synesthesia also has a number of practical applications, one of which is the use of 'intentional synesthesia' in technology.[103]

The Voice

Peter Meijer developed a sensory substitution device called The vOICe (the capital letters "O," "I," and "C" in "vOICe" are intended to evoke the expression "Oh I see"). The vOICe is a privately owned research project, running without venture capital, that was first implemented using low-cost hardware in 1991.[104] The vOICe is a visual-to-auditory sensory substitution device (SSD) preserving visual detail at high resolution (up to 25,344 pixels).[105] The device consists of a laptop, head-mounted camera or computer camera, and headphones. The vOICe converts visual stimuli of the surroundings captured by the camera into corresponding aural representations (soundscapes) delivered to the user through headphones at a default rate of one soundscape per second. Each soundscape is a left-to-right scan, with height represented by pitch, and brightness by loudness.[106] The vOICe compensates for the loss of vision by converting information from the lost sensory modality into stimuli in a remaining modality.[107]

See also

References
  1. Dictionary.com article for synaesthesia, accessed 2017-12-27
  2. "Synaesthesia Research" in Macquarie University's Department of Cognitive Science, accessed 2017-12-27
  3. Cytowic, Richard E. (2002). Synesthesia: A Union of the Senses (2nd edition). Cambridge, Massachusetts: MIT Press. ISBN 978-0-262-03296-4. OCLC 49395033.
  4. Cytowic, Richard E. (2003). The Man Who Tasted Shapes. Cambridge, Massachusetts: MIT Press. ISBN 978-0-262-53255-6. OCLC 53186027.
  5. Cytowic, Richard E; Eagleman, David M (2009). Wednesday is Indigo Blue: Discovering the Brain of Synesthesia (with an afterword by Dmitri Nabokov). Cambridge: MIT Press. ISBN 978-0-262-01279-9.
  6. Harrison, John E.; Simon Baron-Cohen (1996). Synaesthesia: classic and contemporary readings. Oxford: Blackwell Publishing. ISBN 978-0-631-19764-5. OCLC 59664610.
  7. Campen, Cretien van (2009) "The Hidden Sense: On Becoming Aware of Synesthesia" TECCOGS, vol. 1, pp. 1–13."Archived copy" (PDF). Archived from the original (PDF) on 8 July 2009. Retrieved 18 February 2009.CS1 maint: archived copy as title (link)
  8. Rich AN, Mattingley JB (January 2002). "Anomalous perception in synesthesia: a cognitive neuroscience perspective". Nature Reviews Neuroscience (Review). 3 (1): 43–52. doi:10.1038/nrn702. PMID 11823804.
  9. Hubbard EM, Ramachandran VS (November 2005). "Neurocognitive mechanisms of synesthesia". Neuron (Review). 48 (3): 509–20. doi:10.1016/j.neuron.2005.10.012. PMID 16269367.
  10. Galton F (1880). "Visualized Numerals". Nature. 21 (543): 494–5. doi:10.1038/021494e0.
  11. Seron X, Pesenti M, Noël MP, Deloche G, Cornet JA (August 1992). "Images of numbers, or "When 98 is upper left and 6 sky blue"". Cognition. 44 (1–2): 159–96. doi:10.1016/0010-0277(92)90053-K. PMID 1511585.
  12. "How Synesthesia Works". HowStuffWorks. 1 January 1970. Retrieved 2 May 2016.
  13. Mroczko-Wąsowicz A.; Nikolić D. (2014). "Semantic mechanisms may be responsible for developing synesthesia". Frontiers in Human Neuroscience. 8: 509. doi:10.3389/fnhum.2014.00509. PMC 4137691. PMID 25191239.
  14. Nikolić D (2009). "Is synaesthesia actually ideaesthesia? An inquiry into the nature of the phenomenon" (PDF). Proceedings of the Third International Congress on Synaesthesia, Science & Art, Granada, Spain, April 26–29.
  15. Simner J (2012). "Defining synaesthesia" (PDF). British Journal of Psychology (Review). 103 (6): 1–15. doi:10.1348/000712610X528305. PMID 22229768.
  16. Ward, Ossian (10 June 2006) The man who heard his paint box hiss in The Telegraph. Retrieved 3 December 2018
  17. Jewanski, Jörg; Day, Sean A.; Ward, Jamie (2009). "A Colorful Albino: The First Documented Case of Synaesthesia, by Georg Tobias Ludwig Sachs in 1812". Journal of the History of the Neurosciences: Basic and Clinical Perspectives. 18 (3): 293–303. doi:10.1080/09647040802431946. PMID 20183209.
  18. Herman, Laura M. (28 December 2018). "Synesthesia". Encyclopaedia Britannica. Retrieved 25 January 2019.
  19. Konnikova, Maria (26 February 2013). "From the words of an albino, a brilliant blend of color". Scientific American. Archived from the original on 20 September 2016. Retrieved 25 January 2019.
  20. Sagiv, Noam; Robertson, Lynn C (2005). Synesthesia: perspectives from cognitive neuroscience. Oxford: Oxford University Press. ISBN 978-0-19-516623-1. OCLC 53020292.
  21. "Absolute Pitch and Synesthesia | The Feinstein Institute for Medical Research". The Feinstein Institute for Medical Research. Retrieved 2 May 2016.
  22. Do sequence-space synaesthetes have better spatial imagery skills? Maybe not, The National Center for Biotechnology Information
  23. A Mind That Touches the Past, Sciencemag.org
  24. Galton F (1881). "The visions of sane persons" (PDF). Fortnightly Review. 29: 729–40. Retrieved 17 June 2008.
  25. Naumer MJ, van den Bosch JJ (July 2009). "Touching u: thalamocortical plasticity and the neural basis of multisensory integration". J. Neurophysiol. 102 (1): 7–8. doi:10.1152/jn.00209.2009. PMID 19403745.
  26. Simner J, Hubbard EM (December 2006). "Variants of synesthesia interact in cognitive tasks: evidence for implicit associations and late connectivity in cross-talk theories". Neuroscience. 143 (3): 805–14. doi:10.1016/j.neuroscience.2006.08.018. PMID 16996695.
  27. Cytowic, Richard E. (2002). Synesthesia: A Union of the Senses (2nd edition). Cambridge, Massachusetts: MIT Press. ISBN 0-262-03296-1. OCLC 49395033
  28. Edelstein Miren; Brang David; Rouw Romke; Ramachandran Vilayanur S (2013). "Misophonia: Physiological Investigations and Case Descriptions". Frontiers in Human Neuroscience. 7: 296. doi:10.3389/fnhum.2013.00296. PMC 3691507. PMID 23805089.
  29. Heyes, Cecelia. "Where Do Mirror Neurons Come From?" Neuroscience and Biobehavioral Reviews (2009): 576–77. CognitiveScience. University of Oxford, 7 November 2009. Web. 30 January 2015.
  30. "Derek Tastes of Ear Wax". Top Documentary Films. Retrieved 2 February 2015.
  31. "BBC – Science & Nature – Horizon". bbc.co.uk. Retrieved 2 February 2015.
  32. Simner, Julia (2009). "Lexical-Gustatory Synesthesia". Encyclopedia of Neuroscience. Springer Berlin Heidelberg. pp. 2149–2152. doi:10.1007/978-3-540-29678-2_2766. ISBN 978-3-540-23735-8.
  33. "Types-of-Syn". DaySyn.com. Retrieved 26 January 2016.
  34. Dailey A, Martindale C, Borkum J (1997). "Creativity, synesthesia, and physiognomic perception". Creativity Research Journal. 10 (1): 1–8. doi:10.1207/s15326934crj1001_1.
  35. "Types-of-Syn". DaySyn.com. Retrieved 26 January 2016.
  36. Smith, Stephen D.; Katherine Fredborg, Beverley; Kornelsen, Jennifer (2017). "An examination of the default mode network in individuals with autonomous sensory meridian response (ASMR)". Social Neuroscience. 12 (4): 361–365. doi:10.1080/17470919.2016.1188851. PMID 27196787.
  37. van Campen, Cretien (2007). The Hidden Sense: Synesthesia in Art and Science. Cambridge, Massachusetts: MIT Press. ISBN 978-0-262-22081-1. OCLC 80179991.
  38. Flournoy, Théodore (2001). Des phénomènes de synopsie (Audition colorée). Adamant Media Corporation. ISBN 978-0-543-94462-7.
  39. Dittmar, A. (Ed.) (2007) Synästhesien. Roter Faden durchs Leben? Essen, Verlag Die Blaue Eule.
  40. "Investigating Spatial Sequence Synesthesia". Synesthesia Test. 26 June 2012. Retrieved 2 May 2016.
  41. Ramachandran VS, Hubbard EM (2001). "Synaesthesia: A window into perception, thought and language" (PDF). Journal of Consciousness Studies. 8 (12): 3–34. Archived from the original (PDF) on 27 May 2006.
  42. Hupé JM, Dojat M (2015). "A critical review of the neuroimaging literature on synesthesia". Front Hum Neurosci. 9: 103. doi:10.3389/fnhum.2015.00103. PMC 4379872. PMID 25873873.
  43. Grossenbacher P. G.; Lovelace C. T. (January 2001). "Mechanisms of synesthesia: cognitive and physiological constraints". Trends Cogn. Sci. 5 (1): 36–41. doi:10.1016/S1364-6613(00)01571-0. PMID 11164734.
  44. Marcel Neckar; Petr Bob (11 January 2016). "Synesthetic associations and psychosensory symptoms of temporal epilepsy". Neuropsychiatric Disease and Treatment. 12: 109–12. doi:10.2147/NDT.S95464. PMC 4714732. PMID 26811683.
  45. Gray JA, Parslow DM, Brammer MJ, Chopping S, Vythelingum GN, Fytche DH (2006). "Evidence Against Functionalism from Neuroimaging of the Alien Colour Effect in Synaesthesia". Cortex. 42 (2): 309–18. doi:10.1016/s0010-9452(08)70357-5. PMID 16683506.CS1 maint: multiple names: authors list (link)
  46. Baron-Cohen, Simon; Burt, Lucy; Smith-Laittan, Fiona; Harrison, John; Bolton, Patrick (1 September 1996). "Synaesthesia: prevalence and familiality". Perception. 25 (9): 1073–1079. doi:10.1068/p251073. PMID 8983047.
  47. Hubbard, Edward (June 2007). "Neurophysiology of synesthesia". Curr Psychiatry Rep. 9 (3): 193–9. doi:10.1007/s11920-007-0018-6. PMID 17521514.
  48. Simner, Julia; Hubbard, Edward M., eds. (2013). "A brief history of synesthesia research". Oxford Handbook of Synesthesia. Oxford, UK: Oxford University Press. pp. 13–17. ISBN 978-0-19-960332-9. Retrieved 25 February 2018.
  49. Simner J, Mulvenna C, Sagiv N, Tsakanikos E, Witherby SA, Fraser C, Scott K, Ward J (2006). "Synaesthesia: The prevalence of atypical cross-modal experiences" (PDF). Perception. 35 (8): 1024–1033. doi:10.1068/p5469. PMID 17076063. Retrieved 26 April 2016.
  50. Carmichael DA, Down MP, Shillcock RC, Eagleman DM, Simner J (2015). "Validating a standardised test battery for synesthesia: Does the Synesthesia Battery reliably detect synesthesia". Conscious Cogn. 33: 375–85. doi:10.1016/j.concog.2015.02.001. PMC 5047354. PMID 25734257.
  51. Safran, Avinoam; Sanda, Nicolae (24 December 2014). "Colour synesthesia. Insight into perception, emotion, and consciousness". Current Opinion in Neurology. 28 (1): 36–44. doi:10.1097/WCO.0000000000000169. PMC 4286234. PMID 25545055.
  52. Baron-Cohen S, Johnson D, Asher J, Wheelwright S, Fisher SE, Gregerson PK, Allison C, "Is synaesthesia more common in autism?", Molecular Autism, 20 November 2013
  53. Gage, J.Colour and Culture. Practice and Meaning from Antiquity to Abstraction. (London:Thames & Hudson, 1993).
  54. Goethe, Johann Wolfgang (1840). Theory of Colours. J. Murray.
  55. Peacock, Kenneth. "Instruments to Perform Color-Music: Two Centuries of Technological Experimentation,"Leonardo 21, No. 4 (1988) 397–406.
  56. Jewanski, J. & N. Sidler (Eds.). Farbe – Licht – Musik. Synaesthesie und Farblichtmusik. Bern: Peter Lang, 2006.
  57. Mahling F (1926). "Das Problem der 'audition colorée': Eine historisch-kritische Untersuchung". Archiv für die Gesamte Psychologie. 57: 165–301.
  58. Fechner, G. (1876) Vorschule der Aesthetik. Leipzig: Breitkopf und Hartel. Website:
  59. Campen Cretien van (1996). "De verwarring der zintuigen. Artistieke en psychologische experimenten met synesthesie". Psychologie & Maatschappij. 20 (1): 10–26.
  60. Galton F (1880). "Visualized Numerals". Nature. 21 (533): 252–6. doi:10.1038/021252a0.
  61. Galton F (1883). Inquiries into Human Faculty and Its Development. Macmillan. Retrieved 17 June 2008.
  62. Jung, C.G. The Transformation of Libido in "Symbols of Transformation", CW5, London 1912/1956, Routledge & Kegan Paul, para.237.
  63. Bauhaus100.Curriculum. Harmonisation theory 1919-1924. Retrieved 2 December 2018
  64. Farbe-Ton-Forschungen. III. Band. Bericht über den II. Kongreß für Farbe-Ton-Forschung (Hamburg 1. - 5. Oktober 1930). Published 1931.
  65. Schacter, Daniel (1996). Searching for Memory: The Brain, The Mind, And The Past. Basic Books. pp. 81. ISBN 978-0465075522.
  66. "Martian Colors - Cosmic Variance". 5 November 2007. Retrieved 12 April 2018.
  67. Campen C (1999). "Artistic and psychological experiments with synesthesia". Leonardo. 32 (1): 9–14. doi:10.1162/002409499552948.
  68. Berman G (1999). "Synesthesia and the Arts". Leonardo. 32 (1): 15–22. doi:10.1162/002409499552957.
  69. Maur, Karin von (1999). The Sound of Painting: Music in Modern Art (Pegasus Library). Munich: Prestel. ISBN 978-3-7913-2082-3.
  70. Gage, John D. (1993). Colour and culture: practice and meaning from antiquity to abstraction. London: Thames and Hudson. ISBN 978-0-500-27818-5.
  71. Gage, John D. (1999). Color and meaning: art, science, and symbolism. Berkeley: University of California Press. ISBN 978-0-520-22611-1.
  72. Campen, Cretien van (2009) Visual Music and Musical Paintings. The Quest for Synesthesia in the Arts. In: F. Bacci & D. Melcher. Making Sense of Art, making Art of Sense. Oxford: Oxford University Press.
  73. Steen C (2001). "Visions Shared: A Firsthand Look into Synesthesia and Art". Leonardo. 34 (3): 203–208. doi:10.1162/002409401750286949.
  74. Marcia Smilack Website Accessed 20 August 2006.
  75. "Coastal Synaesthesia: Paintings and Photographs of Hawaii, Fiji and California by Brandy Gale – Gualala Arts Center exhibit: January, 2015". gualalaarts.org. Archived from the original on 2 February 2015. Retrieved 2 February 2015.
  76. EG. "The Wondrous Sensory Spectrum of Brandy Gale". FORA.tv. Retrieved 2 February 2015.
  77. brandygale.com
  78. Nabokov, Vladimir. 1966. Speak, Memory: An Autobiography Revisited. New York: Putnam.
  79. see Samuel, Claude. 1994 (1986). Olivier Messiaen: Music and Color. Conversations with Claude Samuel. Translated by E. Thomas Glasow. Portland, Oregon: Amadeus Press.
  80. Ellington, as quoted in George, Don. 1981. Sweet man: The real Duke Ellington. New York: G.P. Putnam's Sons. Page 226.
  81. according to the Russian press: Yastrebtsev V. "On N.A.Rimsky-Korsakov's color sound- contemplation." Russkaya muzykalnaya gazeta, 1908, N 39–40, p. 842–845 (in Russian), cited by Bulat Galeyev (1999).
  82. Feynman, Richard. 1988. What Do You Care What Other People Think? New York: Norton. P. 59.
  83. Seaberg, M. (2011). Tasting the Universe. New Page Books. ISBN 978-1-60163-159-6.
  84. Cairns, Dan (24 February 2008). "Times Online interview". The Times. London. Retrieved 24 July 2008.
  85. Forrest, Emma (30 March 2009). "Emma Forrest meets New York's favourite art-punk rockers Yeah Yeah Yeahs". guardian.co.uk. London: The Guardian. Retrieved 7 May 2009.
  86. Chase, Brian. "Brian Chase's blog". yeahyeahyeahs.com. Archived from the original on 25 January 2009. Retrieved 7 May 2009.
  87. Tesla, Nikola. "The Strange Life of Nikola Tesla" (PDF). pitt.edu. Archived from the original (PDF) on 17 July 2012. Retrieved 4 September 2012.
  88. Hart, M., Stevens, J., & Lieberman, F. (1990). Drumming at the edge of magic: a journey into the spirit of percussion. San Francisco, CA: HarperSanFrancisco. pp.133
  89. It just always stuck out in my mind, and I could always see it. I don't know if that makes sense, but I could always visualize what I was hearing... Yeah, it was always like weird colors." From a Nightline interview with Pharrell
  90. "Synesthetes: "People of the Future"". Psychology Today. 3 March 2012. Retrieved 15 May 2014.
  91. Loose Women | Marina and the Diamonds – ITV Lifestyle ITV – 27 April 2010 – Retrieved 28 April 2010.
  92. Dann, Kevin T. (1998). Bright colors falsely seen: synaesthesia and the search for transcendental knowledge. New Haven, Conn: Yale University Press. ISBN 978-0-300-06619-7.
  93. This is according to an article in the Russian press, Yastrebtsev V. "On N.A.Rimsky-Korsakov's color sound- contemplation." Russkaya muzykalnaya gazeta, 1908, N 39–40, pp. 842–845 (in Russian), cited by Bulat Galeyev (1999).
  94. Barth, Friedrich; Giampieri-Deutsch, Patrizia; Hans-Dieter, Klein (2012). Sensory Perception: Mind & Matter. Vienna: Springer Vienna. p. 221. ISBN 9783211997505. I invented the colours of the vowels!
  95. Tammet, Daniel (2007). Born on a Blue Day. Free Press. ISBN 978-1416535072.
  96. "Chocolat author Joanne Harris talks about her latest novel Blue Eyed Boy". Metro. 7 April 2010.
  97. "Meet the musical genius behind the 'Game of Thrones' soundtrack who watches each season before anyone else". Business Insider. Retrieved 11 January 2018.
  98. Duffy, P.L. (2006). Images of Synesthetes and their Perceptions of Language in Fiction. 6th Annual Meeting of the American Synesthesia Association. University of South Florida. Archived from the original on 17 January 2012.
  99. Duffy PL, Simner J (2010). "Synaesthesia in fiction". Cortex. 46 (2): 277–278. doi:10.1016/j.cortex.2008.11.003. PMID 19081086.
  100. Maurer D, Pathman T, Mondloch CJ (May 2006). "The shape of boubas: sound-shape correspondences in toddlers and adults". Dev Sci. 9 (3): 316–22. doi:10.1111/j.1467-7687.2006.00495.x. PMID 16669803.
  101. Gómez Milán E.; Iborra O.; de Córdoba M.J.; Juárez-Ramos V.; Artacho Rodríguez; Rubio J.L. (2013). "The Kiki-Bouba effect: A case of personification and ideaesthesia". Journal of Consciousness Studies. 20 (1–2): 84–102.
  102. Gray JA, Chopping S, Nunn J, et al. (2002). "Implications of synaesthesia for functionalism: Theory and experiments". Journal of Consciousness. 9 (12): 5–31.
  103. Suslick, Kenneth S (December 2012). "Synesthesia in science and technology: more than making the unseen visible". Current Opinion in Chemical Biology. 16 (5–6): 557–563. doi:10.1016/j.cbpa.2012.10.030. PMC 3606019. PMID 23183411.
  104. Meijer, Peter. "Augmented Reality for the Totally Blind". Retrieved 4 February 2014.
  105. Striem-Amit, Ella; Guendelman, Miriam; Amedi, Amir; Serino, Andrea (16 March 2012). "'Visual' Acuity of the Congenitally Blind Using Visual-to-Auditory Sensory Substitution". PLoS ONE. 7 (3): e33136. doi:10.1371/journal.pone.0033136. PMC 3306374. PMID 22438894.
  106. Carmichael, Joey. "Device Trains Blind People To 'See' By Listening". Retrieved 4 February 2014.
  107. Haigh, Alastair; Brown, David J.; Meijer, Peter; Proulx, Michael J. (2013). "How well do you see what you hear? The acuity of visual-to-auditory sensory substitution". Frontiers in Psychology. 4: 330. doi:10.3389/fpsyg.2013.00330. PMC 3684791. PMID 23785345.

Further reading
Classification
This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.