Papers by Kimihiro Nakamura

Adaptation of the human visual system to the statistics of letters and line configurations
NeuroImage, Jan 17, 2015
By adulthood, literate humans have been exposed to millions of visual scenes and pages of text. D... more By adulthood, literate humans have been exposed to millions of visual scenes and pages of text. Does the human visual system become attuned to the statistics of its inputs? Using functional magnetic resonance imaging, we examined whether the brain responses to line configurations are proportional to their natural-scene frequency. To further distinguish prior cortical competence from adaptation induced by learning to read, we manipulated whether the selected configurations formed letters and whether they were presented on the horizontal meridian, the familiar location where words usually appear, or on the vertical meridian. While no natural-scene frequency effect was observed, we observed letter-status and letter frequency effects on bilateral occipital activation, mainly for horizontal stimuli. The findings suggest a reorganization of the visual pathway resulting from reading acquisition under genetic and connectional constraints. Even early retinotopic areas showed a stronger respo...

Functional neuroanatomy of speech processing within the temporal cortex
NeuroReport, 2007
The phonemic structure of the maternal language determines the way of perceiving speech signals. ... more The phonemic structure of the maternal language determines the way of perceiving speech signals. A typical example is that native Japanese listeners map two English phonemes, /r/ and /l/, onto the same /R/. This perceptual assimilation of speech sounds has been associated with the left and/or right posterior perisylvian region, but the precise functional anatomy is unknown. Using functional magnetic resonance imaging and a repetition priming paradigm, we identified three subregions in the left temporal cortex: an anterior division sensitive to language-specific phonological knowledge, and a midlateral and a posterior division related to other vocal stimuli features. Dynamic causal modeling supports the scheme by which the anterior pathway processes perceptual assimilation; the posterior pathway processes lexico-semantic information.

Frontiers in Psychology, 2014
A growing literature has been showing a profound impact of alphabetization at several levels of t... more A growing literature has been showing a profound impact of alphabetization at several levels of the visual system, including the primary visual cortex and higher-order ventral and dorsal visual areas . Importantly, in typical alphabetization courses, learning to read is not isolated but instead combined with both learning to write and learning to segment the spoken language, relating all these different representations to each other. Indeed, learning to write and to pronounce the elementary sounds of language promotes additional mapping between the visual and motor systems by linking visual representations of letters and motor plans for handwriting and speech production. Thus, besides the already recognized influence of the phonological system, the potential influence from other neural systems in the functioning of the visual system seems to be relatively neglected. In this opinion paper we highlight the importance of multi-systems interplay during literacy acquisition, focusing on the question of how literacy breaks mirror invariance in the visual system. Specifically, we argue for a large contribution of topdown inputs from phonological, handwriting and articulatory representations toward the ventral visual cortex during the development of the visual word form system, which then plays a pivotal role in mirror discrimination of letters in literate individuals.

Proceedings of the National Academy of Sciences, 2014
Learning to read requires the acquisition of an efficient visual procedure for quickly recognizin... more Learning to read requires the acquisition of an efficient visual procedure for quickly recognizing fine print. Thus, reading practice could induce a perceptual learning effect in early vision. Using functional magnetic resonance imaging (fMRI) in literate and illiterate adults, we previously demonstrated an impact of reading acquisition on both high-and low-level occipitotemporal visual areas, but could not resolve the time course of these effects. To clarify whether literacy affects early vs. late stages of visual processing, we measured event-related potentials to various categories of visual stimuli in healthy adults with variable levels of literacy, including completely illiterate subjects, early-schooled literate subjects, and subjects who learned to read in adulthood (ex-illiterates). The stimuli included written letter strings forming pseudowords, on which literacy is expected to have a major impact, as well as faces, houses, tools, checkerboards, and false fonts. To evaluate the precision with which these stimuli were encoded, we studied repetition effects by presenting the stimuli in pairs composed of repeated, mirrored, or unrelated pictures from the same category. The results indicate that reading ability is correlated with a broad enhancement of early visual processing, including increased repetition suppression, suggesting better exemplar discrimination, and increased mirror discrimination, as early as ∼100-150 ms in the left occipitotemporal region. These effects were found with letter strings and false fonts, but also were partially generalized to other visual categories. Thus, learning to read affects the magnitude, precision, and invariance of early visual processing. reading | brain plasticity | education R eading is a cultural activity in which contemporary humans have considerable training. Fluently accessing the sounds and meanings of written words requires very fast and efficient visual recognition of letter strings, at rates exceeding 100 words/ min. Neuroimaging studies have begun to show how learning to read modulates the functioning of the visual system, from early retinotopic areas (1, 2) to extrastriate occipital and temporal cortex (1, 3, 4). In particular, a restricted region of the left occipitotemporal cortex, the visual word form area (VWFA), is robustly activated when orthographic stimuli are presented to literate subjects.

Mirror-image discrimination in the literate brain: a causal role for the left occpitotemporal cortex
Frontiers in Psychology, 2014
Previous studies show that the primate and human visual system automatically generates a common a... more Previous studies show that the primate and human visual system automatically generates a common and invariant representation from a visual object image and its mirror reflection. For humans, however, this mirror-image generalization seems to be partially suppressed through literacy acquisition, since literate adults have greater difficulty in recognizing mirror images of letters than those of other visual objects. At the neural level, such category-specific effect on mirror-image processing has been associated with the left occpitotemporal cortex (L-OTC), but it remains unclear whether the apparent "inhibition" on mirror letters is mediated by suppressing mirror-image representations covertly generated from normal letter stimuli. Using transcranial magnetic stimulation (TMS), we examined how transient disruption of the L-OTC affects mirror-image recognition during a same-different judgment task, while varying the semantic category (letters and non-letter objects), identity (same or different), and orientation (same or mirror-reversed) of the first and second stimuli. We found that magnetic stimulation of the L-OTC produced a significant delay in mirror-image recognition for letter-strings but not for other objects. By contrast, this category specific impact was not observed when TMS was applied to other control sites, including the right homologous area and vertex. These results thus demonstrate a causal link between the L-OTC and mirror-image discrimination in literate people. We further suggest that left-right sensitivity for letters is not achieved by a local inhibitory mechanism in the L-OTC but probably relies on the inter-regional coupling with other orientation-sensitive occipito-parietal regions.

Proceedings of the National Academy of Sciences, 2007
We explored the impact of task context on subliminal neural priming using functional magnetic res... more We explored the impact of task context on subliminal neural priming using functional magnetic resonance imaging. The repetition of words during semantic categorization produced activation reduction in the left middle temporal gyrus previously associated with semantic-level representation and dorsal premotor cortex. By contrast, reading aloud produced repetition enhancement in the left inferior parietal lobe associated with print-to-sound conversion and ventral premotor cortex. Analyses of effective connectivity revealed that the task set for reading generated reciprocal excitatory connections between the left inferior parietal and superior temporal regions, reflecting the audiovisual integration required for vocalization, whereas categorization did not produce such backward projection to posterior regions. Thus, masked repetition priming involves two distinct components in the taskspecific neural streams, one in the parietotemporal cortex for task-specific word processing and the other in the premotor cortex for behavioral response preparation. The top-down influence of task sets further changes the directions of the unconscious priming in the entire cerebral circuitry for reading. effective connectivity ͉ masked priming ͉ reading ͉ repetition suppression and enhancement ͉ task set

Proceedings of the National Academy of Sciences, 2012
Do the neural circuits for reading vary across culture? Reading of visually complex writing syste... more Do the neural circuits for reading vary across culture? Reading of visually complex writing systems such as Chinese has been proposed to rely on areas outside the classical left-hemisphere network for alphabetic reading. Here, however, we show that, once potential confounds in cross-cultural comparisons are controlled for by presenting handwritten stimuli to both Chinese and French readers, the underlying network for visual word recognition may be more universal than previously suspected. Using functional magnetic resonance imaging in a semantic task with words written in cursive font, we demonstrate that two universal circuits, a shape recognition system (reading by eye) and a gesture recognition system (reading by hand), are similarly activated and show identical patterns of activation and repetition priming in the two language groups. These activations cover most of the brain regions previously associated with culture-specific tuning. Our results point to an extended reading network that invariably comprises the occipitotemporal visual wordform system, which is sensitive to well-formed static letter strings, and a distinct left premotor region, Exner's area, which is sensitive to the forward or backward direction with which cursive letters are dynamically presented. These findings suggest that cultural effects in reading merely modulate a fixed set of invariant macroscopic brain circuits, depending on surface features of orthographies.
On the perceptual origin of loanword adaptations: experimental evidence from Japanese
Phonology, 2008
... ing any type of non-native contrast be it segmental, suprasegmental or phono ... experiment... more ... ing any type of non-native contrast be it segmental, suprasegmental or phono ... experimental work is necessary to establish the corre-spondence between loanword adaptations ... by online discrimination tasks, precedes both orthographic and phonological processing levels (see ...

Eating tools in hand activate the brain systems for eating action: A transcranial magnetic stimulation study
Neuropsychologia, 2014
There is increasing neuroimaging evidence suggesting that visually presented tools automatically ... more There is increasing neuroimaging evidence suggesting that visually presented tools automatically activate the human sensorimotor system coding learned motor actions relevant to the visual stimuli. Such crossmodal activation may reflect a general functional property of the human motor memory and thus can be operating in other, non-limb effector organs, such as the orofacial system involved in eating. In the present study, we predicted that somatosensory signals produced by eating tools in hand covertly activate the neuromuscular systems involved in eating action. In Experiments 1 and 2, we measured motor evoked response (MEP) of the masseter muscle in normal humans to examine the possible impact of tools in hand (chopsticks and scissors) on the neuromuscular systems during the observation of food stimuli. We found that eating tools (chopsticks) enhanced the masseter MEPs more greatly than other tools (scissors) during the visual recognition of food, although this covert change in motor excitability was not detectable at the behavioral level. In Experiment 3, we further observed that chopsticks overall increased MEPs more greatly than scissors and this tool-driven increase of MEPs was greater when participants viewed food stimuli than when they viewed non-food stimuli. A joint analysis of the three experiments confirmed a significant impact of eating tools on the masseter MEPs during food recognition. Taken together, these results suggest that eating tools in hand exert a category-specific impact on the neuromuscular system for eating.
Neuropathology, 1997
A 72-year-old woman developed dysarthria and dysphagia followed by weakness and atrophy in the li... more A 72-year-old woman developed dysarthria and dysphagia followed by weakness and atrophy in the limb muscles. Later the patient showed mild dementia and died 17 months after the onset. Postmortem examination revealed typical findings of amyotrophic lateral sclerosis (ALS) consisting of extensive involvement of both upper and lower motor neurons and severe limbic degeneration. In addition, abundant neurofibrillary tangles (NFT) and senile plaques (SP) were seen throughout the cerebral cortex, which were compatible with Alzheimer's disease (AD). This is the first reported case of definite AD and ALS with limbic degeneration.

Neuron, 2006
The visual perception of words is known to activate the auditory representation of their spoken f... more The visual perception of words is known to activate the auditory representation of their spoken forms automatically. We examined the neural mechanism for this phonological activation using transcranial magnetic stimulation (TMS) with a masked priming paradigm. The stimulation sites (left superior temporal gyrus [L-STG] and inferior parietal lobe [L-IPL]), modality of targets (visual and auditory), and task (pronunciation and lexical decision) were manipulated independently. For both within-and cross-modal conditions, the repetition priming during pronunciation was eliminated when TMS was applied to the L-IPL, but not when applied to the L-STG, whereas the priming during lexical decision was eliminated when the L-STG, but not the L-IPL, was stimulated. The observed double dissociation suggests that the conscious task instruction modulates the stimulus-driven activation of the lateral temporal cortex for lexico-phonological activation and the inferior parietal cortex for spoken word production, and thereby engages a different neural network for generating the appropriate behavioral response.

Transient Neural Activity in the Medial Superior Frontal Gyrus and Precuneus Time Locked with Attention Shift between Object Features
NeuroImage, 1999
To investigate the contribution of the superior frontal gyrus and precuneus to the cognitive proc... more To investigate the contribution of the superior frontal gyrus and precuneus to the cognitive process of attention set shift, we examined the correlation between change in neural activity in these areas and the timing of attention set shift using event-related functional magnetic resonance imaging. Seven subjects underwent a card-sorting task in which they matched a test card to one of two target cards according to color or shape. The subjects had to determine the correct category based only on feedback and shift the sorting principle when the feedback changed from "correct" to "incorrect." Transient increase of neural activity time locked with attention shift phases was detected in the medial superior frontal gyrus (the rostral part of the supplementary motor area) and precuneus. During the control task, in which the feedback and the motor responses were preserved without any attention shift, this type of change in neural activity was not observed. Our findings indicate that increase in neural activity in these brain areas may be closely related to attention set shift between object features and suggest that these areas may play a role in the shifting of cognitive sets.
NeuroImage, 2005
Behavioral and neuropsychological studies have suggested that the right hemisphere has a special ... more Behavioral and neuropsychological studies have suggested that the right hemisphere has a special advantage in the visual recognition of logograms. While this long-standing 'right hemisphere hypothesis' has never been investigated systematically by previous neuroimaging studies, a candidate neural substrate of such asymmetry might be found within the occipitotemporal cortex that is known to exhibit lateralized response to a certain class of stimuli, such as letters and faces.

Implicit and explicit processing of kanji and kana words and non-words studied with fMRI
NeuroImage, 2004
Using functional magnetic resonance imaging (fMRI), we investigated the implicit language process... more Using functional magnetic resonance imaging (fMRI), we investigated the implicit language processing of kanji and kana words (i.e., hiragana transcriptions of normally written kanji words) and non-words. Twelve right-handed native Japanese speakers performed size judgments for character stimuli (implicit language task for linguistic stimuli), size judgments for scrambled-character stimuli (implicit language task for non-linguistic stimuli), and lexical decisions (explicit language task). The size judgments for scrambled-kanji stimuli and scrambled-kana stimuli produced activations on the bilateral lingual gyri (BA 18), the bilateral occipitotemporal regions (BA 19/37), and the bilateral superior and inferior parietal cortices (BA 7/40). Interestingly, besides these areas, activations of the left inferior frontal region (Broca's area, BA 44/45) and the left posterior inferior temporal cortex (PITC, BA 37), which have been considered as language areas, were additionally activated during size judgment for kanji character stimuli. Size judgment for kana character stimuli also activated Broca's area, the left PITC, and the left supramarginal gyrus (SMG, BA 40). The activations of these language areas were replicated in the lexical decisions for both kanji and kana. These findings suggest that language processing of both kanji and kana scripts is obligatory to literate Japanese subjects. Moreover, comparison between the scrambled kanji and the scrambled kana showed no activation in the language areas, while greater activation in the bilateral fusiform gyri (left-side predominant) was found in kanji vs. kana comparison during the size judgment and the lexical decision. Kana minus kanji activated the left SMG during the size judgment, and Broca's area and the left middle/superior temporal junction during the lexical decision. These results probably reflect that in implicit or explicit reading of kanji words and kana words (i.e., hiragana transcriptions of kanji words), although using largely overlapping cortical regions, there are still some differences. Kanji reading may involve more heavily visual orthographic retrieval and lexical-semantic system through the ventral route, while kana transcriptions of kanji words require phonological recoding to gain semantic access through the dorsal route.

NeuroImage, 2011
Humans and primates can quickly recognize mirror images of previously exposed pictures. This spon... more Humans and primates can quickly recognize mirror images of previously exposed pictures. This spontaneous mirror invariance, though advantageous for visual recognition, makes it difficult to distinguish the orientation of letters (e.g. to differentiate a "b" from a "d"), and may result in classical mirror reading and writing errors in preschoolers. Mirror invariance must therefore be overcome during reading acquisition. The Visual Word Form Area (VWFA), a region in the ventral stream that develops with reading expertise, was previously shown to discriminate words from their mirror images in literate adults. Here we investigate whether this region underlies mirror-image discrimination at the most elementary level of the orthographic code, the single-letter level. Using an fMRI priming paradigm, we demonstrate that the VWFA distinguishes the left-right orientation of single letters in skilled readers, and yet exhibits mirror invariance for simple pictures of matched complexity. These results clarify how letter shapes, after reading acquisition, escape the process of mirror invariance which is a basic property of the ventral visual shape recognition pathway.

NeuroImage, 2010
Young children often make mirror errors when learning to read and write, for instance writing the... more Young children often make mirror errors when learning to read and write, for instance writing their first name from right to left in English. This competence vanishes in most adult readers, who typically cannot read mirror words but retain a strong competence for mirror recognition of images. We used fast behavioral and fMRI repetition priming to probe the brain mechanisms underlying mirror generalization and its absence for words in adult readers. In two groups of French and Japanese readers, we show that the left fusiform visual word form area, a major site of learning during reading acquisition, simultaneously shows a maximal effect of mirror priming for pictures and an absence of mirror priming for words. Thus, learning to read recruits an area which possesses a property of mirror invariance, seemingly present in all primates, which is deleterious for letter recognition and may explain children's transient mirror errors.

Journal of Experimental Psychology: General, 2014
The ability to recognize 2 mirror images as the same picture across left-right inversions exists ... more The ability to recognize 2 mirror images as the same picture across left-right inversions exists early on in humans and other primates. In order to learn to read, however, one must discriminate the left-right orientation of letters and distinguish, for instance, b from d. We therefore reasoned that literacy may entail a loss of mirror invariance. To evaluate this hypothesis, we asked adult literates, illiterates, and ex-illiterates to perform a speeded same-different task with letter strings, false fonts, and pictures regardless of their orientation (i.e., they had to respond "same" to mirror pairs such as "iblo oldi"). Literates presented clear difficulties with mirror invariance. This "mirror cost" effect was strongest with letter strings, but crucially, it was also observed with false fonts and even with pictures. In contrast, illiterates did not present any cost for mirror pairs. Interestingly, subjects who learned to read as adults also exhibited a mirror cost, suggesting that modest reading practice, late in life, can suffice to break mirror invariance.

Modulation of the Visual Word Retrieval System in Writing: A Functional MRI Study on the Japanese Orthographies
Journal of Cognitive Neuroscience, 2002
We used functional magnetic resonance imaging (fMRI) to examine whether the act of writing involv... more We used functional magnetic resonance imaging (fMRI) to examine whether the act of writing involves different neuropsychological mechanisms between the two script systems of the Japanese language: kanji (ideogram) and kana (phonogram). The main experiments employed a 2 x 2 factorial design that comprised writing-to-dictation and visual mental recall for kanji and kana. For both scripts, the actual writing produced a widespread fronto-parietal activation in the left hemisphere. Especially, writing of kanji activated the left posteroinferior temporal cortex (lPITC), whereas that of kana also yielded a trend of activation in the same area. Mental recall for both scripts activated similarly the left parietotemporal regions including the lPITC. The writing versus mental recall comparison revealed greater activations in the left sensorimotor areas and right cerebellum. The kanji versus kana comparison showed increased responses in the left prefrontal and anterior cingulate areas. Especially, the lPITC showed a significant task-by-script interaction. Two additional control tasks, repetition (REP) and semantic judgment (SJ), activated the bilateral perisylvian areas, but enhanced the lPITC response only weakly. These results suggest that writing of the ideographic and phonographic scripts, although using the largely same cortical regions, each modulates the visual word-retrieval system according to their graphic features. Furthermore, comparisons with two additional tasks indicate that the activity of the lPITC increases especially in expressive language operations regardless of sensory modalities of the input stimulus.

Journal of Cognitive Neuroscience, 2005
& Recent evidence has suggested that the human occipitotemporal region comprises several subregio... more & Recent evidence has suggested that the human occipitotemporal region comprises several subregions, each sensitive to a distinct processing level of visual words. To further explore the functional architecture of visual word recognition, we employed a subliminal priming method with functional magnetic resonance imaging (fMRI) during semantic judgments of words presented in two different Japanese scripts, Kanji and Kana. Each target word was preceded by a subliminal presentation of either the same or a different word, and in the same or a different script. Behaviorally, word repetition produced significant priming regardless of whether the words were presented in the same or different script. At the neural level, this cross-script priming was associated with repetition suppression in the left inferior temporal cortex anterior and dorsal to the visual word form area hypothesized for alphabetical writing systems, suggesting that cross-script convergence occurred at a semantic level. fMRI also evidenced a shared visual occipito-temporal activation for words in the two scripts, with slightly more mesial and right-predominant activation for Kanji and with greater occipital activation for Kana. These results thus allow us to separate script-specific and script-independent regions in the posterior temporal lobe, while demonstrating that both can be activated subliminally. &
Selective Impairment of the Auditory-Verbal Short-Term Memory due to a Lesion of the Superior Temporal Gyrus
European Neurology, 2004
Uploads
Papers by Kimihiro Nakamura