A Cognitive Semiotic Approach To Sound Symbolism
A Cognitive Semiotic Approach To Sound Symbolism
A Cognitive Semiotic Approach To Sound Symbolism
Cross-modal iconicity:
A cognitive semiotic approach to sound symbolism
Felix Ahlner, Jordan Zlatev
Centre for Languages and Literature, Lund University
Box 201, 221 00, Lund, Sweden
e-mail: felix.ahlner@gmail.com, jordan.zlatev@ling.lu.se
1. Introduction
1 www.cognitivesemiotics.com
Cross-modal iconicity: A cognitive semiotic approach to sound symbolism 301
4
As well-known, Saussures most famous publication Cours de linguistique
gnrale, derives from his students lecture notes based on Saussures lectures at
the University of Geneva 19061911. Current research shows that these may have
misrepresented his thinking in various respects (Bouissac 2010).
Cross-modal iconicity: A cognitive semiotic approach to sound symbolism 303
5
Compare: Every existing form of human speech is a body of arbitrary and
conventional signs for thought, handed down by tradition from one generation to
another (Whitney 1867: 32).
304 Felix Ahlner, Jordan Zlatev
6
Schlegel 1857, quoted in http://ideophone.org/early-sources-on-african-
ideophones-schlegel/.
7 For example, in a recent textbook, Yule (2006: 10) boldly states It is generally
the case that there is no natural connection between a linguistic form and its
meaning. [] There are some words in language with sounds that seem to echo
the sounds of objects or activities and hence seem to have a less arbitrary con-
nection. English examples are cuckoo, CRASH, slurp, squelch or whirr. However,
these onomatopoeic words are relatively rare in human language.
306 Felix Ahlner, Jordan Zlatev
2.3.1. Ideophones
8
Dingemanse, Mark. How to do things with ideophones: observations on the
use of vivid sensory language in Siwu. Paper presented at the SOAS Research
Seminar, June 3 2009, London.
308 Felix Ahlner, Jordan Zlatev
Again, we notice features (a) and (c) listed above (Dingemanse does
not mention any contrasts in these particular examples), and we could
perhaps add two more: ideophones are rather hard to translate, and do
not lend themselves easily to paraphrases with other expressions.
Dingemanse, for example, describes Siwu ideophones as typically
evoking a sensory event as a whole rather than describing just one
aspect of it. For example, in (2) above, mnymny is not simply an
intensifying word such as very, and it can only be used with verbs
such as fi (sparkle, shine). Finally, when speakers of Siwu are asked
about their perceived function of such ideophones, they typically reply
that without them, speech is bland, and that they make stories more
interesting. Similar accounts of ideophones are also given by Japanese
speakers.
Several dictionaries of Niger-Congo and Bantu languages contain
thousands of entries for ideophones (Childs 1994). Diffloth (1976)
reports similar numbers from Austroasiatic languages. There are
dictionaries of Japanese especially devoted to ideophones, and they are
also found in many ordinary dictionaries (Ivanova 2006). One
preliminary conclusion is that ideophones are indeed not far fewer
than is generally believed, as Saussure claimed. Also the pure fact that
there could be dictionaries of such items, shows, firstly, that despite
what was suggested above, their meaning can be approximately
rendered through other linguistic expressions, and they are not as
sterile, [] unfit to express anything beyond the one object which
Cross-modal iconicity: A cognitive semiotic approach to sound symbolism 309
match these. Studies of this kind have been conducted since the 1930s,
involving several unrelated languages (Hunter-Smith 2007: 23f).
Brown et al. (1955) asked English speakers to match word pairs in
English with Chinese, Czech and Hindi. For all three unfamiliar lan-
guages, over half of the word pairs were matched correctly signifi-
cantly better than chance, sometimes by over 90% of the participants.
Two conditions for the success of such experiments could be
observed. First, participants are to match a pair of familiar words, with
a pair of unfamiliar ones. Second, the familiar words should contrast
along a given dimension (as noted above for shape symbolism) and
thus form antonym pairs, for example, smallbig, roundflat, bright
dark. For example, when Maltzman et al. (1956) performed a study in
which English speakers were asked to match antonyms in Croatian
and Japanese (both of which were unknown to the speakers), they
failed to perform this at levels higher than chance. When they were
also given the antonyms in English, they performed significantly better
than chance. In another study, Brackbill and Little (1957) did not use
antonyms, but rather a list of highly frequent words in Chinese,
Japanese and Hebrew. English speakers were asked to match given
word pairs across languages, but failed.
In the next section, we offer an explanation of these findings, but
let us first take stock.
The sign (as a whole) can be said to involve at least three entities
interacting in the process of semiosis (see Fig. 1): a representamen
which stands for an object, to somebody (the interpreter). The
9
For example, Chandler, Semiotics for Beginners, http://www.aber.ac.uk/media/
Documents/S4B/
314 Felix Ahlner, Jordan Zlatev
Based on the nature of the ground that is, in what way a repre-
sentamen stands for an object Peirce divided signs into three so-
called ideal types, the first of which is of central importance for our
analysis. In an iconic sign, the ground is that of similarity, or more
precisely when the representamen and object are found to share
certain similar qualities independently of each other. The typical
example is a picture and its visual similarity to that which it depicts.
The second type is an indexical sign, where the ground is not based on
similarity, but on contiguity in time and space. The third type is the
symbolic sign. This differs from the earlier two by being based only on
convention, for example, using $ as a sign for US dollar. It is im-
portant to bear in mind that this taxonomy presents ideal types, and
that real-world signs usually contain properties from more than one of
the three, that is, more than one type of ground.
Cross-modal iconicity: A cognitive semiotic approach to sound symbolism 315
We would like to suggest that the distinction between primary and secondary
iconicity is more of a cline, defined by the degree to which the sign function
(i.e. knowing what an expression represents) is necessary for perceiving the
similarity involved in iconicity. From this perspective, the bouba/kiki pheno-
menon is somewhat intermediary in the cline. (Ikegami, Zlatev 2007: 270)
10
One R-O ground would be, strictly speaking, sufficient for performing the
analogy if there are only two (presumptive) signs involved, as an anonymous
reviewer points out.
320 Felix Ahlner, Jordan Zlatev
The rate of success in this type of experiments was typically lower than
those in which fictive words were matched to figures,11 which can be
explained by the following two factors. First, the matching is per-
formed across sets of composite grounds, that is, a third-order relation.
Given this complexity, it is nevertheless remarkable that such experi-
ments meet success at all! Second, all word-forms (representamina)
are actual existing words which may or may not (for example, due to
11 Some antonyms give very high degrees of correct matching, while others
show results identical to chance. In some cases, different languages appear to have
reversed grounds, leading to results significantly worse than chance (Hunter-
Smith 2007).
322 Felix Ahlner, Jordan Zlatev
Consonants:
voiceless obstruents (hard, sharp, pointy)
vs.
voiced sonorants (soft, smooth, heavy):
[p, t, k, t] vs. [m, l, n, ]
Vowels:
front close unrounded (sharp, small)
vs.
back open (round, large):
[i] vs. [u]
Figure 5. The contrastive figures used in the experiment: the star and the
amoeba. All figures were of these types, but with slight variation, so that no parti-
cipant was shown two identical figures.
4.2. Hypotheses
Table 1. The spoken stimuli used in the experiment, ordered by word pair type (A
to D) and participant group (1 to 4).
C2V1 vs. C2V2 C1V1 vs. C2V1 C1V2 vs. C2V1 C1V1 vs. C2V2
When the target figures (see Figure 5 above) were presented on the
screen, randomized for left-right order, a pre-recorded voice was
Cross-modal iconicity: A cognitive semiotic approach to sound symbolism 327
pair were lili vs. kiki, it is likely that the participant would have been
disinclined to give the name lili to the amoeba figure, despite the fact
that kiki may sound sharper to them in this context.
Each participant performed the experiment in a closed room,
sitting alone at the computer. On completion, participants were asked
a few debriefing questions in a short interview carried out by the first
author, in order to attempt to understand something about their
reasoning when performing the matching task. These interviews were
recorded, and key portions were subsequently transcribed.
4.4. Results
4.5. Discussion
Figure 6. Spectrograms of the fictive words [kiki] and [mumu], as used in the
experiment. The white part in the middle of [kiki] is silence (that is, a blocking of
the vocal tract before a release of air). These spectrograms show 05,000 Hz and
are 400 ms in duration.
If we start with the shapes, the cross-modal mapping between vision and touch
would allow them to be perceived as soft and sharp [respectively],
motivating the use of these quasi-synaesthetic metaphors as a natural way to
describe these figures. From the side of the expressions the production of the
velar stop /k/, even more so combined with the front, unrounded vowel /i/
involves obstructions and narrowings in the vocal tract, which can similarly be
perceived as sharp and edgy. On the other hand, the shape of the vocal tract
and the lips in the production of /u/ in bouba are quite literally roundish and
Cross-modal iconicity: A cognitive semiotic approach to sound symbolism 333
the passage of air is soft. The mappings between the senses Vision-Touch-
Proprioception-Sound in internal meaning space thus provides for a correspon-
dence between the shapes and the labels that would be impossible otherwise. A
robot, or a Martian with a very different kind of body [] would not be able to
perceive the iconicity involved. (Ikegami, Zlatev 2007: 225)
signs), and those claiming something similar to what the early Witt-
genstein famously stated: that language is a picture of reality. The
error of the first group, who we may (non-arbitrarily) call arbitrarians
was due in part to the conflation of the concepts of convention and
arbitrariness, and in part due to a skewed database of linguistic
evidence, disregarding non-European languages, and of course, the
signed languages of the deaf, which were only recognised (in some
quarters still grudgingly) as true languages some 40 years ago. The
error of the second group, the sound symbolists, was again due in part
to lack of adequate concepts: just remember the profusion of terms
used to describe the phenomenon: sound symbolism, shape
symbolism, phonetic symbolism, mimetics, expressives, ideopho-
nes, psychomimes, synaesthemes etc. in which sounds imitate,
directly express, or resemble meanings. Many sound symbolists also
show clear traces of a binary logic (that can still be observed in some
cognitive-functional quarters nowadays), contrary to that of the
arbitrarians: since language is not arbitrary, it must be essentially
motivated, with resemblance, or iconicity as a chief factor.
There have of course been many exceptions to such binary
opposition between the two extremes (for example Givn 2002), some
of these quite old, as can be seen in the following quote from Jespersen
(1964[1922]: 397):
Yes, of course it would be absurd to maintain that all words at all times in all
languages had a signification corresponding exactly to their sounds, each sound
having a definite meaning once for all. But is there really much more logic in the
opposite extreme, which denies any kind of sound symbolism and sees in our
words only a collection of wholly accidental and irrational associations of sound
and meaning?
But such voices have somehow been dwarfed over the ages, it seems.
With the widening of the linguistic database during the 20th century,
Saussures statement that sound-symbolic words are never organic
elements of a linguistic system, became increasingly hard to maintain.
Hinton et al. (1994) contains several descriptions of sound symbolic
Cross-modal iconicity: A cognitive semiotic approach to sound symbolism 335
systems in languages from all over the world, including less exotic
languages including English (Rhodes 1994; Oswalt 1994). But we sense
a new possible error: when sound symbolism can no longer be denied,
there are tendencies to present it as an ordinary linguistic parameter,
like word-order, or an areal feature, like the presence of noun classi-
fiers or click consonants. For example, Svantesson (1983) classifies
sound symbolic words in the Austroasiatic language Kammu as a
distinct word class, with its own morphological, syntactic and into-
national features. But why should symbolic words constitute a unique
word class in languages like Kammu and Japanese, but not in English
or Spanish? To regard it simply as a typological/areal feature is hardly
explanatory.
To some extent, there is indeed evidence that (clearly) sound
symbolic expressions are treated differently from those that are not, by
their speakers and by processes of language change. Dingemanse
(2009: 840f), for example, describes Siwu ideophones as displaying
deviant phonotactic patterns. Hamano (1998: 86) points out that
Japanese sound symbolic words have retained the word-initial sound
[p], which, through sound change, has otherwise become [h] in
Japanese. This can be seen as the result of a perceived connection
between the sound [p] and its sound symbolic connotations of an
abrupt and explosive movement. Even Jespersen (1964[1922]: 406)
mentioned that English cuckoo [kku] has not undergone the regular
sounds changes that would have resulted in [kku].
Kita (1997, 2001) has attempted to provide a theoretical account of
such a dual code system. On the basis of considerable empirical basis,
he argues that the meaning of Japanese ideophones (mimetics)
consists of an affect-imagistic dimension, where language has direct
contact with sensory motor and affective information (Kita 1997:
320), while non-mimetic expressions such as quantifiers, logical
operators, and the members of ordinary noun classes have their
meanings in an analytic dimension (compare Ikegami, Zlatev 2007).
336 Felix Ahlner, Jordan Zlatev
Figure 7. The dimension of SMOOTHNESS, with the two extreme ends smooth
and sharp, constituting the basis for matching visual and phonetic contrasts.
This could explain why there is less primary iconicity, even with the
help of context, in (spoken) language than what one could assume
from the hypothesis laid out at the end of the previous subsection. Far
from all words in a language can be placed on one or another
dimension, as in Figure 7. Adjectives, or other expressions of quality,
are most susceptible to this, whereas nouns like horse obviously much
less so. Hence, the prediction would be that even if such a non-
gradable expression were initially strongly sound symbolic (iconic),
this iconicity would not be preserved with conventionalization and
historical change.
Indeed, Hinton and colleagues list a number of features that are
likely to be expressed by sound symbolic words, namely salient
characteristics of objects and activities, such as movement, size, shape,
color, and texture (Hinton et al. 1994: 10). Note that all of these are
qualities that are more or less gradient, that is, can be placed on
dimensions such as SPEED, SIZE, ROUNDNESS, SMOOTHNESS etc.
Dingemanse points out that sound symbolic words typically involve
characteristics that are discernable by the six senses (sight, touch,
hearing, interoception, taste, smell), as well as emotion, and as we
would expect from our emphasis on cross-modality, combinations of
these.13
13
Dingemanse, Mark What do we really know about ideophones? Paper pre-
sented at the 6th World Congress of African Linguistics, August 21, 2009, Kln.
Cross-modal iconicity: A cognitive semiotic approach to sound symbolism 339
5.3. Experiment
Burmese
Korean
Gujarati
Georgian
Hiragana
14 For example by visualizing the words spelled when hearing them. In one of
the debriefing questions we asked whether the participants had done so. None
reported to have done so, but mysterious are the ways of the brain.
342 Felix Ahlner, Jordan Zlatev
References
Baba, Junko 2003. Pragmatic function of Japanese mimetics in the spoken dis-
course of varying emotive intensity. Journal of Pragmatics 35: 18611889.
Bouissac, Paul 2010. Saussure: A Guide for the Perplexed. London: Continuum.
Brackbill, Yvonne; Little, Kenneth B. 1957. Factors determining the guessing of mea-
nings of foreign words. Journal of Abnormal and Social Psychology 54: 312318.
Brown, Roger W.; Black, Abraham H.; Horowitz, Arnold E. 1955. Phonetic
symbolism in natural languages. Journal of Abnormal and Social Psychology
50: 388393.
Childs, George Tucker 1994. African ideophones. In: Hinton et al. 1994: 178204.
CP = Peirce, Charles S. 19311958. Collected Papers of Charles Sanders Peirce.
Cambridge: Harvard University Press. [Hartshorne, Charles; Weiss, Paul
(eds.), 19311935; vols. 78. Burks, A. W. (ed.) 1958; In-text references are to
CP, followed by volume and paragraph numbers]
Croft, William 2003. Typology and Universals. Cambridge: Cambridge University
Press.
Crowther, Samuel Ajayi 1852. A Vocabulary of the Yoruba language, Together with
Introductory Remarks by the Rev. O. E. Vidal, M. A. London: Seeleys.
De Cuypere, Ludovic 2008. Limiting the Iconic: From the Metatheoretical
Foundations to the Creative Possibilities of Iconicity of Language. Amsterdam:
John Benjamins.
Deacon, Terrance 1997. The Symbolic Species: The Co-evolution of Language and
the Brain. New York: Norton.
DeLoache, Judy S. 2004. Becoming symbol-minded. Trends in Cognitive Sciences
8: 6670.
Diffloth, Grard 1976. Expressives in Semai. Austroasiatic Studies, Oceanic
Linguistics Special Publication 13: 249264.
Dingemanse, Mark 2009. Ideophones in unexpected places. In: Austin, Peter K.;
Bond, Oliver; Charette, Monik; Nathan, David; Sells, Peter (eds.), Proceedings
of Conference on Language Documentation and Linguistic Theory 2. London:
SOAS, 8397.
Donald, Merlin 1991. Origins of the Modern Mind: Three Stages in the Evolution of
Culture and Cognition. Cambridge: Harvard University Press.
2001. A Mind so Rare: The Evolution of Human Consciousness. New York:
Norton.
Firth, John Rupert 1957. Papers in Linguistics 19341951. London: Oxford Uni-
versity Press.
Fuller, Gillian 1997. Reading the readers: The role of semiotics in visitor research.
Visitor Behavior 12(34): 3031.
Gallagher, Shaun; Zahavi, Dan. 2008. The Phenomenological Mind: An Intro-
duction to Philosophy of Mind and Cognitive Science. London: Routledge.
Givn, Tom 2002. Bio-Linguistics. The Santa Barbara Lectures. Amsterdam:
Benjamins.
Haiman, John 1980. The iconicity of grammar: isomorphism and motivation.
Language 56: 515540.
Hamano, Shoko 1998. The Sound-Symbolic System of Japanese. Standord: CSLI
Publications.
344 Felix Ahlner, Jordan Zlatev
:
-
, -
-
.
, -
. , ,
-
?
.
. -
, .
. . -
-
, -
-
. -
,
, ,
.
Modaalsuste-vaheline ikoonilisus:
kognitiivsemiootiline lhenemine hlikusmboolikale