Lecture 9 - Language
Lecture 9 - Language
Lecture 9 - Language
Language
• Definition
• Taxonomy
• Perception
• Critical Window & Stages of Development
• Language in Animals
Definition of Language
– one letter like /t/ will have several variants the are
aspirant or percussive (or non-aspirant) which are
called allophones.
– Phoneme (phonemic)
Categorical Perception
− Tendency to perceive phones within a phoneme
category as the same
− Phonemes are invariant across different contexts
Taxonomy of Language
u 200 to 400 Hz
Labeled by number, from lowest to
o 400 to 600 Hz
highest (F1, F2, F3)
a 800 to 1200 Hz
e 400 to 600 and 2200 to 2600 Hz
Different Vowels have different
i 200 to 400 and 3000 to 3500 Hz
(proportional) distances
Formants
Peak in the speech spectrum. With
resonant peaks below.
● Coarticulation
− A given phoneme sounds different depending on
neighboring phonemes
◘ Phonemes are articulated simultaneously
Bottom-Up / Top-Down
Bottom-Up: McGurk Effect
• http://www.youtube.com/watch?
v=73LE1vKGfy4&feature=related
Bottom-Up: McGurk Effect
• Lip movements to one sound “ga”
• Soundtrack indicates “ba”
• What do you hear?
• McGurk & MacDonald (1976) found that
people make a comprised sound “da”
• http://www.youtube.com/watch?v=73LE1vKGfy4&feature=related
Bottom-Up Uses Bayesian Integration
• Bayesian probability uses prior likelihoods
• Wave patterns (formants) /Ba/ /Da/ & /Ga/
exist on a continuous spectrum
• But we perceive abrupt boundaries between
formants. How?
• Partially, by experience within one modality.
Spectrogram
Spectrogram
of vowels
of pure
that sound
vowel
differently
sounds
due to
surrounding
sounds
Bottom-Up Uses Bayesian Integration
• But we perceive abrupt boundaries between
formants. How?
• Partially, by Bayesian integration across
modalities
Prob of detecting Ba
• Honeybees
• • When a forager bee locates food it returns to the hive and
performs a dance.
• • The number of repetitions of the dance communicates the
quality of the food.
• • Distance is communicated by the form of the dance.
• – Round Dance: < 20 ft
• – Sickle Dance: 20 – 60 ft.
• – Tail-Wagging Dance: > 60 ft, coded by rate
• • Direction is also communicated in the sickle and tail-
wagging dances.
• http://www.youtube.com/watch?v=-7ijI-g4jHg
• http://www.youtube.com/watch?v=4NtegAOQpSs&NR=1
Alex the Parrot
Irene Pepperberg has spent 25 years teaching Grey Parrots
“meaningful use of English speech”.
Model/Rival Training
• Trainer + Model/Rival + Parrot
• Trainer presents objects to the model/rival and queries them
about it.
– Correct: Get the item.
– Incorrect: Get corrective feedback.
• The only reward is the object talked about, but after a correct
response the parrot can
request something it wants (e.g., a nut).
Alex the Parrot
• “Alex exhibits cognitive capacities comparable to those of
marine mammals,apes, and sometimes 4-year-old children.”
• Alex correctly labels
– 50+ objects, 7 colors, 5 shapes, quantities up to 6
• He correctly uses
– “No.”
– “Come here.”
– “Wanna go X.”
– “Want Y.”
• He combines labels to correctly identify more than 100
objects in his environment.
• He surfs the internet
• http://www.pbs.org/saf/1201/video/watchonline.htm
The Great Apes
• Larynx in nasal cavity in most
animals except during vocalizing,
when it moves to oral cavity
• Same true for human infants, but
around 3 months moves to throat
• Lower larynx makes an animal
sound larger, it also happens to
help vocalization and formant
(vowel) production
• Humans have it permanently low,
and it grows even lower in human
male adolescents
Great Primate
• Sarah (Primack, 1971): vocabulary of more than 100 words of various parts of
speech. Showed rudimentary linguistic skills. She modeled her trainer and was able
to use the instructions she received to construct what appeared to be a rudimentary
language of her own.
• Kanzi is the star of animal language studies today (Savage-Rumbaugh, Shanker &
Taylor, 1998).
• He uses a keyboard language called Yerkish.
– Kanzi was not formally introduced to Yerkish.
– He sat on his adopted mother’s back while she received lessons in Yerkish.
– Mom never learned, but Kanzi started using the keyboard spontaneously.
– Since then his “training” has consisted of walks in the woods.
– Kanzi understands over 200 symbols.
Kanzi the Bonobo Chimp
• Kanzi was faced with 310 sentences of various types
• action-object sentences (e.g. "Would you please carry the straw"),
• action-object-location sentences (e.g. "Put the tomato in the
refrigerator")
• action-object-recipient sentences (e.g., "Carry the cooler to
Penny").
• Genie
– Kept in isolation from 20 mo
– Was discovered in 1970 when she was 13+
– Is it possible to learn language at this late age?
– Genie only developed a limited syntax
Applesauce buy store
Man motorcycle have
• Feral Children
– Djuma, “Wolf Boy”
• Found living among wolves
• “Mother dead. Father dead. Brother dead. Sister dead. Mother nice. Father
bad.”
– The Boy from Aveyron
• Within a few months Victor could sit in a chair, express his emotions without
being violent, and he could even speak a few words, like ‘milk’, and ‘Oh
God’, which was something Dr. Itard’s housekeeper, Mme. Guerin, often
said. Victor also came to like Mme. Guerin, who fed and cared for him.
Creole and Pigdin
• Creole languages develop “out of nothing”
• Speakers of Pigdin use many mother tongues, mixing
up words and syntax, usually without articles or
prepositions.
• Their children develop the Creole language, keeping
the words, adding prepositions, articles.
• The Creole vocabulary is reduced, word-order is
variable, with little grammatical structure, meaning is
context dependent.
Language Acquisition
• What makes language hard to acquire?
– How do you know when one syllabe starts and
another ends? Coarticulation: Phonemes overlap in
time
– Variability in speech signal
– No one-to-one correspondence between the
acoustic stimuli and the speech sounds we hear
• How do we recognize sounds in a way so a
stable set of phonemes is perceived?
Language Acquisition
• What newborn and very young infants can
already do
– discriminate human speech from other sounds and
prefer to listen to it
– discriminate their mother’s voice from that of
other adult women
– discriminate their language from another language
– they listen longer to a story that they have heard
read in the womb
Motherese
Stages of Language Acquisition in Infants
• Questions:
• Which are the privileged / legal phonemes?
• Why are some combinations of phonemes
allowed and others not?
• How is the structure of spoken language
visible in this chart?
» Mother Tongue Word Boundary Acquisition in Infants
» Discerning Word Boundaries
– Weak relationship between breaks in the acoustic speech signal
and breaks between words
● Metrical segmentation
− Phonological regularities of a given language
◘ Example: In English, content words tend to start with
strong syllables and end with weak syllables
Using Statistical Probabilities to Detect Word Boundaries
● Statistical regularities present in the speech sequence is used to
detect word boundaries
Phase 1
Presented infants with a two-minute continuous speech stream
composed of 4 different 3-syllable nonsense words strung
together in random order
Bidaku/padoti/golabu/fotavi
Phase 2
Two types of test trials
♦ Previously defined “words” heard by infants
♦ New experimenter defined words containing the same
syllables, but in new combinations
Old: bidaku/padoti/golabu/fotavi
New: kupa/dotigola/avibida/bufot
Results
Prediction (Hypothesis) 1 wins! Kids stared at
light under type 2 words; they recognized the new
words as new
Language is also Syntax
3. The babies listen to the strings following these rules for 2 minutes
4. Test with strings of the same sounds but different rules of combination
But
• Container Locatives • Content Locatives
• Tex nailed the board with posters • Tex nailed the posters on the board
• Serena coiled the pole with a rope • Serena coiled the rope around the pole
• Ellie covered the bed with an afghan • Ellie covered an afghan onto the bed
• Jimmy drenched his jacket with • Jimmy drenched beer onto his jacket
beer
But
• Prepositional Datives • Double-Object Datives
• Goldie drove her bus to the lake • Goldie drove the lake her bus
• Arnie lifted the box to him • Arnie lifted him the box
• The IRS fined a thousand bucks to me • The IRS fined me a thousand bucks
• Friends, Romans, countrymen: • Friends, Romans, countrymen: Lend
Lend your ears to me! me your ears!
But
• Transitives • Intransitives
• She thumped the log • The log thumped
• He wrecked the car • The car wrecked
• The thunder is crying the baby • The baby is crying
• I came my son home early • My son came home early
But
• Container Locatives • Content Locatives
• Tex nailed the board with posters • Tex nailed the posters on the board
• Serena coiled the pole with a rope • Serena coiled the rope around the pole
• Ellie covered the bed with an afghan • Ellie covered an afghan onto the bed
• Jimmy drenched his jacket with • Jimmy drenched beer onto his jacket
beer