PA Assessment Slides BW
PA Assessment Slides BW
PA Assessment Slides BW
Phonological Awareness
Assessment
Disclosure Contact Information
• Financial
• Royalties from Brookes • EMAIL
Publishing for Intensive
C. Melanie Schuele, PhD Phonological Awareness • melanie.schuele@me.com
Professor, Hearing and Speech Sciences Program
Vanderbilt University Medical Center
• Nonfinancial
Martha Lynch Lecture, Recorded May 2021
• none
1 2
1 2
3 4
3 4
5 6
1
5/21/2021
When did we
realize that PA
was so important
to early reading
success?
7 8
Alphabet Alphabetic
Orthographic Knowledge
Knowledge Principle
Implicit Explicit
Phonemic Awareness Learning
Activities
Learning
Activities
Phonological Awareness
9 10
9 10
Pre-K Four-year-olds
It depends …
home experiences Phonological Word Reading and
Kindergartners
awareness spelling influences
influences word phonological
school experiences reading and spelling awareness
First Graders
interest
11
12
11 12
2
5/21/2021
13 14
13 14
15 16
15 16
Struggling Learners
17 18
17 18
3
5/21/2021
19 20
21 22
23 24
23 24
4
5/21/2021
55 70 85 25 26
25 26
example …
• Included in composites • Age-norms
• Sound/Composite Score • 6-month age bands through 7
years
• Oral Composite Score
• 12-month age bands starting at 8
• Can be administered as a years
stand-alone subtest to anyone
within the age norms
27 28
27 28
29 30
5
5/21/2021
31 32
Comprehensive Test of
Phonological Processing-
Second Edition
Phonological
Phonological
Awareness
Memory
Abbreviation: CTOPP-2
Authors: Wagner, Torgesen, Rashotte
Year of publication:
Rapid
Automatized Cost: $347
Naming
33 34
33 34
35 36
6
5/21/2021
37 38
Norms
• Age-based norms
• 4-month, 6-month, annual intervals Why be
• Age- and grade-equivalent scores concerned
• “we provide them (reluctantly)”
about floor
• Percentile Ranks effects?
• Standard Scores
• Descriptive interpretation, Table 3.1
• Floor effects, phonological awareness
39
39 40
41 42
7
5/21/2021
TOPEL
• Print Knowledge Subtest • Norms 3;0 – 5;11
• alphabet knowledge • Normative study: 842 children across
Literacy
• Definitional Vocabulary
intervals
• single word oral vocabulary
• definition information
Abbreviation: TOPEL • Early Literacy Index
• Phonological Awareness
Authors: Lonigan, Wagner, Torgesen, Rashotte • Print Knowledge Composite
• elision
Year of publication: 2007 • Definitional Vocabulary Composite
• blending
Cost: $260 • Phonological Awareness Composite
43 44
43 44
TOPEL: Phonological Awareness Subtest Are there floor effects on the TOPEL: PA?
Raw Score = 1, Standard Score = ?
• 4 item sets, each with own ceiling Lowest Standard Score = 55
• Set A: Deletion items: syllable* and phoneme
• Response format: choose picture from four picture options
• Set B: Deletion items: syllable and phoneme 3;0 – 3;2 3;3 – 3; 5 3;6 – 3;8 3;9 – 3;11 4;0 – 4;2
• Response form: verbal
• Set C: Blend items: syllables* and onset-rime or onset_nucleus- 72 69 63 61 59
coda
• Response form: choose picture from four picture options
• Set D: Blend items: syllables* and onset-rime or onset_nucleus-
coda or onset-nucleus-coda Yes, but not horribly so.
• Response form: verbal
*2 monosyllables = compound word
45 46
45 46
TOPEL Subtest and Composite Standard When interpreting the scores of 5-year-olds,
Scores however, examiners can make distinctions in below
average levels of ability for the subtests and
For 3- and 4-year-olds, the subtest and composite composite.
standard scores help to identify children who are
performing below their peers, but the scores cannot For all ages, the TOPEL subtest and composite
be used to establish specific levels that are below standard scores can be used to identify children
average. who are at risk for literacy problems.
The subtest and composite scores for children at The standard scores attained from the TOPEL
these ages do not have sufficient floor to allow subtests and composite do not reveal the source of
examiners to make distinctions in below average problems, only their existence.
levels of ability.
47 48
47 48
8
5/21/2021
think
think
think
many with early information
Diagnoses and
Diagnostic Have educational
Test results that
hypotheses from reasons that literacy skills that goes
Handle test results have reliabilities less a child might only one beyond test
judgements about and social
carefully than .80 – do not
test results – Need People diagnose,
individuals consequences
consider at all
to confirm by other score low on reason a results tests don’t
observations
a test child scores
low on the
TOPEL
Note: ;Some text is lifted from the manual; these ideas are from the TOPEL manual 49 50
49 50
TOPEL Authors:
Cautions in Interpreting Test Results TOPEL
3. Test Results Do Not Translate Directly into Clinical Programs GOOD BAD, UGLY
• Informative manual! • Normative phonological awareness
Extensive Other Early Literacy assessment (and any normative
Clinical Teaching Sampling Procedures
• Final product represents the work of
Observations field’s leader in phonological awareness
assessment) with 3-year-olds can be
particularly challenging
• Final products represents years of
development • Understand TOPEL limitations
Parent and Teacher
Norm-referenced Tests
Input • Measure taps three critical literacy risk
factors – and three malleable factors
COMPREHENSIVE EVALUATION
51 good bad ugly 52
51 52
So,
when is the TOPEL Test of Phonological
my go-to measure? Awareness-Second Edition:
Plus
Abbreviation: TOPA-2+
What will it tell me? Authors: Torgesen, Bryant
Year of publication: 2004
What won’t it tell me? Cost: $263
53 54
53 54
9
5/21/2021
Kindergarten Version
TOPA-2+ • Phonemic Awareness subtest
• 10 initial sound-same items; which of
TOPA-2+ ~ Normative Data
three words begins with same sound as
target word
• Norms 5;0 – 8;11 • 10 initial sound-different items; which of • Normed on 2085 students, 26 states
• Group administered (but can also
four words begins with different sound • 1035 Kindergarten version
• Letter-Sounds subtest • 1050 Elementary version
administer individually) • 15 items; mark which of four letters
corresponds to phoneme
• Picture Support for PA items
Elementary Version • Time to administer
• Phonemic Awareness subtest • K: 30 – 45 min
• 10 ending sound-same items • 1: 15 – 30 min
• 10 ending sound-different items
• Letter Sound subtest
• Spell simple pseudowords (2 – 5 • Standard Scores and Percentiles
phoneme, monosyllables)
55 56
55 56
TOPA-2+
So,
GOOD BAD, UGLY when is the TOPA-2+
• Revision included new normative data • Variation in PA performance expectations
and addition of letter-sound knowledge
subtest
across districts and schools may weaken
the value of normative comparison my go-to measure?
• Efficient for gathering classroom-wide • Group administered test may be invalid or
normative comparisons less valid for distractible children
• # of children participating in normative • Follow up with individual measure?
study
• Narrow age range allows for design that
• Normative data may not reflect current
student performance ~ 20 years old,
What will it tell me?
better captures young children’s skills instruction has changed
What won’t it tell me?
good bad ugly 57 58
57 58
59 60
59 60
10
5/21/2021
ATLAS-PA
So,
GOOD BAD, UGLY when is the ATLAS-PA
• Free, free, free • Ran into some problems …
• Some other measures have ‘parts’ that
don’t require a verbal response, but this is
• Able to choose a response before item
administered. my go-to measure?
• Letters and letter sounds did not work
the only measure that requires no verbal
• System froze
response
• Levels of directions to meet needs of Web-based ~ they are likely collecting user data
varied learner to drive future development
What will it tell me?
What won’t it tell me?
good bad ugly 61 62
61 62
Phonological Awareness
• Norms: 5;0 – 9;11 classroom reading instruction.
• The straightforward,
Test-Second Edition:
• PA 5;0 – 9;11 developmental format lets you
easily tease out specific skills
and plan effective
Normative Update
• Supplemental 6;0 – 9;11
interventions.
• Administration 40 – 50 min • The test is comprehensive and
Abbreviation: PAT-2:NU includes a wide variety of tasks;
Authors: Robertson, Salter performance on each of these
Year of publication: 2007 tasks has been correlated with
Cost: $209 success in early reading and
spelling.
63 64
63 64
• Substitution with Manipulatives: isolate a phoneme in a word, then change • There are better options for normative
comparisons
into another phoneme to form a new word
• The pie is sliced into too many pieces
• Blending: Syllables and Phonemes blend units of sound to form new words
• The PAT came about when a criterion-
referenced measure was normed – not a
• Phoneme-Grapheme Correspondence: assesses knowledge of good idea!
sound/symbol correspondence for consonants, vowels, consonant blends,
consonant digraphs, r-controlled vowels, vowel diagraphs, and diphthongs
• Phonemic Decoding: assesses general knowledge of sound/symbol
correspondence to blend sounds into nonsense words 65 good bad ugly 66
65 66
11
5/21/2021
So,
when is the PAT-2:NU Test of
my go-to measure? Auditory Processing Skills –
4th edition
Abbreviation: TAPS
What will it tell me? Authors: Martin, Brownell, Hamaguchi
Year of publication: 2018
What won’t it tell me? Cost: $205
67 68
67 68
auditory nervous system is essential for understanding and interpreting Binaural processing
Auditory discrimination
underlying processes and deficits. Medwetsky (2011) provides in- • Sound localization and lateralization
• Auditory performance with competing
depth information on this topic. or degraded acoustic signals
https://www.asha.org/Practice-Portal/Clinical-
Topics/Central-Auditory-Processing-Disorder/ (including dichotic listening; ASHA,
69 2005) 70
69 70
From website
72
71 72
12
5/21/2021
TAPS-4 TAPS-4
Auditory Memory Index Listening Comprehension
•
•
Number Memory Forward
Word Memory
Index
• Processing Oral Directions
Theory Matters
• Sentence Memory (without background noise)
• Number Memory Reversed • Auditory Comprehension What is phonological awareness?
(Supplemental) • Auditory Figure–Ground—
Processing Oral Directions A metalinguistic skill
with background noise An auditory processing skill
(Supplemental)
73 74
So,
when is the TAPS-4
my go-to measure? SCREENER, BENCHMARK, and
PROGRESS MONITORING
MEASURES
What will it tell me?
What won’t it tell me?
75 76
75 76
77 78
13
5/21/2021
RHYME AWARENESS: Out of a set of three pictures, students identify the one • CONCEPT OF WORD measures
that rhymes with the target picture. children's ability to (a) • PALS-K
accurately touch words in a
BEGINNING SOUND AWARENESS: Group: Out of a set of three pictures, memorized rhyme, (b) use • Rhyme and Beginning
students identify the one that has the same beginning sound as the target context to identify individual Sounds
picture. Individual: Sort 10 pictures based on initial sounds, 4 header words within a given line of text, • Administer in group
pictures. and (c) identify words • Administer individual follow-up
presented outside of the text. for those children who did not
reach benchmark
ALPHABET KNOWLEDGE: Students name the 26 lower-case letters of the WORD RECOGNITION IN
alphabet. ISOLATION
is an optional task on PALS-K, • Remainder of tasks
LETTER SOUNDS: Students produce the letter sounds of 23 upper-case letters but can be administered to individual administration.
of the alphabet, as well as three digraphs. students who have some
reading ability. Preprimer,
SPELLING: Students spell five consonant-vowel-consonant words, receiving Primer, and First-grade level lists
credit for phonetically acceptable substitutions. are provided.
79 80
79 80
81 82
83 84
83 84
14
5/21/2021
85 86
So,
Criterion-Referenced
when is the DIBELS:PA Measures of Phonological
my go-to measure? Awareness
87 88
89 90
89 90
15
5/21/2021
91 92
93 94
PAST
• 4 versions
• Measure tied to Kilpatrick’s
Phonological Awareness intervention and based on
Rosner’s work in the 1970s
Screening Test • Segmentation and
Abbreviation: PAST
manipulation task
Authors: David Kilpatrick
Year of publication: 2016
Cost: free, https://equippedforreadingsuccess.com/
95 96
95 96
16
5/21/2021
PASS Tasks
1. Word Discrimination
2. Rhyme recognition
Phonological Awareness
3. Rhyme production
4. Syllable blending
Skills Screener
5. Syllable segmentation
6. Syllable deletion
7. Phoneme recognition
Abbreviation: PASS 8. Phoneme blending
Authors: Mather, Sammons, Podhajski, Kroese, Varricchio
9. Phoneme segmentation
Year of publication: no date
10. Phoneme deletion
Cost: Free, search on web
97 98
97 98
99 100
Looking more closely at PASS Tasks Looking more closely at PASS Tasks
• Rhyme Recognition: What rhymes with sun? | cat run Phoneme Blending Phoneme Segmentation
What is /b/ /e/? Tell me the sound in TOE.
• Rhyme Production: Tell me a word that rhymes with tree? 1. CV 1. CV
• 5 monosyllables, then ringing, money, stamp 2. CV 2. CV
• Syllable Blending: What is sail … boat? 3. CVC 3. CVC
• 2 compound words, 2 2-syllable words, one morphology, 3 3- or 4. CVC 4. CVC
4-syllable compound words (basketball), 4 syllables, 5 syllables 5. CVC 5. CVC
6. CCVC 6. CCVC
• Syllable Segmentation: Tell and show me the parts of 7. CVCC 7. CVCC
football. 8. CVCV 8. CCVCC
• 3 compound words, 3 2-syllable words (1 morph), 2 3-syllable 9. CVCCV 9. CCVCC
words, 2 4-syllable words 10. CVCCVC 10. CCCVC
101 102
101 102
17
5/21/2021
103 104
So,
when is the PASS
my go-to measure?
What skills does this child have?
What do I need to teach this child?
Has this child mastered the skills I have taught?
What will it tell me?
What won’t it tell me?
105 106
105 106
Awareness instructionally
relevant,
Abbreviation: MOPA criterion-
Author: Schuele referenced
Date: 2017, 2020
Publisher: Author
measure of PA
Cost: FREE
107
108
107 108
18
5/21/2021
MOPA Tasks
109 110
109 110
Interpretation of MOPA
111 112
111 112
The End
MELANIE.SCHUELE@ME.COM
113 114
113 114
19