Assessing Reading
Assessing Reading
Assessing Reading
ASSESSING READING
Reading, the most essential skill for success in all educational contexts, remains a skill of
Paramount importance as we create assessments of general language ability.
Two primary hurdles must be cleared in order to become efficient readers:
a. Be able to master fundamental bottom up strategies for processing separate letters,
words and phrases, as well as top-down, conceptually driven strategies for
comprehension.
b. as part of the top-down approach, second language readers must develop appropriate
content and format schemata—background information and cultural experience—to
carry out those interpretations effectively.
The assessment of reading ability does not end with the measurement of comprehension.
Strategic pathways to full understanding are often important factors to include in assessing
learners, especially in the case of most classroom assessments that are formative in nature.
All assessment of reading must be carried out by inference.
GENRES OF READING
1. Academic Reading
general interest articles (in magazines, newspapers)
technical reports (e.g., lab reports), professional journal articles
reference material (dictionaries)
text books. theses
essays, papers
test directions
2. Job-related Reading
messages (e.g., phone messages) letters/emails
memos (e.g., interoffice)
reports (e.g., job evaluations, project reports)
schedules, labels, signs, announcements
3. Personal Reading
newspapers and magazines
letters, emails, greeting cards, invitations
messages, notes, lists
schedules (train, bus, plane)
Importance of Genres of Reading
It enables the readers to apply certain schemata that will assist them in extracting
appropriate meaning
Efficient readers have to know what their purpose is in reading a text, the strategies for
accomplishing that purpose and how to retain the information.
TYPES OF READING
Perceptive
Involve attending to the components of larger stretches discourse: letters, words,
punctuation and other graphemic symbols.
Bottom-up processing is implied.
Selective
This is largely an artifact of assessment formats.
certain typical tasks are used such as picture-cued tasks, matching, true/false,
multiple choice.
stimuli include sentences, brief paragraphs and simple charts and graphs.
brief responses are intended and a combination of bottom-up and top-down
processing may be used.
Interactive
include stretches of language of several paragraphs to one page or more in which
the reader must interact with the text.
genres: anecdotes, short narratives and descriptions, excerpts from longer texts,
questionnaires, memos, announcements, directions, recipes and the like.
focus: to identify relevant features (lexical, symbolic, grammatical and discourse)
within texts of moderately short length with the objective of retaining the
information that is processed.
Extensive
it applies to texts of more than a page, up to and including professional articles,
essays, technical reports, short stories and books.
purpose: to tap into a learner’s global understanding of a text, as opposed to
asking test-takers to “zoom in” on small details.
Top-down processing is assumed for most extensive tasks.
PITURE-CUED ITEMS
test takers are shown a picture along with a written text and are given possible tasks to
perform.
1. Picture-cued matching word identification
Designing Assessment Tasks: Selective Reading
Selective Reading
focus on formal aspects of language (lexical, grammatical and a few discourse features).
it includes what many incorrectly think of as testing “vocabulary and grammar”.
MULTIPLE CHOICE
1. Multiple-choice vocabulary/grammar tasks
2. Contextualized multiple-choice vocabulary/grammar tasks
3. Multiple-choice cloze vocabulary/grammar tasks
MATCHING TASKS
1. Vocabulary matching task
2. Selected response fill-in vocabulary task
3. Matching task
ADVANTAGES AND DISADVANTAGES
- it offers an alternative to traditional
multiple-choice or fill in the blank formats
and are easier to construct than multiple
choice item.
- it become more of a puzzle-solving
process than a genuine test of
comprehension as test-takers struggle with
the search for a match.
EDITING TASKS
-editing for grammatical or rhetorical errors is a widely used test method for assessing
linguistic competence in reading.
- it does not only focus on grammar but also introduces a simulation of the authentic
task of editing or discerning errors in written passages.
PICTURE-CUED TASKS
Diagram-labeling task
GAP-FILLING TASKS
-the response is to write a word or phrase.
-to create sentence completion items where test-takers read part of a sentence and
then complete it by writing a phrase.
Sentence Completion task
Gap Filling Task
DISADVANTAGES
It has a questionable assessment of reading ability. The task requires both reading
and writing performance, thus, rendering it of low validity in isolating reading as the sole
criterion.
Scoring the variety of creative responses that are likely to appear is another
drawback. A number of judgment is needed on what comprises a correct response.
Designing Assessment Tasks:
Interactive Reading
Tasks at this level have a combination of form-focused and meaning-focused objectives
but with more emphasis on meaning.
It implies a little more focus on top-down processing than on bottom-up.
Texts are a little longer from a paragraph to as much as a page or so in the case of
ordinary prose. Charts, graphs and other graphics are somewhat complex in their format.
CLOZE TASKS
The ability to fill in gaps in an incomplete image (visual, auditory or cognitive)
and supply (from background schemata) omitted details.
cloze tests are usually a minimum of two paragraphs in length in order to
account for discourse expectancies. Typically, every seventh word (plus or minus two) is
deleted (known as fixedratio deletion) but many cloze test designers instead use a rational
deletion procedure of choosing deletions according to the grammatical or discourse
functions of the words.
Two approaches to the scoring of cloze test
Exact word method- gives credit to test-takers only if they insert the exact word that was
originally deleted.
Appropriate word method- gives credit to the test-taker for supplying any word that is
grammatically correct and that makes good sense in the context.
1. Cloze procedure, fixed ratio deletion (every seventh word)
2. Cloze procedure, rational deletion (prepositions and conjunctions)
Variations on Standard Cloze Testing
C-test- the second half (according to the number of letters) of every other word is
obliterated and the test-taker must restore each word.
Cloze-elide procedure- it inserts words into a text that do not belong. The test-taker’s
task is to detect and cross out the “intrusive” words.
Cloze-elide procedure is actually a test of reading speed and not of proofreading skill.
Cloze-elide procedure is actually a test of reading speed and not of proofreading skill.
DISADVANTAGES
Neither the words to insert nor the frequency of insertion appears to have any rationale.
Fast and efficient readers are not adept at detecting the intrusive words. Good readers
naturally weed out such potential interruptions.