Validity of The Assessment Tools: UNIT-6
Validity of The Assessment Tools: UNIT-6
Validity of The Assessment Tools: UNIT-6
VALIDITY OF THE
ASSESSMENT TOOLS
Written by:
Dr. Muhammad Tanveer Afzal
Revised by:
Prof. Dr. Rehana Masrur
CONTENT
Sr. No Topic Page No
Introduction ...............................................................................................................117
Objective ..................................................................................................................118
Examples:
1. Say you are assigned to observe the effect of strict attendance policies on class participation.
After observing two or three weeks you reported that class participation did increase after the
policy was established.
2. Say you are intended to measure the intelligence and if math and vocabulary truly represent
intelligence then a math and vocabulary test might be said to have high validity when used as a
measure of intelligence.
A test has validity evidence, if we can demonstrate that it measures what it says to measure. For instance,
if it is supposed to be a test for fifth grade arithmetic ability, it should measure fifth grade arithmetic
ability and not the reading ability.
Activity 6.1: Make a test from any chapter of science book of class 7th and test whether it is valid or
not with the reference to its content?
There are different types of content validity; the major types face validity and the curricular validity are as
below.
1 Face Validity
Face validity is an estimate of whether a test appears to measure a certain criterion; it does not guarantee
that the test actually measures phenomena in that domain. Face validity is very closely related to content
validity. While content validity depends on a theoretical basis for assuming if a test is assessing all
domains of a certain criterion (e.g. does assessing addition skills yield in a good measure for
mathematical skills? - To answer this you have to know, what different kinds of arithmetic skills
mathematical skills include ) face validity relates to whether a test appears to be a good measure or not.
This judgment is made on the "face" of the test, thus it can also be judged by the amateur.
Face validity is a starting point, but should NEVER be assumed to be provably valid for any given
purpose, as the "experts" may be wrong.
For example- suppose you were taking an instrument reportedly measuring your attractiveness, but the
questions were asking you to identify the correctly spelled word in each list. Not much of a link between
the claim of what it is supposed to do and what it actually does.
2. Curricular Validity
The extent to which the content of the test matches the objectives of a specific curriculum as it is formally
described. Curricular validity takes on particular importance in situations where tests are used for high-
stakes decisions, such as Punjab Examination Commission exams for fifth and eight grade students and
Boards of Intermediate and Secondary Education Examinations. In these situations, curricular validity
means that the content of a test that is used to make a decision about whether a student should be
promoted to the next levels should measure the curriculum that the student is taught in schools.
Curricular validity is evaluated by groups of curriculum/content experts. The experts are asked to judge
whether the content of the test is parallel to the curriculum objectives and whether the test and curricular
emphases are in proper balance. Table of specification may help to improve the validity of the test.
Activity 6.3: Curricular validity affects the performance of the examinees, how can you measure the
curricular validity of tests, discuss the current practice followed by the secondary level
teachers with two or three SST in your town.
Activity 6.4: Make a tests for a child of class 4th which measures the shyness construct of his
personality, and valid this test with reference to its construct validity.
There are different types of construct validity; the convergent and the discriminant validity are explained
as follows.
1. Convergent Validity
Convergent validity refers to the degree to which a measure is correlated with other measures that it is
theoretically predicted to correlate with. OR
Convergent validity occurs where measures of constructs that are expected to correlate do so. This is
similar to concurrent validity (which looks for correlation with other tests).
For example, if scores on a specific mathematics test are similar to students scores on other mathematics
tests, then convergent validity is high (there is a positively correlation between the scores from similar
tests of mathematics).
2. Discriminant Validity
Discriminant validity describes the degree to which the operationalization does not correlate with other
operationalizations that it theoretically should not be correlated with. OR
Discriminant validity occurs where constructs that are expected not to relate with each other, such that it
is possible to discriminate between these constructs. For example, if discriminant validity is high, scores
on a test designed to assess students skills in mathematics should not be positively correlated with scores
from tests designed to assess intelligence.
Convergence and discrimination are often demonstrated by correlation of the measures used within
constructs. Convergent validity and Discriminant validity together demonstrate construct validity.
Activity 6.5: Administer any test of English to grade 9th and predict the performance of the students for
future on the basis of that test. Compare its results after a month with their monthly
English test to check the criterion validity of that test with reference to the prediction
made about his performance on English language.
For example:
To assess the validity of a diagnostic screening test. In this case the predictor (X) is the test and the
criterion (Y) is the clinical diagnosis. When the correlation is large this means that the predictor is useful
as a diagnostic tool.
Examples:
1. If higher scores on the Boards Exams are positively correlated with higher G.P.A.’s in the
Universities and vice versa, then the Board exams is said to have predictive validity.
2. We might theorize that a measure of math ability should be able to predict how well a person will
do in an engineering-based profession.
Activity 6.6: Select a teacher made test for 10th grade and discuss it with any teacher for improvement
of the validity evidences in light of factors discussed above.
6.5 Summary
The validity of an assessment tools is the degree to which it measures for what it is designed to measure.
Lots of terms are used to describe the different types of evidence for claiming the validity of a test result
for a particular inference. The terms have been used in different ways over the years by different
authors. More important than the terms, is knowing how to look for validity evidence. Does the score
correlate with other measures of the same domain? Does the score predict future performance? Does the
score correlate with other domains within the same test? Does it negatively correlate with scores that
indicate opposite skills? Do the score results make sense when one simply looks at them? What impact
on student behaviour has the test had? Each of these questions relates to different kinds of validity
evidence (specifically: content validity, concurrent validity, predictive validity, construct validity, face
validity). Content validity evidence involves the degree to which the content of the test matches a content
domain associated with the construct. The concurrent validity evidences can be assured by comparing the
two tests. There are many factors that can reduce the validity of the test, the teachers or test developers
have to consider these factors while constructing and administration of the tests. It better to follow the
systematic procedure and this rigorous approach may help to improve the validity and the reliability of the
tests.
Web Resources
17. http://changingminds.org/explanations/research/design/types_validity.htm
18. http://professionals.collegeboard.com/higher-ed/validity/ ces/ handbook/ test-validity
19. http://professionals.collegeboard.com/higher-ed/ validity/ aces/ handbook /evidence
20. http://www.socialresearchmethods.net/kb/measval.php
21. http://www.businessdictionary.com/definition/validity.html
22. http://www.cael.ca/pdf/C6.pdf
23. 15.http://www.cambridgeassessment.org.uk/ca/digitalAssets/171263BB_CT
definitionIAEA08.pdf