13-How To DesignAssessmentMethods

Student Learning Outcome
Assessment Methods
Student Learning Outcome

Assessment Methods
Presented by
Office of Strategic Planning & Assessment
Participants’ Learning
Outcomes
At the end of this training section, participants will be able to do the

following:
 Select appropriate assessment methods for evaluating students’

mastery of the SLOs or PLOs;
 Apply embedded-question method to the assessment of SLOs or

PLOs
Assessment Methods
Assessment methods: refer to the use of direct or indirect

measures (data sources) to gauge students’ mastery of student
learning outcomes.
Appropriate use of assessment methods requires faculty

members to have the following two skills:
1. Selecting and designing direct measures (e.g. assignments

or exams) or indirect measures (e.g. surveys or interviews)
at the program level or course level;
2. Selecting and designing evaluation instruments (a

rubric or a score distribution guide.)
Direct Measures
Direct Measures look at the actual student work

(assignments or exams) that can be used to directly
measure students’ knowledge and skills
Examples: Pre-test, post-test, comprehensive subject

matter exam, licensure exam, portfolio, thesis, writing
assignment, capstone assignment, and performance
demonstration (recital, art exhibit,
or science project)
Indirect Measures
Indirect Measures refer to the type of data that can be

used to infer students’ knowledge and skills
Examples: Surveys, Interviews, Focus Group Studies,

Document Analyses, Students’ Self-Reports.
Program Level Vs. Course
Level Measures
Program-Level Measures: Refer to assignments or tests that

assess students’ knowledge and skills at the end of the program,
not embedded in any particular course.
Examples:
 Exit exams (standardized, licensure/professional exams)
 Thesis, Dissertation
 Capstone Course Paper or Project
 Portfolios
Program Level Vs. Course
Level Measures
Course-Level Measures: Refer to assignments or tests that are

given in specific courses. These course-level data can be used to
measure students’ knowledge and skills at the end of a course or a
program.
Examples:
 Exams, Tests
 Rubric-Based Assignments:
 Projects
 Essays
 Portfolios
 Presentations
 Performance Demo.
How to Select Measures?
Cognitive Domain Measures Aligned with Cognitive Domain
Demonstrating knowledge Objective Assignments: Assignments that have

and comprehension right or wrong answers or the best answers:
Multiple-choice questions, true-or-false questions.
Subjective Assignments: Assignments that
entail varied responses (no right or wrong
answer): Essays, Presentations, Portfolios
Application of skills Performance-Based Assignments:

Performance Demonstrations, Artwork, Music
Performance, Projects, Presentations, Internship
Projects
Analysis, synthesis, and Subjective Assignments: Essays, Essay

evaluation Questions, Research Paper, Presentations,
Portfolios, Internship Projects, Capstone Projects
Examples of Measures Aligned with
Student Learning Outcomes
Student Learning Outcomes Measures

(that address different areas of
cognitive domain)
Students will be able to describe Exam on the history and purpose of

history, purpose, and scope of Physical Therapy
physical therapy. Essay describing the scope of
(Demonstrating Knowledge) physical therapy
Students will be able to distinguish Exam or Essay Questions on the

important aspects of the western Exam summarizing the principles of
moral theories, from the virtue ethical theories
theory of ancient philosophers to the Essay comparing the similarities
modern theories of act ethics. and differences between the ancient
(Demonstrating Comprehension) and modern theories
Examples of Measures
Aligned with SLOs
Student Learning Outcomes Measures
Students will be able to apply Demonstration of public speaking

appropriate organizational skills for in front of the class
selected types of speeches.
(Application of Skills)
Students will be able to analyze a Essay analyzing which educational
variety of issues that influence movements affected minority
learning in secondary schools. students’ learning
(Analysis)
Students will be able to coordinate Internship in a clinical setting to
human information and material provide patient care under the
resources in providing care for supervision of an experienced
patients and their families. physical therapist.
(Synthesis).
Rubrics or Not?
A rubric is needed if an assignment entails varied

responses, rather than one correct answer.
 Essay
 Essay questions on an exam
 Research paper
 Oral presentation
 Portfolio
 Demonstration of critical thinking skills
 Demonstration of technical skills
 An Art Show, etc.
Rubrics or Not?
If assignments or exam questions entail only right or

wrong answers, then a score distribution guide indicating
the distribution of points for correct answers is used.
 Math questions
 Multiple-choice questions
 True or false questions
 Filling-in-the-blanks test
 Matching exercise or test
Hands-on Activity
Directions: For each of the following PLOs, specify what assignment or exam can be used to assess
the PLO. Also, identify if the assignment or the exam need a rubric or a score distribution guide.
Measures Evaluation Instrument
(Assignments or Exams) (Does this assignment need
Program PLOs a rubric or a score
distribution guide?)
Establish and maintain effective

interpersonal relationships and be
Respiratory Care able to function interdependently
Therapist with allied health personnel.
Apply design principles to execute

Visual industry specific project
Communications objectives.
Demonstrate basic math skills by

calculating percentages, payroll,
Administrative Services loans, discounts, etc.
Hands-on Activity
Directions: For each of the following course SLOs, specify what assignment or exam can be used
to assess the PLO. Also, identify if the assignment or the exam need a rubric or a score
distribution guide.
Measures Evaluation Instrument
(Assignments or Exams) (Does this assignment
Courses SLOs
need a rubric or a score
distribution guide?)
Analyze and evaluate economic events

Accounting that apply to the preparation of
(ACNT 2303) financial statements.
Explain the role of scarcity,

specialization, opportunity cost and
Economics cost/benefit analysis in economic
(ECON 2301) decision making.
Government Demonstrate understanding of

(GOVT 2305) federalism.
Embedded Questions
Embedded questions are questions that assess a course learning

outcome (SLO) or a program learning outcome (PLO), but are
embedded in an exam or in an assignment.
Nursing program exit exam EDUC 2301 Capstone Project:
Create a Lesson Plan
Questions in "Communication" The part of the lesson plan

section of Quality and Safety that addresses legal aspects
Education category assess of accommodating ESL
PLO2 students is used to assess
PLO1
Questions in
"Collaboration/Managing
The part of the lesson plan
Care" section of Nursing
that demonstrates critical
Concepts category assess
thinking skills assesses PLO5
PLO4
Embedded Questions
 Report the embedded questions’ result for its related PLO;

 Don’t use the whole exit exam’s score or the whole capstone
project’s score as one particular PLO’s result.
Nursing program exit exam EDUC 2301 Capstone Project:
Create a Lesson Plan
PLO2 result: 925 PLO1 result: 96%
PLO4 result: 915 PLO5 result: 85%

Discussion
1. MATH 2413 assesses SLO2 (“Draw graphs of algebraic

and transcendental functions considering limits, continuity,
and differentiability at a point”) by using two questions
embedded in the final exam.
The pass rate for the exam was 78%, but the pass rate for
the two embedded questions was 50%.
Which pass rate should be used to demonstrate the

mastery of SLO2?
Discussion (Continued)
2. HIST 2322 assesses SLO1 (“Create an argument

through the use of historical evidence”) by using an essay
question embedded in Exam II.
The pass rate for Exam II was 71%, and the pass rate for
the essay question was 65%.
Which pass rate should be used to demonstrate the

mastery of SLO1?
Resources
Stiggins, R., Arter, J., Chappuis, J, & Chappuis, S.

(2004). Classroom Assessment for Student Learning :
Doing it Right-Using it Well. Assessment Training
Institute. www.assessmentinst.com
Suskie, L. (2009). Assessing Student Learning. San

Francisco: Jossey-Bass.
UT-Austin Assessment Webpage:

https://www.utexas.edu/provost/planning/assessment/iap
a/workshops.html

13-How To DesignAssessmentMethods

Uploaded by

Copyright:

Available Formats

13-How To DesignAssessmentMethods

Uploaded by

Document Information

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

13-How To DesignAssessmentMethods

Uploaded by

Copyright:

Available Formats

Student Learning Outcome

Student Learning Outcome

At the end of this training section, participants will be able to do the

 Select appropriate assessment methods for evaluating students’

 Apply embedded-question method to the assessment of SLOs or

Assessment methods: refer to the use of direct or indirect

Appropriate use of assessment methods requires faculty

1. Selecting and designing direct measures (e.g. assignments

2. Selecting and designing evaluation instruments (a

Direct Measures look at the actual student work

Examples: Pre-test, post-test, comprehensive subject

Indirect Measures refer to the type of data that can be

Examples: Surveys, Interviews, Focus Group Studies,

Program-Level Measures: Refer to assignments or tests that

Course-Level Measures: Refer to assignments or tests that are

Cognitive Domain Measures Aligned with Cognitive Domain

Demonstrating knowledge Objective Assignments: Assignments that have

Application of skills Performance-Based Assignments:

Analysis, synthesis, and Subjective Assignments: Essays, Essay

Student Learning Outcomes Measures

Students will be able to describe Exam on the history and purpose of

Students will be able to distinguish Exam or Essay Questions on the

Student Learning Outcomes Measures

Students will be able to apply Demonstration of public speaking

A rubric is needed if an assignment entails varied

If assignments or exam questions entail only right or

Establish and maintain effective

Apply design principles to execute

Demonstrate basic math skills by

Analyze and evaluate economic events

Explain the role of scarcity,

Government Demonstrate understanding of

Embedded questions are questions that assess a course learning

Questions in "Communication" The part of the lesson plan

 Report the embedded questions’ result for its related PLO;

PLO2 result: 925 PLO1 result: 96%

PLO4 result: 915 PLO5 result: 85%

1. MATH 2413 assesses SLO2 (“Draw graphs of algebraic

Which pass rate should be used to demonstrate the

2. HIST 2322 assesses SLO1 (“Create an argument

Which pass rate should be used to demonstrate the

Stiggins, R., Arter, J., Chappuis, J, & Chappuis, S.

Suskie, L. (2009). Assessing Student Learning. San

UT-Austin Assessment Webpage:

You might also like