kirkpatrick's learning and

training evaluation theory

Donald L Kirkpatrick's training
evaluation model - the four levels of
learning evaluation
Donald L Kirkpatrick, Professor Emeritus, University Of Wisconsin
(where he achieved his BBA, MBA and PhD), first published his ideas
in 1959, in a series of articles in the Journal of American Society of
Training Directors. The articles were subsequently included in
Kirkpatrick's book Evaluating Training Programs (originally published
in 1994; now in its 3rd edition - Berrett-Koehler Publishers).
Donald Kirkpatrick was president of the American Society for
Training and Development (ASTD) in 1975. Kirkpatrick has written
several other significant books about training and evaluation, more
recently with his similarly inclined son James, and has consulted
with some of the world's largest corporations.
Donald Kirkpatrick's 1994 book Evaluating Training Programs
defined his originally published ideas of 1959, thereby further
increasing awareness of them, so that his theory has now become
arguably the most widely used and popular model for the evaluation
of training and learning. Kirkpatrick's four-level model is now
considered an industry standard across the HR and training
communities.
More recently Don Kirkpatrick formed his own company, Kirkpatrick
Partners, whose website provides information about their services
and methods, etc.

kirkpatrick's four levels of evaluation

model
The four levels of Kirkpatrick's evaluation model essentially
measure:

reaction of student - what they thought and felt about

the training
learning - the resulting increase in knowledge or
capability
behaviour - extent of behaviour and capability
improvement and implementation/application

results - the effects on the business or environment

resulting from the trainee's performance

All these measures are recommended for full and meaningful

evaluation of learning in organizations, although their application
broadly increases in complexity, and usually cost, through the levels
from level 1-4.

Quick Training Evaluation and Feedback

Form, based on Kirkpatrick's
Learning Evaluation Model - (Excel
file)
kirkpatrick's four levels of training
evaluation
This grid illustrates the basic Kirkpatrick structure at a glance. The
second grid, beneath this one, is the same thing with more detail.
leve evaluatio evaluation
l
n type
description and
(what is
characteristics
measured
)

examples of
evaluation tools
and methods

relevance and
practicability

Reaction
evaluation is how
the delegates
felt about the
training or
learning
experience.

'Happy sheets',
feedback forms.

Quick and very easy

to obtain.

Verbal reaction,
post-training
surveys or
questionnaires.

Not expensive to
gather or to analyse.

Learning
evaluation is the
measurement of
the increase in
knowledge before and after.

Typically
assessments or
tests before and
after the training.

Relatively simple to
set up; clear-cut for
quantifiable skills.

Behaviour
evaluation is the
extent of applied
learning back on

Observation and
interview over
time are required
to assess change,

Reaction

Learning

Behaviou
r

Interview or
observation can
also be used.

Less easy for complex

learning.

Measurement of
behaviour change
typically requires
cooperation and skill

Results

the job implementation.

relevance of
change, and
sustainability of
change.

of line-managers.

Results
evaluation is the
effect on the
business or
environment by
the trainee.

Measures are
already in place
via normal
management
systems and
reporting - the
challenge is to
relate to the
trainee.

Individually not
difficult; unlike whole
organisation.
Process must
attribute clear
accountabilities.

kirkpatrick's four levels of training

evaluation in detail
This grid illustrates the Kirkpatrick's structure detail, and particularly
the modern-day interpretation of the Kirkpatrick learning evaluation
model, usage, implications, and examples of tools and methods.
This diagram is the same format as the one above but with more
detail and explanation:
evaluatio
n level
and type

evaluation
description and
characteristics

examples of
evaluation tools and
methods

relevance and
practicability

1.
Reaction

Reaction
evaluation is how
the delegates felt,
and their personal
reactions to the
training or learning
experience, for
example:

Typically 'happy
sheets'.

Can be done
immediately the
training ends.

Did the trainees like

and enjoy the
training?
Did they consider the
training relevant?
Was it a good use of
their time?
Did they like the
venue, the style,
timing, domestics,

Feedback forms based

on subjective personal
reaction to the training
experience.
Verbal reaction which
can be noted and
analysed.

Very easy to obtain

reaction feedback
Feedback is not
expensive to gather
or to analyse for
groups.

Post-training surveys or Important to know

questionnaires.
that people were not
upset or
Online evaluation or
disappointed.
grading by delegates.
Important that
Subsequent verbal or
people give a
written reports given
positive impression
by delegates to
when relating their
managers back at their experience to others

etc?

jobs.

who might be
deciding whether to
experience same.

Typically assessments
or tests before and
after the training.

Relatively simple to
set up, but more
investment and
thought required
than reaction
evaluation.

Level of participation.
Ease and comfort of
experience.
Level of effort
required to make the
most of the learning.
Perceived
practicability and
potential for applying
the learning.

2.
Learning

Learning
evaluation is the
measurement of the
increase in
knowledge or
intellectual
capability from
before to after the
learning experience:
Did the trainees learn
what what intended
to be taught?
Did the trainee
experience what was
intended for them to
experience?
What is the extent of
advancement or
change in the
trainees after the
training, in the
direction or area that
was intended?

Interview or
observation can be
used before and after
although this is timeconsuming and can be
inconsistent.

Highly relevant and

clear-cut for certain
training such as
quantifiable or
Methods of assessment technical skills.
need to be closely
related to the aims of
Less easy for more
the learning.
complex learning
such as attitudinal
Measurement and
development, which
analysis is possible and is famously difficult
easy on a group scale. to assess.
Reliable, clear scoring
and measurements
need to be established,
so as to limit the risk of
inconsistent
assessment.

Cost escalates if
systems are poorly
designed, which
increases work
required to measure
and analyse.

Hard-copy, electronic,
online or interview
style assessments are
all possible.

3.
Behaviou
r

Behaviour
evaluation is the
extent to which the
trainees applied the
learning and
changed their
behaviour, and this
can be immediately
and several months

Observation and
interview over time are
required to assess
change, relevance of
change, and
sustainability of
change.
Arbitrary snapshot

Measurement of
behaviour change is
less easy to quantify
and interpret than
reaction and
learning evaluation.
Simple quick
response systems

after the training,

depending on the
situation:
Did the trainees put
their learning into
effect when back on
the job?
Were the relevant
skills and knowledge
used
Was there noticeable
and measurable
change in the activity
and performance of
the trainees when
back in their roles?
Was the change in
behaviour and new
level of knowledge
sustained?
Would the trainee be
able to transfer their
learning to another
person?
Is the trainee aware
of their change in
behaviour,
knowledge, skill
level?

assessments are not

unlikely to be
reliable because people adequate.
change in different
ways at different times. Cooperation and skill
of observers,
Assessments need to
typically linebe subtle and ongoing, managers, are
and then transferred to important factors,
a suitable analysis tool. and difficult to
control.
Assessments need to
be designed to reduce
Management and
subjective judgement
analysis of ongoing
of the observer or
subtle assessments
interviewer, which is a
are difficult, and
variable factor that can virtually impossible
affect reliability and
without a wellconsistency of
designed system
measurements.
from the beginning.
The opinion of the
trainee, which is a
relevant indicator, is
also subjective and
unreliable, and so
needs to be measured
in a consistent defined
way.

Evaluation of
implementation and
application is an
extremely important
assessment - there
is little point in a
good reaction and
good increase in
capability if nothing
360-degree feedback is changes back in the
useful method and
job, therefore
need not be used
evaluation in this
before training,
area is vital, albeit
because respondents
challenging.
can make a judgement
as to change after
Behaviour change
training, and this can
evaluation is
be analysed for groups possible given good
of respondents and
support and
trainees.
involvement from
line managers or
Assessments can be
trainees, so it is
designed around
helpful to involve
relevant performance
them from the start,
scenarios, and specific and to identify
key performance
benefits for them,
indicators or criteria.
which links to the
level 4 evaluation
Online and electronic
below.
assessments are more
difficult to incorporate assessments tend to be
more successful when
integrated within
existing management
and coaching protocols.
Self-assessment can be
useful, using carefully

designed criteria and

measurements.

4.
Results

Results evaluation
is the effect on the
business or
environment
resulting from the
improved
performance of the
trainee - it is the acid
test.
Measures would
typically be business
or organisational key
performance
indicators, such as:

It is possible that many

of these measures are
already in place via
normal management
systems and reporting.
The challenge is to
identify which and how
relate to to the
trainee's input and
influence.

Therefore it is
important to identify
and agree
accountability and
Volumes, values,
relevance with the
percentages,
trainee at the start of
timescales, return on the training, so they
investment, and other understand what is to
quantifiable aspects
be measured.
of organisational
This process overlays
performance, for
instance; numbers of normal good
management practice complaints, staff
it simply needs linking
turnover, attrition,
to the training input.
failures, wastage,
non-compliance,
Failure to link to
quality ratings,
training input type and
achievement of
timing will greatly
standards and
reduce the ease by
accreditations,
which results can be
growth, retention, etc.
attributed to the
training.

Individually, results
evaluation is not
particularly difficult;
across an entire
organisation it
becomes very much
more challenging,
not least because of
the reliance on linemanagement, and
the frequency and
scale of changing
structures,
responsibilities and
roles, which
complicates the
process of
attributing clear
accountability.
Also, external factors
greatly affect
organisational and
business
performance, which
cloud the true cause
of good or poor
results.

For senior people

particularly, annual
appraisals and ongoing
agreement of key
business objectives are
integral to measuring
business results
derived from training.

Since Kirkpatrick established his original model, other theorists (for

example Jack Phillips), and indeed Kirkpatrick himself, have referred
to a possible fifth level, namely ROI (Return On Investment). In my
view ROI can easily be included in Kirkpatrick's original fourth level
'Results'. The inclusion and relevance of a fifth level is therefore

arguably only relevant if the assessment of Return On Investment

might otherwise be ignored or forgotten when referring simply to
the 'Results' level.
Learning evaluation is a widely researched area. This is
understandable since the subject is fundamental to the existence
and performance of education around the world, not least
universities, which of course contain most of the researchers and
writers.
While Kirkpatrick's model is not the only one of its type, for most
industrial and commercial applications it suffices; indeed most
organisations would be absolutely thrilled if their training and
learning evaluation, and thereby their ongoing people-development,
were planned and managed according to Kirkpatrick's model.
For reference, should you be keen to look at more ideas, there are
many to choose from...

Jack Phillips' Five Level ROI Model

Daniel Stufflebeam's CIPP Model (Context, Input, Process,
Product)
Robert Stake's Responsive Evaluation Model
Robert Stake's Congruence-Contingency Model
Kaufman's Five Levels of Evaluation
CIRO (Context, Input, Reaction, Outcome)
PERT (Program Evaluation and Review Technique)
Alkins' UCLA Model
Michael Scriven's Goal-Free Evaluation Approach
Provus's Discrepancy Model
Eisner's Connoisseurship Evaluation Models
Illuminative Evaluation Model
Portraiture Model
and also the American Evaluation Association

Also look at Leslie Rae's excellent Training Evaluation and tools

available on this site, which, given Leslie's experience and
knowledge, will save you the job of researching and designing your
own tools.