UG - Tier II - Evaluation
UG - Tier II - Evaluation
UG - Tier II - Evaluation
WRITING
Muhammad Ismail
Director Quality Assurance, NUST
3
ASSESSMENT OF AN
ACADEMIC PROGRAM
Assessment is a systematic process of gathering,
reviewing and using important qualitative and
quantitative data and information about a program
from multiple sources, for the purpose of:
4
SELF ASSESSMENT OF
PROGRAMS
Self assessment is an exercise conducted by the
institution / department itself to assess whether its
programs meet their educational objectives and
outcomes with the purpose to improve quality of
programs and enhance students’ learning
Legend: NO
SA: Self Assessment SAR Complete
SAR: SA Report
PT: Program Team
6
AT: Assessment Team YES
Cont’d…
SELF- ASSESSMENT PROCEDURE
Rector/Comdt forms the AT in consultation
with the QEC
Cont’d…
SELF- ASSESSMENT PROCEDURE
8
PROGRAM TEAM
PROGRAM TEAM
HEC Recommendation:
11
DESIRED SKILLS OF PT
Demonstrate commitment to the principles of quality
in higher education and the policies set by the Higher
Education Commission of Pakistan.
An enquiring disposition.
Power of analysis and judgment.
Ability to work in teams.
Time management skills.
Experience of organization and management,
particularly in relation to teaching and learning
matters.
High standards of oral and written communication
skills.
Self motivated and willing to work for quality
improvement.
RESPONSIBILITIES OF PT
Compiling the report by responding to each criteria/
standards given in the SA Manual and integrating the
collected information / feedback
Collecting relevant data on faculty, students, libraries,
laboratories and infrastructure
Getting SA Performae filled by faculty, students, alumni
and employers
Writing summaries of feedback received through
Performae.
Analyzing the feedback and drawing conclusions
Writing a foreword giving brief history of the program,
particulars of the PT, date of starting / finalizing report
writing
The report may be signed by the convener / chairperson of
the program team
WRITING OF SAR
CRITERIA AND STANDARDS
17
OBJECTIVES
Learning Objective:
Statement about what students are expected
to learn or to be able to do as a result of
studying a program.
OR
Statements that describe the expected
accomplishments of graduates following
graduation from the program)
Implementation Objective: A measurable
operationalization of a policy, strategy or mission.
A strategic plan must be in place to achieve
the program objectives. 18
ELEMENTS OF THE STRATEGIC PLAN
Curriculum design: Core subjects, elective subjects, a
wide variety of elective subjects are offered which
brings diversity in the program. It also includes provision
of areas of specialization.
Concept building through extensive laboratory / practical
work, applying theoretical knowledge.
Small-scale practical projects compatible with
contemporary technological advancements throughout
the degree program, and one practical Project in the final
semester
Co-curricular activities like academic clubs, participating
in national and international competitions and
exhibitions. 19
OUTCOMES
The product or endeavours of a higher education
institution, including student-learning and skills
development, research outputs and contributions to the
wider society locally or internationally (institutional
outcomes)
OUTCOME-BASED APPROACH
An outcomes-based approach to learning and teaching
specifies in advance what the student should be able to
do at the culmination of a program of study
20
OUTPUT
Output refers to the products of HE
institutions: including, graduates, research
outcomes, community / business activities and
the social function of academia.
21
CRITERION 1
PROGRAM MISSION, OBJECTIVES AND
OUTCOMES
Each program must have a mission,
measurable objectives and expected
outcomes for graduates.
22
Standard 1-1
The program must have documented measurable
objectives that support college / institution mission
statements:
Requirements
Document institution, department and program mission
statements.
State program objectives
Describe how each objective is aligned with program,
departmental and institution mission statements.
Outline the main elements of the strategic plan to
achieve the program mission and objectives.
Provide for each objective how it was measured, when it
was measured and improvements identified and made.23
PROGRAM OBJECTIVES ASSESSMENT
Improvements
How When Identified (Based Improve-
Objectives
Measured Measured on the Outcomes ments Made
examination)
Improve Arranged
Alumni End of last
1 communication extra
Survey semester
skills of students classes
Procured
Employer End of last Improve IT skills more soft
2
Survey semester of students wares and
Computers
25
Requirements
Describe the means for assessing the extent to which
graduates are performing the stated program
outcomes / learning objectives:
Conducting a survey of graduating students every
semester / year (Proforma – 3)
Conduct a survey of alumni every two years
(Proforma – 7)
Conduct a survey of employers every two years
(Proforma – 8)
Carefully designed questions asked during
interviews / presentations
Specially designed Outcome assessment
examination
Note: Data obtained from above sources should be
26
analyzed & presented in SAR Table 4.2
OUTCOMES VERSES OBJECTIVES
3
27
Table 4.2: Outcomes versus objectives
EXAMPLE OF MATRIX RELATING
OUTCOMES TO OBJECTIVES
Program Objectives
Enable
Skills in critical
Initiate Understand organizations
thinking, Employ
Program and professional to make
problem solving Information
Learning manage ethics and optimal
and Technology
Outcomes change responsibility decision
communication
making
Change Mgt x x x
Life long
x x x
learning
Professional
ethics and x x
responsibility
28
Standard 1-3
Requirements
Describe the actions taken based on the results of
(previous) periodic assessments.
Describe major future program improvement plans
based on recent assessments.
30
Table A.2 Assessment Results Implementation Plan Summary
Standard 1- 4
The department must assess its overall performance
periodically using quantifiable measures.
Requirements
Present (i) students enrolment during the last three
years indicating percentages of honour students, (ii)
student-faculty ratio, (iii) average graduating grade
point average per semester, (iv) average time for
completing the undergraduate program and (v) attrition
(drop-out) rate.
Requirements
Cont’d…
CRITERION 2
C. Provide the Framework for relevant Program for
which SAR is being written
34
Cont’d…
CRITERION 2
E. For each course in the program that can be
counted for credit specify the following:
Course Breakdown
Course Code No.
Course title
Course objectives and outcomes
Text book(s) and references (books and
journals etc.)
Course breakdown in credit hours (class
work including assignment , quizzes, OHT,
Exam plan)
Computer usage
Laboratory/practical (clinical) work 35
Standard 2-1:
The curriculum must be consistent and
supports the program’s documented
objectives.
Requirements
Sample
37
PROGRAM OBJECTIVES - SAMPLE
Courses or Group of courses Program Objectives
1 2 3 4 5 6 7
COE 200, COE 205, COE 305, COE 360 + + + + + + +
COE 400, COE 485 + + + + + + +
COE 399, COE 350, 351, 352 + + + + +
COE 390
COE 308 +
COE 342 + +
COE 442 + +
ICS Courses + + + +
Stat & Mathematics, Phy & Chem Courses + +
English Courses +
IAS Courses +
EE Courses + + + +
Technical Electives + + +
COE Electives + +
Courses Vs Program Objectives
38
Standard 2-2
Theoretical background, problems analysis and
solution design must be stressed within the program’s
core material
Requirements
Indicate which courses contain a significant portion (more
than 30%) of the elements in this standard.
Elements Courses
Theoretical Background
Problem Analysis
Solution Design
Table 4.5: Standard 2-2 requirement
39
Example
Example:
Element Courses
All Courses with the exception of
Theoretical Background Practical courses
40
Standard 2-3
The curriculum must satisfy the core requirements
for the program, as specified by the respective
accreditation body.
Standard 2-4
The curriculum must satisfy the major requirements
for the program as specified by the respective
accreditation body.
Standard 2-5
The curriculum must satisfy general education, arts,
and professional and other discipline requirements
for the program, as specified by the respective
accreditation body.
41
Requirements
42
Standards 2-6
Information technology component of the curriculum
must be integrated throughout the program
Requirements
Indicate the courses within the program that will satisfy each
standard.
Describe how these courses are applied and integrated
through out the program.
Standards 2-7
Oral and written communication skills of the student
must be developed and applied in the program
Requirements
Indicate the courses within the program that will satisfy each
standard.
Describe how these courses are applied and integrated
through out the program. 43
Example
IT contents of the program (Example: Mech Engg)
Courses IT Contents
Standard 3-2
There must be adequate support personnel for instruction
and maintaining the laboratories (Lab Demonstrators, Lab
Assistants / Attendants, etc.)
47
CRITERION 4
STUDENT SUPPORT AND ADVISING
48
CRITERION 4
Standard 4-1
Courses must be offered with sufficient frequency and
number for students to complete the program in a timely
manner
Requirements:
Standard 4-2
Courses in the major must be structured to ensure
effective interaction between students, faculty and
teaching assistants
Requirements:
50
CRITERION 4
Standard 4-3
Guidance on how to complete the program must be available to all
students (in particular to graduate students), and access to qualified
advising must be available to make course decisions and career
choices
Requirements
societies.
CRITERION 5
PROCESS CONTROL
Cont’d…
Standard 5-2
The process by which students are registered in
the program and monitoring of students progress
to ensure timely completion of the program must
be documented. This process must be periodically
evaluated to ensure that it is meeting its objectives.
Cont’d…
Standard 5-3
The process of recruiting and retaining highly qualified
faculty members must be in place and clearly
documented. Also processes and procedures for faculty
evaluation, promotion must be consistent with institution
mission statement. This process must be periodically
evaluated to ensure that it is meeting its objectives.
Requirements
Describe the process and procedures used to ensure
that teaching and delivery of course material is effective
and has focus on students learning
Indicate how frequently this process is evaluated and if
the evaluation results are used to improve the process
Requirements
Describe the procedures used to ensure that graduates
meet the program requirements
Describe when this procedure is evaluated and whether
the evaluation results are used to improve the process
Requirements:
Fill the Research Students Progress Review Form
(Proforma – 4)
Complete the Survey of Department Offering Ph.D.
Program (Proforma – 6)
57
CRITERION 6
FACULTY
Faculty members must be current and
active in their discipline and have the
necessary technical depth and breadth to
support the program.
58
Standard 6-1
There must be enough full time faculty who are committed to
the program to provide adequate coverage of the program
areas/courses with continuity and stability. The interests and
qualifications of all faculty members must be sufficient to teach
all courses, plan, modify and update courses and curricula. The
majority of the faculty must hold a Ph D in the discipline.
Requirements:
Give Student to faculty and Section to faculty ratios
Attach list of faculty members with Qualification and
specialization
Each faculty member should complete a Faculty Resume
(Proforma – 9)
Complete the following table (No. 4.6) indicating program
areas and number of faculty in each area.
59
Cont’d…
FACULTY DISTRIBUTION BY
PROGRAM AREAS
Number of
Courses in the area Number of
Program’s area and average number faculty with
Faculty members
of specialization Ph.D.
of sections per year in each area
degree
Area 1
4&4 3 2
(Anatomy)
Area 2
3&3 2 1
(Physiology)
Area 3
5&3 2 1
(Biochemistry)
Total
Table 4.6: Faculty distribution by program areas.
Standard 6-2
All faculty members must remain current in the discipline
and sufficient time must be provided for scholarly
activities and professional development. Also, effective
programs for faculty development must be in place.
Requirements:
Describe programs and processes in place for faculty
motivation
64
Standard 7-1
Requirements:
65
Standard 7-2
The library must possess an up-to-date (technical)
collection (of books and journals) relevant to the program
and must be adequately staffed with professional (library)
personnel.
Requirements:
Mention the number of reference and text books.
Attach the list of titles of the journals and magazines
subscribed by the department related to the program.
Describe the digital-library resources available for users.
Describe the adequacy of the library resources (staff,
space, sitting capacity, etc)
Describe the adequacy of the library timings.
List down the equipment (Computers, Photo copier,
printer, scanner, etc.) available in the library 66
Describe the support rendered by the library.
LIBRARY RESOURCES
Item Quantity Remarks
Text / Reference Books
Periodicals (bound
volumes)
Full- text journals
E-books / Journals
DVDs
Films
Newspapers / Magazines
Other media
Seating Capacity
Computer s / Printers
Photo Copier
Standard 7-3
68
TOTAL NUMBER OF LABS,
OFFICES AND CLASSROOMS
Requirements:
Provide the number of Bachelors, Masters and
PhD students and research assistants for the last
three years
71
Standard 8-3
Financial resources must be provided to acquire and
maintain Library holdings, laboratories and computing
facilities
Requirements:
Describe the resources available for the library.
72
NUMBER OF STUDENTS DURING
LAST THREE YEARS
74
USUAL WEAKNESSES IN
THE SARs
USUAL WEAKNESSES IN SARs
Missing response(s) to various standards
Improper mission statement of program
Unrealistic documentation of objectives and
outcomes of the program
No / lack of correlation between the objectives and
outcomes
Deficient / no feedback from alumni and employers
Missing / improper summaries of the feedback
proformae
Irrelevant feedback from the faculty or students
included in the report
USUAL WEAKNESSES IN SARs
80
QUALITY CONTROL
Definition
Quality Control is the mechanism for
ensuring that an output (product or service)
conforms to a predetermined specification.
81
MISSION STATEMENTS
Mission Statement of University / Institute)
To develop human resources by inculcating professional knowledge, skills
and ethical values, to bring-in prosperity and technological advancement
based on high-tech research in the individual’s life and society at large