Report Exit Survey DPR DIS 2012
Report Exit Survey DPR DIS 2012
Report Exit Survey DPR DIS 2012
Report
Diploma in Marketing
DPR
December 2012 Session
Politeknik Kota Kinabalu (PKK)
Sabah
RESEARCH COMMITTEE
Member of Advisory Committee
NO
1
2
3
NAME
Wan Mohamad Nasir bin Wan Abdul Rahman
Norehan bt Md Shariff
Dalinah @ Dulimah Banting
POSITION
Director
Deputy Director (Academic)
Head of Department
NAME
Dr Hasnim bin Harun (Chief, Bureau of Research and Innovation)
Dr Suzan binti Impak
Azman B Talib
Farah Asyikin Abd Rahman
Shalizan B. Kadir
Norzila Salim
Halina Binti Hamid
Alester G Jakuil
Grace Jennifer Philip
Cynthia Nicholas
Julkifli bin Awang Besar
Bahril bin Balli
NAME
Azrin Bin Jalasi (Head of Program)
Ladvia Anak Ajiu
Siti Hajar Binti Khazali
ABSTRACT
2
The purpose of this Programme Exit Survey (PES) was to provide data to gauge perceptions
of various aspects of programmes and services offered and to identify areas where
improvements may be needed in the Department of Marketing, Politeknik Kota Kinabalu
(PKK). This PES was conducted on 35 final semester students, graduating from Diploma in
Marketing (DPR). They were the first Cohort whose intake was in June 2010. The survey
questionnaire had five main sections: respondents profile; assessment of overall quality;
assessment of skills and knowledge; assessment of Lecturers and Academic Advisor; and
assessment of academic resources and facilities. All the data were analysed using the
Statistical Product and Service Solutions (SPSS) software version IBM SPSS Statistics 19.0.
For the assessment of the overall quality, attribute for teaching and learning experience was
rated 95.7% with very good and good, and 4.3% with marginal. Skills and knowledge
section was evaluated by relating the statements with nine items as stated in the Programme
Learning Outcomes (PLO). All the PLOs were marked with very good, good, and
adequate by 100% of the students. Assessment on lecturers and academic advisor were
rated 57.6% as very good, 38.01% as good, 2.9% as adequate, 0.97% as marginal
and 0.48% as poor. In terms of academic resources and facilities, at least 1 respondent were
dissatisfied with all the academic resources and facilities provided to them during their
studies in PKK. Meanwhile, the access to Wi-Fi had the highest unsatisfactory concerned
from the respondent whereby 17.1% rated the item as poor and 20.0% as marginal.
Keywords: overall quality, skills and knowledge, lecturer and academic advisor, academic
resources and facilities
1. INTRODUCTION
1.1 Programme Exit Survey (PES)
PES is a method of collecting information on the quality of diploma education from the
perspective of graduating students upon the completion of their diploma programme. This
report refers to an indirect measurement method by way of self-evaluation based on
individual perception for the assessment of PLO. PLOs are the specific statements of
graduates knowledge, skills and attitudes acquired at the end of the programme as evidence
for the programme objectives achievements [1]. This PES was conducted to assess the
graduate students satisfaction and perceptions about various aspects of their academic
experiences [2]. 100% of the final semester students from the DPR programme had
participated in the survey.
The main objectives of this PES are to [3]:
1) Determine the students perception in their attainment on the overall quality of
learning and teaching in PKK;
2) Determine the students self-assessment of knowledge, skills and soft skills
achievement after going through the PLOs of the programme;
3) Evaluate the students opinion towards contributions of Lecturer and Academic
Advisor system implemented based on Outcome Based Education (OBE) approach;
4) Evaluate the students opinion towards academic resources and facilities provided in
PKK.
1.2 Programme Learning Outcomes (PLO)
OBE is an educational philosophy that believed that educational assessment should recognise
and reflect progress made by individual students. PLOs are statements that describe what
graduates are expected to know or be able to do on graduation. In the curriculum for DPR
programme it has been specified that there are nine (9) PLOs to be acquired by the graduates
upon graduation [4]. The nine PLOs are as follows:
i.
ii.
iii.
Communicate effectively both in written and spoken form with colleague, other
professionals and community provide creative, innovative and effective solutions to
business situations
iv.
Identify, formulate and provide creative, innovative and effective solution to business
situations
v.
Develop an effective social responsibility and humanistic values to meet the common
goals
vi.
vii.
viii.
ix.
2. METHODOLOGY
This survey involved 35 DPR students from December 2012 semester. Students were asked
to fill up the PES questionnaires which were posted online and 100% of them responded.
The respondents were required to evaluate and rate themselves based on 5-Likert Scale
indicated below [5]:
1 = Poor
2 = Marginal
3 = Adequate
4 = Good
5 = Very good
Students satisfaction and acceptance level were determined from the level of the likert scale.
Very good, Good and Adequate indication rate shows the students were satisfied with the
item. While Marginal and Poor indication rate shows the program needs some improvements
and correction.
This online survey was conducted between Marchs until May 2013. The survey
questionnaires were divided into five sections as follows:
i.
ii.
iii.
iv.
v.
The data collected in this survey was processed through Statistical Product and Service
Solutions (SPSS) software version IBM SPSS Statistics 19.0.
The questionnaires were based on students perception on teaching and learning in
PKK, students response on skills and knowledge related to PLOs, students attainment on the
soft skills, students rating for lecturers and academic advisors contribution, students opinion
towards academic resources, overall services and facilities in PKK [6,7]. This assessment
strategy was aligned with the Curriculum Development Cycle - develop-implement-review
as required by the MQA in order to improve the quality of programme. A description of the
survey findings is discussed below.
3. RESULTS
The response from the students were analysed based on the following four criteria:
i.
ii.
iii.
iv.
In Section C: (Skills and Knowledge) the statements have been classified under a particular
PLO so that the data analysis can be done appropriately for accreditation purposes. The
results can be used an indicator to show how well the students have acquired their skills and
knowledge as required in the PLOs of the programme.
3.1 SECTION B: OVERALL QUALITY
Overall Quality was evaluated by relating the students experience with the teaching and
learning environment in PKK. Two survey statements were as follows:
a)
What is your impression on the overall quality of curriculum; and teaching and learning
at PKK?
b)
To what extent has the quality of teaching and learning in PKK improved since you
were here?
For statement (a) (Figure 1), 32 of the respondents (48.5%) agreed and categorized as
good for the impression on the overall quality of curriculum and teaching and learning at
PKK. The other 16 (45.7%) responded very good while 2 (5.7%) expressed as marginal.
No respondent rated for adequate and poor indication.
While for statement (b), 15 (42.9%) of the respondents agreed that item to what
extent has the quality of teaching and learning in Politeknik Kota Kinabalu improved since
you were here the scale given was good. The other 19 (54.3%) responded very good
while 1 (2.9%) expressed marginal. No respondent rated for adequate and poor
indication.
From the analysis on overall quality, 91.4% of DPR were satisfied and 8.6% were not
satisfied with the overall quality for this students programme during their study in PKK based
on the experience with the teaching and learning environment.
3.2 SECTION C: SKILLS AND KNOWLEDGE
In assessing the skills and knowledge of the students, the statements had been classified into
nine PLOs as follows:
3.2.1 PLO 1 (Knowledge)
For PLO 1 (Knowledge), four statements were given as follows:
a)
b)
c)
d)
For statement (a) (Figure 2), I am able to apply knowledge of core discipline courses
in my programme, a total of 21 (60.0%) respondents rated very good. The other 11 (31.4%)
respondent selected good while 3(8.6%) responded adequate, respectively. While for the
statement (b) I am able to apply knowledge of specialized courses in my programme, a total
of 17 (48.5%) respondents rated very good. The other 16 (45.7%) respondent selected
good while 2(5.7%) responded adequate, respectively. No respondent rated for
marginal and poor indication.
For the third statement (c) I am able to apply knowledge of elective courses in my
programme, a total number of 18 (51.4%) respondents rated very good while 17 (48.5%)
rated as good.
Moving to the fourth statement (d) I am able to understand the technological
applications relevant to my programme of study, the highest score was for good with 21
(60.0%) respondents while 12 (34.2%) respondents rated very good and 2 (5.7%)
responded for adequate. No respondent rated for marginal and poor.
100% of DPR students were satisfied with the knowledge they gained and agreed that
they had understood the relevancy of the technological application during their studies in
PKK.
3.2.2 PLO 2 (Technical & Practical Skills)
For PLO 2 (Technical & Practical Skills), three statements were given as follows:
a)
b)
c)
b)
c)
10
For statement (a) (Figure 4), 20 (57.1%) respondents rated very good for I am able
to communicate effectively orally/visually (informal / formal / conversational / presentation).
The other 15 (42.9%) responded good while no respondent rated for
adequate,
I am able to solve problems using methods, tools and skills related to my programme.
b)
c)
11
Under PLO 4 (Figure 5), Critical Thinking & Problem Solving Skills, for statement
(a) a majority of 19 (54.3%) respondents rated good. The other 16 (45.7%) responded
very good. Moving to statement (b) I am able to think critically and logically, the highest
rated was for very good indicator with 19 (54.3%) respondents while 16 (37.5%)
respondents rated good.
Finally for statement (c), a total of 20 (57.1%) respondents rated very good. The
other 13 (37.1%) responded good while 2 (5.71%) responded expressed adequate. No
respondent rated for marginal and poor indication for all statements under PLO 4.
As a conclusion on this sections analysis, that is, 100% of DPR students were
equipped with critical thinking & problem solving skills which they gained during their
studies in PKK because all the DPR students were exposed with case study and problem
scenario to boost their critical thinking and problem solving skills.
3.2.5 PLO 5 (Social Skills and Responsibilities)
For PLO 5 (Social Skills and Responsibilities), three statements were given as follows:
a)
b)
c)
b)
c)
d)
As for PLO 6 assessments, statement (a) and statement (b) share the same score
(figure 7), 24 (68.6%) respondents rated very good and 11 (31.4%) responded good
while no responded adequate, marginal and poor respectively.
13
Moving to statement (c), the highest rated was for very good indicator with 19
(54.3%) respondents while 15 (42.9%) respondents rated good and 1 (2.9%) responded
adequate rating.
Finally for statement (d) I am able to use information resources (databases, libraries,
internet etc), 20 (57.1%) respondents rated very good. 14 out of 35 (40.0%) responded
good while 1(2.9%) responded adequate. No respondent rated for marginal and poor
indication for all statements under PLO 6.
So under PLO 6 we can summarize that, 100% of DPR students were able to learn
new skills and knowledge and able to use information resources effectively after their study
in PKK.
3.2.7 PLO 7 (Management & Entrepreneurial Skills)
For PLO 7 (Management & Entrepreneurial Skills), two statements were provided as follows:
a)
b)
14
As for statement (b), the highest rating is for very good indicator with 19 (54.3%)
respondents while 16 (45.7%) respondents rated good indicator. No respondents rated for
adequate, marginal and poor indication for all statements under PLO 7.
We can conclude that, all respondents feel satisfied and believed that their
management & entrepreneurial skills were developed in PKK.
3.2.8 PLO 8 (Professionalism, Ethics & Moral)
For PLO 8 (Professionalism, Ethics & Moral), two statements were provided as follows:
a)
b)
15
b)
c)
d)
For very good rating (figure 10), statement (a) I am able to work with individuals
from different backgrounds rated by 24 (68.9%) respondents while statement (b) was rated by
a number of 22 (62.9%) respondents, statement (c) I am able to work successfully as a leader
of a team by 17 (48.6%) respondents and statement (d) I am able to function in
multidisciplinary teams rated by 21 (60.0%) respondents.
On the other hand, statement (a) was rated by 11 (31.4%) as good, statement (b)
was 12 (34.3%), statement (c) received 15 (42.9%) and statement (d) was 12 (34.3%)
respondents. As for adequate rating, only 1 (2.9%) rated for statement (b) and statement
(d), 2 (5.7%) rated for statement (c). No respondents rated adequate for statement (a).
So under PLO 9 we can summarize that, 100% of DPR students were able to work in
a team successfully and capable of being a leader after finishing their studies in PKK.
3.3 SECTION D: CONTRIBUTIONS OF LECTURERS AND ACADEMIC ADVISORS
16
Responses from students towards the lecturers and academic advisors contributions are
summarized below. Graduates were asked to offer insights of encouragement given into the
programme delivery process. Six attributes of encouragement were offered and they are given
as follows:
To what extent did your lecturer/academic advisor encourage you to:
a) Set high expectations for learning?
b) Be an actively involved learner?
c) Show concern for student learning?
d) Provide feedback frequently and promptly?
e) Effectively communicate critical concepts and ideas?
f) Incorporate teamwork as part of the learning process?
Table 1: Contributions of Lecturers and Academic Advisors rating
Question
(a)
Question
(b)
Question
(c)
Question
(d)
Question
(e)
Question
(f)
Qty
%
Qty
%
Qty
%
Qty
%
Qty
%
Qty
%
Poor
Marginal
0.0
Responses
Adequate
Good
Very good
13
22
0.0
0.0
37.1
62.9
14
19
0.0
2.9
2.9
40.0
54.3
10
23
5.7
28.6
65.7
16
18
2.9
0.0
0.0
45.7
51.4
16
17
0.0
2.9
2.9
45.7
48.6
11
22
0.0
0.0
5.7
31.4
62.9
From Table 1 for the attribute of statement (a), 22 (62.9%) of the respondents said that it was
very good while 13 (37.1%) disclosed that it was good. For statement (b), 19 (54.3%)
respondents rated it as very good while 14 (40.0%) rated that it was good and 1 (2.9%)
rated it as adequate and as marginal respectively.
For statement (c), 23 (65.8%) of the respondents rated as very good and 10 (28.6%)
respondents rated that it was good and 2 (5.7%) respondents rated it as adequate. For
statement (d), 18 (51.4%) of the respondents rated the feedback as very good, while 16
(45.7%) stated that it was good and 1 (2.9%) rated as poor. For statement (e), 17 (34.0%)
17
of the respondents rated it as very good while 16 (45.8%) rated it as good and 1 (2.9%)
rated it as adequate, and as marginal respectively.
Finally for statement (f) 22 (62.9%) of the respondents rated it as very good and 11
(31.4%) rated as good, only 2 (5.7%) rated as adequate. No respondent rated for
marginal and poor indication for all six statements under this section. As conclusion for
Contributions of Lecturers and Academic Advisors rating, 1.5% students were dissatisfied
and 98.5% of DPR students were satisfied with the contributions of lecturers and academic
advisors during their studies in PKK.
3.4 SECTION E: ACADEMIC RESOURCES/FACILITIES
In the education eco-system, academic resources/facilities were important in terms of
educational hardware. The teaching and learning process would be greatly enhanced provided
that there were sufficient resources/facilities for students to thrive academically. Table 4
shows the percentage of respondents ratings towards the sufficiency of resources/facilities at
the PKK. Eleven statements of resources/facilities were given as follows:
To what extent did Politeknik Kota Kinabalu provide you with the following
resources/facilities?
a) Operation hours of the library
b) Access to databases and collections both physically and online in the library
c) Easy and responsive services of the HEP staff
d) Easy and responsive services of the counselling staff
e) Easy and responsive services of the library staff
f) Easy and responsive services of the administration staff
g) Access to Wi-Fi internet
h) Quality of computer labs
i) Quality of laboratories / workshops / kitchens
j) Quality of classrooms
k) Quality of sports and recreational facilities
Question
Qty
Poor
Marginal
Responses
Adequate
4
Good
Very good
17
12
18
(a)
Question
(b)
Question
(c)
Question
(d)
Question
(e)
Question
(f)
Question
(g)
Question
(h)
Question
(i)
Question
(j)
Question
(k)
%
Qty
%
Qty
%
Qty
%
Qty
%
Qty
%
Qty
%
Qty
%
Qty
%
Qty
%
Qty
%
2.9
2.9
11.4
48.6
34.3
18
5.7
5.7
14.3
51.4
22.9
16
10
5.7
2.9
17.1
45.7
28.6
19
10
8.6
2.9
5.7
54.3
28.6
19
10
5.7
2.9
8.6
54.3
28.6
21
2.9
5.7
11.4
60
20
11
17.1
20
31.4
20
11.4
10
13
8.6
17.1
28.6
37.1
8.6
10
13
8.6
17.1
28.6
37.1
8.6
17
5.7
5.7
22.9
48.6
17.1
19
2.9
11.4
20
54.3
11.4
From Table 2 for the statement (a), 12 (34.3%) of the respondents said that the operation
hours of the library was very good, 17 (48.6%) rated as good, while 4 (11.4%) was stated
as adequate and 1 (2.9%) rated for marginal and 1 (2.9%) rated as poor.
For statement (b) 8 (22.9%) of the respondents rated it as very good for the library
collection, while 18 (51.4%) stated that it was good, 5 (14.3%) rated as adequate. 2
(5.7%) rated for marginal and 2 (5.7%) rated for poor.
Statement (c), 10 (28.6%) of the respondents rated the services of the HEP staff very
good and 16 (45.7%) stated that it was good and 6 (17.1%) as adequate. 1 (2.9%) rated
as marginal and only 2 (5.7%) rated as poor. Moving to statement (d), 10 (28.6%) of the
respondents rated the counselling services as very good. While 19 (54.3%) rated that it was
good and 2 (5.7%) rated as adequate. 1 (2.9%) rated for marginal and 3 (8.6%)
respondent rated for poor.
Next for statement (e), 10 (28.6%) of the respondents rated the services of the library
staff as very good, while 19 (54.3%) good and 3 (8.6%) rated as adequate. 1 (2.9%)
rated for marginal and 2 (5.7%) was poor. For statement (f) 7 (20.0%) of the respondents
rated the services of the administration staff as very good on the other hand 21 (60.0%)
19
rated it as good. 4 (11.4%) rated it as adequate and 2 (5.7%) rated it as marginal and
poor 1 (2.9%) respectively.
Statement (g), 6 (17.1%) respondents rated it as poor for the Wi-Fi internet services
in PKK. While 7 (20.0%) rated that it was marginal and 11 (31.4%) rated as adequate. 7
(20.0%) rated it as good and 4 (11.4%) good respectively. Next for statement (h), a total
of 13 (37.1%) respondents rated good on the quality of computer labs. While 3 (8.6%)
rated it as very good and 10 (28.6%) rated it as adequate. 6 (17.1%) rated it as
marginal and 3 (8.6%) poor.For statement (i) 3 (8.6%) of the respondents rated the
quality of laboratories / workshops / kitchens as very good and 13 (37.1%) as good and
10 (28.6%) rated as adequate. On the other hand for marginal was 6 (17.1%) respondent.
3 (8.6%) poor.
Moving to statement (j), 6 (17.1%) respondents rated the quality of classrooms as
very good. While 17 (48.6%) rated it as good and 8 (22.9%) rated as adequate. 2
(5.7%) was stated as for marginal and 2 (5.7%) poor. Finally for statement (k), 4 (11.4%)
respondents rated the quality of sports and recreational facilities in PKK as very good and
19 (54.3%) rated it as good. 4 (11.4%) rated for marginal and 7 (20.0%) rated for
adequate. And 1 (2.9%) rated for poor. Concluding this sections analysis, 15.3 % were
dissatisfied with the academic resources/facilities, meanwhile 84.7% of DPR students were
satisfied with the academic resources/facilities provided during their study in PKK.
4. CONCLUSION
The results of the survey indicated high considerable for Overall Quality of teaching and
learning since 95.7% students rated as very good and good measures of achievement for
20
all the statements. Unfortunately, 4.3% students were dissatisfied with the Overall Quality of
teaching and learning in PKK.
100% of graduates agreed that they had achieved the PLOs of the programme. The
data showed majority of students responded between very good to good scale in for PLO
7 (Management & Entrepreneurial Skills) and PLO 8 (Professionalism, Ethics & Moral)
assessment. The rest of the PLOs are rated at least adequate by the graduates. Fortunately,
no graduates rated marginal and poor for all the nine PLOs.
Evaluation of the graduates opinions towards contributions of lecturers and academic
advisors system implemented also showed that graduates were satisfied with the lecturers.
Result showed that assessment on lecturers and academic advisor were rated 98.51% for
very good, good, and adequate. However, 1.5% students rated as marginal and poor.
This also supports the implementation of OBE in PKK which emphasized for student-centred
learning.
Finally 84.7% graduates were satisfied with the academic resources and facilities
provided. The most significant item that graduates were not satisfied with was the Wi-Fi
internet access in PKK where 37.1% of them rated for marginal and poor. Insufficient
Wi-Fi coverage around PKK was due to lack of Access Point (AP) installed.
This exit survey was found to be an essential tool to help identify the areas needs to
be improved in the quality of education as a whole in PKK especially for Diploma in
Marketing (DPR).
REFERENCES
[1] Sani, M.S.M. (2009) Exit Surveys Assessment of Bachelor Mechanical Engineering
Programs at Universiti Malaysia Pahang. Proceedings of MUCEET 2009.
21
22