Journal of Electrical, Electronics and Informatics, Vol. 5 No.

1 5

Analysis Evaluation Management Information

System Audit Internal Quality
Dewa Ayu Putri Wulandari1, and Made Dona Wahyu Aristana2

1,2
Informatics Departement, STMIK STIKOM Indonesia
Denpasar – BALI, Indonesia
putri.wulandari@stiki-indonesia.ac.id.

Abstract- Information systems are very important in this globalization era. Information systems generally can be used as a
reference for decision making or to monitor the progress of an activity process. In high education, information systems are no less
important than information systems within the company. Higher education is an institution that uses information systems to monitor
work systems to improve quality. Higher Education Institute STMIK STIKOM Indonesia has implemented an internal quality
assurance system (SPMI). An example of its application is by carrying out an internal quality audit (AMI). To ensure the quality
of the application meets the standards and needs of the user, it can be done by performing software testing based on the ISO 25010
standard.

Index Terms—Information System, ISO 25010, Software, Testing.

higher education unit can take corrective steps to achieve the

I. INTRODUCTION1 desired quality level.
Information systems are very important in this STMIK STIKOM Indonesia utilizes an internal quality
globalization era. Every organization and company cannot be audit management information system, which is expected to
separated from the role of information systems. Many be able to achieve the predetermined plan. The internal
information systems have been created to assist activities in quality audit management information system at STMIK
organizations and companies. Information systems are used STIKOM Indonesia uses the Laravel framework. To ensure
to support and improve the progress of a company. the quality of the application meets standards and user needs,
Information systems generally can be used as a reference for software testing can be carried out. One of the popular
decision making or to monitor the progress of an activity standards for performing software testing is ISO 9126 due to
process. In Higher Education the information system is very its flexibility and general nature however, this standard has
important to the information system in the company. Higher now been replaced by ISO 25010 [2]. To ensure that the
Education Institutions are institutions that use information information system used is of high quality and meets
systems to monitor work systems to improve quality. Higher standards, research is carried out to analyze the quality of the
Education Institutions as well as STMIK STIKOM Indonesia system in the Internal Quality Audit Management
will not be able to realize their vision and mission properly Information System of STMIK STIKOM Indonesia using the
if they ignore aspects of quality management. ISO 25010 quality standard.
In education the concept of quality audit has also been
stated in the Law of the Republic of Indonesia Number 20 of II. RELATED RESEARCH
2003 concerning the National Education System. The Research related to software testing has been carried out
existence of an internal quality audit has an effect on the entitled "Analisa Evaluasi Aplikasi Augmented Reality
quality of higher education. The Indonesian Institute of Untuk Informasi Kebudayaan Bali Berdasarkan Standar
Higher Education STMIK STIKOM has implemented an ISO 25010" which has conducted an Evaluation Analysis
internal quality assurance system (SPMI), for example by with ISO 25010 quality standards on Android-based
carrying out an internal quality audit (AMI) [1]. Internal applications and in Compatibility testing, 27 Android-based
quality audit is able to provide information on the strengths smartphones were installed. with various specifications, and
and weaknesses of the institution so that all members of the the results obtained that the installation on all devices was
Journal of Electrical, Electronics and Informatics, p-ISSN: 2549–8304 e-ISSN: 2622–0393 6

successful with a percentage of 100% and no error messages TABLE I

Standar Microsoft Certification Logo
appeared [3].
Pass Criteria Failure Criteria
The research was conducted with the title " Evaluasi Each primary function tested There is one primary function being
Kualitas Website Bandung Smart City Menggunakan is running as it should. The tested is not working properly. There
ISO/IEC 25010 Quality-in-Use Model " in which this study support function tested did is a support function that was tested
not work properly, but it was not running properly and it is a serious
discusses the evaluation of website quality using standard not a serious error and had no error that affects normal use.
methods to evaluate the quality of use by paying attention to effect on normal use
the user's perspective, including effectiveness, efficiency,
level website satisfaction in meeting user needs, and the B. Usability Aspect
results of research conducted in the form of a prototype [4]. Analysis of the quality from the usability testing
The research entitled "SOAQM: Quality Model for SOA aspect was carried out using a questionnaire method. The
Applications based on ISO 25010" analyzes the important questionnaires distributed were given to Lecturers of STMIK
contributions contained in ISO 25010 regarding SOA STIKOM Indonesia as a research location from the usability
applications and compared to ISO 9126, the result is that aspect. The questionnaire used refers to the System Usability
most of the quality attributes produced by ISO 25010 can be Scale (SUS) questionnaire by John Brooke. In the
applied to SOA to a degree. certain. However, some of these questionnaire, the answer to each question item uses a Likert
quality attributes must be adapted when applied to SOA scale which has a very positive gradation and a very negative
projects [5]. gradient. The score conversion from the Likert scale on the
questionnaire is in the Table II
III. METHODOLOGY
TABLE II
Methods and instruments in this evaluation are used to Conversion of Answers to Questionnaire Items
assist in analyzing the quality of the STMIK STIKOM Answer Score
Indonesia Internal Quality Audit Management Information Strongly Disagree 1
System which was developed, the method used in this Disagree 2
Doubtful 3
evaluation is the ISO 25010 quality standard which focuses Agree 4
on four (4) characteristic aspects including: Strongly agree 5
A. Functional Suitability Aspect
Quality analysis on the aspect of functional suitability testing To calculate the score on the questionnaire, SUS has its
is carried out by observing and experimenting with functions own rules. For odd-numbered questions, the score answered
using the test case instrument. Each test case describes on the questionnaire is reduced by one. While statements
whether a function can run properly or not. To get a firm with an even number, the number five is reduced by the score
answer to whether the functions that are running are as of the answered value. Then all the scores are added up and
expected, testing with the test case instrument uses the then multiplied by the number 2.5. The SUS score ranged
Guttam scale. The results of the test are then analyzed using from 0-100 and the mean score was 68 [7]. The SUS score
(1) and (2). obtained from all respondents was then calculated the
average value using (3):
∑𝑥
× 100% … (1)
𝑛 ∑𝑋
𝑋̅ = … (3)
∑𝑦 𝑁
× 100% … (2)
𝑛 Annotation :
Annotation: 𝑋̅ : Average Score
𝑛 : The total number of functions available ∑𝑋 : Total score
∑𝑥 : Number of functions that are running well 𝑁 : Number of Respondents
∑𝑦 : Number of functions that are running is not good
A range of values that can be used to assist in determining
The results of these calculations indicate the percentage whether the SUS score obtained indicates that an application
of most functions that are running well or not. Testing on the is acceptable or not in terms of usability. In this study, after
functional suitability aspect, the system is said to be good if knowing the SUS average score, the score was compared
the percentage of X (number of functions that are running with the range of values. SUS score ranges and their
well) is more than Y (number of functions that are not interpretations are shown in the Table III.
running well). The test results were also compared with the TABLE III
standard functional suitability criteria set by Microsoft in the SUS Score and Its Interpretation
Microsoft Certification Logo program (James Bach & Skor SUS Interpretasi
< 50 Not Acceptable
Micahael Bolton, 2013: 34-35) [6]. The standards 50 - 70 Marginal
determined by Microsoft in the Microsoft Certification Logo > 70 Acceptable
program are described in the Table I.
Journal of Electrical, Electronics and Informatics, Vol. 5 No. 1 7

C. Performance Efficiency Aspect It can be concluded that the results obtained are said to
Testing from the aspect of performance efficiency is pass according to the standard criteria for functionality
carried out by load testing using the GTmatrix software. The aspect on the Microsoft Certification Logo because every
test results on the aspect of performance efficience with function that runs on the system can run as it should. Then
GTmatrik software include a page speed score and a Yslow from the percentage results, the software quality obtained
score as well as a detailed page that includes the full load from the functional suitability aspect is in accordance with
time. Total page size and request. In testing the aspect of web the functionality attribute and has a very high scale because
performance efficiency, it is said to be good if the load time all functions have been running well.
is at least less than 10 seconds [8]. The results are then
compared with the Hoxmeier scale regarding user B. Usability Aspect Testing Results
satisfaction with the response time proposed by Hoxmeier
The usability aspect test was carried out using a
and DiCesare (2000) [9]. The Hoxmeier scale can be seen in
questionnaire method. The questionnaire used is a system
Table IV.
usability scale (SUS) questionnaire. In the system usability
TABLE IV scale (SUS) questionnaire, there are 10 questions that will be
Hoxmeire scale given to respondents. The questionnaire was given to 20
Response Time Predicate respondents, namely lecturers at STMIK STIKOM
(Seconds) Indonesia. The analysis of the results obtained is shown in
<3 Very Satisfied
3-9 Satisfied
Table VI.
9-12 Quite Satisfied Based on the calculation of the results of the
>12 Not Satisfied questionnaire, the average SUS score was 71.1. The mean
SUS score was then compared with the table regarding the
D. Portability Aspect SUS score. The average result of SUS 71.1 is in the
Quality testing on the portability aspect is carried out by acceptable category, this shows that the application
observing and running the STMIK STIKOM Indonesia developed can be accepted by end users well, it can be seen
internal quality audit information system on several from the usability aspect.
browsers. The browser on a PC / Desktop is used to perform
cross browser testing or system checking with various TABLE V
Functional Suitability Test Results
browsers..
No Test Name Result
1 Login.php pass
IV. RESULT
2 Bidang.php pass
In this study, testing was carried out to obtain results from
3 Jabatan.php pass
systems that meet the standards. Although the system can do 4 Pegawai.php pass
what was planned beforehand, namely displaying the 5 User.php pass
information system results from monitoring and evaluation 6 User_data.php pass
of the Internal Quality Audit Management Information 7 Proses.php pass
System STMIK STIKOM Indonesia, however, to ensure the 8 Index.blade.php pass
system is running with standards, it is necessary to do 9 Audit.php pass
usability testing. The results of the four aspects of the test are 10 Audit_detil.php pass
as follows 11 Laporan.blade.php pass
A. Functional Suitability Aspect Testing 12 Temuan.blade.php pass
Testing the functional suitability quality aspect is carried
13 Temuan_Rekap.blade.php pass
out by conducting tests on each function contained in the
14 Role.php pass
STMIK STIKOM Indonesia internal quality audit
15 Tx_akt.php pass
management information system. Functional suitability
16 Tx_akt_bukti.php pass
testing is assisted by a test case. The summary of the
functional suitability test case test can be seen in the Table
V. C. Performance Efficiency Aspect Testing Results
From table above, it proves that all the functions tested in Testing on the aspect of performance efficiency is carried
the internal quality audit management information system out by load testing using the GTmatrix software which is
are running well so that: tested on each page of the internal quality audit management
information system. The test results can be seen in Table VII.
𝑇𝑜𝑡𝑎𝑙 16 Obtained an average time of Page Speed 100% (Grade
𝑌𝑒𝑠 = × 100% = × 100% = 100% A), Yslow of 76% (Grade C) and load time of 2.1 seconds.
𝑀𝑎𝑥 16
The web is said to be good if the load time is at least less than
𝑇𝑜𝑡𝑎𝑙 0 10 seconds. The results of the test load time of 2.1 seconds
𝑁𝑜 = × 100% = × 100% = 0% are then compared by using the Hoxmeier Scale Table about
𝑀𝑎𝑥 16 user satisfaction with the response time, these results are
included in the very satisfying category because they are less
than 3 seconds..
Journal of Electrical, Electronics and Informatics, p-ISSN: 2549–8304 e-ISSN: 2622–0393 8

TABLE VI TABLE VIII

Usability Test Results Portability Testing Result
No Browser Name Version Result
1 Mozilla 81.0.2 Runs well without
Firefox error messages
2 Google 74.0.3729.108 Runs well without
Chrome error messages
3 Opera 71.0.3770.271 Runs well without
error messages
4 Microsoft 86.0.622.51 Runs well without
Edge error messages

The documentation of the results of testing the portability

aspects of the developed internal quality audit management
information system is shown in the Table IX.
Based on the test results above, it is known that the
internal quality audit management information system
STMIK STIKOM Indonesia can run well on several types of
web browsers. So it can be concluded that the internal quality
audit management information system STMIK STIKOM
Indonesia has met the quality criteria in terms of the aspect
of protection..
TABLE IX
Screen Capture Portability Testing Results
Browser Screen Capture
Name

Mozilla
Firefox

TABLE VII
Performance Efficiency Aspect Testing Results
No Page Testing Result
Page Speed Yslow Time
Administrator
1 Login 100 76 2.6 Google
2 Home 100 76 2.4
3 Bidang 100 76 2.5
Chrome
4 Jabatan 100 76 2.5
5 Pegawai 100 76 2.6
6 User 100 76 2.5
7 Proses 100 76 3.0
8 Jadwal Audit 100 76 2.8
9 Halaman Laporan 100 76 2.7
Employees
1 Login 100 76 2.4
2 Home 100 76 2.7
3 Auditor 100 76 2.7
4 Auditie 100 76 2.5
Average 100 76 2.1 Opera

D. Portability Testing Results

Testing from the aspect of protability to be done by
operating the internal quality audit information system
STMIK STIKOM Indonesia in several different browsers.
The browsers used for testing are Mozilla Firefox, Google
Chrome, Opera and Microsoft Edge. The test results are
shown in the Table VIII.
Journal of Electrical, Electronics and Informatics, Vol. 5 No. 1 9

Browser Screen Capture ACKNOWLEDGMENT

Name This research supported by STMIK STIKOM Indonesia.

REFERENCES
Microso
[1] I Putu Adi Pratama, I. G. T. S. 2017. "Rancang Bangun Sitem
ft Edge Monitoring Pelaksanaan Dan Hasil Audit Mutu Internal". Jurnal
S@CIES Volume 7, Nomor 2.
[2] Martino, C.-, dan Andry, J. F. 2020. "Testing Aplikasi Business
Activity Monitoring Pada Internet Service Provider Menggunakan Iso
25010". Jurnal Teknoinfo, 14(1), 35.
https://doi.org/10.33365/jti.v14i1.451.
[3] Andika, I. G., dan Yanti, C. P. 2018. "Analisis Evaluasi Aplikasi
Augmented Reality Untuk Informasi Kebudayaan Bali Berdasarkan
Standar ISO 25010". Jurnal RESISTOR (Rekayasa Sistem
Komputer),1(1),34–40.
https://doi.org/10.31598/jurnalresistor.v1i1.241.
V. CONCLUSION [4] Afiah, H., Darwiyanto, E., dkk. 2019. "Evaluasi Kualitas Website
Bandung Smart City Menggunakan ISO / IEC 25010 Quality-in-Use
This study shows that the results of the analysis using the Model", 6(2), 8830–8837.
ISO 25010 quality standard in testing the four characteristic [5] Soares, M. S. 2015. "SOAQM : Quality Model for SOA Applications
based on ISO 25010", 60–70.
aspects of the internal quality audit management information [6] Kuswidiardi, J. 2015. "Sistem Informasi Perpustakaan Berbasis
system as a whole, the system is functioning properly, in Microsoft Visual Di Perpustakaan Smk Ypkk 1 Sleman Library
terms of the results of the Functional Suitability test, all Information System Based on Microsoft Visual Basic6 . 0 With".
Sistem Informasi Perpustakaan.... (Jenar Kuswidiardi), 1–11.
functions are running well. Based on the usability aspect, it [7] Bramantara, R. 2015. "Pengembangan dan Analisis Kualias Aplikasi
was acceptable with an average score of sus 71.1. and the Finding Moo Sebagai Pemetaan Lokasi Museum di Yogyakarta
average response time generated by the system is 21 seconds, Berbasis Android", 1–9.
indicating that these results fall into the very satisfying [8] Setiawan, H., dan Jati, H. 2012. "ANALISIS KUALITAS SISTEM
INFORMASI PANTAUAN PEMBENTUKAN KARAKTER SISWA
category When compared to the user satisfaction table for the DI SMK N 2 DEPOK SLEMAN".
response time. [9] Nur Islam, M. A., Muslim, M. A., dkk. 2018. "Analisis dan
Perancangan Geographic Information System pada Pelacakan Lokasi
Kurir Secara Real Time". Techno.Com, 17(2), 186–196.