Coding Query - Results Preview Model
Coding Query - Results Preview Model
Coding Query - Results Preview Model
customized tourism recommendations. It allows users to more effectively search through travel
information and arrange their trip. This study also integrates the technology acceptance model (TAM) and
the information system success model (ISSM) to present a research model that explores users’ intention to
use the PLMTA. The questionnaire survey method is used to collect our data, and the hypotheses are
tested via structural equation modeling (SEM). The results show that information quality, perceived ease
of use, and perceived usefulness significantly affect the intention to use PLMTA, while information quality
and perceived convenience are found to have an influence on perceived usefulness. Information quality,
system quality, and perceived convenience are found to significantly affect perceived ease of use, which
consequently affects the intention to use the system.
The study was built on the premise that system quality (SQ), service quality (ServQ) and information
quality (IQ) are determinants of behavioral intention to use Canvas and user satisfaction of Canvas, both
of which in turn influence the actual usage of Canvas. Responses from 366 students were analyzed with
AMOS 22 using structural equation model (SEM) to test the relationships between the constructs of the
proposed model.
Theoretically, the study contributes to the body of knowledge on eLearning adoption by empirically
validating the DeLone and McLean model in a different context, specifically sub-Saharan Africa.
This study adopts the six variables used in the updated DeLone and McLean IS success model (D&M ISS
model) to determine the factors responsible for the usage of Canvas LMS by students of a private
university in Nigeria. The updated D&M ISS model was chosen as the basis for this study as it has been
tested and validated previously, especially in the domain of elearning adoption (see Lin, 2007; Lwoga,
2014; Mohammadi, 2015; Mtebe & Raisamo, 2014b). In Nigeria, Ajoye and Nwagwu (2014) used a
conceptual model adapted from the updated D&M ISS model to investigate the effect of the quality
antecedents on user satisfaction of the postgraduate school portal for the University of Ibadan. The results
from Ajoye and Nwagwu (2014) showed that the quality antecedents significantly influenced user
satisfaction thus justifying the investment in the school portal. Further support for this claim, in the
context of eLearning in Nigeria, is the need to assist other higher education institutions aiming to adopt
eLearning systems. Another reason for selecting the D&M ISS model is in order to meet the objectives of
this study, which is to examine the system and information design attributes of Canvas LMS. The D&M ISS
model is a natural fit because it captures both the information and system qualities, unlike other
acceptance theories that only cater for a subset of these attributes. For example, the “perceived ease of
use” construct used in the technology acceptance model (TAM) by Davis (1989) only captures how easy it
is to use the technology, which is only one out of six attributes that measure system quality according to
Jalote (2008). The six attributes as identified by Jalote (2008) are functionality, reliability, usability,
efficiency, maintainability, and portability. The system quality construct in the D&M ISS model measures
most of these attributes depending on the context it is used in.
Anderson, J. C., & Gerbing, D. W. (1988). Structural equation modeling in practice: A review and
recommended two-step approach. Psychological Bulletin, 103(3), 411. https://doi.org/10.1037/0033-
2909.103.3.411
This study developed and empirically tested a model to predict the factors affecting students’ behavioral
intentions toward using mobile learning (m-learning). This study explored the behavioral intention to use
m-learning from the perspective of consumers by applying the extended unified theory of acceptance and
use of technology (UTAUT) model with the addition of perceived enjoyment, mobile self-efficacy,
satisfaction, trust, and perceived risk moderators. A cross-sectional study was conducted by employing a
research model based on multiple technology acceptance theories. Data were derived from an online
survey with 1,562 respondents and analyzed using structural equation modeling. Partial least squares
(PLS) regression was used for model and hypothesis testing. The results revealed that (1) behavioral
intention was significantly and positively influenced by satisfaction, trust, performance expectancy, and
effort expectancy; (2) perceived enjoyment, performance expectancy, and effort expectancy had positive
associations with behavioral intention; (3) mobile self-efficacy had a significantly positive effect on
perceived enjoyment; and (4) perceived risk had a significantly negative moderating effect on the
relationship between performance expectancy and behavioral intention. Our findings correspond with the
UTAUT model and provide a practical reference for educational institutions and decision-makers involved
in designing m-learning for implementation in universities.
Keywords: mobile learning, mobile self-efficacy, unified theory of acceptance and use of technology
model, trust, perceived enjoyment, perceived risk
INTRODUCTION
With the recent rapid advancement in mobile telecommunication technologies, mobile phone
applications have changed not only how we use mobile phones but also our lives. People now through
new methods by using mobile gadgets and technologies. Thus, mobile devices are a crucial tool for
mobile health, banking, and mobile learning (m-learning) (Alalwan et al., 2017; Briz-Ponce et al., 2017;
Hoque and Sorwar, 2017; Nikou and Economides, 2017; Crompton and Burke, 2018). M-learning is a tool
with considerable potential that provides new possibilities for education and learning assessment (Nikou
and Economides, 2017). The United Nations Educational, Scientific and Cultural Organization (UNESCO)
indicated the potential of m-learning to enhance learning quality and students’ test results. In addition,
UNESCO has suggested that governments should
or information system (IS) depends on user acceptance (Davis, 1989). In recent decades in the domains of
psychology, ISs, and sociology, numerous theoretical models have been developed to predict and explain
user acceptance of IT or ISs. One of the most widely cited frameworks in the field of IT and ISs is the
technology acceptance model (TAM) (Chauhan and Jaiswal, 2016; Cimperman et al., 2016; Šumak and
Šorgo, 2016; Šumak et al., 2017). However, some scholars (Sánchez-Prieto et al., 2016; Šumak et al., 2017;
Tsai et al., 2018) have contended that the TAM has several disadvantages, including (1) not providing
adequate insight into individuals’ perspectives ofnovel systems; (2) neglecting its indicators and directly
investigating the external variables of perceived ease of use (PEOU) and perceived usefulness (PU); and (3)
ignoring the relationship between usage attitude and usage intention. In their search for a more complete
IT acceptance model and to address the weaknesses of the TAM, Venkatesh et al. (2003) integrated core
elements from eight models and prominent theories (including the theory of reasoned action [TRA],
innovation diffusion theory [IDT], the theory of planned behavior [TPB], the TAM; the combined TAM-TPB,
the motivational model (MM), the model of PC utilization [MPCU], and social cognitive theory [SCT]) to
predict or explaining new technology adoption, acceptance, and usage, and proposed a unified model
called the unified theory of acceptance and use of technology (UTAUT) model. Since its introduction, the
UTAUT model has been applied
and tested extensively for predicting system usage and making technology-adoption- and technology-
usage-related decisions in various fields such as interactive whiteboards (Šumak and Šorgo, 2016; Šumak
et al., 2017), near-field communication technology (Khalilzadeh et al., 2017), mobile health (Hoque and
Sorwar, 2017), home telehealth services (Cimperman et al., 2016), and acceptance of Enterprise Resource
Planning (ERP) software (Chauhan and Jaiswal, 2016). Applied research regarding the UTAUT model has
been extensive. This model provides a framework that not only explains acceptance of IT and ISs but also
elucidates the actual use of such technologies and systems. Because of its capability to integrate different
the TAMs, the UTAUT model contributes substantially to the exploration of technology acceptance and
usage (Venkatesh et al., 2003). Therefore, this study used the UTAUT model as the theoretical
Statistical Analysis and Hypotheses Testing Partial least squares regression was used to test the main
effects of EE and PE and the moderating effect of PR on BI to use m-learning (Figures 3, 4, respectively).
For example, to test the moderating effect, PE (predictor) and PR (moderator) were multiplied to create an
interaction construct (PE × PR) for predicting BI to use m-learning. Regarding the overall quality of the
research model, the
SEM procedure based on PLS regression was applied to analyze the goodness of fit (GoF), path
coefficients, and coefficient of determination (R2). The GoF (0 < GoF < 1) is considered the geometric
mean of the average commonality and average R2
This study tested the relationships between dependent and independent variables by using the path
coefficient (β) and t statistics. By using PLS regression to estimate the path relationship of each pair of
research constructs, among all eight path relationships, we revealed that seven assumptions attained
significance. Bootstrapping resampling was performed to test the significance of the path coefficients in
the inner model (number of iterations: 1000). To verify the hypotheses and moderating effects, the
moderator analysis method proposed by Baron and Kenny (1986) was followed. The empirical analysis
determined the moderating roles of PR based on the significance of the interaction terms in Model 3.
Among the two hypothesized moderating effects, M1 was non-significant; that is, PR did not have
moderating effect on the relationship between EE and BI. However; PR negatively moderated the
relationship between PE and BI in relation to m-learning use (M2: β = −0.15, p < 0.05); this finding
indicates that M2 was significant. These additional analyses provided support for the moderation pattern
presented in our model. Figure 5 provides all results ofthe moderation analysis, including
EE PE SAT TRU M-SE PR BI TRU M-SE PEN R2=0.261 0.33* SAT R2=0.414 0.43* BI R2=0.458 PE R2 =0.223
FIGURE 3 | Path coefficients for the research model (excluding moderator main effect). Value on path:
standardized coefficients (β), R2: Coefficient of determination and ∗p < 0.05.
satisfied this requirement. However, a substantial portion of unexplained variances indicated that other
key factors beyond the scope of this study could be incorporated to improve the explanatory power of
the endogenous variables. In summary, the model employed in this study explained a considerable
number of variations in the endogenous variables. The endogenous variables exhibited strong explanatory
power for these variations, thereby indicating the stability and robustness ofthe model. All estimated and
standardized path coefficients (significant paths are indicated with asterisks) are illustrated in Figure 5.
Mobile applications are getting a great deal of interest among researchers due to their proliferation and
pervasiveness, especially in the context of digital libraries of educational institutes. However, their low
acceptance and usage are observed, hence, in-depth investigations are required in order to understand
the factors behind low acceptance and intention to use mobile library application (MLA). Therefore, the
aim of this work is to empirically explore the acceptance of MLA with a proposed model that is evolved
from the technology acceptance model (TAM). The study objects to deliver empirical provision on
acceptance of MLA. A self-administrated cross-sectional survey-based study was conducted to gather
data from 340 users of MLA. Structural equation model (SEM) with an analysis of moment structure
(AMOS) software was conducted to examine quantitative data. Results revealed that perceived usefulness
and perceived ease of use are direct significant predictors with the intention to use MLA whereas system
quality and habit are the influencing factors toward the usage intention of MLA. The findings help as a
guide for effective decision in the design and development of MLA. Further, the outcomes can be utilized
in the resource allocation process for ensuring the success of library’s vision and mission.
Keywords: Smart library, Smartphone applications, Technology acceptance model (TAM), Digital Library,
mobile library 1.1. Introduction
the huge investment of resources in technology, particularly in the MLA domain, its low usage, ignorance
and overlooking were observed by intended user (Hong, Thong, & Tam, 2006)(Yoon, 2016). Like other
regions (Europe, America) (Rafique et al., 2018)(Zha et al., 2015), with the advancement of technology,
many institutes in Pakistan are now adopting MLA, namely, COMSATS University Islamabad (CUI) and
Quaid-eAzam University (QAU) etc. Besides the tremendous increase in telecom infrastructure in Pakistan,
the acceptance and adaptation of mobile applications has been very slow. As reported by Pakistan
Telecommunication Authority (PTA), tele-density for mobile phone subscribers jumped to 68.2% with
118,316,916 users (Habib & Ateeq, 2014) . In order to verify the usage position of MLA among universities,
pre-survey was conducted from students. It was conducted to identify the status about usage of general
mobile applications during daily life routine as well as to inquire about the usage of MLA in their study
period or throughout the whole day. Online survey from both universities helped to get the statistics
about the usage as shown in Table 1, which illustrate that more than 85% of the students don’t use MLA
for their study purpose as they prefer to visit library or online search. Therefore, the aims of this study are
to investigate the adoption of MLA in the context of Pakistan and to compare its adoption with other
regions of world. Specifically, this study focuses on the identification of various factors causing low usage
and espousal of MLA launched by COMSATS university with the name INSIGNIA ILS in 2014 by extending
technology acceptance model (TAM) proposed by Davis (Davis, 1989)(Adams, Nelson, & Todd, 1992).
TAM was adapted in different research fields, namely, m-shopping (Hubert, Blut, Brock, Backhaus, &
Eberhardt, 2017), e-learning (Jeong, 2011), online libraries (Zhao, Deng, & Zhou, 2015), digital libraries
(Zha et al., 2015), and MLA (Rafique et al., 2018) to investigate the acceptance of technology. In literature,
TAM was adopted and extended with external factors on the bases of three reasons. First of all, it helps in
understanding the users’ perspective in the adoption of MLA. Secondly, TAM was adopted by different
researchers in various domains like mshopping (Hubert et al., 2017), e-learning (Jeong, 2011), online
libraries (Zhao et al., 2015), digital libraries (Zha et al., 2015), and MLA (Joo & Choi, 2015)(Aharony, 2014).
Thirdly, it helps researcher in investigating the effect of external factors on dependent variables. Therefore,
the current research extended TAM by incorporated two external factors (habit (H) and system quality
(SQ)) with the core constructs of TAM. These factors were incorporated in this research because habits of
the users usually change on the basis of system quality. Therefore, this study aims to check this effect on
intention to use MLA (Hubert et al., 2017)(Jeong, 2011). Therefore, current study selected TAM as a
proposed model, as it will help us in understanding the initial adoption of the implemented technology in
developing country context.
To collect data, the quantitative cross-sectional survey-based study was performed at CUI. In Semester Fall
2018, data were collected from 1st September 2018 to 25 December 2018 from the users of MLA. Library
officials of CUI were requested to provide the list of frequent users of MLA along with their contact
information. The provided list was then transformed to excel sheet and RAND function was applied to
select the random number of users from the provided list. After retrieving the list of random users, 400
were approached by researchers. The selected respondents were requested to fill in the instrument
Afterwards questionnaires were gathered from the respondents, the questionnaire went through basic
pre-processing. In this, invalid responses were removed. Responses with a high percentage of the same
answers against all points of the used Likert scale and those with a high percentage of missing values
were dropped from the collected responses. Only 30 respondents did not return the questionnaires,
whereas 9 responses were half-filled i.e. responses with a maximum missing value (reasons for the missing
value might be that they were not able to correctly interpret the technical terms in few questions) and 11
responses were completely blank. Therefore, 85% responses were used in the final investigation that is
340 out of 400, as the overall sample size is greater than the optional sample size of 100-150 for reliable
outcomes in structural equation modelling (Hairs, Anderson, Tatham, & Black, 1998)(Hair, Black, Babin, &
Anderson, 2010).The illustration of demographic evidence is shown in Table 2. The results infer that 194
(57%) were males and 146 (42.9%) were the female respondent. Most of the responses were from the
students of age ranging from 20-25 years, as the majority of the application users were from
undergraduate studies. Moreover, second-most high response rate (i.e. 193 respondents) was from
students of post graduates i.e. MS.
1.5. Data Analysis In the current research, two software’s are used for data analysis i.e. Statistical Package
for Social Science (SPSSv20) and analysis of moment structure (AMOS v20). SPSS was used for data
coding, cleaning, assumption checking and factor analysis, whereas, AMOS was used to test the validity,
reliability, discriminant validity and goodness of Fit indices in a measurement model and testing of the
proposed hypothesis was performed through structural model. The data analysis strategy is shown in
Figure 2.
SEM was used because of multiple measurement items against constructs within the multivariate
environment and for identifying the association among dependent and independent variables
simultaneously instead of individual testing of relationships (Hair et al., 2010). Therefore, a two-step
approach endorsed by (Gerbing & Anderson, 1993) was executed to conduct SEM analysis over data.
Firstly, the analysis of measurement model
(MM) was conducted for determining the relationship among observed and unobserved variables through
CFA using AMOS 0 software and in the second step, the analysis of the structural model (SM) was
performed to test the proposed hypothesis for dependent and independent variables. SEM fit was
determined with a coefficient parameter and goodness-of-fit indices (Hair et al., 2010)(Byrne, 2001).
Causal relationships were evaluated in SM using AMOS with statistical support of coefficient of
determination (R2) and path coefficient. R2 helps in the elucidation of estimate supremacy of constructs
whereas proposed hypothesis was strengthened with path coefficient. Values of R2 and path coefficient
elaborate the data support towards the hypothesized model (Lee, 2010). SM provides the support for
casual relationships that were measured with the fit indices as was done in MM. the representation of fit
indices
1.7. Conclusion The enormous advancement of technology in the educational sector, particularly in library
services is changing the trend of users toward the usage of the library. This study helps in clarifying and
understanding the behaviour users toward the adoption and use of MLA. This rapid change in behaviour
toward the use of technology totally depends on various factors, hence the proposed model provides
elementary information for the improvement and understanding of MLA usage intentions. The findings of
this study provide in-depth knowledge and useful guideline which helps designer and developers of MLA
for improving the usage of MLA experience. Our results explain that Habit, SQ, PEOU, and PU are
significantly important in MLA usage. Hence, developers must keep these factors and core construct of
TAM (i.e. PEOU and PU) in priority for developing the application. There is always a limitation of
generalizability; therefore, this research is not exempted from it. The results cannot generalize in another
context. Mediating and moderating variables will be considered in future as they strengthen the
hypothesis of the research model.
View metadata, citation and similar papers at core.ac.uk brought to you by CORE provided by Sheffield
Hallam University Research Archive
Measuring e-learning success in developing countries: applying the updated DeLone and McLean model
YAKUBU, Nasir and DASUKI, Salihu <http://orcid.org/0000-0002-4130-8509> Available from Sheffield
Hallam University Research Archive (SHURA) at: http://shura.shu.ac.uk/21526/
YAKUBU, Nasir and DASUKI, Salihu (2018). Measuring e-learning success in developing countries: applying
the updated DeLone and McLean model. Journal of Information Technology Education: Research.
This study is based on the DeLone and McLean’s Information Systems Success (D&M ISS) model which
was modified to determine the success factors responsible for the acceptance of an e-learning system
called Canvas by students of a Nigerian University. The study was built on the premise that system quality
(SQ), service quality (ServQ) and information quality (IQ) are determinants of behavioral intention to use
Canvas and user satisfaction of Canvas, both of which in turn influence the actual usage of Canvas.
Responses from 366 students were analyzed with AMOS 22 using structural equation model (SEM) to test
the relationships between the constructs of the proposed model. The results partially supported the effect
of the quality antecedents on behavioral intention and user satisfaction of students. There was full support
for the relationship between behavioral intention and user satisfaction of students on their actual usage of
Canvas. The study aims at contributing to the formulation of strategies and methods to be used to
enhance the adoption of eLearning systems in developing countries, specifically Nigeria. Keywords:
eLearning systems, IS success, Universities, Nigeria.
eLearning in Nigeria and this could be due to the relatively small number of higher education institutions
that have the facilities and resources to implement eLearning. One notable study on the acceptance of
eLearning in a Nigerian University was done by Yakubu and Dasuki (2018). The research employed the
UTAUT framework to investigate the factors responsible for influencing the students’ usage of Canvas
learning management system (LMS). The UTAUT (unified theory of acceptance and use of technology)
framework, by Venkatesh et al. (2003), was formulated to explain user’s behavioral intentions to use
technology based on four fundamental constructs namely: performance expectancy, effort expectancy,
social influence, and facilitating conditions Yakubu & Dasuki (2018) called for further research using other
frameworks to investigate Nigerian students’ acceptance of eLearning. In an attempt to answer the call
posted by Yakubu & Dasuki (2018), this study uses a modified version of the updated DeLone and McLean
information systems success model (D&M ISS) as a theoretical lens to identify the factors responsible for
the acceptance of eLearning by Nigerian students. The study aims at examining the system and
information design attributes and their relationship to use of eLearning technologies via behavioral
intention and user satisfaction. The eLearning application under investigation in this study is called Canvas
LMS. Canvas LMS is used to organize courses using a unified calendar and syllabus system, facilitate
discussion forums, plagiarism checks, and to set up and grade assignments and quizzes. The findings from
this study will provide a theoretical foundation and empirical evidence explaining the determinants
responsible for the successful usage of Canvas LMS by students of a Nigerian higher education institution.
Literature Review
The original DeLone and McLean’s Information Systems Success (D&M ISS) model (DeLone & McLean,
1992) was formulated to identify the factors responsible for defining information systems success. Six
factors were identified as shown in figure 1. System quality and information quality were responsible for
influencing use and user satisfaction of information systems. Use and user satisfaction influence each
other and they both have an influence on individual impact which in turn influences organizational
impact.
This study adopts the six variables used in the updated DeLone and McLean IS success model (D&M ISS
model) to determine the factors responsible for the usage of an Canvas LMS by students of a private
university in Nigeria. The updated D&M ISS model was chosen as the basis for this study as it has been
tested and validated previously, especially in the domain of elearning adoption (see Mtebe & Raisamo,
2014a; Lwoga, 2014; Lin, 2007; Mohammadi, 2015). In Nigeria, Ajoye et al., (2014) used a conceptual
model adapted from the updated D&M ISS model to investigate the effect of the quality antecedents on
user satisfaction of the postgraduate school portal for the University of Ibadan. The results from Ajoye et
al. (2014) showed that the quality antecedents significantly influenced user satisfaction thus justifying the
investment in the school portal. Further support for this claim, in the context of eLearning in Nigeria, is the
Table 3 displays the recommended and actual measurement model values for the different fit indicators
as suggested by Hu and Bentler (1999), Kline (2015) and Hair et al. (2010). All indices are within the
recommended values as shown in table 3 indicating a good model fit. Table 3. Model Fit indices
Anderson, J. C., & Gerbing, D. W. (1988). Structural equation modeling in practice: A review and
recommended two-step approach. Psychological bulletin, 103(3), 411.
The sudden change in the learning process during the Covid-19 pandemic has brought schools at all
levels to adopt e-learning. In this study, we analyze user acceptance of NUADU platform in private schools
in Balikpapan, Indonesia. The extended Technology Acceptance Model is used as a reference model. The
study results indicate that facilitating conditions have a significant effect on perceived usefulness. All core
constructs of TAM have a significant effect except the relationship between perceived ease of use and
attitude and perceived usefulness and behavior. Based on these findings, recommendations are then
made to strengthen the acceptance of NUADU platform.
organizations can be considered as the main determinant of the performance of any IS project. There are
several models commonly used in evaluating information systems, namely the Technology Acceptance
Model (TAM), End User Computing Satisfaction (EUCS), Task-Technology Fit (TTF), Human, Organization,
Technology Fit (HOT Fit), and Unified Theory of Technology Acceptance and Utilization (UTAUT). Based on
the information system evaluation models that have been described, an analysis result is obtained that
can be used as a consideration for using the evaluation model in research. The EUCS model only
emphasizes the evaluation of the technical aspects. At the same time, the TTF model states that
information technology is only used if its features and advantages can be used to assist users in doing
their work. Then for the HOT-Fit model, the human variable does not explain in more detail the factors
that affect technology acceptance. Furthermore, the UTAUT model, according to research conducted by
Al-Gahtani, et al. shows that the limitation of UTAUT is that it cannot adapt to different environments such
as the cultural differences between Saudi Arabia and the typical western culture, which becomes an
obstacle for them to use UTAUT to analyze technology adoption by workers in Saudi Arabia [8]. In
contrast to the TAM model, this model emphasizes 2 main variables, namely user convenience and
perceived benefits in influencing each individual's intention to use the newly adopted technology.
According to the meta-analysis research conducted by William RK and Jun He, some good results have
been achieved when using the TAM model.
2.2. Technology Acceptance Model (TAM) The technology acceptance model defines attitudes; people’s
positive or negative perceptions of the intention to
adopt the system are predicted by perceived usefulness and ease of use. TAM was first proposed by Davis
in 1986. In TAM theory, it is believed that ease of use can also predict perceived usefulness. In addition,
the behavioral intention of adopting the system is predicted by attitude and perceived usefulness. Then,
the behavioral intentions are used to predict actual usage described as system usage. Several technology
acceptance theories are quite well known and used throughout the world, including TRA, TPB, TAM,
TAM2. In gathering general information about one's views on using technology, TAM is simpler and faster.
This was revealed based on the TAM meta-analysis research conducted by Legris et al in 2003 [10]. The
TAM construct has five main structures. The following is an explanation of each TAM structure:
Perceived ease of use (PEU): Ease of use is defined by a measure that according to individuals can easily
understand and use computers [11].
discussion. At the design stage, there are three processes, namely designing a conceptual model,
determining research respondents, and designing a questionnaire. In addition, there are four processes in
the implementation phase, namely data collection, descriptive analysis, questionnaire data testing, and
conceptual model testing. At the stage of results and discussion, there are two processes, namely analysis
of interpretation of hypothesis testing and providing recommendations. The questionnaire data were
tested using SPSS software, while the conceptual model was tested using the GeSCA web-based software
[15].
Reference 5 - 1,05% Coverage
4.3. Evaluation of Measurement Model (Outer Model) In the test of the measurement model (outer
model), if the indicators are reflective, then an evaluation is needed in
the form of instrument calibration, namely through testing the validity and reliability of the instrument.
Convergent validity can be measured through the loading value with a statistical limit of 0.5 [19]. While
discriminant validity can be checked through the average variance extracted (AVE) value if the AVE value
of 0.5 or higher is a good rule of thumb that shows adequate convergence [18]. In addition, internal
consistency reliability can be measured by looking at the alpha value greater than or equal to 0.6 [19].
Table 1 shows that all research variables are valid and reliable.
AFIT, GFI, and SRMR values are checked. FIT_M and FIT_S can be interpreted in a similar way to FIT. The FIT
and AFIT values ranged from 0 to l, with values 0.676 and 0.657 indicating a good match to explain the
phenomenon under study. The GFI (Goodness of Fit Index) value shows the level of application of the
model theory being studied. If the GFI value passes the suitability criteria (> 0.90), then the conceptual
model is declared appropriate. Based on the calculation results, the GFI value of the conceptual research
model is 0.992 or 99.2%. The SRMR (standardized root mean square residual) value shows the degree of
suitability of the model. The closer the value to 0 indicates the model better. Based on the calculation of
the SRMR value of 0.104, it indicates that the situation is very good [15].
[12] Tangke, Natalia. (2004) "Analisa penerimaan penerapan teknik audit berbantuan komputer (TABK)
dengan menggunakan technology acceptance model (TAM) pada BPK RI [Title in English: Analysis of
acceptance of the application of computer-assisted audit techniques (TABK) using the technology
acceptance model (TAM) at BPK RI.]" Journal of Accounting and Finance Petra Christian University 6 (1):
10-28.
II. LITERATUR REVIEW The technology acceptance model (TAM) is a model that
has been used extensively in various domains such as business, government to education that utilize
information technology in its business processes. In the field of education, there are already a number of
researchers who use TAM to explain user acceptance of technologies such as e-learning, multimedia
learning technologies, digital libraries, e-journals, etc.
Learning by using e-learning system at this time become an important part of university to carrying out
the education. Learning by e-learning system is very supportive to conventional learning, so it is necessary
to measure the success of e-learning implementation. In this article, the research model was developed by
integrating. DeLone& McLean IS concept of success model and adoption model of e-learning success.
The variables that used in this research is technical system quality, service quality, content and information
quality, use, user perceived satisfaction, and individual impact. Data collection is by conducting surveys to
e-learning users which is lecturers and students. To test the model that has been developed, conducted a
survey on UPN "Veteran" Jakarta with the total number of respondents as many as 180 respondents and
obtained 157 respondents who fill the questionnaire correctly. This research, shows both the use and
satisfaction of e-learning system have an impact for individual performance. This research also found that
educational system quality and technical quality are the main factors that encourage user satisfaction with
e-learning system, while the use of elearning system that influenced by content & information quality,
also user perceived satisfaction for e-learning system.
implemented e-learning system in recent years. Through this research, it is hoped that the success model
of elearning system will be more suitable to the Indonesian context.
3. CONSEPTUAL MODEL The research model has four e-learning quality constructs that play an important
role as a direct
determinant between use and user perceived satisfaction like, Technical System Quality (TES), Educational
System Quality (ESQ), Service Quality (SQ), and Content & Information Quality (CIQ) as can be seen in
Figure 3. Technical System Quality (TES) measuring the quality of e-learning system techniques that
related to system navigation, ease to finding information, structured, fast accessing, having security,
flexibility, ease to integration with other systems, reliability which is high, has an interactive and structured
design. Educational System Quality (ESQ) measuring the quality of educational system related to
communication facilities, attendance, collaborative, and active learning, evaluation of learning, outcomes,
communication facilities, storage and sharing documents, effective and efficient sharing of information.
Serving Quality (SQ) measuring the quality of e-learning system services related to help desk support in
the provision of assistance services and the speed of responding to complaints against problems that
occur, available documents and other information in e-learning. Content & Information (CIQ) measuring
the quality of information and content from e-learning information system regarding usability, ease of
understanding, reliability, timeliness, accuracy and organized. While Use (U) describes the use of e-
learning system for information retrieval, publication
4. RESEARCH METHOD Stages of research conducted on this research that is determination of research
models and research
hypotheses, the formation of questionnaires, testing the results of the questionnaire include validity test,
realibility test model and hypotheses as can be seen in table 1.
collected. In the processing, the authors use statistics with multivariate techniques Structural Equation
Modeling (SEM). In that technique, the author uses SmartPLS program to process the data. This data
analysis phase aims to know the interrelationship between variables in the proposed model. At this stage,
the authors also try to answer the question in this research.
<Files\\eng - admin,+06+Ruth+Johana> - § 2 references coded [3,88% Coverage]
1)2)3)School of Business IPB University, Indonesia Jl. Raya Pajajaran Babakan, Bogor Tengah, Bogor
1)ruthjohana.rj@gmail.com, 2)ajiher@ipb.ac.id, 3)imamsuroso@gmail.com
Article history:
Received 9 June 2019 Revised 13 September 2019 Accepted 17 September 2019 Available online 28
October 2019
Keywords:
DeLone and McLean model,ECommerce Success,
Information
System Success Measurement, IS Success Model
Abstract
Background: The increasing usage and development of e-commerce in Indonesia, demands competition
between e-commerce that exists. To be successful e-commerce should be balanced with a good
information system. Some clinical research has established what factors that affected the success,
including DeLone and McLean. According to their e-commerce success model, there are six variables that
affect e-commerce success, system quality, information quality, service quality, use, user satisfaction, and
net benefit Objective: The study aims to analyze the relationship between system quality, information
quality and service quality to user satisfaction and use. In addition, the study aims to analyze the
relationship between user satisfaction and use to a net benefit. Methods: This study draws on the DeLone
and McLean Model of Information System (IS) success model. It is a quantitative study that was conducted
in the form of a survey of 110 users of each Lazada, Bukalapak, and Shopee users. Results: By applying
DeLone and McLean model, this findings confirmed four hypotheses were significant in Bukalapak,
Lazada, and Shopee. Conclusion:There were significant effect between the system quality on user
satisfaction, service quality on use, service quality on user satisfaction and user satisfaction on net
benefits. Meanwhile, system quality had insignificant effect to use and also information quality to use in
Bukalapak, Lazada, and Shopee.
The purpose of this LVS value is to simplify the model because of the limitation of the total sample [17].
After obtaining a latent variable score for each variable, the value were reprocessed using SEM (Structured
Equation Modeling) as in Fig 2. This path diagram is adopting the updated DeLone and Mclean IS success
model by taking several dimensions or hypothesis. After all data of three e-commerce had been
processed, then the author analyzed and compared the result of all hypothesis (H1-H8). The hypothesis to
be tested, such as:
Technology Acceptance Model (TAM) model which is combined with the DeLone & McLean Information
System (D&M IS) Success Model. The population of this research is UIN student Syarif Hidayatullah who is
a user of the AIS Mobile application. Sampling is done by purposive sampling. There were 237
respondents from that population who were used as samples for this study. Data processing using the
Partial Least SquareStructural Equation Modelling (PLS-SEM) method with the help of SmartPLS
application version 3.0. The results of this study are information quality, system quality, service quality,
perceived usefulness, and perceived ease of use affect the acceptance of application users. Of the 8
hypotheses proposed, there is one hypothesis that is rejected, namely the relationship of service quality
with perceived ease of use because it gets a ttest value of 1,844. This research produces recommendations
to the department information technology and database center (PUSTIPANDA) as the developer to focus
more on the services provided to application users to make it easier for users to use the application.
used in this study already has statistically good characteristics if three indicators are removed, namely IQ5,
SEQ4, and SEQ5. After removing the three indicators, this model is in accordance with the conditions that
exist at each stage of the outer model analysis accuracy
(individual reliability, average variance extracted,
item reliability, internal and
discriminant validity). So it can be concluded that this model can be continued for further analysis, namely
the analysis of the inner model.
International Journal of Computer Applications (0975 – 8887) Volume 142 – No.4, May 2016
Proposed M-learning Model based on Two Models
(Technology Acceptance Model and DeLone and McLean IS success Model)
Ammar Khader Mohammad Almasri
Albalqa Applied University Amman Jordan
ABSTRACT This paper presents findings from an ongoing cross-cultural study exploring the
implementation of M-learning environments in higher education in Jordan. The aim of the study was to
explore factors affecting students’ acceptance and use of M-learning. A questionnaire was developed
based on the Technology Acceptance Model and DeLone and McLean IS success model. Data was
collected from different master students in public and private universities in Jordan. The findings of the
study suggest that Information Quality by students in regard to mobile learning as the most important
antecedent to their Intention and Attitude To Use of mobile technologies for learning.
Keywords IS success model, Information Quality, TAM
1. INTRODUCTION E-Learning is using electronic media information and communication technologies
(ICT) in education [1]; Such as, Computer Based Instruction (CBI), Computer-Based Training (CBT),Internet-
Based Training (IBT),Web-Based Training (WBT), online education, and M-learning. Many definitions of E-
Learning are related to the type of learning that is falling in and what is being learned from definitions
that concentrate on the role of technology and infrastructure [2].
3. LITERATURE REVIEW
3.1 Technology Acceptance Model (TAM) Technology Acceptance Model (TAM) model is one of the most
widely used in the field of information technology acceptance modeling which was developed by Davis.
TAM consists of three key concepts that are, Perceived Usefulness, Perceived Ease of Use, and Attitude
toward using, that has a direct influence on intention to use it. This model is shown in Fig. 1.
Reference 3 - 2,83% Coverage
International Journal of Computer Applications (0975 – 8887) Volume 142 – No.4, May 2016
Users’ Motivation X1
Perceived Usefulness
X2
Attitudes Towards Use
X3 Perceived Ease of Use Fig 1: Technology acceptance model by Davis based on the original model [22]
All previous researches found with TAM model can efficiently expect the intention and adoption about
information technology and systems. Moreover, the proposed research model will adopt Technology
Acceptance Model of Davis (1989) as a theoretical model.
3.2 Information system success model Identify the factors to determine the success of information
systems was very hard. DeLone and McLean after reviewed the existing definitions of IS success and their
related measures ;they have published paper with title “Information
System Quality
Information Quality
Use
Individual Impact
User satisfaction Fig 2: DeLone and McLean IS success model[23]
The model can be interpreted as follows: a system can be evaluated by information quality and system
quality; these characteristics affect on use and user satisfaction. Use and user satisfaction affect on
individual impact and finally organizational impact will be affected by organizational impact positively or
negatively.
The Technology Acceptance Model (TAM) will be adopted and guided the study. The model in figure (3)
explains the causal relationships between Quality Factors (Information Quality and System Quality),
Perceived Usefulness (PU), Perceived Ease of Use (PEOU), Attitude Toward (AT), and
H1 Quality factors
Information Quality
H6 H12 H9 H7
Perceived Ease of Use
System Quality
H10 H8
H4 H5
H11 Fig 3 : Proposed model based on TAM And IS success model(Fig1 and Fig2)
4.1 Research Hypotheses H1: Information Quality will have a positive influence on behavior intention to
use.
(1992). The statements were adapted to higher education students context from in private and public
universities in Jordan. The statements measuring the core constructs are described in table 3. The students
were asked to rate their level of agreement to each statement on a five-point Likert scale (“I disagree
completely” to “I agree completely”). The five core constructs of technology acceptance were
hypothesized to influence students’ rate of use of M-learning environments in a positive way.
Reference 6 - 0,42% Coverage
[22] F. D. Davis, R. P. Bagozzi, and P. R. Warshaw, "User acceptance of computer technology: a comparison
of two theoretical models," Management science, vol. 35, pp. 982-1003, 1989.
<Files\\eng - Behavioural Intention to Re-Use Online Learning Platform> - § 6 references coded [5,99%
Coverage]
Abstract. The Technology Acceptance Model (TAM) is a model used to predict user acceptance of
information systems based on perceived usefulness and perceived ease of use. If the user sees the
benefits and ease of using the information system, it will cause the user to accept it. This study examines
IT system quality and perceived usefulness to reuse online learning applications. This research analyses
the measurement of perceptions of the quality of the IT system used by respondents in the scope of
online learning. We operate a survey method; the respondents in this research were students and
teaching staff users of online learning applications. Respondents, most of whom are students in Sumatra,
are interested or intend to reuse online learning applications if there is a good information quality factor
and more benefits from online applications. The perceived usefulness construct plays a full role in
mediating the relationship between information quality and intention to reuse online learning
applications.
Rai et al. (2002) examined the relationship between perceived usefulness and user
satisfaction using three information system success models. The three models are the DeLone and
McLean (1992) information system success model, the Seddon Model (1997), and the Seddon Model
(1997), which were modified by adding the relationship between perceived usefulness and system use.
The results of the research show that perceived usefulness affects user satisfaction. Zhong et al. (2020)
empirically test the level of technology acceptance by
Bengkulu Province, are not generally able to access a good internet connection. Therefore, this hampers
the online learning process. This is confirmed in one of the respondents’ statements regarding the
perceived usefulness of online learning, which states “online learning is effective” with the code u5, which
has a loading factor value below 0.4. Hypotheses Test Technique The analysis of the measurement model
in this research was carried out using Confirmatory Factor Analysis (CFA); the researcher will only examine
one research model and use structural equation modeling (SEM) to assess how well the model fits the
empirical data (Hair et al., 2010). To examine the hypothesis, we operated the regression analysis based on
structural equation modeling by looking at the critical ratio value generated from the calculation of
loading of each relationship between constructs contained in the research model and looking at the
estimated value of standardized regression weights.
Result
The results of Structural Equation Modelling (SEM) Result of Measurement Model Test We operated
AMOS 20 software program to analyze Structural Equation Modelling based on confirmatory factor
analysis. Figure 1 is the result of the measurement model test based on SEM. Based on Table 1, the chi-
square (X2
) and degree of freedom Figure 2. Result of Measurement Model While the value of the normed chi-
square (X2/df) is 2.052, indicating that this
measurement model has a good fit based on the empirical data and is appropriate based on the
goodness of fit index value, which is less than 3.00. The GFI value of the measurement model, the CFI
Index, and the RMSEA shows a good fit between the measurement model and the empirical data. Table 1.
Goodness of Fit Index of Measurement Model Index Goodness of fit Chi-square (X2)
Journal of Health and Behavioral Science Vol.4, No.1, March 2022, pp. 1~16
Result of Structural Model Test After performing the test of the measurement model, the next step is to
analyze the structural model. Figure 2 is the result of structural model measurement based on SEM.
of freedom value in this study of 74 so that the normed chi-square (X2/df) value is 2.008. The value of the
Normed Chi-square (X2/df) is more significant than 3.00, so that
the structural model in this study has a good match with the empirical data. Table 2. Goodness of Fit
Index Structural Model Goodness of fit Index
examined user-intention towards e-government products, and Pai and Huang (2011) investigated
influence users’ intention to use a healthcare system. But this integrated model is still lack of the
behaviour intention for smartphone usage. Taking into account the gaps in previous research, the
purpose of this study is to investigate the effect of customer smartphone user intention. We try to use a
hybrid model integrating the ISSM and TAM, and seeking to develop and validate a theoretical model.
Especially, we investigated the effects of ISSM on user acceptance of smartphone in Taiwan, and we built
a research model for explaining and predicting the adoption of smartphone. The study explored both
intrinsic and extrinsic factors that influence the acceptance
The model demonstrated good fit and required no model modification as shown in Table 1. Table 1
Goodness-of-fit of measurement model Indices
Absolute fit measure
χ2/df GFI
CFI
Comparative fit measures
RMSEA SRMR NFI IFI
RFI
Parsimonious fit measures
PGFI PCFI PNFI
Recommended guidelines 3
0.8 0.9
0.08 0.1 0.9 0.9 0.9 0.5 0.5 0.5
Results 4.564
0.855 0.946 0.067
0.0420 0.932 0.946 0.923 0.712 0.840 0.828
Goodness-of-fit High Good
Good Good Good Good Good Good Good Good Good
104 C-H. Cheng et al. 4.2 Measurement model: reliability and validity
4.3 Structural model analysis The test results were verified using the model fit indices, shown in Table 2.
Table 2 Goodness-of-fit of measurement model Indices
Intisari—KitaBisa adalah wadah untuk berdonasi dan menggalang dana secara Online di KitaBisa,
masyarakat bisa menggalang dana untuk beragam hal yang mereka maupun berdonasi untuk hal yang
ingin mereka bantu. Pengukuran kesuksesan aplikasi mobile KitaBisa menggunakan model DeLone dan
McLean telah diketahui variabel yang memiliki hubungan signifikan antara lain Kualitas Pelayanan (Service
Quality) terhadap Kepuasaan Penggunaan (User Statisfaction) dengan nilai tstatistic 2,893, Kualitas Sistem
(System Quality) terhadap Pengguna (Use) dengan nilai t-statistic 10,204, serta Kepuasan Pengguna (User
Statisfaction) terhadap Hasil atau Manfaat Bersih (Net Benefit) dengan nilai t-statistic 3,680. Sesuai
dengan pengujian hipotesis bahwa kepuasan pengguna terhadap aplikasi mobile KitaBisa sebagai wadah
untuk berdonasi secara online telah terbukti dengan berpengaruhnya Kepuasan Pengguna (User
Statisfaction) terhadap Hasil atau Manfaat Bersih (Net Benefit) secara keseluruhan atau berarti pengguna
telah merasakaan manfaat adanya aplikasi mobile KitaBisa. Kata Kunci: DeLone dan McLean, Kesuksesan
Sistem Informasi, KitaBisa.
progressing can be utilized to raise social donations, humanity, and handling victims of natural disasters.
There are many internet-based startups (startups) that use crowdfunding systems to raise funds from the
public(I.Chailis, 2019). The donation-based crowdfunding model used for fundraising has proven to be
successful in raising aid funds (Nugroho & Rachmaniyah, 2019) especially in the event of natural disasters
and other emergencies. Obstacles to accessing information,
KitaBisa mobile application and measure the success rate of the KitaBisa mobile application donation
system. By measuring the KitaBisa mobile application we can find out the users who benefit from the
KitaBisa mobile app as an online donation drive application. In this study, the success model of the
Delone and Mclean model uses variables of system quality, information quality, service quality, users, user
satisfaction, and final results. This research was conducted by analyzing the Structural Equation Model
(SEM) to measure the success rate of the KitaBisa mobile application. The stages to analyze are by testing
the Outer Model, Inner Model, and Bootstrapping.
5. User Satisfaction is the user's response to the use of information systems. 6. Net benefits are the effects
of information on users and the effect of information on organizations to improve knowledge and
communication. Based on the DeLone and McLean model
variables as above, we get a hypothesis like the following: H1a: The quality of the system will have a
positive and significant effect on users (used);
H1b: The quality of the system will have a positive and significant effect on user satisfaction (satisfaction
of use);
H2a: Information quality will have a positive and significant effect on system usage (usage);
H2b : Kualitas informasi (information quality) akan berpengaruh positif dan signifikan terhadap kepuasan
pengguna satisfaction);
(user
H3a: Service quality will have a positive and significant effect on system usage (usage);
H3b: Service quality will have a positive and significant effect on user satisfaction; Then if
first is the initial stage which contains problem identification, literature study, model selection, sample
calculation. In the second stage, the implementation phase which includes website analysis, website
success analysis. In the third stage, conclusions are drawn containing the results of the analysis and
discussion as well as providing recommendations and making research reports. (Arifin & Pratolo, 2012)
Descriptive analysis
obtained through a questionnaire, the author will conduct an SEM analysis using the help of smartPLS 3
software (version 3.0). Analysis using smartPLS consists of two submodels, namely the measurement
model (measurement model) or often called the outer model, and the structural model (structural model),
or often called the inner model. The following is a test of the measurement model as well as the structural
model: 1. Analysis of Measurement Models (External Models) At this stage, the test will be carried out to
determine whether the measurements used in this study are valid and reliable or not. a. Convergent
Validity Test Convergence Validity or convergent validity
The rapid development of information technology influences on all fields of the economy. One form of
the development of information technology is about how consumers shop through online stores.
Researchers need to do this research, because nowadays there are many online stores that have
developed in Indonesia. Researchers want to know how much influence the quality of information and
service quality on customer satisfaction and make a positive contribution and make continuous purchases
at the online store. This study uses the Delone and Mclean methods and with AMOS software. The
purpose of this study is to analyze a number of hypotheses, which are: H1: System Quality has positive
effect on Use; H2: Use has positive impact on net benefits; H3: System Quality has a positive impact on
User Satisfaction; H4: User Satisfaction has a positive effect on Use; H5: Information Quality has a positive
effect on Use; H6: Information Quality has a positive effect on User Satisfaction; H7: User Satisfaction has a
positive effect on Net benefits; H8: System Quality has a positive effect on Information Quality; H9:
Information Quality has a positive effect on System Quality. The test results can be seen that Quality
System has positif effect on User Satisfaction, this can be seen from the estimated value of 0.529, User
Satisfaction has positive effect on the Net benefits that can be seen from the estimated value of 1,146,
and User Satisfaction has positive effect on Use with estimated value of 1,352. From the test results with
the final research model that supports the hypothesis (H0) said that there is a relationship between
variables with the level of satisfaction of the Sorabel Application to the Sorabel Application user as a
medium for online purchases.
1. Introduction The internet creates a new economic paradigm. With another technology, i.e. the
information and communication technology (ICT), they produce many economic models. Progress in the
field of information technology, makes no boundaries communication. Our society now depends on the
internet as a tool to meet their needs, such as online buying, selling and service activities, etc. E-
Commerce, stands for electronic commerce, uses computers and communication
This study aims to determine the factors that influence the successful implementation of the development
monitoring and evaluation system (SMEP) in Malang Regency Government. Measurement of information
system success is measured through a modified DeLone & McLean model approach. The population in
this study were employees of the evaluation and reporting section of all agencies in the Malang Regency
Government who used the development monitoring and evaluation system (SMEP). Data collection
techniques using a questionnaire with a sample taken as many as 138 respondents. Data analysts use the
Structural Equation Model (SEM) with the SmartPLS 2.0 application program. The results showed that
system quality, information quality, perceived usefulness, top management support had a positive effect
on user satisfaction and user satisfaction had a positive effect on net benefits.
The reason researchers use the Information System Success Model is because the Information System
Success Model has contributed greatly to the development of information systems (Hussein et al., 2005).
In addition, the Information Systems Success Model has advantages in order to predict and explain the
success of information systems (Karaman and Bolen, 2015; Kulkami, Ravindran, and Freeze, 2006). Delone
& Mclean's information system success model (2003) is already good in measuring information system
success compared to other information system success models such as the Seddon & Kiew (1996) model
that only measures information system success from the level of usability and user satisfaction. To adjust
to the characteristics and conditions of the most recent information system, further development of the
success model of the information system Delone & McLean (2003) is needed.
Analysis Method Data analysis method used in this study uses Partial Least Square (PLS). The application
used is SmartPLS2. The reason researchers use PLS is that this statistical method can be used to test the
predictive effect of relationships between latent variables that are in one model. In addition, in testing
through PLS, data does not have to be normally distributed and can be used to test research models that
use a weak theoretical basis (Hartono and Abdilah, 2009: 21-22). The use of PLS can also be done on a
small number of samples (Hartono and Abdilah, 2009: 21). So PLS-SEM is considered more suitable to be
used as a statistical analysis tool in this study. Then the model evaluation is done through PLS which is
divided into evaluation of the outer model and inner model.
Outer model evaluation is used to measure the validity and reliability. Validity testing is directed towards
testing the construct validity to find out how well the results obtained from the use of a measurement in
defining the construct. Validity testing is done through convergent validity test and discriminant validity
test. Convergent validity is related to measurements of a construct that should be highly correlated. The
score is considered satisfactory if the factor loading value is more than 0.7, the average varianced
extracted (AVE) is more than 0.5 and the communality is more than 0.5. Discriminant validity associated
with different construct gauges should not be correlated. The score is considered satisfactory if the root
value of AVE is greater than
Inner Model Evaluation Evaluation of the inner model is done by looking at the R-Squared (R2) and the
value of the path coefficient / t-values at each path to test the significance of the constructs in the
structural model. The results of the R-Squared (R2) value can be seen in Table 8.
Based on Table 8 shows that the value of R-Square (R2) of user satisfaction is 0.703. This can be
interpreted that system quality, information quality, service quality, perceived usefulness, and top
management support can explain changes in user satisfaction by 70.3%, while the remaining 29.7% is
explained by other variables that do not exist in this research model . Furthermore, the R-Square (R2)
value of net benefits is 0.456. This can be interpreted that peak user satisfaction can explain changes in
user satisfaction by 45.6% while the remaining 54.4% is explained by other variables that are not present
in this research model.
The Effect of User Satisfaction on Net Benefits The test results show that hypothesis 6 is accepted. This
means that users who are satisfied with the Development Monitoring and Evaluation System can have a
positive impact on individuals and organizations. The positive impact that can be obtained from satisfied
users of the Development Monitoring and Evaluation System is an increase in employee performance,
employee work effectiveness and employee work productivity. The results of this study support the
DeLone & McLean (2003) information system success model that user satisfaction is a significant predictor
of net benefits at both the individual and organizational levels. The results of this study are consistent with
research conducted by Livari (2005), Wang & Liao (2008) and Oktavia (2016) that user satisfaction has a
significant influence on individual and organizational impacts. In this study, system users
McGill, T., Hobbs, V., & Klobas, J. (2003). User-developed applications and information systems success: A
Test of DeLone and McLean‟s model. Information Resources Management Journal, 16(1), 24–45.
<Files\\eng - Impact of self-service technology SST service quality on customer loyalty and behavioral
intention The mediating role of customer satisfaction> - § 5 references coded [2,07% Coverage]
This study is an attempt to explain the impact of service quality of self-service technologies (SSTs) on
customer loyalty and behavioral intention by adding the mediating role of customer satisfaction. The SSTs
are technological interfaces through which customer can attain services without direct involvement of
service firm employee. SSTs include ATM, online banking, mobile banking, self-checkin machines at air
ports, online shopping, and online bill payment etc. The proposed model is applied in service sector of
Pakistan and results reveal that firms can enhance satisfaction, loyalty, and intention of their customers by
improving the SSTs service quality. Study also provides the insights for the service firms that they must
pay intensive attention to improve their customer loyalty and drive positive intentions using advance
technological interface.
Moreover, to determine service quality, a scale named as “SERVQUAL” was introduced regarding face-to-
face environment of service process. A three-dimensional model of service quality was presented by
Grönroos (1984) named “technical quality, functional quality, and corporate image”. Similarly, another
model was offered by Lehtinen and Lehtinen (1991) with three dimensions named as (1) Physical Quality,
(2) Interactive Quality, and (3) Corporate Quality. According to them, physical quality is related to physical
products that are included in service production process in term of service delivery as well as service
consumption. So, in the customary service circumstances, measurements of service quality have paid
attention largely on the interactions of clients with the organization’s staff (human-human encounters) as
well as by some marketing mix variables.
Most of the model’s Incremental fit indices i.e. Normed Fit Index (NFI), Non-Normed Fit Index (NNFI),
Comparative Fit Index (CFI), Goodness of Fit Index (GFI), and Adjusted Goodness of Fit Index (AGFI), do
not use χ2
in its unrefined structure but compare the χ2 value is values to its base line model. The
NFI provides “a sign of how the target model compares with the baseline model”. It can be seen from the
table 4 that values of NFI (0.95), NNFI (0.98), and CFI (0.98) exceed the standard 0.90 (Medsker, Williams,
& Holahan, 1994). A major drawback to NFI index as stated by Mulaik et al. (1989) and Bentler (1990) is
that “it is sensitive to sample size, underestimating fit for samples less than 200”, and “it is therefore not
recommended to be exclusively relied on” (Kline, 2005). This problem was remedied by the Non-Normed
Fit Index (NNFI, also recognized as the Tucker-Lewis index), an index that chooses simpler models. The
model’s GFI values demonstrate the variance and covariance anticipated by model matrix.
The second step in assessing the hypothesized model is to access the adequacy of parameter estimates
(Hoyle, 1995). The most important parameters in this regard are standardized factor loadings (SL),
Standard Error (S.E), corresponding t-value and R2
KEYWORDS: Alignment, Information systems success mode, Nursing information system, Technology
acceptance model
N
ursing information systems (NISs) provide technological assistance to nursing care services and are
expected to create a significant improvement in the efficiency
and quality ofnursing care and nurses' information management.1,2 Thus, understanding the factors that
influence nurses' use ofNIS and designing better systems to create benefits
evaluate discriminant validity. All items have significant factor loadings ofat least 0.7; they ranged from
0.733 to 0.881. The results implied that the instrument has a favorable outcome for convergent validity.32
Cronbach α ranged from .748 to .914, showing that all values were greater than the minimum requirement
of Cronbach α coefficients at .7.32 As presented in Table 2, the results indicated that all constructs had
good reliability. Table 3 shows the AVE square root values on the diagonal line, which surpassed the
values on the nondiagonal line that were correlation coefficients between interconstruct correlations. The
results implied that the measurement model has acceptable convergent validity and discriminant
validity.31 The variance inflation factor ofthe research model ranged
from 1.833 to 5.070. The variance inflation factor values were less than 10, which implied no
multicollinearity in the research model.33
RESULTS Structural Model Assessment Since partial least squares could not provide a measure ofthe
goodness offit ofthe model, it was thus found to be appropriate to use the R2 value to be a measure of
goodness of fit between the model and data, as suggested by Bentler and Bonett.36 The proportions of
the R2 value were 31.7% for nurses' satisfaction. Maria Correia Loureiro et al37
that an R2 value greater than 10%was acceptable; this value will indicate the goodness offit ofthemodel.
In the study, the R2 value was 32.6%, and, thus, the result indicated that the research model is a model of
goodness of fit. Moreover, the co-alignment of TAM and ISSM has a significant
variance in performance was determined from the increment in R2, after each given variable was added to
the regression equation.40 Hence, the hierarchical procedure required that the independent variables
were integrated into the regression model in a specific order. In this study, the performance factor
wasinitially regressedontwo variables of TAM (perceived usefulness and perceived ease ofuse). Next, the
three variables of ISSM (system, information, and service qualities) were added to estimate their
incremental contribution to the performance factor. Finally, the TAM-ISSM of the alignment variable was
added to the prior regression equation for testing nurses' satisfaction.
bInformation Systems Department, Widyatama University, Jl Cikutra No. 204A, Bandung 40125, Indonesia
Abstract
This study aims at testing the conceptual model for predicting intention to use the information system as
part of DeLone-Mclean information system success framework. A study literature has revealed that
DeLone-Mclean Information System success model has difficulty for defining predictor variables for
intention to use. This paper offers a solution by finding the proper variables from technology acceptance
models which have strong theoretical background for predicting behavioral intention. A conceptual model
is proposed based on literature review. An empirical study is conducted to validate the conceptual model.
The object for empirical study is a government agency which has offices in several cities/towns in
Indonesia. A quantitative data analysis is being done using SmartPLS with the result showing that
perceived usefulness is the strongest predictor for intention to use while service quality surprisingly gives
a negative coefficient toward intention to use.
this particular research still lacks of an appropriate definition and consensus on what factors affecting
information system success [1], [2]. Even though some prominent IS success theories have been
introduced, some researchers still expressed the urgency of refining the theories since empirical studies
have shown the inconsistency of the results [3], [4], [5]. There are several concerns regarding previous
works that are listed by [5] including: poor measurements, lack of theoretical grounding, concern heavily
on financial performance, weak survey instruments, inappropriate data collection approaches, and lack of
agreement on the dependent variables measurement that result on its incomparability. The most
prominent model for assessing information system success is [6]’s model since it got a lot of
attentions (citation, replication, validation, and modification) from the IS research community. However,
after getting a lot of criticism from some researchers, especially Seddon [7], DeLone and McLean updated
2. Literature Review In the updated DeLone and McLean model Fig 1, intention to use is predicted by
information quality,
system quality, service quality, and user satisfaction. Since behavioral intention to use is drawn
theoretically from psychology discipline while information quality and system quality were drawn from
technical aspect of [9]’s communication theory, therefore it will raise an internal consistency from
theoretical perspective. Based on this argument, the search for finding the surrogate variables for
intention to use will be broaden into other disciplines which have strong theoretical background in
addressing behavioral intention. This discipline has been known widely as technology acceptance or
technology diffusion research. This paper is proposing to make a connection between information system
success model and technology acceptance models in the quest of finding the proper variables for
intention to use.
their theory of reasoned action (TRA), Fishbein and Ajzen asserted that certain behavior can be predicted
by the intention for doing the behavior in question. In the theory of information system success, the
behavior in question is actual system use (presented by variable “Use” as seen in Fig 1). The intention to
use then can be translated as the willingness of user to use the system. Researchers in technology
acceptance discipline are the most supporters of the postulate that behavioral intention to use is the
antecedent of actual system use. Most studies for validating technology acceptance model (TAM) have
proven the aforementioned relationship [10]. In a TAM meta-analysis study, [11] revealed that behavioral
intention is a good predictor for actual system use in both subjective and objective measurement.
Subjective measurement
P. B. Seddon, “A respecification and extension of the DeLone and McLean model of IS success,” Inf. Syst.
Res., vol. 8, no. 3, pp. 240–253, 1997.
R. P. Bagozzi and Y. Yi, “On the evaluation of structural equation models,” J. Acad. Mark. Sci., vol. 16, no. 1,
pp. 74–94, 1988.
C. Fornell and D. . Larcker, “Evaluating structural equation models with unobservable variables and
measurement error,” J. Mark. Res., vol. 18, no. 1, pp. 39–50, 1981.
Telematics and Informatics 31 (2014) 376–385 Contents lists available at ScienceDirect Telematics and
Informatics journal homepage: www.elsevier.com/locate/tele
An Integrated Adoption Model of Mobile Cloud Services: Exploration of Key Determinants and Extension
of Technology Acceptance Model
Eunil Park a, Ki Joon Kim b,⇑ a Graduate School of Innovation and Technology Management, Korea
Advanced Institute of Science and Technology (KAIST), Daejeon, Republic of Korea b Interaction Science
Research Center, Sungkyunkwan University, Seoul, Republic of Korea
article i nfo
Article history: Received 19 September 2013 Received in revised form 14 November 2013 Accepted 20
November 2013 Available online 4 December 2013
Keywords: Mobile cloud computing services Technology acceptance model Perceived mobility Perceived
connectedness Perceived security Perceived service and system quality
ab stra ct
This study identifies and investigates a number of cognitive factors that contribute to shaping user
perceptions of and attitude toward mobile cloud computing services by integrating these factors with the
technology acceptance model. A structural equation modeling analysis is employed on data collected
from 1099 survey samples, and results reveal that user acceptance of mobile cloud services is largely
affected by perceived mobility, connectedness, security, quality of service and system, and satisfaction.
Both theoretical and practical implications of the study’s findings are discussed. Ó 2013 Elsevier Ltd. All
rights reserved.
ined how user perceptions are shaped in mobile cloud computing, and these studies provide little
information on how psychological factors involved in the mobile context determine user acceptance of
the service. Therefore, this study first identifies user perceptions of mobility, security, connectedness,
service and system quality, and satisfaction as key components of mobile cloud services and then
examines how these factors affect user perceptions and acceptance of the services. More importantly, this
study integrates these psychological factors with the technology acceptance model (TAM) and develops a
new research model to predict the adoption of mobile cloud services by confirming the convergent,
discriminant, and internal validity of the proposed model via structural equation modeling (SEM).
era ofWeb 3.0. In 2007, Schmidt (2007), CEO of Google, referred to Web 3.0 as a computing application
model and defined it as applications that are pieced together so that they (1) are relatively small, (2) are
very fast and customizable, (3) can operate on any device (PC or mobile), and (4) store data in the cloud.
These characteristics of the predicted Web 3.0 precisely correspond to the key components and strengths
of mobile cloud computing, suggesting the significant potential of mobile cloud computing as the future
mainstream technology.
3. User acceptance model of mobile cloud services 3.1. Technology acceptance model (TAM) TAM consists
of two main beliefs known as perceived ease of use and perceived usefulness, which Davis (1989, 1993)
defined as ‘‘the degree to which a person believes that using a specific system would be free of mental
and physical efforts’’ and ‘‘the degree to which a person believes that using a specific system would
enhance his/her job performance,’’ respectively. Numerous studies have successfully utilized and
replicated TAM to predict user acceptance of novel technologies and systems and demonstrated that
perceived ease of use and perceived usefulness largely determine user attitude toward a specific
technology, while attitude and perceived usefulness significantly affect behavioral intention to use the
technology. The TAM framework has been particularly useful in exploring user acceptance of recent novel
mobile technologies and
factor loadings and values of average variance extracted (AVE) should be greater than 0.70 and 0.50,
respectively. As reported in Table 2, the measurement model satisfied these recommendations. For
discriminant validity, Fornell and Lacker (1981)
user-centered decision process. The excellent fit indices between the model and the collected sample
data, as well as confirmations of the hypothesized causal paths, indicate the validity of the proposed
integrated user acceptance model, which identifies key psychological factors that largely determine the
adoption pattern of mobile cloud services and explicate their causal relationship. As summarized in Fig. 2,
the integrated model shows that the combinatory effects of perceived usefulness, perceived
connectedness, perceived security, and service and system quality explained 75.2% of the variance in user
attitude toward mobile cloud services, while 85.8% of the variance in user intention was found to be
explainable by the combination of perceived usefulness, attitude, satisfaction, and service and system
quality. Perceived mobility and perceived security emerged as meaningful predictors of service and
system quality by explaining 71.7% of its variance. All these findings statistically demonstrate that our
proposed model, as in prior research on the adoption of novel mobile technology (Huang et al., 2007;
Park and Kim, 2013; Wang et al., 2008; Wu et al., 2007), successfully establishes valid links between the key
psychological factors of the services (i.e., perceived mobility, perceived connectedness, perceived security,
service and system quality, and satisfaction) and the constructs from the original TAM framework (i.e.,
perceived usefulness, attitude, intention to use), thereby extending adoption theories on mobile
technology. More specifically, perceived connectedness and perceived security emerged as influential
antecedents of attitude toward
institutions, such as Universitas Pembangunan Nasional “Veteran” Jakarta = UPNVJ and Sekolah Tinggi
Teknologi Telematika Telkom (ST3 Telkom) Purwokerto, Central Java. The objective of this research is to
measure the e-learning system success implemented by UPNVJ and ST3 Telkom Purwokerto and then
compare the similarities and differences between of two. The modified DeLone & McLean Information
Systems Success Model and part of Technology Acceptance Model are adopted in this study. The
respondents are students who have been experience in using e-learning and are selected randomly from
the Faculty of Computer Science of UPNVJ and from ST3 Telkom Purwokerto. The total respondents are
387, which consist of 215 students from UPNVJ and 172 from ST3 Telkom Purwokerto. For the results at
UPNVJ, there are two hypotheses that were proven insignificant and at ST3 Telkom there are three
hypotheses that were proven insignificant. Findings at UPNVJ show that the e-learning benefit can be
explained by its independent variables by 53.8%%, and at ST3 Telkom by 60.6%. These percentages show
that the predictors explained 53.8% for UPNVJ’s e-learning benefit and 60.6% elearning benefit for ST3
Telkom Purwokerto. These findings could be considered as novelties, because they are different from the
original model.
discussion among scholars, especially in the area of ICT, in recent years. It’s causing a shift changing from
traditional to internet based learning. It’s mainly because e-learning conducted via internet, without
internet connection e-learning is not possible to be implemented. Dorobat’s [2] proposed model and
future research to a more comprehensive model for the evaluation of E-Learning System Success (ELSS).
Her [2] proposed model based on six perspectives: overall system quality; user perceived control;
usefulness and user satisfaction;
978-1-5090-1669-3/15/$31.00 ©2015 IEEE
user attitude; social factors; and benefits of using the e-learning systems. In her conclusions, she proposed
a more comprehensive model of ELSS. Meanwhile, Park [3] concluded his research that the result of his
study demonstrated that some TAM constructs had a direct and indirect effect on university students’
behavior to use e-learning. Furthermore, he said that this type of research needs to be implemented in
other elearning circumstances or infrastructures. So, the purpose of this study is to measure the e-learning
systems success implemented in the two higher educational institutions mentioned above. In doing so,
researcher combine the DeLone & McLean Information Systems Success Model with part of Technology
Acceptance Model. In addition to that, by implementing this model, novelties can be obtained because D
& M IS and TAM have been around quite sometime since its original version. After so many years these
models have been implemented, developments and modifications have been made from its original
version; researcher thinks that something must be done to evaluate it. One of the reasons because the
development of ICTs is so fast from time to time, therefore we need to keep up with it.
research with causative approach. The results of the research will be analyzed using path analysis and
structural equation modelling (SEM) software, which is AMOS (Analysis of Moment Structures) [15]. Path
analysis (SEM models without latent variables) is employed in this study to analyse the relationship among
variables, specifically to measure the direct and indirect effect from exogenous variables to endogenous
variables [16]. Maximum Likelihood estimation method is implemented using AMOS and the chosen
outputs are minimization history, standardized estimates, squared multiple correlations and indirect,
direct & total effects [17] [18]. This research was done without any special treatment to the data obtained
by the researcher. The survey was conducted at University of National
almost all hypotheses are significant, it is worth considering some of the limitations of the study. First, in
this study the researcher only measures e-learning benefit in connection with seven other variables, but in
reality it is much more than that. Second, although the sample has been considered enough but a larger
sample could help to reveal smaller population effects. Third, the research model was tested with a
specific case study, in this case only implemented in two higher educational institutions, i.e., UPNVJ and
ST3 Telkom Purwokerto. Although the similar model has been tested several times, further study is
needed to test whether it can be more widely applied to other circumstances. These results can be
considered as novelties of this study, so that can be used as future research.
and McLean (1992) in an attempt to respond to this problem presented a Success Model that has been
used and keeps evolving in the field of IS. The IS success model presented by DeLone and McLean (1992)
was updated in 2003 and the model holds that information quality, service quality, systems quality,
intention to use/use, user satisfaction and net benefit are the six components of IS success. Concerning
the IS success model, system use precedes user satisfaction while positive experience with use enhances
satisfaction leading to greater intention to use (Petter et al., 2008). Some research studies have
augmented IS model with other technology adoption frameworks. For instance, Li et al. (2012) recognized
that e-learning determinants such as service quality, perceived usefulness, course quality, perceived ease
of use and self-efficacy directly affect e-learning systems use, whereas, the functionality features of the
system and the response user get from the system indirectly affect e-learning systems use. Yakubu and
Dasuki (2018) conducted a study on e-learning adoption among university students in Nigeria with a
newly proposed model of the IS success model. The authors added behavioural intention and actual
usage to some constructs of the IS Success model to study user e-learning adoption. Cheng (2012)
examined the effect of quality e-learning on the intention to adopt and use, in doing so, he
3. RESEARCH FRAMEWORK AND HYPOTHESES The study adopted the DeLone and McLean IS success
model (D&M) (Delone and McLean, 2003) and the
Technology acceptance model (TAM) (Davis et al., 1992) to explore e-learning adoption from an academic
faculty perspective, specifically; lecturers. The two research frameworks were integrated to improve the
understanding of e-learning adoption within a developing country context like Ghana. The technology
adoption model (TAM) has been seen as a very powerful model that helps to understand individual
technology adoption. TAM has been used in a wide range of studies, including 3G adoption service
(Chong et al., 2012; Opoku and Adu, 2016) mobile commerce (Yang, 2005; Kim et al., 2007; Alalwan et al.,
2018) E-banking (Kolodinsky et al., 2004; Hassan et al., 2018) Elearning (Gamble, 2017; Tan and Hsu, 2018)
cloud computing (Oliveira et al., 2014; Gangwar et al., 2015; Sharma et al., 2016) etc. The TAM model
intends to explain users’ behavioural intention to use any information technology. According to Davis
(1989) TAM proposed that two primary factors, namely; perceived ease of use and perceived usefulness,
are able to determine users' intentions to accept or reject a new information technology (Chong et al.,
2012). Perceived usefulness is the degree to which a person believes that using a particular system would
be beneficial to him or her, while perceived ease of use is the degree to which a person believes that
using a particular information technology would be free of effort (Davis, 1989). However, the construct
perceived ease of use, in turn,
Hair, J.F., G.T.M. Hult, C.M. Ringle and M. Sarstedt, 2013. A primer on partial least squares structural
equation modeling (PLS-SEM). Thousand Oaks: Sage.
Jagannathan, V., S. Balasubramanian and T. Natarajan, 2018. An extension to the Delone and Mclean
information systems success model and validation in the internet banking context. In M. Khosrow-Puour
(Ed.), Encyclopedia of Information Science and Technology. 4th Edn., pp: 49-60.
McFarland, D.J. and D. Hamilton, 2006. Adding contextual specificity to the technology acceptance model.
Computers in Human Behavior, 22(3): 427-447.Available at: https://doi.org/10.1016/j.chb.2004.09.009.
Abstract: Online meeting platforms have been widely utilized during the COVID-19 pandemic due to the
current shift from traditional learning. However, the acceptance of the different online meeting platforms
for e-learning has been underexplored. The purpose of this study was to determine the factors for
acceptance of an online learning platform among students during the COVID-19 pandemic. A total of 500
senior high school students voluntarily participated to answer constructs under the Extended Technology
Acceptance Model (ETAM) and Delone and McLean IS Success Model. Several latent including user
interface (UI), perceived ease of use (PEU), perceived usefulness (PU), information quality (IQ), system
quality (SQ), behavioral intentions (BI), and actual use were analyzed by Structural Equation Modeling
(SEM). The results indicated that PEU was found to have the greatest on actual use (AU), followed by UI
and SQ towards PEU, which subsequently led to BI and AU. Finally, IQ was found to have a significant
effect on PU, which led to BI and AU. The level of student acceptability considers the ease of use, user
interface, system quality, information quality, leading to a positive behavioral intention for actual use.
With that, it would be of best interest to consider the factors that would lead students towards accepting
the platforms utilized and therefore the current education system. Moreover, this will lead to their
acceptance and promote learning even with the COVID-19 pandemic. Finally, the model construct can be
applied and utilized to analyze the online learning platforms in other countries.
have examined the responsibility of family support towards the technology adoption process of the
students [10]. These studies integrated extended TAM, which is intended to affect intern convictions,
perceptions, and intentions of students’ family support, which has positively estimated the ease of use,
usefulness, attitude to tablets as well as the intention of using tablet computers among students [10]. In
addition, extended TAM is used to identify several factors that impact the behavior of users while utilizing
a mobile library application [11]. The positive impact of the behavior considered perceived usefulness and
perceived ease of use addressing the system quality [11]. Furthermore, TAM is commonly combined with
several theories such as DeLone and McLean IS Model [12]. According to Hsu et al. (2014), the DeLone
and McLean IS Success Model is used
for IS research papers as a valid model and framework for variables that are complex dependent [12]. In
addition, this model is developed and proposed to information systems to study what the user behavior is
and explain it through the utilization of technology [13]. Moreover, this model is still widely used by
researchers and journalists of the service industry because the comprehension and understanding about
Information System Success are continuously progressing. Additionally, if a proper understanding of the
model is achieved, it would help to show the importance of the system. It can even serve as the
foundation for the decisions to the said systems [14]. The significance of the DeLone and McLean IS
Success Model will contribute greatly as help to create new ideas and strategies that will further aid the
students in developing countries on the adaptation to the use of e-learning platforms [15]. Therefore, the
current adaptation of e-learning due to the COVID-19 pandemic should be explored. Specifically, the
acceptance of students in utilizing online meeting platforms for e-learning. The purpose of this study was
to determine the factors contributing to the acceptance
3.3. Statistical Analysis Structural Equation Modeling (SEM) is a quantitative tool that is commonly utilized
in advertising and institutional behavior analysis for instrument validation and model testing [27]. In
addition, it can be used for evaluating the relationship between the numbers observed and the latent
variables [28]. According to Teo and Noyes [29], SEM can be used for assessing and analyzing the
intentions and behavior of the user on the usage of technology. In the study, SEM was utilized to explain
and estimate the factors that influenced senior high students to choose an e-learning platform and their
acceptance.
Table 5 demonstrated the IFI, TLI, CFI, GFI, AGFI, and RMSEA. From the study of
Gefen et al. [30] and Steiger [31], values higher than 0.80 for TLI, IFI, CFI, GFI, and AGFI f and a value less
than for 0.07 RMSEA are considered good model fit [32,33]. Based on Table 5, all the model fits passed
the cut-off, indicating that the model was a good presentation of the data.
most important quests of learning. Especially the broaden the learning experience teachers can be
benefited Computer literacy has caused a major apprehension to from IT by delivering some of the part of
course content many individuals accepting the fact that most of the online [1]. For this purpose
acceptance of computer things we do today is computer-aided. In order to technology is required. Lots of
models have been enhance learning, computer has made major impacts developed for better
understanding and investigation of especially in education. There is online learning, distance such factors
that affect the computer technology education and e-learning. Today’s education has taken acceptance
like TRA (theory of reasoned action) by various shapes, especially this time the language that is [5 7, 8];
the theory of planned behavior (TBP)) [5, 6], the spoken by most of the learners and individuals is based
technology acceptance model i-e TAM [9]. However on ICTs i-e information and communication
technologies. current research is focused on the TAM i-e technology Increasing innovative trends
communication technologies (ICTs)
in information and acceptance model and to understand how it is and the current implemented on e-
learning.
In today’s world,
learning model that initiates a classroom course, meeting technology is more flexible, accessible, more
portable and or lectures with the help of internet technologies. While more persistent than before.
Everyone is now aware of the Asynchronous learning uses a web-based version of importance of digital
technology that how it changes the computer-based training (CBT), which is accessible on a ways for
learning and education. This may serves as a CD-ROM or across an organization’s LAN i-e local area mean
for improved quality of educational opportunity, network. There are lots of studies that have investigated
greater education diversity, greater standards and higher about what factors are influencing most the e-
learning effectiveness. E-learning has implications for teachers and participation. Most of them are the
extension of TAM i-e leaders, pupils and parents. The success of technology acceptance model [16, 17,
18]. This model implementation of e-learning depends on following the states that if we want to
determine the success of a pedagogical principles that are embedded in the e-learning system it can be
done by determining the user acceptance experiences and can be applied to both the e-learning and of
the system, that could be measured by 3 factors i-e the traditional classroom delivery method [25]. He
also Perceived Usefulness (PU), perceived ease of use (PEOU) identified seven parameters that may affect
the successful and attitude towards usage (ATU) of the system [16].
Intention of Use. 2.3. Information system success model proposed by DeLone and McLean [35] developed
a
It is considered that perceived behavior control is multidimensional IS success model, that integrates the
verified with the help of total number of accessible control model of communication which is created by
Shannon and beliefs, or it is also said that persons perceived behavioral Weaver [36] and information
impact theory created by control is more stronger, if he feels that he got a lot more Mason [37].
opportunities and resources when the difficulties in
IS use and the degree of user satisfaction directly and integration can lead to cognitive development
indirect relationship with the individual's performance and (Wang, 2005) and it is ‘e-learning environments
[-that] can affect the whole organization eventually. Pitt et al. provide students with dynamic, interactive
nonlinear [38] revealed that information system success model of access to a wide range of information
represented as text, DeLone and McLean's did not contain IS service quality graphics, animation, audio
and video’ (Kramarski & measures. They have the view that it is very important to Gutman, 2006, p.25).
include IS service quality and declare that system, service
the study's weather the model fits or not and to establish the Variables include perceived usefulness
acceptability of the model. [45] has given few indices that The model provides an acceptable fit to the
data, i.e.
conclusion, e-learning system users have responded the values of CFI, NFI, RMSEA, GFI and AGFI were
found positively in all the information, service and system according to the cut points in both the
measurement qualities, which indicate the models applied in the study models. Model fit was achieved by
following an are appropriate.
<Files\\eng - The Applicability of the Modified Technology Acceptance Model TAM on the Sustainable
Adoption of eHealth Systems in Resource-Limited Settings> - § 3 references coded [2,39% Coverage]
2. Empirically test the modified technology acceptance model for determining the key factors influencing
the intention of healthcare professionals to adopt eHealth technologies in a resource-limited setting.
84. Fan X, Thompson B, Wang L. Effects of sample size, estimation methods, and model specification on
structural equation modeling fit indexes. Struct Equ Model. 1999;6(1):56–83.
doi:10.1080/10705519909540119
The technology acceptance model (TAM) has proven to be one of the most powerful theories to explain
users’ technology adoption. Among many external variables incorporated into TAM, service quality
(ServQ) and experience (PE) are considered as important factors that influence technology use. In this
study TAM (Davis et al 1989) and information system success models (Delone and McLean 1992) are
combined and then revised. The results show that service quality and alternative attractiveness had strong
external influence on both perceived ease of use (PEOU) and perceived usefulness (PU) of accounting
software programs, however product experience had not. Furthermore, instead of “attitude”, mediating
effect of switching cost is analyzed. Results show how the influence of PU gain more importance in
creation of long-term loyalty compared to that of short-term use intentions. The indirect effect of service
quality on intention to use via perceived usefulness is found ineffective while it stays significant to obtain
a continuos loyaty. Switching cost support both intention to use and loyalty. The research data is collected
from professional accountants working in accounting bureaus in Turkey. Briefly, the study helped to find-
out the main affective decision-making criteria in use of accounting software programs.
increase the efficiency of their business operations and to improve productivity. Thus, IT has become a
strategic weapon to obtain competitive advantages in accounting based job accomplishments. The
information system performance is found critical for software usage (Hernandez et al β009, Hsu et al
β009). Delone and Mclean 199β “information system success model” is represented mainly by three
fundamental dimensions as information system quality, information quality and service quality (Delone
and McLean 199β, Landrum et al β008, Pitt et al
Academy of Information and Management Sciences Journal, Volume 17, Number 1, 2014
Page 2
1995). Other system dimensions are system quality, frequency of use, customer satisfaction, personal and
organizational effects (Delone and McLean 199β). One of them, service quality, is used in our extended
TAM. In this study, it is aimed to find out the criterias that effect the use of a technological product and
loyalty to that product based on the external effects of three variables; service quality, alternative
attractiveness and product experience via “switching cost”. Specifically, the objectives of this study are: (1)
to evaluate how service quality, product experience, and alternative attractiveness effect perceived ease of
use and perceived usefulness of accounting software programs , (β) to find-out the impact of perceived
ease of use and perceived usefulness on switching cost, (γ) to determine the impact of service quality and
switching cost on behavior intention to use and behavior loyalty (4) At the end compare two
combinations of the model, one with behavior intention to use and the other one with behavior loyalty.
A lot of empirical work has proved the positive relationships between service quality and
behavioral consequences like customer loyalty in different fields of service industry such as banking and
travel agencies (Jones et al β00β), information systems and internet (Hoxmier β000, Good and Harris
β007). The most important unique value of this study is to find-out the effects of switching cost on
accountants’ software preferences using an extended technolgy acceptance model. Accountants are going
to decide to keep or change the current accounting software program after making a comparative
benefit-cost analysis of switching between alternatives, so the importance of switching cost effect is taken
into consideration. The external influences of product experience (Lee and Kim β009, Igbaria 1990) and
service quality (Kim et al β008, Robinson et al β005, Ha and Stoel β009) on both PEOU and PU have been
looked for previously, however the one of alternative attractiveness has not been studied yet to our
knowledge. Beside switching cost (Fornell 199β, Jones et al β00β), alternatives’ deficiency(Ping 199γ) in the
market also is a good opportunity for a firm to keep clients on hand, which also analyzed in the study.
Finally the model is comparatively tested one-side using a short-term use intentions and the other side
long-term loyalty. According to face-to-face interviews with professional accountants from accounting
types on PEOU and PU like design aesthetics quality in mobile services (Cyr et al β006) or technical
support in intranet usage (Lee and Kim β009), personal computing acceptance (Igbaria et al 1997), web-
based learning (Sánchez and Huerosβ010). Different combinations of TAM with Delone and McLean’s
information system success model (199β) studied the positive effects of service quality on both PEOU for
hotel information systems (Kim et al β008), CRM applications(Avlonitis and Panagopoulos β005) and also
on PU for library information systems
Academy of Information and Management Sciences Journal, Volume 17, Number 1, 2014
Page 6
(Landrum et al β008). Beside those, Lin et al (β011) found that the information quality of eGovernment
filing systems positively affects the PU of internet use. Indeed, a good service assistance that assure
privacy and security of the customer accounts during software program setups or upgrading should
increase expectations overall. More recently, the direct positive effects of a favorable web-site appearance
and design
Confirmatory Factor Analysis for Switching Cost As exploratory factor analysis is defined as a precursor for
confirmatory factor analysis
(Gerbing and Hamilton 1996), five first-order factors (monetary, benefit-loss, uncertainty, evaluation/set-
up, learning costs) with βγ items are directed to obtain a second-order switching cost variable. A
maximum likelihood method of estimation by LISREL 8.51 is used for confirmatory factor analysis. First of
all, the items used to measure each of the five components of switching cost were averaged to arrive at a
single score for each component. Then, one single
Figure1: Second-order measurement model of switching cost Monetary cost 0.7γ(16.18**) 0.4γ(9.1γ**)
Switching Cost
0.84(18.γ4**) 0.77(19.50**)
Uncertainty cost Benefit-loss cost Learning cost 0.8β(15.γ4**) Evaluation/set-up cost The model was found
to be statistically significant (Xβ (ββγ)= γ.78, p<0.01). In general,
model fit is assured if CFI, NFI, IFI and GFI are larger than 0.9, AGFI is larger than 0.8 and RMSEA is smaller
than 0.08. The ratio of chi-square to degrees-of-freedom with a suggested value of 5 or below is
acceptable (Bagozzi & Yi, 1988; Hair et al., 1998; Jöreskog & Sörbom, 199γ). The fit indices suggested a
good model fit (RMSEA=0.06γ, CFI=0.98, IFI=0.98, NFI=0.97, RFI=0.96, SRMR=0.058, GFI=0.91,
AGFI=0.88). (Bagozzi and Yi, 1988;Hair et al., 1998; Jöreskog and Sörbom, 199γ). To assure discriminant
validity, two models were compared using Xβ difference tests for
each pair of constructs : one where the correlation between pair is a free parameter and the other where it
is fixed at one (Mak and Sockel, β001). The chi-square of the first model where the correlation is a free
parameter should be much smaller than the other model where it’s fixed at one and be significant at p <
0.01 (Bagozzi & Yi, 1988, Mak and Sockel, β001). Ten different models were first tested by chi-square for
the first-order factors and discriminant validity is achieved with minimum Xβ
(1)= 140.75, p<0.01. The difference of chi-square between two constructs must be γ.84 or greater to
justify that two models are different at a 95% confidence Academy of Information and Management
Sciences Journal, Volume 17, Number 1, 2014
parameter estimation (Anderson and Gerbing, 1988). Therefore convergent validity was achieved for all
the constructs in the study. To assess discriminant validity, a chi-square difference test was used following
the standards set by Mak and Sockel(β001). As a result, β0 different chisquare values were obtained for β0
different models for both BL and BI models. Discriminant validity had been achieved for both BI and BL
models with (minimum Xβ
Moreover, Cronbach’s alpha values for all factors were greater than 0.70, meeting the criterion set by
Nunnally (1978). In addition to that, composite reliability(CRC) values were above the acceptable limits
(Siguaw & Diamantopoulos,β000) . In addition to that, average variance extracted (pv) was either close or
above the acceptable limit (table 4). Thus, all reliability analyses indicated that the structural model is
statistically reliable.
Table 4: Structural measurement model assessment results Stand
Constructs and scales
Service Quality (α=0.90) Brown and Swartz 1989
Delone and McLean β00γ Items
ServQ1 ServQβ ServQγ ServQ4 ServQ5
Product Experience(α=0.8γ) Burnham et al β00γ
Thompson et al 1994
Alternative Attractiveness (α=0.80) Ping 199γ
Burnham et al β00γ
Perceived Ease of Use(α=0.91) Davis et al 1989
Venkatesh and Davis β000 Igbaria 1990
Perceived Usefulness(α=0.94) Davis et al 1989
Venkatesh and Davis β000 Igbaria 1990
PE1 PEβ PEγ
AATβ
loadings BL/BI
0.77
0.79/0.80 0.80 0.84 0.77
0.76
0.88/0.89 0.7β
AAT1 0.80/0.64 0.86/0.7β
AATγ 0.6γ/0.57 AAT4 0.51/0.57
PEOU1 PEOUβ PEOUγ PEOU4
PU1 PUβ PUγ PU4 PU5 PU6 PU7 PU8
0.81 0.87 0.8β 0.88
0.76 0.8γ 0.71 0.65 0.87 0.88 0.88 0.8γ
t values BL/BI
β9.04/β1.77 ββ.79/ββ.80 -/-
Structural equation model analysis and hypothesis testing results The both proposed structural models
were found statistically significant with good model
fit indices. The overall fit of the BI model was sound with (Xβ (507): β.96, p < 0.01, RMSEA:
Academy of Information and Management Sciences Journal, Volume 17, Number 1, 2014 0.46 0.81 0.59
0.90 0.69 0.90
AVE BL/BI
CCR BL/BI
Page 14 Table 5: Structural equation model analysis and hypothesis testing results Hypothesized paths
Mbehavioral Loyalty/ MBehavioral Intention to use
H1a H1b Hβa Hβb Hβc Hγa Hγb H4a H4b H5a H5b H6a H6b H7a H7b
PEOU→ PU PEOU→ SC PU → SC PU→ BI PU→ BL
PE→ PEOU PE→ PU
AAT → PEOU AAT → PU
ServQ → PEOU ServQ → PU ServQ→ BI ServQ→ BL
SC→ BI SC→ BL
SQ→ SC PE→ SC
AAT→ SC PE→ BL PE→ BI
Rβ
AAT→ BL AAT→ BI *PEOU * *PU * *SC*
Rβ Rβ
Rβ *BL/BI*
0.ββ/0.β7 0.6γ/0.70 0.β8/0.β8 0.5γ/0.54
the correlation between service quality and PU was positive and significant at 0.β0 for only BL model, but
not significant at 0.06 for BI model. Therefore H5b is partly supported. As proposed in H7a,b perceived
quality has positive and significant relationship both with BI( 6a:0.γ5 p < 0.01) and BL( 6b :0.γ4 p < 0.01).
Switching cost positively and significantly effect BI( 7a:0.09; p < 0.01) and BL( 7b:0.11; p < 0.01), so H7a,b
is supported (figure β,γ-table 5).
Figure 2: Structural equation model analysis and hypothesis testing results for BI model Service Quality
0.β0(γ.β0**) 0.06(1.γ9)
interesting future research projects. For instance, the effects of personal characteristics like being market-
maven(Stern and Stephen 1988, Goldsmith et al 1996 ), or innovativeness (Cestre and Darmon 1998) on
usage intention and loyalty can be explored. The possible moderator effects of switching cost antecedents
like product characteristics, investment and relationship lenght (Burnham et al β00γ, Zhang and Gosain
β00γ, Sengupta et al 1997) on the relationship between the switching cost, behavioral intention to use
and loyalty can be looked for. Beside, the role of brand trust (Zhang and Gosain β00γ, Lee at al β011,
Goode and Harris β007) can be searched in this circle under both high and low alternatives’ availability
conditions in the market. For example Sharma and Patterson (β000) found that trust has a stronger effect
on commitment under low alternative attractiveness, however satisfaction becomes the main criteria
under high alternative attractiveness. Moreover, the research model can comparatively be tested
separating respondents from different regions and cities of Turkey, to follow whether the hypothesis
results
Academy of Information and Management Sciences Journal, Volume 17, Number 1, 2014
Page 18
are changing or not. On the other hand, the effects of demographic variables like education level or
gender might be included in the model.
Avlonitis, G.J. & N.G. Panagopoulos (2005). Antecedents and consequences of CRM technology
acceptance in the sales force. Industrial Marketing Management 34(4), 355– 368.
Chen, S.& S. Chaiken ( 1999). The Heuristic-Systematic Model in its broader context. In S. Chaiken and Y.
Trope (Eds.), Dual-process Theories in Social Psychology , New York, The Guilford Press
Davis, F. D., R. P. Bagozzi, & P.R. Warshaw (1989). User acceptance of computer technology: A comparison
of two theoretical models. Management Science, 35(8), 982-1003
DeLone, W. H. & E. R. McLean (1992). Information systems success: the quest for the dependent variable.
Information systems research, 3(1), 60-95
Igbaria, M. (1990). End-user computing effectiveness: A structural equational model. Omega, 18(6), 637–
652. Igbaria, M., N. Zinatelli, P. Cragg & A. Cavaye (1997) Personal computing acceptance factors in small
firms: a structural equation model. Journal of Management Information Systems 21(3) 279–302.
Kim, T.G., J. H.Lee & R. Law (2008). An empirical examination of the acceptance behaviour of hotel front
office systems: An extended technology acceptance model. Tourism Management, 29(3), 500–513
Straub, D. W. (1989). Validating instruments in MIS research. MIS Quarterly, 1γ(β), 147–169. Thompson, R.
L., C. A. Higgins, & J. M. Howell (1994). Influence of experience on personal computer utilization: Testing a
conceptual model. Journal of Management Information Systems, 11(1), 167–187.
<Files\\eng - the-influence-of-information-system-quality-on-the-organization-performance-a-
modification-of-technology-based-information-system-acceptance-and-success-model> - § 8 references
coded [8,30% Coverage]
accounting field. The use of AIS applications is expected to improve the performance of the accounting
field which would indirectly improve the overall organization performance. However, according to Usnodo
(2010), about 70% of information systems failed to be applied due to behavioral aspects issue. This study
uses 3 models as the basis of its research, namely TAM (Davis et al, 1989),
IS Success Model (DeLone and McLean, 1992), as well as technology-based information systems
acceptance and success model (Baridwan, 2012). Building a technology-based accounting information
system requires huge investment.
(1992); Seddon and Kiew (1997); and Saeed and Helm (2008). The first study was DeLone and McLean
research (1992) on the success model of technology-based information systems. The second study was
Seddon and Kiew research (1997) that reviewed the DeLone and McLean information systems success
model. This study examines the relationship between five variables, system quality, information quality,
usefulness, user satisfaction, and importance of the system. A third study by Saeed and Helm (2008)
examined the effect of information system characteristics and beneficiary perceptions on the use of post-
adoption information systems. Based on these three studies, there are five variables tested in this study,
namely information system qualities, benefit perception, user satisfaction, system usage, and
organizational performance. In the previous research models DeLone and McLean’s success of
information
systems model were widely used to examine private companies. On the other hand, this study examined
public sector organizations in East Java Province.
This model was developed by DeLone and McLean in 1992 based on a causal relationship process of six
dimensions consisting of system quality, information quality, usage, user satisfaction, individual impact
and organizational impact. The IS Success Model does not independently measure these dimensions but
measures them as a whole. This model is a parsimony model, therefore, this model is useful to test and
analyze the success of information systems in organizations that applied information technology.
Technology-Based Information System Acceptance and Success Model. This model is
of an information system (DeLone and McLean in Livari 2005). The information system quality construct is
defined by the IS Success Model developed by Delone and McLean (1992). Furthermore, DeLone and
McLean information system success model was improved by Seddon and Kiew in 1997 by connecting
system quality and information quality variable on benefit perception. Several other studies (Kim & Lee,
2014, Ali & Younes, 2013, HsuehYing Wu et al, 2010, Saeed & Helm, 2008) also stated that there is a
positive relationship between information system qualities and benefit perception. H1: Information system
qualities positively affects the perception of benefits.
Reference 5 - 0,91% Coverage
accounting information systems usage and their impact on the performance of local government
organizations. Based on hypothesis assessment result, every hypothesis in this research was accepted. This
research adopted three previous models: TAM (Davis et al, 1989), IS Success Model (DeLone and McLean,
1992), and Technology-Based Information System Acceptance and Success Model (Baridwan, 2012). The
first hypothesis in this study states that information system qualities positively
These results are supported by previous studies conducted by Igbaria and Tan (1997), Bokhari (2005),
DeLone and McLean (1992), Kim and Lee (2014), Peter et al. (2008), livary (2005), Hollsaple and Lee-post
(2006). The results of this study also state that there is a positive relationship between the use of system
with organizational performance. These results support the results of previous research conducted by
Petter and McLean (2009),
111
RJOAS, 12(72), December 2017
Lee-Post (2009), Urbach et al. (2010), DeLone and McLean (2003), Wang and Liao (2008) and Baridwan
(2012). Implications of research. This study has two implications, namely theoretical
1. Abdillah, Willy dan Jogiyanto Hartono. 2015. Partial Least Square (PLS): Alternative Structural Equation
Modeling (SEM) dalam Penelitian Bisnis. C.V. Andi Offset. Yogyakarta.
9. Davis, Fred D., Richard P. Bagozzi, dan Paul R. Warshaw. 1989. User Acceptance of Computer
Technology: A Comparison Two Theoretical Models. Management Science 35, no. 8: 982-1003.
IOP Conference Series: Materials Science and Engineering PAPER • OPEN ACCESS
Using DeLone and McLean model for evaluating an e-commerce website
To cite this article: Mesra Betty Yel et al 2020 IOP Conf. Ser.: Mater. Sci. Eng. 725 012108 - View the article
online for updates and enhancements.
Measuring The Quality of Website Services covid19.kalbarprov.go.id Using The Webqual 4.0 Method
Kartika Handayani, Eka Herdit Juningsih, Dwiza Riana et al.
-
Study of the Usability Testing of ECommerce Applications
Samkit Jain and Pradnya Purandare
User interface evaluation of official store for FMCG (fast moving consumer goods) products in e-
commerce website using user experience approach R A Lestari, E Muslim and B N Moch
This content was downloaded from IP address 103.183.251.134 on 29/11/2023 at 00:30
3rd NICTE IOP Publishing IOP Conf. Series: Materials Science and Engineering 725 (2020) 012108
doi:10.1088/1757-899X/725/1/012108
Using DeLone and McLean model for evaluating an e-commerce website Mesra Betty Yel1,1, Sfenrianto
Sfenrianto2,2, Raka Doni Anugrah2,3
1Faculty of Computer Science, STIKOM CKI Jakarta, Indonesia 2Information Systems Management
Department, BINUS Graduate Program – Master of Information Systems Management, Bina Nusantara
University, Jakarta, Indonesia 11480
*betty.mby@stikomcki.ac.id
Abstract. E-commerce in Indonesia has grown rapidly and provided many positive impacts especially on
the field of online business. Through the developments, there are certainly many factors that must be
carefully considered in all aspects to get the "goal" as desired. So, when an e-commerce website has
made changes whether we can conclude that the results worked so far or not. It can start by taking the
existing factors that become the determinant of one of the successes in the e-commerce website. The
study aims to evaluate factors become the success of an e-commerce (jualandbeli.com). Using the McLean
and Delone success model approach that has 5 factors, namely: system quality, information quality, use,
user satisfaction and net benefit. The result shows system quality, user satisfaction, and net benefits
influence to use factor. net benefit influence to use. Quality of information influence to user satisfaction
factor.While user satisfaction influence on net benefit factor. Thus, be expected, the model can be used as
reference in related evaluating an e-commerce website.
4. Conclusion In the measurement model analysis showed that all variables have met the criteria of validity
and reliability and on the analysis of structural models, H1, H4, H5, H6, and H8 support the proposed
hypothesis. These hypotheses are consistent with previous studies, namely H1 [10], H4 [10] [14], H5 [10]
[15], H6 [10], and H8 [10]. Thus, system quality, user satisfaction, and net benefits can become the success
factors on jualandbeli.com website in terms of use. Quality of information is one of the success factors on
jualandbeli.com website in terms of user satisfaction. User satisfaction is one of the success factors on
jualandbeli.com website in terms of user Net Benefit.While others (H2, H3, H7 and H9) are not support.