A study on the standard setting, validity, and reliability of a standardized patient performance rating scale – student version, 2023
Introduction: The quality of the performances of standardized patients plays a significant role
i... more Introduction: The quality of the performances of standardized patients plays a significant role
in the effectiveness of clinical skills education. Therefore, providing standardized patients with
constant feedback is essential. It is especially important to get students’ perspectives immediately
following their encounters with standardized patients. In the literature, there is no scale for
use by students to evaluate the performance of standardized patients. Thus, the three main
goals of this study were to: (1) develop a scale for use by students to evaluate the performance
of standardized patients, (2) examine the psychometric properties of the scale, and (3) determine
a cut-off score for the scale in a standard-setting
Materials and methods: Seven hundred and two medical students participated in the scaledevelopment
process, the pilot test, and the validation process, and seven educators took part
in the standard-setting process. After the evaluation of content validity, construct validity was
assessed via exploratory and confirmatory factor analyses. For the standard-setting study, the
extended Angoff method was used.
Results: The exploratory factor analysis revealed that the scale had a single-factor structure,
which was confirmed by confirmatory factor analysis. The Cronbach’s alpha internal consistency
coefficient was 0.91. The scale consists of nine items. The cut-off score was determined to be
24.11/45, which represents the minimum acceptable standard for standardized patient
performance.
Conclusions: Our study outlined the critical steps in developing a measurement tool and produced
a valid and reliable scale that allows medical students to assess the performance of
standardized patients immediately following their interaction with the standardized patient. This
scale constitutes an important contribution to the literature as it provides a tool for standardized
patient trainers to assess standardized patients’ weaknesses and help them improve their
performance.
Uploads
Papers by deha dogan
in the effectiveness of clinical skills education. Therefore, providing standardized patients with
constant feedback is essential. It is especially important to get students’ perspectives immediately
following their encounters with standardized patients. In the literature, there is no scale for
use by students to evaluate the performance of standardized patients. Thus, the three main
goals of this study were to: (1) develop a scale for use by students to evaluate the performance
of standardized patients, (2) examine the psychometric properties of the scale, and (3) determine
a cut-off score for the scale in a standard-setting
Materials and methods: Seven hundred and two medical students participated in the scaledevelopment
process, the pilot test, and the validation process, and seven educators took part
in the standard-setting process. After the evaluation of content validity, construct validity was
assessed via exploratory and confirmatory factor analyses. For the standard-setting study, the
extended Angoff method was used.
Results: The exploratory factor analysis revealed that the scale had a single-factor structure,
which was confirmed by confirmatory factor analysis. The Cronbach’s alpha internal consistency
coefficient was 0.91. The scale consists of nine items. The cut-off score was determined to be
24.11/45, which represents the minimum acceptable standard for standardized patient
performance.
Conclusions: Our study outlined the critical steps in developing a measurement tool and produced
a valid and reliable scale that allows medical students to assess the performance of
standardized patients immediately following their interaction with the standardized patient. This
scale constitutes an important contribution to the literature as it provides a tool for standardized
patient trainers to assess standardized patients’ weaknesses and help them improve their
performance.
in the effectiveness of clinical skills education. Therefore, providing standardized patients with
constant feedback is essential. It is especially important to get students’ perspectives immediately
following their encounters with standardized patients. In the literature, there is no scale for
use by students to evaluate the performance of standardized patients. Thus, the three main
goals of this study were to: (1) develop a scale for use by students to evaluate the performance
of standardized patients, (2) examine the psychometric properties of the scale, and (3) determine
a cut-off score for the scale in a standard-setting
Materials and methods: Seven hundred and two medical students participated in the scaledevelopment
process, the pilot test, and the validation process, and seven educators took part
in the standard-setting process. After the evaluation of content validity, construct validity was
assessed via exploratory and confirmatory factor analyses. For the standard-setting study, the
extended Angoff method was used.
Results: The exploratory factor analysis revealed that the scale had a single-factor structure,
which was confirmed by confirmatory factor analysis. The Cronbach’s alpha internal consistency
coefficient was 0.91. The scale consists of nine items. The cut-off score was determined to be
24.11/45, which represents the minimum acceptable standard for standardized patient
performance.
Conclusions: Our study outlined the critical steps in developing a measurement tool and produced
a valid and reliable scale that allows medical students to assess the performance of
standardized patients immediately following their interaction with the standardized patient. This
scale constitutes an important contribution to the literature as it provides a tool for standardized
patient trainers to assess standardized patients’ weaknesses and help them improve their
performance.