External quality assessment

External quality assessment ('EQA), or external quality assessment schemes(EQAS) is a challenge of the effectiveness of a laboratory's quality management system, typically referring specifically to medical laboratories. The term external refers to the fact that the laboratory's results are assessed by a third party. The most common EQA process is proficiency testing, in which an organization sends samples to a group of different laboratories and results are compared among the group. Retesting of the same sample by different laboratories and on-site visits to evaluate laboratory processes may also be part of an EQA scheme.^[1]

Organization

Typically, an EQA scheme consists of several rounds per year. In each round participants receive test items, which are also called samples. The EQA organizer is also called the provider. The organizer ensures that the test items are sufficiently similar and homogeneous. The test items' properties and analyte concentrations are not disclosed to participants before the final report. The participants' results are then compared to check if any participant had a bias towards e.g. higher values, or an unexpected imprecision. At the end of each round, the EQA organizer sends out reports and/or certificates to the participating laboratories.^[2]

Accreditation

Laboratories are often accredited for ISO 17025 and ISO 15189 compliance. Internationally, the International Laboratory Accreditation Cooperation establishes global recognition of these standards. Locally, conformance with ISO standards is checked by accreditation bodies. These often mandate, but always encourage laboratories to participate in EQA schemes.

Typically, EQA scheme organizers are accredited according to the ISO 17043 standard.

Motivation

EQA or proficiency testing is different from quality assurance which, in a laboratory setting, is the total process whereby the quality of laboratory results can be guaranteed. This is because relying solely on the lab-internal quality management can create a false sense of safety.

Laboratories are instructed to treat proficiency testing samples in the same way as normal patient samples.^[1] For a laboratory, gaining and keeping the ISO 17025 accreditation status is of high commercial importance. For this reason, laboratory employees might treat EQA test items differently.^[3]

There are several ways in which PT samples may be given ‘special’ treatment. They may be handled by more experienced staff than those who examine typical routine samples, subjected to more rigorous checking procedures than normal, or results and information from other participants (collusion) may be sought before reporting. These practices must be discouraged by laboratory management. If the scheme organizers suspect collusion then the laboratories concerned will be contacted.

Statistics & scoring

In most EQA schemes, laboratories receive scores for their results. The most popular score is the Z-score, also called standard deviation index (SDI). The score is given per analyte and per test item.^[4]

Available schemes

PT/EQA is of paramount importance in food, water and medical testing where the impact of incorrect results can impact on people's health. Many countries have organisations with a government remit to protect people's health such as the Health Protection Agency in the United Kingdom.

Other very important sectors are mining: Ore value estimation is very important commercially, therefore its reliance is usually proven by laboratories with their participation in EQA schemes.

A wide range of global EQA schemes or proficiency testing schemes for laboratories are listed in the online database EPTIS, which is operated by the German Federal Institute for Materials Research.

References

^ ^a ^b World Health Organization (2 November 2009). "Overview of External Quality Assessment (EQA)" (PDF).
^ Miller, W Greg; Jones, Graham RD; Horowitz, Gary L; Weykamp, Cas (1 December 2011). "Proficiency Testing/External Quality Assessment: Current Challenges and Future Directions". Clinical Chemistry. 57 (12): 1670–1680. doi:10.1373/clinchem.2011.168641.
^ "Assessments and External Quality Assurance" (PDF). National Health Laboratory Service (South Africa). Archived from the original (PDF) on 5 March 2016. Retrieved 29 August 2015.
^ Kottke-Marchant, K; Davis, B (2012). Laboratory Hematology Practice (1 ed.). John Wiley & Sons. p. 701. ISBN 978-1-4443-9857-1.

[WHO-1] World Health Organization (2 November 2009). "Overview of External Quality Assessment (EQA)" (PDF).

[2] Miller, W Greg; Jones, Graham RD; Horowitz, Gary L; Weykamp, Cas (1 December 2011). "Proficiency Testing/External Quality Assessment: Current Challenges and Future Directions". Clinical Chemistry. 57 (12): 1670–1680. doi:10.1373/clinchem.2011.168641.

[3] "Assessments and External Quality Assurance" (PDF). National Health Laboratory Service (South Africa). Archived from the original (PDF) on 5 March 2016. Retrieved 29 August 2015.

[kottke-4] Kottke-Marchant, K; Davis, B (2012). Laboratory Hematology Practice (1 ed.). John Wiley & Sons. p. 701. ISBN 978-1-4443-9857-1.

[1]

[2]

[3]

[4]