LQMS 6 7 8 Quality Control
LQMS 6 7 8 Quality Control
LQMS 6 7 8 Quality Control
Process control—
introduction to
quality control
6-1: Introduction
Role in quality Process control is an essential element
management of the quality management system, Organization Personnel Equipment
system and refers to control of the activities
employed in the handling of samples
and examination processes in order
to ensure accurate and reliable testing. Purchasing
Process Information
and
Sample management, discussed in inventory
control management
What is QC? QC is the part of quality management focused on fulfilling quality requirements
(ISO 9000:2000 [3.2.10]). Simply put, it is examining “control” materials of known
substances along with patient samples to monitor the accuracy and precision of the
complete analytic process. QC is required for accreditation purposes.
In 1981, the World Health Organization (WHO) used the term "internal quality
control" (IQC), which it defined as “a set of procedures for continuously assessing
laboratory work and the emergent results”. The terms QC and IQC are sometimes
used interchangeably; cultural setting and country may influence preferences for
these terms.
In the past few years, "internal quality control' has become confusing
in some settings because of the different meanings that have been
associated with the term. Some manufacturers of test kits for qualitative tests have
integrated "built-in" controls in the design of their kits, which they sometimes refer
to as internal controls. Other manufacturers include their own control materials
with the kits they sell and they refer to these as "internal controls", meaning that
the materials are meant specifically for that manufacturer’s kit. Finally, some people
refer to any quality control materials that are used in conjunction with test runs as
IQC, as in the 1981 WHO definition.
To avoid confusion, the term "quality control" will be used here to mean use
of control materials to monitor the accuracy and precision of all the processes
associated with the examination (analytic) phase of testing.
QC for varying Quality control processes vary, depending on whether the laboratory examinations
methods use methods that produce quantitative, qualitative or semiquantitative results.
These examinations differ in the following ways.
Elements of a Regardless of the type of examination that is performed, steps for implementing
QC programme and maintaining a QC programme include:
establishing written policies and procedures, including corrective actions
training all laboratory staff
ensuring complete documentation
reviewing quality control data.
Summary QC is part of the quality management system and is used to monitor the
examination (analytic) phase of testing.
The goal of QC is to detect, evaluate and correct errors due to test system
failure, environmental conditions, or operator performance, before patient
results are reported.
Different QC processes are applied to monitor quantitative, qualitative and
semiquantitative tests.
Because it is more efficient to have controls that last for some months, it is best
to obtain control materials in large quantities.
Types and Control materials are available in a variety of forms. They may be frozen, freeze-
sources of dried or chemically preserved. The freeze-dried or lyophilized materials must be
control material reconstituted, requiring great care in pipetting in order to ensure the correct
concentration of the analyte.
When using either unassayed or “in-house” controls, the laboratory must establish
the target value of the analyte.
The use of in-house controls requires resources to perform validation and testing
steps. An advantage is that the laboratory can produce very large volumes with
exact specifications.
Choosing When choosing controls for a particular method, select values that cover medical
controls decision points, such as one with a normal value, and one that is either high or
low, but in the medically significant range.
Controls are usually available in "high", "normal" and "low" ranges. Shown in the
graphic are normal, abnormal high and low, and critical high and low ranges. For
some assays, it may be important to include controls with values near the low
end of detection.
PATIENT CONTROLS
Critical
? Abnormal C O N TRO L
Critical high
and low range
Normal range
Normal C O N TRO L
Abnormal high
Abnormal
and low ranges
C O N TRO L
Critical
Preparing and When preparing and storing QC materials, it is important to carefully adhere to
storing control the manufacturer’s instructions for reconstituting and storage. If in-house control
material material is used, freeze aliquots and place in the freezer so that a small amount
can be thawed and used daily. Do not thaw and refreeze control material. Monitor
and maintain freezer temperatures to avoid degradation of the analyte in any
frozen control material.
Once the data is collected, the laboratory will need to calculate the mean and
standard deviation of the results. A characteristic of repeated measurements is
that there is a degree of variation. Variation may be due to operator technique,
environmental conditions or the performance characteristics of an instrument.
Some variation is normal, even when all of the factors listed above are controlled.
The standard deviation gives a measure of the variation.This process is illustrated
below.
3 SD
2 SD
1 SD
Calculate mean and Mean
+ 1, 2, 3 standard deviations
1 SD
2 SD
3 SD
the sum of
X1 individual result
Before calculating The purpose of obtaining 20 data points by running the QC sample is to quantify
QC ranges normal variation and establish ranges for QC samples. Use the results of these
measurements to establish QC ranges for testing.
If one or two data points appear to be too high or low for the set of data, they
should not be included when calculating QC ranges. They are called “outliers”.
If there are more than 2 outliers in the 20 data points, there is a problem with
the data and it should not be used.
Identify and resolve the problem and repeat the data collection.
Normal If many measurements are taken, and the results are plotted on a graph, the values
distribution form a bell-shaped curve as the results vary around the mean. This is called a
normal distribution (also termed Gaussian distribution).
The distribution can be seen if data points are plotted on the x-axis and the
frequency with which they occur on the y-axis.
Frequency
number of measurements are plotted. It is
assumed that the types of measurements
used for quantitative QC are normally
distributed based on this theory.
Bias is the difference between the expectation of a test result and an accepted
reference method.
The reliability of a method is judged in terms of accuracy and precision.
Measurements can be precise but not accurate if the values are close together but do not
hit the bull’s eye.These values are said to be biased.The middle figure demonstrates
a set of precise but biased measurements.
Measures of The methods used in clinical laboratories may show different variations about the
variability mean; hence, some are more precise than others. To determine the acceptable
variation, the laboratory must compute the standard deviation (SD) of the 20
control values.This is important because a characteristic of the normal distribution
is that, when measurements are normally distributed:
68.3% of the values will fall within –1 SD and +1 SD of the mean
95.5% fall within –2 SD and +2 SD
99.7% fall between –3 SD and +3 SD of the mean.
Knowing this is true for all normally shaped distributions allows the laboratory to
establish ranges for QC material.
Once the mean and SD are computed for a set of measurements, a QC material
that is examined along with patients' samples should fall within these ranges.
SD = (X1 – X)2
n–1
The number of independent data points (values) in a data set are represented
by “n”. Calculating the mean reduces the number of independent data points to
n – 1. Dividing by n –1 reduces bias.
The values of the mean, as well as the values of + 1, 2 and 3 SDs are needed to
Calculating develop the chart used to plot the daily control values.
acceptable
limits for To calculate 2 SDs, multiply the SD by 2 then add and subtract each result from
the control the mean.
To calculate 3 SDs, multiply the SD by 3, then add and subtract each result from
the mean.
For any given data point, 68.3% of values will fall between + 1 SD, 95.5% between
When only one control is used, we consider an examination run to be “in control”
if a value is within 2 SD of the mean.
Developing In order to develop Levey–Jennings charts for daily use in the laboratory, the
data for Levey– first step is the calculation of the mean and SD of a set of 20 control values as
Jennings charts explained in 7-3.
Levey–Jennings A Levey–Jennings chart can then be drawn, showing the mean value as well as
chart + 1, 2, and 3 SD. The mean is shown by drawing a line horizontally in the middle
of the graph and the SD are marked off at appropriate intervals and lines drawn
horizontally on the graph, as shown below.
196.5 +3 SD
194.5 +2 SD
192.5 +1 SD
190.5 MEAN
188.5 –1 SD
186.5 –2 SD
184.5 –3 SD
Days
Run the control and plot it on the Levey–Jennings chart. If the value is within
+2 SD, the run can be accepted as “in-control”.
196.5 +3 SD
194.5 +2 SD
192.5 +1 SD
190.5 MEAN
188.5 –1 SD
186.5 –2 SD
184.5 –3 SD
Days
The values on the chart are those run on days 1, 2 and 3 after the chart was made.
In this case, the second value is “out of control” because it falls outside of 2 SD.
When using only one QC sample, if the value is outside 2 SD, that run is considered
“out of control” and the run must be rejected.
Number of If it is possible to use only one control, choose one with a value that lies within
controls used the normal range of the analyte being tested. When evaluating results, accept all
runs where the control lies within +2 SD. Using this system, the correct value will
be rejected 4.5% of the time.
In order to improve efficiency and accuracy, a system using two or three controls
for each run can be employed. Then another set of rules can be used to avoid
rejecting runs that may be acceptable. These rules were applied to laboratory
QC by a clinical chemist named James Westgard. This Westgard multirule
system requires running two controls of different target values for each set of
examinations, developing a Levey–Jennings chart for each, and applying the rules.
The use of three controls with each run gives even higher assurance of accuracy
of the test run. When using three controls, choose a low, a normal and a high
range value. There are also Westgard rules for a system with three controls.
Detecting Errors that occur in the testing process may be either random or systematic.
error
With random error, there will be a variation in QC results that show no pattern.
This type of error generally does not reflect a failure in some part of the testing
system, and is therefore not like to reccur. Random error is only a cause for
rejection of the test run if it exceeds +2 SD.
Systematic error is not acceptable, as it indicates some failure in the system that
can and should be corrected. Examples of evidence of systematic error include:
shift—when the control is on the same side of the mean for five consecutive
runs;
trend—when the control is moving in one direction, and appears to be heading
toward an out-of-control value.
Even when a control value falls within 2 SD, it can be a cause for concern. Levey–
Jennings charts can help distinguish between normal variation and systematic
error.
Shifts and Shifts in the mean occur when an abrupt change is followed by six or more
trends consecutive QC results that fall on one side of the mean, but typically within
95% range as if clustered around a new mean. On the sixth occasion this is called
a shift and results are rejected.
Trends occur when values gradually, but continually, move in one direction over
six or more analytical runs. Trends may display values across the mean, or they
may occur only on one side of the mean. On the sixth occasion, this is determined
to be a trend and results are rejected.
The source of the problem must be investigated and corrected before patients’
samples are reported.
But the degree of variation also depends on the method used. Methods that are
more precise have less uncertainty because the amount of variation included in
the 95% limits is smaller.
Laboratories should strive to use methods that have a high degree of precision,
and always follow standard operating procedures.
For quantitative testing, statistical analysis can be used for the monitoring process,
and the use of Levey–Jennings charts provides a very useful visual tool for this
monitoring.
When controls are out of range, corrective action and troubleshooting must be
undertaken; the problem must be fixed before reporting patient results. Therefore,
good protocols for troubleshooting and corrective action are an important part
of the QC process.
Examples of qualitative
examinations include microscopic
examinations for cell morphology
or presence of parasitic organisms,
serologic procedures for presence or
absence of antigens and antibodies,
some microbiological procedures and
some molecular techniques.
quantity of a substance. The difference is that results of these tests are expressed
as an estimate of how much of a measured substance is present. This estimate
is sometimes reported as a number. Therefore, test results for semiquantitative
tests may be shown as “trace amount”, “1+, 2+ or 3+”, or positive at 1:160 (titre
or dilution). Examples of semiquantitative examinations are urine dipsticks, tablet
tests for ketones and serological agglutination procedures.
Examples of test kits with built-in controls are rapid tests that detect the
presence of antigens or antibodies, such as those for infectious disease (human
immunodeficiency virus [HIV], influenza, lyme disease, streptococcal infection,
infectious mononucleosis), drugs of abuse, pregnancy or faecal occult blood.
Even though these built-in controls give some degree of confidence, they do not
monitor for all conditions that could affect test results. It is advisable to periodically
test traditional control materials that mimic patient samples, for added confidence
in the accuracy and reliability of test results.
Traditional control materials are made to mimic patient samples and they are tested
Traditional with the patient samples to evaluate the examination component. Positive controls
controls have known reactivity and negative controls are nonreactive for the analyte being
tested. The controls should have the same composition, or matrix, as patient
samples, including viscosity, turbidity and colour, in order to properly evaluate the
test performance. Control materials are often lyophilized when received, and
need to be carefully reconstituted before use. Some manufacturers may provide
these controls with their test kits but, more frequently, they need to be purchased
separately.
Traditional controls evaluate the testing process more broadly than built-in controls.
They assess the integrity of the entire test system, the suitability of the physical
testing environment (temperature, humidity, level workspace), and whether the
person conducting the test performs it correctly.
Positive and negative controls are recommended for many qualitative and
semiquantitative tests, including some procedures that use special stains or reagents,
and tests with end-points such as agglutination or colour change. These controls
should generally be used with each test run. Use of controls will also help to validate
a new lot number of test kits or reagents, to check on temperatures of storage and
testing areas, and to evaluate the process when new testing personnel are carrying
out the testing.
The following organizations offer reference strains, which are available from local
distributors:
American Type Culture Collection (ATCC)
National Type Culture Collection (NTCC, United Kingdom)
Pasteur Institute Collection (CIP, France).
Purchased reference strains are usually lyophilized and kept in the refrigerator.
Once they are reconstituted, plated and checked for purity, they can be used to
make working cultures for quality control.
Some laboratories may choose to use isolates from their own laboratories for QC.
If so, they should be monitored closely to verify that reactions tested are sustained
over time.
The common elements for QC are the same: the stains should be prepared and
stored properly, and checked to be sure they perform as expected. Remember
that many of the microscopic examinations that rely on stains are critical in
diagnosis of many diseases.
Stain Some stains can be purchased commercially, but others must be prepared by
management the laboratory, following an established procedure. Once stains are made, their
bottles should be labelled with the following information:
name of the stain
concentration
date prepared
date placed in service
expiration date/shelf life
preparer’s initials.
It may be useful to keep a logbook for recording information on each stain in use,
including the lot number and date received. The expiration date must be noted
on the label. Some stains deteriorate and lose their ability to produce the correct
reactions.
Stains should be stored at the correct temperature at all times and in an appropriate
staining bottle. Some stains must be protected from light. In some cases, working
solutions can be made from stock solutions. If so, storage of working solutions
should be carefully monitored.
Quality Because of their importance, stains should be checked each day of use with
control positive and negative QC materials, to make sure their reagents are active and
they provide the intended results. In most cases, positive and negative controls
should be stained with each batch of patients’ slides. All QC results must be
recorded each time they are run.
Stains should also be examined to look for precipitation or crystal formation, and
to check for bacterial contamination. Careful maintenance and care of the stock
and working solutions of stains is an essential component in a system to provide
good quality in microscopic examinations.
Be aware that many stains are toxic, therefore, take appropriate safety
precautions when working with them.
Verifying The performance characteristics of all media used in the laboratory must be
performance verified by the appropriate QC methods. For media that is prepared in-house,
this evaluation must be conducted for each batch prepared; for all commercially
prepared media, the performance verification will be performed for each new lot
number.
In all cases, in-house and purchased media should be carefully checked for:
sterility—incubate overnight before use
appearance—check for turbidity, dryness, evenness of layer, abnormal colour
pH
ability to support growth—using stock organisms
ability to yield the appropriate biochemical results—using stock organisms.
The laboratory must maintain sufficient stock organisms to check all its media
Use of control and test systems. Some examples of important stock organisms, and the media
organisms for checked, include:
verification Escherichia coli (ATCC 25922): MacConkey or eosin methylene blue (EMB),
some antimicrobial susceptibility testing;
Staphylococcus aureus (ATCC 25923): blood agar, mannitol salt and some
antimicrobial susceptibility tests;
Neisseria gonorrhoeae (ATCC 49226): chocolate agar and Thayer–Martin agar.
For selective media, inoculate a control organism that should be inhibited as well
as one that should grow. Discard any batch of media that does not work as
expected.
For differential media, inoculate the media with control organisms that should
demonstrate the required reactions. For example, inoculate both lactose-
fermenting and non-lactose-fermenting organisms onto EMB or MacConkey agar
to verify that the colonies exhibit correct visual appearance.
Note: sheep and horse blood are preferred in preparing media for routine cultures.
Blood agar made from human blood should not be used as it will not demonstrate
the correct haemolysis pattern for identification of certain organisms, and it may
contain inhibitory substances. In addition, human blood can be biohazardous.
In-house media It is important to keep careful records for media that is prepared in the laboratory.
preparation A logbook should be maintained that records:
records date and preparer's name
name of the medium, the lot number and manufacturer
number of prepared plates, tubes, bottles or flasks
assigned lot and batch numbers
color, consistency and appearance
number of plates used for QC
sterility test results at 24 and 48 hours
growth test(s)
pH.
The laboratory must establish a QC programme for all of its qualitative and
semiquantitative tests. In establishing this programme, set policies, train staff and
assign responsibilities, and ensure that all resources needed are available. Make
sure that recording of all QC data is complete, and that appropriate review of
the information is carried out by the quality manager and the laboratory director.
Key messages All staff must follow the QC practices and procedures.
Always record QC results and any corrective actions that are taken.
If QC results are not acceptable, do not report patient results.