Mitchell 2013
Mitchell 2013
Mitchell 2013
Abstract. Background: The role of environment in infection prevention and control is being increasingly
acknowledged. However, gaps remain between what is promoted as best practice in the literature and what is occurring
in healthcare settings. In part, this is due to a lack of generally accepted scientific standards, further confounding the
ability to demonstrate an undisputed role for the healthcare environment in healthcare-acquired infections (HAIs).
Evaluating environmental cleanliness in a standardised format is required, in order to enable a framework for
performance management and provide a method by which interventions can be evaluated. Standardised assessment
would provide reliable data to support quality-improvement activities and to ensure that healthcare staff have relevant
and useful information to inform and adapt practice.
Methods: This integrative literature review describes approaches to assessing environmental cleanliness. A search
of the published literature was undertaken, in combination with a targeted review of the grey literature.
Results: Four methods for assessing environmental cleanliness were identified: visual inspection, fluorescent gel
marker, adenosine triphosphate (ATP) and microbial cultures. Advantages and disadvantages for each are explored.
Conclusion: Methods that evaluate cleaning performance are useful in assessing adherence to cleaning protocols,
whereas methods that sample bio-burden provide a more relevant indication of infection risk. Fast, reproducible, cost-
effective and reliable methods are needed for routine environmental cleaning evaluation in order to predict timely
clinical risk.
Received 26 October 2012, accepted 19 December 2012, published online 27 February 2013
Journal compilation Ó Australasian College for Infection Prevention and Control 2013 www.publish.csiro.au/journals/hi
24 Healthcare Infection B. G. Mitchell et al.
through this process was reviewed by two researchers. typically passing between 17–93% more surfaces as ‘clean’
Information obtained via the grey literature search and from than other assessment methods.
phone interviews was summarised. Where information was
obtained via a phone interview, the researchers provided the Fluorescent gel marker
interviewee with a summary of the extracted key points to This method employs an invisible transparent gel that
ensure their views were accurately reported. dries on surfaces and resists dry abrasion, but is easily
removed with light abrasion after wetting. The gel is visible
Results only under ultraviolet (UV) light so thoroughness of cleaning
A total of 124 published articles were reviewed. These can be determined by using UV illumination for sites where
described methods for assessing both the efficacy of cleaning the gel was applied before cleaning (Fig. 1). We identified
and the extent of environmental contamination in the studies that used this method to assess the thoroughness of
hospital environment. Methods for assessing environmental routine hospital cleaning and the subsequent effect of cleaning
cleanliness were assessed as one of two main types: process interventions.19,29,38–42
evaluation, where the cleaning process is monitored by visual The fluorescent gel method demonstrates frequent lack of
inspection or by using a fluorescent gel marker; and outcome attention to high-risk surfaces in the near-patient zone.
evaluation, where cleanliness is evaluated with the use of Targeting objects and their subsequent evaluation following
adenosine triphosphate (ATP) or microbial cultures.13 We cleaning has been shown to take less than two minutes per
present the findings within these two categories in conjunction room for each activity, permitting cleaning evaluation to be
with a summary of current Australian and international undertaken on a large scale.38
practices.
Outcome evaluation
Process evaluation Adenosine triphosphate bioluminescence
Visual inspection The measurement of ATP is the first of two methods
The primary method for assessing the cleanliness of commonly employed for sampling bio-burden in the hospital
healthcare environments is visual inspection.33 Visual environment. Sampling a surface for ATP measures the
inspection detects visible dirt, dust, rubbish, stains, soiling amount of organic soil present. This method uses a specialised
and moisture. Environmental cleanliness audits reliant upon swab to sample a standardised area. The swabs are placed in a
visual inspection are generally undertaken by environmental detection device that uses the firefly enzyme and substrate
cleaning staff, and the effectiveness of these is intermittently luciferase and luciferan, respectively, to catalyse a reaction
assessed by healthcare professionals such as infection control with ATP. Light output from the reaction is proportional to
staff or trained monitoring consultants.30,31 the amount of ATP present, and can be measured with a
We identified quantitative studies that compared the luminometer (measured in relative light units or RLUs)
performance of visual assessments with results from (Fig. 2). While considerable variation can occur among
microbial swabbing or ATP assays in the healthcare readouts34,43 and in the sensitivity of commercially available
environment.23,33–37 In these six studies, visual assessment systems,44 very low readings are typically associated with low
was reported to perform poorly at identifying microbial load, aerobic colony counts (ACC) on surfaces.45
Fig. 1. Examples of a fluorescent marker. Note: Pictures of the DAZO Fluorescent Marking Gel and UV Light pen
are used with permission from Ecolab.
26 Healthcare Infection B. G. Mitchell et al.
Fig. 2. Example of an ATP bioluminescence system. Note: Pictures of the 3M Clean-Trace system are used with permission
from FOSS.
Adenosine triphosphate measurement has been used to sample surfaces, and the choice of sampling method will
evaluate cleanliness of food preparation surfaces for over affect microbial colony counts. Dipslides have been evaluated
30 years.13,33 It is increasingly used in studies of hospital as having superior sensitivity and consistency, particularly
surface contamination where ATP data is gathered in for dry surfaces, while swabs will not always accurately
addition to microbial swabbing, either to evaluate cleaning detect surface bio-burden and may retain bacteria within the
performance or to test the success of a cleaning swab bud itself52–54 Finally, there is an airborne component
intervention.23–25,33–36,43,45,46 of infection risk in a ward and this can often be overlooked
Adenosine triphosphate measurements provide in environmental sampling studies. Settle plates and air
quantification of organic material collected from a swab, samplers have been used to measure airborne contamination
including viable bacteria, but also including non-viable caused by floor mopping and bed making, as well as routine
bacteria and organic debris such as food and liquids such cleaning.55–57
as milk, blood or urine.34 Thus, an ATP result represents a In today’s hospitals, environmental sampling typically
quantitative indicator of all of these. However, it is possible targets a range of surfaces within wards or work stations as
to distinguish the ratio of microbial to non-microbial well as equipment. It involves the use of swabs or dipslides to
components of an ATP measurement by enzymatic removal culture organisms in order to gain a quantitative colony count
of non-bacterial ATP before the assay. Studies that have and/or to detect the presence of specific bacteria. This type of
done this calculated that 33% of the ATP load was attributable investigation is generally only recommended as part of an
to microbial organisms.33,47 ongoing outbreak investigation, as a research study, or as
For this reason, ATP measurements illustrate low part of policy or process evaluation because the time taken to
sensitivity and specificity in detecting bacteria, with one study enumerate microbial counts or identify pathogens may be at
finding that one ATP measurement system had a sensitivity least two days, and requires specific expertise as well as
and specificity of just 57%.43 ATP measurements can also access to a microbiology laboratory.31,58
be compromised by factors such as residual detergents or
disinfectants including sodium hypochlorite,48,49 eroded Costs
surfaces,33 plasticisers found in microfibre cloths or
ammonium compounds found in laundry products.50 These We estimated costs of three of the assessment methods –
factors may all impact on ATP readings.34 fluorescent gel marker, ATP and microbiological sampling.
The costs were based on a 350 bed hospital with an
assumption that 10% of hospital beds would be sampled per
Microbial methods quarter, with 6 high-touch areas screened around individual
Microbial methods for evaluating environmental cleaning beds. This equates to 140 bed areas assessed per annum with
have long been used to evaluate surface contamination 840 high-touch areas sampled. Costs were sought from the
and have been employed in hospitals to assess surface manufacturers of the fluorescent gel marker and ATP as
cleanliness.51 Through the late 1950s and 1960s, well as via an Australian microbiology laboratory which
microbiological sampling was common practice as part of is National Association of Testing Authorities (NATA)
on-going hospital monitoring programs and accordingly, accredited to assess environmental surface swabs.
colony counts, Rodac plate counts, and quantitative air The complete fluorescent gel marker system included
sampling were all routinely used in the hospital environment, initial set-up costs, direct data-entry devices, reporting
including screening of inanimate objects13,51 Swabs, software with the gel markers and UV lights. The kit cost
dipslides, sampling sponges and settle plates may all be used to approximately A$9500 for the first year, with costs decreasing
Methods to evaluate environmental cleanliness Healthcare Infection 27
by approximately A$1300 to $A8200 per annum for A review of the literature demonstrates that benefits and
subsequent years. This cost could be reduced to approximately limitations exist for all methods of environmental cleaning
A$900 per annum if gel markers and UV lights only are evaluation. These are summarised in Table 1.
purchased and the training and development of a reporting
matrix was done in-house with costs absorbed by the Discussion
organisation. The initial set-up costs of the ATP system were
Increasing focus on methods for quantitative assessment of
calculated to be approximately A$10 000 with a per annum
cleanliness in hospital environments has highlighted many of
running cost of around $A5000. Again these costs do not
the shortcomings of visual assessment. These studies reiterate
include any software and are only calculated using the costs
that a visual appraisal of cleanliness is not a proxy for adequate
of ATP swabs and luminometer. Microbiological methods
decontamination. While visual assessment of the cleanliness
had a range of costs depending on whether non-selective or
of a hospital ward, surface or item may satisfy aesthetic
selective plates were used, and/or settle plates and/or diluent
obligations, it cannot reliably assess the infection risk posed
methods were used. Estimated costs of A$6300–A$11 620 per
to patients.28 It is the cheapest and quickest of all methods
annum also includes the reporting fee.
described in this report however, requiring less training and
fewer personnel than other methods. As a means of measuring
Australian practices the efficacy of hospital cleaning and personnel performance,
The most commonly used method for assessing visual inspection has its merits as it is the only method that
environmental cleaning within Australian healthcare can quickly assess a large number of surfaces for gross
facilities is visual assessment with a variety of methods deficiencies in a hospital ward that may harbour pathogens.
and programs in use. No jurisdictions routinely use any As with visual assessment, the fluorescent gel method
alternative methodologies such as fluorescent markers, evaluates cleaning performance rather than environmental
ATP bioluminescence or microbial counts for assessing contamination per se and relies upon the assumption that
environmental cleanliness. improved cleaning procedures can reduce environmental
sources of pathogens and thus risk of microbial
transmission.22,61 Furthermore the fluorescent gel method
Local and international guidelines can provide a more standardised approach to process
Routine environmental sampling is not recommended as evaluation compared with visual inspection. Addressing
part of the Australia National Health and Medical Research cleaning performance remains a vital step in the evaluation of
Council guidelines owing to the limitations of the methods environmental cleaning and the use of a fluorescent marking
available. Thus, cleaning audits are mainly carried out via system to monitor cleaning can provide an effective method
visual assessment. A role for environmental sampling may be to accomplish this.
considered in the management of a specific situation.31 The benefits of using ATP measurements to evaluate
In the United Kingdom, a self-assessment framework hospital cleanliness are speed of data collection,35 ease of
known as the Patient Environment Action Team (PEAT) was use36 and the facility to benchmark.
used in all hospitals with more than 10 beds. One component Limitations of ATP measurement systems are found in
of this benchmarking tool enabled hospitals to perform both the propensity of systems to produce false positives, and
an annual assessment of environmental cleanliness. The in the ability of the system to produce consistent results for
cleanliness of both the hospital environment and clinical and all sampling assessments and surfaces. In addition, the low
non-clinical equipment was visually assessed. The results of sensitivity and specificity along with the wide range of
the annual audit could then be benchmarked with the aim factors that can compromise ATP measurements could be
of improving non-clinical services. Each year, a proportion considered to be too unreliable to justify stringent monitoring
of PEAT assessments were validated by an independent using this method alone.
member.59 In January 2012, a replacement for the PEAT Microbiological evaluation of hospital surfaces provides
program was proposed. The development of a patient- lead the most accurate indication of infection risk of all the methods
inspection program is currently underway to replace the discussed because it can detect and quantify viable bacteria
PEAT program. The National Institute for Health and Clinical and fungi. Reasons for not advocating microbiological
Excellence also has a quality-improvement statement for evaluations in all situations centre on the time and resources
environmental cleanliness.60 required to process conventional microbiological cultures.
In the United States of America, the Healthcare Infection While microbiological methods can produce results with
Control Practices Advisory Committee (HICPAC) Guidelines high specificity, sampling techniques have varied sensitivity
for Environmental Infection Control in Health-Care Facilities and often underestimate bio-burden on a surface, thereby
do not outline any specific methodology for assessing hindering accurate assessments of surface contamination
environmental cleanliness, but they do recommend limiting and study comparability.34
microbiological sampling for use in quality assurance A limiting factor for all of the assessment methods studied
purposes, epidemiological investigations or for research is the cost. None of the methods are particularly cheap but
purposes.58 savings could be made if the testing protocol and reporting
28 Healthcare Infection B. G. Mitchell et al.
Advantages DisadvantagesA
Assessing performance
Visual inspection Ease of use for large areas (wards, rooms) Subjective
Can be done with minimal training Does not assess bio-burden
Benchmarking possible Does not correlate with bio-burden
Simple and inexpensive Can be confounded by clutter, fabric deficits and odours
Fluorescent gel Quick Does not assess bio-burden
Provides immediate feedback on performance Could be labour intensive as surfaces must be marked
before cleaning and checked post cleaning
Minimal training required Potentially costly
Objective Emphasis on easily visible non-high-touch
surfaces (walls, floors)
Benchmarking possible
Assessing outcome
Adenosine Quick Expensive
triphosphate
bioluminescence
Provides immediate feedback Low sensitivity and specificity
Minimal training required No current standardisation of tests
Objective Variable benchmarks
Technology constantly changing
Microbial cultures High sensitivity and specificity Expensive
Objective Prolonged time for results
Can identify screened pathogen Requires accessible laboratory resources and trained
personnel for interpreting results
Provides quantitative data Not supported for routine use by local
and international guidelines
May suggest or confirm environmental Few laboratories NATA accredited to perform
reservoir(s) and/or source of outbreak these tests
Relies on standardised benchmark to assess infection risk
A
Disadvantages of all of these methods include requiring feedback to cleaners, the fact that they may lose impact over time and that they need to be linked
with formal performance indicators.
matrix are done in-house. This was particularly noticeable in standardised format is required, to enable a framework for
the fluorescent gel system where a substantial sum of money performance management and provide a method by which
could be saved by using in-house devised reporting systems. interventions can be evaluated.
Evaluating environmental cleanliness in a standardised
format is required, in order to enable a framework for Conflict of interest
performance management and provide a method by which
interventions can be evaluated. Standardised assessment One of the authors has an editorial affiliation with the journal.
would provide reliable data to support quality improvement This author play no part whatsoever in the review process.
activities and to ensure that healthcare staff have relevant
and useful information to inform and adapt practice. We need Funding
a definition for ‘clean’ which relates to clinical risk for patients No funding was received in relation to this article.
in healthcare facilities.
Acknowledgements
Conclusion
The authors would like to acknowledge the following personnel for their input
There are four main methods used to evaluate environmental and assistance in this obtaining data for this paper: Executive Directors of
cleanliness in healthcare facilities – ATP bioluminescence, Nursing and infection control units in Tasmania; Fiona Kimber, Infection
microbiological methods, visual inspection and gel markers. Control Department, Canberra Hospital; Ronald Govers, Project Officer,
Each of these methods has advantages and limitations. Healthcare Associated Infections, Clinical Excellence Commission, NSW
Methods that evaluate cleaning performance are useful in Ministry of Health; Tain Gardiner, Infection Control Unit, Darwin Hospital;
assessing adherence to cleaning protocols, whereas methods Irene Wilkinson, Infection Control Service Manager, SA Health; Fiona
Fullerton, Nursing Director, Infection Prevention and Control, CHRISP,
that sample bio-burden provide a more relevant indication of Queensland Health; Rebecca McCann, Infection Control HISWA; Mary-
infection risk. Fast, reproducible, cost-effective and reliable Rose Godsell, Nurse Consultant, Infection Prevention, WACHS; Allison
methods are needed for routine environmental cleaning Peterson, Infection Control Nurse, HISWA, Healthcare Associated Infection
evaluation in order to predict timely clinical risk. Further, a Unit.
Methods to evaluate environmental cleanliness Healthcare Infection 29
37. Malik RE, Cooper RA, Griffith CJ. Use of audit tools to evaluate patient room hygiene? J Hosp Infect 2010; 74(2): 193–5. doi:10.1016/
the efficacy of cleaning systems in hospitals. Am J Infect Control 2003; j.jhin.2009.10.006
31(3): 181–7. doi:10.1067/mic.2003.34 51. McGowan JE Jr. Environmental factors in nosocomial infection: a
38. Carling PC, Briggs JL, Perkins J, Highlander D. Improved cleaning selective focus. Rev Infect Dis 1981; 3(4): 760–9. doi:10.1093/clinids/
of patient rooms using a new targeting method. Clin Infect Dis 2006; 3.4.760
42(3): 385–8. 52. Moore G, Griffith C. A comparison of surface sampling methods for
39. Carling PC, Parry MM, Rupp ME, Po JL, Dick B, Von Beheren S. detecting coliforms on food contact surfaces. Food Microbiol 2002;
Improving cleaning of the environment surrounding patients in 36 19(1): 65–73. doi:10.1006/fmic.2001.0464
acute care hospitals. Infect Control Hosp Epidemiol 2008; 29(11): 53. Moore G, Griffith C, Fielding L. A comparison of traditional and
1035–41. doi:10.1086/591940 recently developed methods for monitoring surface hygiene within the
40. Carling PC, Von Beheren S, Kim P, Woods C. Intensive care unit food industry: a laboratory study. Dairy, Food and Environmental
environmental cleaning: an evaluation in sixteen hospitals using a Sanitation 2001; 21(6): 478–88.
novel assessment tool. J Hosp Infect 2008; 68(1): 39–44. doi:10.1016/ 54. Obee P, Griffith CJ, Cooper RA, Bennion NE. An evaluation of
j.jhin.2007.09.015 different methods for the recovery of meticillin-resistant
41. Goodman ER, Platt R, Bass R, Onderdonk AB, Yokoe DS, Huang SS. Staphylococcus aureus from environmental surfaces. J Hosp Infect
Impact of an environmental cleaning intervention on the presence of 2007; 65(1): 35–41. doi:10.1016/j.jhin.2006.09.010
methicillin-resistant Staphylococcus aureus and vancomycin-resistant 55. Andersen BM, Rasch M, Kvist J, Tollefsen T, Lukkassen R, Sandvik L,
enterococci on surfaces in intensive care unit rooms. Infect Control et al. Floor cleaning: effect on bacteria and organic materials in
hospital rooms. J Hosp Infect 2009; 71(1): 57–65. doi:10.1016/
Hosp Epidemiol 2008; 29(7): 593. doi:10.1086/588566
j.jhin.2008.09.014
42. Murphy CL, Macbeth DA, Derrington P, Gerrard J, Faloon J, Kenway
56. Sexton T, Clarke P, O’Neill E, Dillane T, Humphreys H.
K, et al. An assessment of high touch object cleaning thoroughness
Environmental reservoirs of methicillin-resistant Staphylococcus
using a fluorescent marker in two Australian hospitals. Healthc Infect
aureus in isolation rooms: correlation with patient isolates and
2011; 16(4): 156–63. doi:10.1071/HI11024
implications for hospital hygiene. J Hosp Infect 2006; 62(2): 187–94.
43. Mulvey D, Redding P, Robertson C, Woodall C, Kingsmore P,
doi:10.1016/j.jhin.2005.07.017
Bedwell D, et al. Finding a benchmark for monitoring hospital
57. Shiomori T, Miyamotoy H, Makishima K, Yoshida M, Fujiyoshi T,
cleanliness. J Hosp Infect 2011; 77: 25–30. doi:10.1016/j.jhin.2010.
Udaka T, et al. Evaluation of bedmaking-related airborne and surface
08.006
methicillin-resistant Staphylococcus aureus contamination. J Hosp
44. Simpson J, Archibald L, Giles CJ. Repeatability of hygiene test
Infect 2002; 50: 30–5. doi:10.1053/jhin.2001.1136
systems in measurement of low levels of ATP. Cara Technology Ltd 58. Sehulster L, Chinn RY, Arduino MJ, Carpenter J, Donlan R, Ashford
Report 30606, 27 July 2006. D. et al. Guidelines for environmental infection control in health-care
45. Aycicek H, Oguz U, Karci K. Comparison of results of ATP facilities. Recommendations from CDC and the Healthcare Infection
bioluminescence and traditional hygiene swabbing methods for the Control Practices Advisory Committee (HICPAC). Chicago, IL:
determination of surface cleanliness at a hospital kitchen. Int J Hyg American Society for Healthcare Engineering/American Hospital
Environ Health 2006; 209(2): 203–6. doi:10.1016/j.ijheh.2005.09.007 Association; 2004.
46. Malik RE, Cooper RA, Griffith CJ. Use of audit tools to evaluate 59. Patient Environment Action Team (PEAT) – 2012 results, England.
the efficacy of cleaning systems in hospitals. Am J Infect Control 2003; Leeds, UK: National Health and Social Care Information Centre; 2012.
31(3): 181–7. doi:10.1067/mic.2003.34 Available online at: https://catalogue.ic.nhs.uk/publications/patient/
47. Vanne L, Karwoski M, Karppinen S, Sjöberg AM. HACCP-based food facilities/pat-envi-acti-team-res-eng-2012/pat-envi-acti-team-res-eng-
quality control and rapid detection methods for microorganisms. Food 2012-rep.pdf [verified 6 February 2013].
Contr 1996; 7(6): 263–76. doi:10.1016/S0956-7135(96)00064-3 60. National Institute for Health and Clinical Excellence. Prevention and
48. Green TA, Russell SM, Fletcher DL. Effect of chemical cleaning control of healthcare-associated infections: Quality improvement
agents and commercial sanitizers on ATP bioluminescence guide. NICE public health guidance 36. London: National Institute for
measurements. J Food Prot 1999; 62(1): 86–90. Health and Clinical Excellence; 2011.
49. Boyce JM, Havill NL, Lipka A, Havill H, Rizvani R. Variations 61. Eckstein BC, Adams DA, Eckstein EC, Rao A, Sethi AK, Yadavalli
in hospital daily cleaning practices. Infect Control Hosp Epidemiol GK, et al. Reduction of Clostridium difficile and vancomycin-resistant
2010; 31(1): 99. doi:10.1086/649225 Enterococcus contamination of environmental surfaces after an
50. Brown E, Eder AR, Thompson KM. Do surface and cleaning intervention to improve cleaning methods. BMC Infect Dis 2007; 7(1):
chemistries interfere with ATP measurement systems for monitoring 61. doi:10.1186/1471-2334-7-61
www.publish.csiro.au/journals/hi