Early Switch From Intravenous To Oral Antibiotic Therapy in Patients With Cancer Who Have Low-Risk Neutropenic Sepsis: The Easi-Switch RCT
Early Switch From Intravenous To Oral Antibiotic Therapy in Patients With Cancer Who Have Low-Risk Neutropenic Sepsis: The Easi-Switch RCT
Early Switch From Intravenous To Oral Antibiotic Therapy in Patients With Cancer Who Have Low-Risk Neutropenic Sepsis: The Easi-Switch RCT
DOI 10.3310/RGTP7112
a
Early switch from intravenous to oral antibiotic
therapy in patients with cancer who have low-
risk neutropenic sepsis: the EASI-SWITCH RCT
Corresponding author
*
Disclosure of interests
Full disclosure of interests: Completed ICMJE forms for all authors, including all related interests, are
available in the toolkit on the NIHR Journals Library report publication page at https://doi.org/10.3310/
RGTP7112.
Primary conflicts of interest: Vicky Coyle reports a Cancer Research UK Doctoral Fellowship research
grant that part-supported this submitted work. She also reports research grants from Cancer Research
UK and Astex Pharmaceuticals (UK) as well as personal fees and non-financial support from Servier
Laboratories (France) for attending educational meetings, all unrelated to the submitted work. Richard
Adams reports research grants from AstraZeneca PLC (UK) and Merck Sharp & Dohme Ltd (MSD, UK) as
well as personal fees from Bayer Healthcare Pharmaceuticals LLC (Germany), Amgen Inc. (USA) and
Servier Laboratories and non-financial support for attending meetings from Amgen Inc., Servier
Laboratories and Merck Serono (Switzerland), all unrelated to the submitted work. Ashley Agus reports
membership of the NIHR HTA Programme General Funding Committee. Ian Chau reports grants or
contracts from Janssen-Cilag and Eli Lilly and Company. He also reports personal fees from Eli Lilly and
Company (USA), AstraZeneca PLC, MSD, Merck Serono, Bristol Meyers Squibb Inc. (USA), Bayer
Healthcare Pharmaceuticals LLC, Roche AG (Switzerland), OncXerna (China), Pierre Fabre
Pharmaceuticals Inc. (France), Boehringer Ingelheim (Germany), Incyte Inc. (USA), Astellas Pharma
(Japan), GlaxoSmithKline Ltd (UK), SOTIO (Czech Republic), Eisai (Japan), Five Prime Therapeutics, Inc.
(USA), Symphogen (Denmark) and Servier Laboratories. Mike Clarke reports membership of the NIHR
CRSU Funding Board, NIHR HTA Funding Teleconference Members, NIRH HTA Prioritisation Committee
B Methods Group and NIHR HTA General Committee. Daniel McAuley reports research grants from
NIHR, Innovate UK, Medical Research Council (MRC), Novavax Inc. (USA), the Northern Ireland HSC
R&D Division, and the Wellcome Trust as well as personal fees from Bayer Healthcare Pharmaceuticals
LLC, GlaxoSmithKline Ltd (UK), Boehringer Ingelheim (Germany), Novartis AG (Switzerland) and Eli Lilly
and Company (USA); he also reports non-financial support for attending meetings from Vir
Biotechnology Inc. (USA) and Faron Pharmaceuticals (Finland). He also reports spousal personal fees
from Insmed, Inc. and the California Institute for Regenerative Medicine. Apart from NIHR funding for
this trial, all others listed are unrelated to the submitted work. He is co-director of research for the
Intensive Care Society (UK) and Programme Director of the NIHR/MRC Efficacy & Mechanisms
Evaluation (EME) Programme. He also reports membership of the EME Strategy Advisory Committee,
the EME Funding Committee, the EME Funding Committee Sub-Group: Remit and Competitiveness and
former membership of the NIHR/UKRI COVID-19 reviewing committee and the HTA General
Committee and Commissioning Committees. Ronan McMullan reports research grants from the NIHR
HTA Programme, NIHR EME Programme, Wellcome Trust, NI Chest, Heart & Stroke Association and
Randox Laboratories Ltd (UK), as well as personal fees and non-financial support for attending meetings
from Gilead Sciences Europe Ltd (UK), all unrelated to the submitted work. He is also a member of the
NIHR HTA Programme Prioritisation Committee B. Ruth Plummer reports membership of the NIHR EME
Funding Committee. Caroline Forde, Rosemary Barnes, Annmarie Doran, Margaret Grayson, Cliona
McDowell, Glenn Phair, Dawn Storey, Anne Thomas and Richard Wilson report no competing interests.
Coyle V, Forde C, Adams R, Agus A, Barnes R, Chau I, et al. Early switch from intravenous to
oral antibiotic therapy in patients with cancer who have low-risk neutropenic sepsis: the
EASI-SWITCH RCT. Health Technol Assess 2024;28(14). https://doi.org/10.3310/RGTP7112
Health Technology Assessment
ISSN 2046-4924 (Online)
A list of Journals Library editors can be found on the NIHR Journals Library website
Launched in 1997, Health Technology Assessment (HTA) has an impact factor of 3.6 and is ranked 32nd (out of 105 titles) in the
‘Health Care Sciences & Services’ category of the Clarivate 2022 Journal Citation Reports (Science Edition). It is also indexed
by MEDLINE, CINAHL (EBSCO Information Services, Ipswich, MA, USA), Embase (Elsevier, Amsterdam, the Netherlands), NCBI
Bookshelf, DOAJ, Europe PMC, the Cochrane Library (John Wiley & Sons, Inc., Hoboken, NJ, USA), INAHTA, the British Nursing
Index (ProQuest LLC, Ann Arbor, MI, USA), Ulrichsweb™ (ProQuest LLC, Ann Arbor, MI, USA) and the Science Citation Index
Expanded™ (Clarivate™, Philadelphia, PA, USA).
This journal is a member of and subscribes to the principles of the Committee on Publication Ethics (COPE)
(www.publicationethics.org/).
Reviews in Health Technology Assessment are termed ‘systematic’ when the account of the search appraisal and synthesis
methods (to minimise biases and random errors) would, in theory, permit the replication of the review by others.
HTA programme
Health Technology Assessment (HTA) research is undertaken where some evidence already exists to show that a technology can
be effective and this needs to be compared to the current standard intervention to see which works best. Research can evaluate
any intervention used in the treatment, prevention or diagnosis of disease, provided the study outcomes lead to findings that
have the potential to be of direct benefit to NHS patients. Technologies in this context mean any method used to promote health;
prevent and treat disease; and improve rehabilitation or long-term care. They are not confined to new drugs and include any
intervention used in the treatment, prevention or diagnosis of disease.
The journal is indexed in NHS Evidence via its abstracts included in MEDLINE and its Technology Assessment Reports inform
National Institute for Health and Care Excellence (NICE) guidance. HTA research is also an important source of evidence for
National Screening Committee (NSC) policy decisions.
This manuscript
The research reported in this issue of the journal was funded by the HTA programme as award number 13/140/05. The
contractual start date was in October 2015. The draft report began editorial review in September 2021 and was accepted for
publication in October 2022. The authors have been wholly responsible for all data collection, analysis and interpretation, and for
writing up their work. The HTA editors and publisher have tried to ensure the accuracy of the authors’ manuscript and would like
to thank the reviewers for their constructive comments on the draft document. However, they do not accept liability for damages
or losses arising from material published in this manuscript.
This manuscript presents independent research funded by the National Institute for Health and Care Research (NIHR). The views
and opinions expressed by authors in this publication are those of the authors and do not necessarily reflect those of the NHS,
the NIHR, the HTA programme or the Department of Health and Social Care. If there are verbatim quotations included in this
publication the views and opinions expressed by the interviewees are those of the interviewees and do not necessarily reflect
those of the authors, those of the NHS, the NIHR, the HTA programme or the Department of Health and Social Care.
Copyright © 2024 Coyle et al. This work was produced by Coyle et al. under the terms of a commissioning contract issued by
the Secretary of State for Health and Social Care. This is an Open Access publication distributed under the terms of the Creative
Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction and adaptation in any medium
and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the
title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
Published by the NIHR Journals Library (www.journalslibrary.nihr.ac.uk), produced by Newgen Digitalworks Pvt Ltd, Chennai, India
(www.newgen.co).
DOI: 10.3310/RGTP7112 Health Technology Assessment 2024 Vol. 28 No. 14
Abstract
1
Patrick G Johnston Centre for Cancer Research, Queen’s University Belfast, Belfast, UK
2
Centre for Trials Research – Cancer Division, Cardiff University, Cardiff, UK
3
Northern Ireland Clinical Trials Unit, Belfast Health and Social Care Trust, Belfast, UK
4
School of Medicine, Cardiff University, Cardiff, UK
5
Department of Medicine, Royal Marsden Hospital, Surrey, UK
6
Centre for Public Health, Queens University Belfast, Belfast, UK
7
Northern Ireland Cancer Research Consumer Forum, Belfast Health and Social Care Trust, Belfast, UK
8
Wellcome-Wolfson Institute for Experimental Medicine, Queens University Belfast, Belfast, UK
9
Translational and Clinical Research Institute, Newcastle University, Newcastle upon Tyne, UK
10
The Beatson West of Scotland Cancer Centre, Gartnavel General Hospital, Glasgow, UK
11
Leicester Cancer Research Centre, University of Leicester, Leicester, UK
12
Institute of Cancer Sciences, University of Glasgow, Glasgow, UK
Copyright © 2024 Coyle et al. This work was produced by Coyle et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care.
This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction vii
and adaptation in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the title, original
author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
Abstract
Main outcome measures: Treatment failure, a composite measure assessed at day 14 based on the
following criteria: fever persistence or recurrence within 72 hours of starting intravenous antibiotics;
escalation from protocolised antibiotics; critical care support or death.
Results: The study was closed early due to under-recruitment with 129 patients recruited; hence, a
definitive conclusion regarding non-inferiority cannot be made. Sixty-five patients were randomised to
the early switch arm and 64 to the standard care arm with subsequent intention-to-treat and per-
protocol analyses including 125 (intervention n = 61 and control n = 64) and 113 (intervention n = 53
and control n = 60) patients, respectively. In the intention-to-treat population the treatment failure rates
were 14.1% in the control group and 24.6% in the intervention group, difference = 10.5% (95%
confidence interval 0.11 to 0.22). In the per-protocol population the treatment failure rates were 13.3%
and 17.7% in control and intervention groups, respectively; difference = 3.7% (95% confidence interval
0.04 to 0.148). Treatment failure predominantly consisted of persistence or recurrence of fever and/or
physician-directed escalation from protocolised antibiotics with no critical care admissions or deaths.
The median length of stay was shorter in the intervention group and adverse events reported were
similar in both groups. Patients, particularly those with care-giving responsibilities, expressed a
preference for early switch. However, differences in health-related quality of life and health resource use
were small and not statistically significant.
Conclusions: Non-inferiority for early oral switch could not be proven due to trial under-recruitment.
The findings suggest this may be an acceptable treatment strategy for some patients who can adhere to
such a treatment regimen and would prefer a potentially reduced duration of hospitalisation while
accepting increased risk of treatment failure resulting in re-admission. Further research should explore
tools for patient stratification for low-risk de-escalation or ambulatory pathways including use of
biomarkers and/or point-of-care rapid microbiological testing as an adjunct to clinical decision-making
tools. This could include application to shorter-duration antimicrobial therapy in line with other
antimicrobial stewardship studies.
Trial registration: This trial is registered as ISRCTN84288963.
Funding: This award was funded by the National Institute for Health and Care Research (NIHR)
Health Technology Assessment programme (NIHR award ref: 13/140/05) and is published in full in
Health Technology Assessment; Vol. 28, No. 14. See the NIHR Funding and Awards website for further
award information.
viii
Contents
List of tables xiii
List of figures xv
Chapter 1 Introduction 1
Neutropenic sepsis 1
Empirical management of NS 1
Risk stratification 2
Oral antibiotic therapy as treatment 3
Outpatient management of low-risk NS 3
Rationale for the trial 4
Acute oncology service development 4
Chapter 2 Methods 5
Trial design 5
Trial objectives 5
Primary objective 5
Secondary objectives 5
Research hypotheses 6
Study conduct 6
Ethics, regulatory and research and development approvals 6
Sponsorship 6
Trial management 6
Trial set-up 7
Patient information and consent 7
Screening and randomisation procedures 7
Trial treatment 8
Standard care arm 8
Intervention arm 8
Other treatments 8
Patient population 9
Inclusion criteria 9
Exclusion criteria 9
Co-enrolment 9
Withdrawal of consent 9
Data management 10
Trial database 10
Data quality 10
Data collection 10
Adverse event reporting 10
Serious adverse event 12
Suspected unexpected serious adverse reaction 13
Serious breaches 13
Copyright © 2024 Coyle et al. This work was produced by Coyle et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care.
This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction ix
and adaptation in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the title, original
author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
Contents
Protocol amendments 13
July 2016 13
August 2016 13
April 2017 13
June 2018 13
Embedded pilot study 14
Statistical analysis plan 15
Non-inferiority design and non-inferiority margin 15
Sample size 15
Review of study design post-pilot phase and revision of sample size 15
Statistical methods 15
Subgroup analyses 16
Survey design and delivery 16
Site interviews 16
Patient and public involvement 17
Chapter 7 Discussion 67
Aim of the study 67
Main findings and interpretation of results 67
Conclusion 69
Implications for future research 69
Acknowledgements 71
References 75
Copyright © 2024 Coyle et al. This work was produced by Coyle et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care.
This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction xi
and adaptation in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the title, original
author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
DOI: 10.3310/RGTP7112 Health Technology Assessment 2024 Vol. 28 No. 14
List of tables
TABLE 1 Multinational Association of Supportive Care in Cancer risk index 2
TABLE 6 Summary of difficulties encountered with the original trial eligibility criteria
used during the initial pilot phase 21
TABLE 8 Summary of extended pilot phase (I) (December 2016 to February 2017) 23
TABLE 9 Recruitment activity in the extended pilot phase (II) (April 17 to November 17) 23
TABLE 19 Analyses for the primary outcome in the ITT and PP populations 44
Copyright © 2024 Coyle et al. This work was produced by Coyle et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care.
This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction xiii
and adaptation in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the title, original
author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
List of tables
TABLE 25 Hospital service use by group with complete cost and QALY data 53
TABLE 26 Cost (£UK) of hospital service use by group inpatients with complete
cost and QALY data 53
TABLE 30 Hospital resource use by group in patients (complete cost and treatment
failure data) 58
TABLE 31 Cost of hospital service use by group in patients (complete cost and
treatment failure data) 59
TABLE 40 Hospital resource use by group using all available data 100
TABLE 41 Cost of hospital service use by group (all available data) 101
xiv
List of figures
FIGURE 1 Summary of recruitment activity at the end of the pilot phase
(February 2016 to November 2017): total recruitment of 42 patients 24
Copyright © 2024 Coyle et al. This work was produced by Coyle et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care.
This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction xv
and adaptation in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the title, original
author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
DOI: 10.3310/RGTP7112 Health Technology Assessment 2024 Vol. 28 No. 14
List of abbreviations
(G)CSF (granulocyte) colony- ITT intention-to-treat
stimulating factor i.v. intravenous
AE adverse event MASCC Multinational
ALT alanine aminotransferase Association for
Supportive Care in Cancer
AR adverse reaction
NICE National Institute for
ASCO American Society of
Health and Care Excellence
Clinical Oncology
NICTU Northern Ireland
AST aspartate aminotransferase
Clinical Trials Unit
BHSCT Belfast Health and
NIHR National Institute for
Social Care Trust
Health and Care Research
CEA cost-effectiveness analysis
NMB net monetary benefit
CEAC cost-effectiveness
NS neutropenic sepsis
acceptability curves
PI principal investigator
CI confidence interval
PP per-protocol
CISNE clinical index of stable
febrile neutropenia PPI patient and public
involvement
CRF case report form
QALY quality-adjusted life-year
CUA cost–utility analysis
R&D research and development
DMEC data monitoring and
ethics committee RD risk difference
EQ-5D-5L EuroQoL-5 Dimensions, RN research nurse
five-level version SACT systemic anticancer therapy
ESMO European Society for SAE serious adverse event
Medical Oncology
SAR serious adverse reaction
GCP good clinical practice
SUSAR suspected
GDG guideline development unexpected serious
group adverse reaction
GEE generalised estimating SPC summary of product
equations characteristics
HRQoL health-related quality of life TMG trial management group
HTA Health Technology TSC trial steering committee
Assessment
UKONS United Kingdom
ICER incremental cost- Oncology Nursing Society
effectiveness ratio
ULN upper limit of normal
IMP investigational
medicinal product WTP willingness-to-pay
Copyright © 2024 Coyle et al. This work was produced by Coyle et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care.
This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction xvii
and adaptation in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the title, original
author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
DOI: 10.3310/RGTP7112 Health Technology Assessment 2024 Vol. 28 No. 14
Neutropenic sepsis, or infection with a low white blood cell count, can occur following cancer treatment.
Usually patients receive treatment with intravenous antibiotics (antibiotics delivered into a vein) for two
or more days. Patients at low risk of complications from their infection may be able to have a shorter
period of intravenous antibiotics benefitting both patients and the NHS.
The trial compared whether changing from intravenous to oral antibiotics (antibiotics taken by mouth as
tablets or liquid) 12–24 hours after starting antibiotic treatment (‘early switch’) is as effective as usual
care. Patients could take part if they had started intravenous antibiotics for low-risk neutropenic sepsis.
Patients were randomly allocated to ‘early switch’ or to usual care.
The main outcome measured was treatment failure. Treatment failure happened if fever persisted or
recurred despite antibiotics, if patients needed to change antibiotics, if they needed to be re-admitted to
hospital or needed to be admitted to intensive care within 14 days or died.
We had originally intended that 628 patients would take part, but after review of the design of the study
the number needed to take part was revised to 230. We were not able to complete the trial as planned
as unfortunately only 129 patients took part. As the trial was smaller than expected we were not able to
draw conclusions as to whether ‘early switch’ is no less effective than usual care. Our findings suggest
that ‘early switch’ might result in a shorter time in hospital initially; however, treatment failure was more
likely to occur, meaning some patients had to return to hospital for further antibiotics. There were no
differences in side effects and no serious complications from treatment or treatment failure (such as
intensive care admission or death) among the 65 patients in the ‘early switch’ group. Patients were
satisfied with ‘early switch’.
Early switch may be a treatment option for some patients with low-risk neutropenic sepsis who would
prefer a shorter duration of hospital admission but accept a risk of needing hospital re-admission.
Copyright © 2024 Coyle et al. This work was produced by Coyle et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care.
This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction xix
and adaptation in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the title, original
author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
DOI: 10.3310/RGTP7112 Health Technology Assessment 2024 Vol. 28 No. 14
Scientific summary
Background
Objectives
To establish the clinical and cost effectiveness of early switch to oral antibiotics (within 12–24 hours of
starting antibiotics) in patients with NS at low risk of infective complications. The primary objective was
to assess whether early switch was non-inferior to standard care (continuation of i.v. antibiotics for at
least 48 hours) in terms of treatment failure at day 14. The secondary objectives were to assess the
effects of early oral switch on quality of life, length of hospital admission, re-admission to hospital,
changes to subsequent planned SACT and death within 28 days in addition to an assessment of cost-
effectiveness and patient preference for these treatment strategies at day 14.
Study design
A pragmatic, randomised, open-label, multicentre non-inferiority trial was designed to compare early
oral switch to standard care i.v. antibiotics. Participants were randomised with randomly permuted
blocks 1 : 1 to intervention and standard care. Allocation concealment was maintained through use of an
automated system with access to the randomisation sequence restricted to the trial statistician.
Participants and clinical or research team members were not blinded to allocated treatment due to both
the pragmatic nature of the study and patient representatives’ advice that outcome assessors would be
likely to be made aware by participants of their allocated treatment. An embedded pilot study was
included to test the assumptions related to recruitment, adherence and separation between treatment
arms underpinning the study design.
The initial sample size was 628 patients based on a stringent approach to trial design in accordance with
a typical Phase 3 efficacy study with a line of sight to therapeutic licensing and a non-inferiority margin
suggested by consensus guidelines. On review after study initiation, the stringency of this design was
felt to be less relevant to a treatment strategy involving agents already routinely used and/or licensed
for use in NS and the low-risk nature of this patient population where treatment failure is not associated
with serious adverse outcomes such as critical care admission or death. The revised target sample size
was 230 patients. This was based on an assumed 15% treatment failure rate in the standard care arm
and a 15% non-inferiority margin, at 90% power [one-sided 95% confidence interval (CI)] requiring 98
patients per group. Allowing for a 5% dropout rate and 10% crossover from control to intervention the
target was 115 participants per group (230 in total). To conclude non-inferiority of the intervention, the
primary analysis was required to demonstrate non-inferiority in both the intention-to-treat (ITT) and
per-protocol (PP) analyses.
Copyright © 2024 Coyle et al. This work was produced by Coyle et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care.
This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction xxi
and adaptation in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the title, original
author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
Scientific summary
Methods
Patients aged 16 years and over receiving SACT with fever (≥ 38°C), or symptoms and signs of sepsis,
and neutropenia (≤ 1.0 × 109/l) within 24 hours of randomisation, with a Multinational Association
for Supportive Care in Cancer (MASCC) score of ≥ 21 and receiving i.v. piperacillin/tazobactam or
meropenem for < 24 hours were eligible. Patients with acute leukaemia or stem cell transplant were
excluded. Participants were recruited from 19 sites across the UK.
Patients were randomised on a 1 : 1 basis to (1) early switch to oral ciprofloxacin (750 mg twice daily)
and co-amoxiclav (625 mg three times daily) within 12–24 hours of starting antibiotics and completing
5 days treatment in total or to (2) continuation of i.v. antibiotics for at least 48 hours with ongoing
treatment at physician discretion. Patients were discharged by their treating physician in accordance
with their routine clinical practice. A patient diary was used to record any further temperatures and oral
antibiotic compliance. Follow-up at day 14 determined whether the primary outcome measure of
treatment failure was met and health-related quality of life (HRQoL) and patient preference
questionnaires were completed. At day 28, survival status and the effect of NS on any subsequent cycle
of anticancer treatment were assessed.
Outcome measures
• persistence, recurrence or new onset of fever (temperature ≥ 38°C) after 72 hours of starting i.v.
antibiotic treatment
• physician-directed escalation from protocol antibiotic treatment
• re-admission to hospital (related to infection or antibiotic treatment)
• critical care admission
• death.
• Short-term change in HRQoL, using EuroQoL-5 Dimensions, five-level version (EQ-5D-5L) as the
measurement tool, at baseline and 14 days.
• Cost-effectiveness, based on the cost per treatment failure avoided at 14 days and a cost–utility
analysis (CUA) estimating the cost per quality-adjusted life-year (QALY) at 14 days.
• Time to resolution of fever from initial i.v. antibiotic administration.
• Adverse events (AEs) related to antibiotics.
• Hospital discharge and total length of hospital stay.
• Re-admission to hospital.
• Death within 28 days.
• Adjustment to the subsequent scheduled cycle of chemotherapy.
• Patient preferences for antibiotic treatment strategy assessed at day 14.
Results
The embedded pilot phase of the study highlighted challenges in recruitment and study delivery but no
concerns regarding treatment adherence or separation between treatment arms. Despite revisions to the
study design and eligibility criteria, and taking account of the lower than anticipated incidence of NS,
recruitment remained challenging and appeared to plateau as the study progressed. While logistical aspects
such as the number of potential patients and the short time window for enrolment continued to impact on
xxii
recruitment, review of standard care practice in NS management suggested increasing variation in equipoise
between trial arms as clinicians shifted towards early or upfront oral antibiotics as the trial progressed.
The study was closed early due to under-recruitment with 129 patients recruited. Sixty-five patients
were randomised to the early switch (intervention arm) and 64 to the standard care (control) arm with
subsequent ITT and PP analyses including 125 patients (intervention n = 61 and control n = 64) and 113
(intervention n = 53 and control n = 60), respectively. In the ITT population, the treatment failure rates
were 14.1% in the control and 24.6% in the intervention group, respectively; difference = 10.5% (95%
CI 0.11 to 0.22). In the PP population, the treatment failure rates were 13.3% and 17.7% in control and
intervention groups, respectively; difference = 3.7% (95% CI 0.04 to 0.148). The criteria for non-
inferiority were not met in the ITT analysis but were met in the PP analysis; however, given the under-
recruitment, no definitive conclusion regarding non-inferiority can be made and the discordant results
between ITT and PP analyses add to the uncertainty in interpreting these data.
The main constituents of the composite primary outcome measure accounting for treatment failure
were persistence/recurrence of fever and/or physician-directed escalation from the protocolised
antibiotic regimen. None of the treatment failure events recorded in either arm were attributable to the
need for critical care support or death before day 14. There were no apparent differences between the
two trial arms for time to fever resolution, re-admission to hospital to day 28, survival to day 28 or
changes to the originally intended SACT regimen. AEs were as anticipated for the agents used and
reported at similar rates between treatment arms.
A within-trial economic evaluation was performed to assess the cost effectiveness of early switch to oral
antibiotics. This included a cost-effectiveness analysis (CEA) consistent with the primary outcome measure
to estimate the cost per treatment failure avoided at day 14 and a CUA to estimate the cost per QALY at
day 14. The primary measure used in these analyses, the QALY, was estimated from the EQ-5D-5L
questionnaire. A bespoke Patient Follow-up Questionnaire at day 14 was used to collect information on
non-health outcome measures important to patients. Overall, early oral switch appears to be a cost-
effective approach within existing NHS care pathways and leads to improvements in global HRQoL. The
majority of patients were content with the treatment they received, regardless of the group they were
randomised to. Notably, patients had a much higher acceptance of the possibility of treatment failure in
order to enable early discharge for their primary admission than might be anticipated by clinicians.
Conclusions
Non-inferiority for early oral switch could not be proven. The findings suggest this may be a an
acceptable treatment strategy for some patients who can adhere to such a treatment regimen and would
prefer a potentially reduced duration of hospitalisation while accepting a potentially increased risk of
treatment failure resulting in re-admission.
Trial registration
Funding
This award was funded by the National Institute for Health and Care Research (NIHR) Health Technology
Assessment programme (NIHR award ref: 13/140/05) and is published in full in Health Technology
Assessment; Vol. 28, No. 14. See the NIHR Funding and Awards website for further award information.
Copyright © 2024 Coyle et al. This work was produced by Coyle et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care.
This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction xxiii
and adaptation in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the title, original
author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
DOI: 10.3310/RGTP7112 Health Technology Assessment 2024 Vol. 28 No. 14
Chapter 1 Introduction
T his chapter contains some text reproduced from the study protocol ‘Early switch from intravenous
to oral antibiotic therapy in patients with cancer who have low risk neutropenic sepsis (the EASI-
SWITCH trial): study protocol for a randomised controlled trial’ published in Trials (2020). https://doi.
org/10.1186/s13063-020-04241-1.1
Neutropenic sepsis
Robust predictors of NS risk are lacking in patients with cancer receiving SACT. It seems that NS is more
common soon after treatment is initiated (within the first two cycles)16 and following administration of
anthracycline or taxane-containing regimens in treatment of early-stage breast cancer. Other factors
associated with risk of developing NS include age, performance status and a diagnosis of blood cancer
rather than solid tumour.17,18
Significant patient morbidity can also occur through hospitalisation, with a strong desire not to
be hospitalised during treatment cited as a common barrier to patients promptly seeking help for
symptoms.22 An episode of NS can also result in dose delays and reductions to patients’ planned SACT,
potentially compromising treatment efficacy in certain tumour types and settings.3,23–25 There are
associated financial implications on healthcare systems managing NS episodes, with hospital, antibiotic,
diagnostic and additional therapeutic costs involved resulting in an estimated average cost per inpatient
admission in the NHS ranging from approximately £257226 to £3163.27
Empirical management of NS
Copyright © 2024 Coyle et al. This work was produced by Coyle et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care.
This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction 1
and adaptation in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the title, original
author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
Introduction
and duration of antibiotic treatment and hospital admission. Widely variable practice has been noted
among cancer centres in the UK.30 A review of 51 English and Welsh centres, prior to the introduction
of a national UK NS clinical guideline, highlighted the heterogeneity that existed in almost all aspects
of NS management, commenting that there was ‘surprisingly little agreement’ and ‘dramatic variations’
in clinical practice. These findings were consistent with previously published audits of both adult and
paediatric haemato-oncology practice.6,31,32
Risk stratification
A spectrum of NS severity exists, encompassing a heterogeneous group of patients with variable risk of
septic complications such as organ failure, need for critical care support and death.33
At the low-risk end of the spectrum, there are patients who do not demonstrate clear clinical or
microbiological evidence of proven infection, have uncomplicated hospital admissions and are at low risk
of developing septic complications. These patients potentially receive overtreatment, with the associated
distress of hospitalisation and additional burden to the healthcare system.34
Risk stratification tools have therefore been developed in an attempt to identify patients predicted to be
at low risk of an adverse outcome. The Multinational Association of Supportive Care in Cancer (MASCC)
score (Table 1) is the most widely validated risk score for SACT-induced NS.3,28,29,33
Characteristic Weight
Outpatient status 3
a Points attributable to the variable ‘burden of febrile neutropenia’ are not cumulative. The maximum theoretical score is
26. A score of ≥ 21 suggests a low risk of a serious medical complication, including organ failure, critical care support or
death.
In the original validation set, a risk index score of 21 or greater out of 26 identified low-risk patients with
a positive predictive value of 91%, a sensitivity of 71% and a specificity of 68%. A low rate of adverse
outcomes (6% serious medical complication, 1% mortality) was observed in patients with a risk index
score ≥ 21 compared with 49% in those with a risk score of < 21.35
A Cochrane review37 of oral versus i.v. antibiotics for NS, evaluating 22 trials comprising 3142
neutropenic episodes in 2372 patients, concluded that it is not likely that significant differences exist
in treatment failure or mortality rates between oral antibiotic and i.v. antibiotic strategies. There was a
trend towards more adverse events (AEs) in patients receiving oral antibiotics, typically gastrointestinal
events, which did not necessitate treatment discontinuation. The majority of studies did not utilise any
formal risk stratification tools but excluded high-risk patients with acute leukaemia, haemodynamic
instability, evidence of organ failure or localising signs of infection.
The Cochrane review therefore broadly supported the early use of oral antibiotics in low-risk NS, but it
was noted most trials were small in sample size, often single-centre and with methodological concerns
and so a robust recommendation for upfront or early oral antibiotic therapy could not be made. It was
suggested that ‘the combination of a quinolone and a second drug active against Gram-positive bacteria
(for example ampicillin-clavulanate) seems prudent’.37 This group also recommended that this therapeutic
approach should be formally evaluated in patients with low-risk NS. The NICE GDG also considered
oral antibiotic therapies but were unable to make a specific recommendation given variation in local
microbiological resistance patterns and variation in use of prophylactic antibiotics.3
The NICE GDG reviewed the evidence for inpatient versus outpatient management of NS and
concluded outpatient management can be considered for selected low-risk patients, taking into account
their individual clinical and social circumstances.3 Although the metaregression undertaken by the GDG
suggested early discharge (before 24 hours) may be associated with increased likelihood of re-admission
or therapy change, the quality of evidence supporting outpatient management was low to moderate.
The available data were limited by a lack of reporting of key outcomes such as critical care admission
or clinically documented infection and a very low event rate for adverse outcomes including death.3
Similarly, there is negligible literature relating to impact on quality of life for different models of care,
including immediate use of oral antibiotics and non-admission to hospital, with a single study suggesting
role function improved more for inpatients than home care patients but that emotional function
declined with hospital admission.38 It was therefore proposed that if a short period of hospital admission
was found to be safe and effective for selected patients with NS, it could provide considerable
improvements in quality of life and health resource usage.
Copyright © 2024 Coyle et al. This work was produced by Coyle et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care.
This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction 3
and adaptation in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the title, original
author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
Introduction
NICE therefore recommended that a randomised trial should be undertaken to evaluate the
effectiveness of switching from i.v. to oral antibiotics within the first 24 hours of treatment in patients
receiving i.v. antibiotics for NS. The early switch to oral antibiotic therapy in patients with low-risk NS
(EASI-SWITCH) trial was developed in response to this recommendation and a commissioned call from
the UK National Institute for Health and Care Research (NIHR) Health Technology Assessment (HTA)
programme to address this evidence gap. It aimed to establish the clinical and cost effectiveness of an
early switch to oral antibiotics 12–24 hours after i.v. antibiotic treatment commences in low-risk cancer
patients with NS.
While prospective RCTs evaluating upfront or early oral antibiotics remain lacking from publication of the
NICE guidance, there have been significant service developments in response to acute care pressures
and increasing demands due to increases in cancer incidence and available treatments with the aim of
developing novel models of care for meeting cancer patients’ complex needs.39 Ambulatory care has
been introduced in acute medical and elderly care NHS settings with growing interest in developing care
pathways in cancer services in recent years. This has included management of low-risk NS although it
has only been implemented by a limited number of UK cancer centres.40,41 Some have reported results
from longitudinal patient series. Marshall et al.42 reported a series of 100 patients from a large UK tertiary
cancer centre over a 2-year period with NS who were assessed and given a first dose of i.v. antibiotics
then managed on an ambulatory low-risk NS pathway. Patients were stratified using MASCC score
and National Early Warning Score (NEWS) score and following observation for at least 4 hours were
discharged for outpatient follow-up (repeat clinical assessment and routine bloods) within 48 hours.42
Six of the 100 patients (8.8%) required re-admission within 7 days, typically with positive blood cultures,
but none required critical care support. Brunner et al.43 reported a low-risk NS ambulatory care pathway
case series from another UK centre. One hundred and twenty-three patients presented with NS over a
2-year period, 41% of whom were deemed low risk based on MASCC score. Of these, 24 were managed
on the ambulatory care pathway with a first dose of i.v. antibiotic and discharge with oral antibiotics and
proactive telephone follow-up. A further 24 patients were admitted but had early discharge. Again, no
serious complications occurred and the re-admission rate was 10%. However, despite the investment in
establishing the ambulatory care pathway, approximately 80% of patients with NS were still admitted.
Similarly, other international centres have reported real-world data where only a minority of patients are
managed on ambulatory pathways or considered for same-day discharge.44 For example, in a large US
emergency department (ED) only 5% of NS patients were discharged home, with most low-risk patients
admitted for inpatient antibiotics.45 A subsequent large-scale review of approximately 350,000 US ED
visits with NS confirmed this finding, with 94% of visits resulting in hospitalisation.46 Cost analysis data
from real-world data sets are also lacking.
Chapter 2 Methods
T his chapter contains some text reproduced from the study protocol ‘Early switch from intravenous
to oral antibiotic therapy in patients with cancer who have low risk neutropenic sepsis (the EASI-
SWITCH trial): study protocol for a randomised controlled trial’ published in Trials (2020). https://doi.
org/10.1186/s13063-020-04241-1.1
Trial design
The main aim was to determine the clinical effectiveness of early switch to oral antibiotics 12 to
24 hours after commencement of empirical i.v. antibiotics compared to standard care, which comprises
continuation of i.v. treatment for at least 48 hours, based on treatment failure rate. Treatment failure
was defined by a composite measure incorporating a number of important clinical outcomes assessed at
day 14 of follow-up.
The trial included an embedded pilot study across four UK sites in order to test the recruitment and
adherence assumptions which had informed the trial design.
Trial objectives
Primary objective
To determine whether early switch to oral antibiotic therapy is non-inferior to standard care therapy in
terms of treatment failure measured at day 14.
Treatment failure was defined as a composite measure incorporating the following important
treatment outcomes:
1. persistence, recurrence or new onset of fever (temperature ≥ 38°C) after 72 hours of starting i.v.
antibiotic treatment
2. physician-directed escalation from protocol antibiotic treatment
3. re-admission to hospital (related to infection or antibiotic treatment)
4. critical care admission
5. death.
Secondary objectives
To assess the effect of early switch to oral antibiotics on:
1. short-term change in health-related quality of life (HRQoL), using EuroQoL-5 Dimensions, five-level
version (EQ-5D-5L) as the measurement tool, at baseline and 14 days
2. cost-effectiveness, based on the cost per treatment failure avoided at 14 days and a cost–utility
analysis (CUA) estimating the cost per QALY at 14 days
3. time to resolution of fever from initial i.v. antibiotic administration
4. AEs related to antibiotics
5. hospital discharge and total length of hospital stay
6. re-admission to hospital within 28 days
Copyright © 2024 Coyle et al. This work was produced by Coyle et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care.
This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction 5
and adaptation in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the title, original
author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
Methods
Research hypotheses
1. Early oral switch (within 12–24 hours after commencing i.v. antibiotic therapy) in cancer patients
with low-risk NS is non-inferior to standard care (continuation of i.v. antibiotic therapy for at least
48 hours).
2. The incremental cost effectiveness of early oral switch is significant compared to standard care.
3. AEs are comparable between the two study arms.
4. Patients’ preference will be for early oral switch.
Study conduct
Sponsorship
EASI-SWITCH was sponsored by the Belfast Health and Social Care Trust (BHSCT).
Trial management
Clinical trial management was undertaken by the Northern Ireland Clinical Trials Unit (NICTU). Additional
trial oversight committees were convened by the trial including a Trial Management Group (TMG), Trial
Steering Committee (TSC) and Data Monitoring and Ethics Committee (DMEC).
The TMG comprised the co-chief investigators, other clinical investigators, the trial manager/co-ordinator,
the trial statistician, the trial health economist, the sponsor pharmacovigilance representative and the
patient and public representative. The TMG met monthly to review site set-up, screening and recruitment,
trial conduct, AEs and any other issues relating to trial conduct. A TMG charter detailed the terms of
reference of the TMG including roles/responsibilities.
The TSC provided oversight for the progress of the trial on behalf of the sponsor and funder. The TSC was
appointed by the NIHR and comprised an independent chair (a microbiologist), an independent oncologist,
an independent statistician, at least one patient/public representative and TMG members. The remit of
the TSC was progression of the trial including recruitment and adherence, the well-being, safety and rights
of trial participants and ensuring trial conduct was appropriate. A TSC charter described the terms of
reference of the TSC including membership and roles/responsibilities.
The DMEC provided independent review of the trial. Its role was to safeguard the rights and safety of
participants, to review trial data related to recruitment, protocol compliance, safety and efficacy and
to recommend to the TSC whether the trial should continue or not based on ethical or safety reasons.
DMEC appointments were approved by NIHR and included an independent chair (an oncologist), an
independent clinician, an independent statistician and a patient/public representative. DMEC reports
were provided by the trial statistician to include recruitment, AE and outcome data along with any other
information requested by the Committee. These reports were confidential and not shared with the trial
investigators. A DMEC charter described the terms of reference of the DMEC including memberships
and roles/responsibilities.
Trial set-up
In total 19 sites in hospitals and cancer centres across the four UK nations were opened to patient
recruitment. A list of these sites can be found in the Acknowledgements. Potential sites were asked
to complete an eligibility questionnaire that assessed clinical trial experience and local capability and
capacity for the study. Local antimicrobial guidelines and treatment care pathways for NS were also
requested from sites at this stage to identify and address any potential issues with protocol compliance.
Prior to sites opening to recruitment a face-to-face site initiation visit was undertaken by trial team
members to provide training on trial procedures to local research team members. Additional training,
where needed, was provided by teleconference. The trial team maintained regular communication with
sites by e-mail and teleconferencing to provide any ongoing training needed, answer any queries arising
at site and support sites in identifying and resolving barriers to recruitment.
Potentially eligible patients were those who had commenced treatment with i.v. antibiotics for NS.
Patients were identified at each study site daily through local acute admission/handover processes
dependent on the unscheduled care admission pathways at site. Patients meeting these criteria were
discussed with their treating physician on that day prior to enrolment to confirm their agreement to
patient participation. This also provided an opportunity to confirm that their treating physician would
be willing to follow the treatment strategy outlined in either arm of the trial. Patients were approached
by a member of the research team and a patient information sheet was provided. Patients were given
time to review the patient information sheet although this time period was < 24 hours given the acute
care setting and timing of the intervention.
As enrolment was occurring at ward level and patients had already been initiated on treatment, patients
being approached were clinically stable and viewed as competent to give informed consent in this
setting. Patients who were unable to give informed consent, for any reason, were not recruited. Patients
who indicated they were unwilling or unable to make a decision within the 24-hour time period were
not recruited. Regulatory approvals were obtained for patient-facing materials additional to the patient
information sheet to be used at site to make patients aware of the trial. These included a summary
information sheet about the trial that could be included in the standard SACT patient education
materials about NS and a poster to be displayed in SACT clinics and treatment units. All of these
materials were prepared in collaboration with the trial patient representatives.
Informed consent for participation was sought from patients by appropriately trained research nurses
(RNs) and medically trained investigators at site supported by the site principal investigator (PI) and local
infrastructure. If patients required any further clarification about the risks and benefits of participation,
this was provided by other research team members or an independent senior physician (one nominated
in advance at each trial site). The PI (or designee) taking informed consent was required to have
completed GCP training, be suitably qualified and experienced and be delegated this duty by the PI on
the delegation log.
Electronic trial screening and recruitment logs, submitted by sites to the clinical trial unit (CTU) on a
monthly basis, aimed to capture all patients who received a patient information sheet and whether
Copyright © 2024 Coyle et al. This work was produced by Coyle et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care.
This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction 7
and adaptation in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the title, original
author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
Methods
they proceeded to consent and randomisation. Research teams were asked to provide a reason for
non-participation if patients were not recruited.
After informed consent was obtained and eligibility was confirmed, participants were allocated to
intervention or standard care groups using an automated randomisation system (sealed envelopes).
Blocked randomisation with randomly permuted block sizes was used and a 1 : 1 allocation ratio.
There were no factors for stratification. Access to the randomisation sequence was restricted and
not accessible to site staff who enrolled patients or assigned interventions. Only the allocation of the
intervention was blinded. As this was a pragmatic trial, it was felt that blinding clinical teams, researchers
and trial participants to the intervention would limit the ability of the trial to measure the impact of the
intervention on routine care pathways. Additional support from this approach came from our patient
and public involvement (PPI) representatives, who viewed that participants would be highly likely to
reveal their treatment allocation during discussion with healthcare providers and outcome assessors,
making it unlikely these groups could remain blinded.
Trial treatment
Patients eligible to participate were aged over 16 years, receiving SACT for a cancer diagnosis and were
receiving standard-dose i.v. piperacillin/tazobactam or meropenem as initial antibiotic treatment for
suspected NS for < 24 hours. Patients were only permitted to be enrolled in the trial on one occasion
in line with consensus guidelines.47 All protocolised antibiotics were considered to be investigational
medicinal products (IMPs) for the purpose of the trial: co-amoxiclav 500 mg/125 mg film coated tablets;
ciprofloxacin 250 mg, 500 mg, 750 mg film coated tablets; meropenem 1 g powder for solution for
injection or infusion and tazocin 4 g/0.5 g powder for solution for infusion.
Intervention arm
Participants randomised to the intervention group switched from i.v. antibiotic treatment within
12–24 hours after starting treatment, to co-amoxiclav 625 mg three times daily and ciprofloxacin
750 mg twice daily, to complete at least 5 days antibiotic treatment in total. The combination of a
quinolone and a second drug active against Gram-positive bacteria (e.g. co-amoxiclav) was based on the
conclusions of the Cochrane review.37
Other treatments
Any other treatments or investigations that patients required were carried out in accordance with
standard care. It was recognised that escalation from protocol-specified antibiotic treatment might be
required in the event of clinical deterioration, progression of the presumed infection, a microbiological
indication based on microbiological culture results or an adverse reaction (AR) to the prescribed
antibiotics. A change from protocol-specified antibiotics, including additional antibiotic treatment other
than the study drugs, or persistent/recurrent fever (> 38°C) after 72 hours was within the definition of
treatment failure, with such participants reaching the trial’s primary end point.
Patients were discharged home from hospital once their treating physician was content to do so, with
a patient diary to record any further temperatures and oral antibiotic compliance. Due to the pragmatic
nature of the trial, specific discharge criteria were not protocolised, but it was assumed the patient’s
overall clinical condition and psychosocial circumstances would be considered by the treating clinician in
line with their normal clinical practice.
Patient population
Patients commenced on i.v. antibiotics within 24 hours after starting treatment for low-risk NS were
recruited from sites across England, Scotland, Wales and NI, comprising both large cancer centres and
cancer units, to ensure that the sample is broadly representative of patients developing NS in the UK.
Inclusion criteria
Exclusion criteria
Co-enrolment
Patients who were enrolled in other Phase I IMP studies and other antimicrobial IMP studies were
excluded. Patients enrolled in other Phase II–IV IMP or observational studies were eligible for enrolment
in this study at the PI’s discretion and when the burden on participants was not considered to be onerous.
Withdrawal of consent
Participants were able to withdraw consent to participate in the trial at any time. If the participant
withdrew consent during protocolised treatment, no further treatment within the trial was given and the
Copyright © 2024 Coyle et al. This work was produced by Coyle et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care.
This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction 9
and adaptation in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the title, original
author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
Methods
clinician responsible for their care determined the safest and most appropriate continued management
plan. A withdrawal of consent form identified which parts of the trial the patient wished to withdraw
from: protocol-specified antibiotic therapy; future data collection (all data collected or data collected at
day 14 and/or day 28 follow-up). Participants could be withdrawn from the study at the discretion of the
investigator if any safety concerns arose.
Data management
Trial database
The EASI-SWITCH trial database is an electronic clinical trial database (MACRO) held by the NICTU. Trial
data were entered on to a web-based case report form (CRF) with imposed rules for data entry with valid
responses and linkage of dates and trial identification numbers by trained and delegated site personnel.
Data were processed in accordance with the trial Data Management Plan and CTU Standard Operating
Procedures. Data queries were ‘raised’ electronically via MACRO where clarification was needed for data
entries or to complete missing data and staff at site ‘responded’ electronically to queries and amended
database entries where applicable. A final review for missing or inconsistent data was carried out by the
trial statistician with subsequent opportunity for query resolution / data completion prior to the database
lock for end of trial analyses. All essential documentation and trial records were stored securely with
access restricted to authorised staff only.
Data quality
Data management within the CTU was governed by Standard Operating Procedures to ensure
standardisation and compliance with International Conference of Harmonisation Good Clinical Practice
(ICH-GCP) guidance and regulatory requirements. NICTU provided site staff training in data collection
and CRF completion. On-site monitoring visits during the trial checked accuracy of CRF entries against
source documents in addition to protocol and trial procedure adherence. Discrepancy reports were
generated after data entry to identify inconsistent or out-of-range data and protocol deviations based
on data validation checks programmed into the clinical trial database.
Data collection
Data were collected by delegated research team members. Each participant was allocated a unique
Participant Study Number at randomisation, alongside their initials for identification for the duration of
the trial. Data were collected from the time of trial entry until day 28 (± 1 day) in accordance with the
schedule of assessments shown in Table 2. Baseline data collection occurred in the hospital setting. Primary
and secondary outcome data were collected via a review of patient medical notes (including laboratory
results), submission of participant questionnaires, patient diary, GP records and telephone calls with
patients. Participants discharged before day 14 were asked to complete a diary noting administration of oral
antibiotics, any new medications and a temperature diary (if required) until day 14. Questionnaires were
administered face-to-face or via telephone (if discharged or no scheduled outpatient visit) at day 14 (± 1 day).
Directly observed or patient-reported AEs that were not related to underlying medical conditions were
recorded by the site PI or designee. AEs clearly related to SACT administration (such as peripheral
neuropathy) were not required to be recorded; however, if an AE could be due to SACT, NS or antibiotic
therapy (such as fever or gastrointestinal symptoms), then it was required to be recorded. Initially the AE
reporting period for the trial was from enrolment until 28 days after randomisation. This was amended
subsequently to 14 days from enrolment until 14 days after randomisation in recognition that antibiotic
AEs generally occurred within this time frame and that patients were typically receiving a further course
of SACT within the 14–28 day window, resulting in AEs that were more likely to be SACT-related or a new
episode of NS rather than related to the episode of NS that had resulted in trial entry or antibiotic therapy.
10
Informed consent
EQ-5D-5L ✗
Randomisation
Send GP letter ✗
Demographics ✗
Medical historyc ✗
Cancer assessmentd ✗
Concomitant medications ✗ ✗ ✗ ✗ ✗
Antibiotic regimenf ✗ ✗ ✗ ✗ ✗ ✗
Protocol compliance
continued
Copyright © 2024 Coyle et al. This work was produced by Coyle et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care.
This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction 11
and adaptation in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the title, original
author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
Methods
Patient follow-up
EQ-5D-5L ✗
Follow-up contact ✗ ✗
Survival status ✗ ✗
New medications ✗
Hospital discharge/re-admission/ ✗ ✗ ✗ ✗ ✗
critical care admission details
The PI (or designee) was required to make an assessment of expectedness of any AE deemed possibly,
probably or definitely related to any of the trial IMPs based on the relevant Summary of Product
Characteristics (SPCs).
AEs related to IMP exposure were deemed ARs. ARs were classified as expected (consistent with IMP
side effects listed in the SPC) or unexpected (not consistent with the SPC).
• resulted in death
• was life-threatening
• required hospitalisation or prolongation of existing hospitalisation
• resulted in persistent or significant disability or incapacity
• consisted of a congenital anomaly or birth defect
• was any other important medical event(s) that carried a real, not hypothetical, risk of one of the
outcomes above.
All deaths that occurred within 28 days of randomisation were recorded and reported as a SAE
regardless of the nature of the event (even if due to progressive cancer). PIs were required to report
SAEs to NICTU using the trial-specific SAE form within 24 hours after becoming aware of the event.
Treatment failure due to persistence, recurrence or new occurrence of fever after 72 hours of antibiotic
commencement and/or clinician-directed escalation of protocolised antibiotic therapy during the first
14 days was captured as part of the primary outcome measure. This was only reported as an AE when
categorised as a SAE.
12
Serious breaches
A serious breach was defined as an occurrence which represented a deviation from the trial protocol that
was likely to result in significant effect on the safety of a trial participant or the scientific value of the trial.
The PI (or designee) was responsible for direct reporting of serious breaches to the trial sponsor with
onward reporting to the relevant competent authorities in accordance with UK regulations.
Protocol amendments
All amendments to the trial protocol, patient information sheet, informed consent form and other key
documents were submitted to the relevant regulatory authorities for approval prior to implementation.
Local research and development approval was also obtained at each site. Version 2 of the trial protocol
was the protocol approved for use as trial commencement and subsequent substantial protocol
amendments are summarised below.
July 2016
Version 3 of the protocol was submitted to the regulatory authorities. This incorporated changes to the
eligibility criteria in order to align better with the NICE guidance and routine practice in the NHS setting.
The NICE guidance stated ‘Diagnose neutropenic sepsis in patients having anticancer treatment whose
neutrophil count is 0.5 × 109 per litre or lower and who have either: a temperature higher than 38°C
or other signs or symptoms consistent with clinically significant sepsis’. On initial design, the trial had
only incorporated the objective definitions (i.e. temperature and neutrophil count) because of possible
difficulty in defining ‘signs or symptoms consistent with clinically significant sepsis’ for a trial population.
This protocol amendment permitted recruitment of patients with either:
1. a neutrophil count of ≤ 0.5 × 109 per litre who have either a temperature of at least 38°C or other signs
or symptoms consistent with clinically significant sepsis (to align fully with the NICE guidance); or
2. a neutrophil count of < 1.0 × 109 per litre, and falling or expected to fall, who have a temperature of
at least 38°C (to reflect usual NHS practice). Given the pragmatic nature of the trial this amendment
was felt to allow a more realistic evaluation of the intervention in routine care.
August 2016
Versions 4 and 5 of the protocol incorporated an extension to the pilot phase of the study including the
addition of up to four new sites, the resultant change in the overall study duration and clarification of
eligibility criteria and outcome measure definitions. The key change within these amendments was the
extension of the embedded pilot study to 12 months to assess the impact of the change in eligibility
criteria on recruitment, which had been lower than anticipated after the trial commenced.
April 2017
Protocol version 7 was submitted to the regulatory authorities (protocol version 6 was a non-substantial
amendment). The purpose of this amendment was to clarify use of non-protocolised antibiotics and
reporting of AEs.
June 2018
Protocol version 8 was submitted to the regulatory authorities. This incorporated revisions to the
study design following review of the pilot study and discussions with the research team, trial sites, trial
Copyright © 2024 Coyle et al. This work was produced by Coyle et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care.
This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction 13
and adaptation in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the title, original
author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
Methods
oversight committees. While the extended pilot study did meet the pre-specified recruitment target for
study continuation, the trial team and oversight committees concluded that it would not be possible to
recruit the originally planned sample size of 628 patients within a meaningful time frame to ensure the
results remained relevant to clinical practice. Both the trial team and oversight committees continued
to view the research question as important and relevant to current practice; opinion sought from the
oncology clinical community and PPI representatives nationally also supported this view. The DMEC
confirmed in November 2017 that there were no concerns regarding treatment adherence, separation
between treatment groups or the observed treatment failure rate. Therefore, the assumptions that had
underpinned the original trial design remained valid but, in retrospect, the choice of non-inferiority
margin and statistical analysis may have been too stringent for a pragmatic trial where the risk of
treatment failure was unlikely to result in serious risk to patients (in particular critical care admission
or death). Following extensive stakeholder discussion and consideration of alternative assumptions for
sample size recalculation, the sample size was recalculated using a 15% non-inferiority margin as this
was felt to maintain an acceptable trade-off between the possibility and consequences of treatment
failure for this low-risk patient population. This amendment included a sample size recalculation that
comprised both a widening of the non inferiority margin from 10% to 15% and a change in the one-
sided confidence interval (CI) from 97.5 % to 95%. This was recommended by the TSC independent
statistician and following discussion with the wider TSC felt to be reasonable given the original 97.5% CI
had been based on regulatory agency recommendations for licensing studies of new treatments which
require a greater degree of certainty than was felt warranted for a pragmatic trial testing antibiotics
already licensed or within routine clinical use for the same indication. This amendment also included an
increase in the total number of study sites and an extension to the project duration.
The trial contained an embedded pilot study involving four UK sites to test the recruitment and
adherence assumptions underpinning the study design. Progression to the full study was based on the
following criteria:
1. Recruitment rate:
a. progression without major modification if at least 75% adherence in both trial arms
b. if adherence was between 50% and 75% of target, progression would be supported by a de-
tailed analysis of the process and decision-points that led to non-adherence and a recognised
strategy to address this identified
c. progression unlikely if < 50% adherence in either arm.
3. Separation:
a. separation in terms of the timing of antibiotic switch of at least 24 hours between the trial
arms to enable progression was required.
The four-site pilot study was expected to run for 6 months between February and July 2016.
Recruitment was < 50% target threshold for progression and the study was halted to review progress
and proposals to address under-recruitment. This review identified the stringent eligibility criteria
14
as a barrier to recruitment and not reflective of the routine management of patients with suspected
NS. A protocol amendment (July 2016, described above) was submitted to address this. Recruitment
was resumed with a 3-month extension to the pilot study (December 2016 to February 2017)
with an improvement in recruitment rates (11 patients of an anticipated 13.5 recruited). On the
recommendation of the HTA Programme Director, a larger pilot phase extension followed from April
until November 2017. Progression with addition of new sites continued from this point until the end
of the study.
It was estimated that the treatment failure rate in the control arm would be 15% based on data from three
studies with patient populations most comparable to the proposed EASI-SWITCH population. Selecting
the non-inferiority margin, the maximum clinically acceptable extent of non-inferiority, was challenging due
to the limited evidence available to help guide this selection. A 10% non-inferiority margin was originally
chosen to reflect the recommendations of a published expert consensus in NS antibiotic trials but this did
not take into consideration risk stratification.47 Input from patient representatives was also considered,
but it is important to note that feedback initially came predominantly from our PPI co-applicant rather
than a wider range of patient representatives, who felt if an extra 10% failed an early switch, in addition to
the expected 15% treatment failures that occur with standard care, the advantage of 75% of early switch
patients having successful treatment outweighed this.
Sample size
The original target sample size for the trial was 628 patients. This was based on the assumed 15%
treatment failure rate in the standard care arm and a 10% non-inferiority margin, at 90% power
(one-sided 97.5% CI), which would require 269 patients per arm. A dropout rate of up to 5% was also
accounted for based on previously reported NS trial data and a crossover rate of up to 10% from the
control to the intervention arm, giving 314 patients per arm (628 in total).
Statistical methods
The primary analysis was conducted on both the per-protocol (PP) population and the intention-to-treat
(ITT) population. Given the potential risk of bias arising from either of these analyses alone within a
non-inferiority trial, it was pre-specified that non-inferiority of the intervention would only be proven if
demonstrated in both the PP and ITT groups.
Copyright © 2024 Coyle et al. This work was produced by Coyle et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care.
This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction 15
and adaptation in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the title, original
author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
Methods
Analyses were one-sided and at a significance level of 0.05. The difference in treatment failure rate
(one-sided 95% confidence limit) was compared to the non-inferiority margin of 15%. As this was
a non-inferiority trial, the null hypothesis was that the degree of inferiority of the intervention to
the control was greater than the non-inferiority margin of 15%. The alternative hypothesis was
therefore that the intervention was inferior to the control by less than the non-inferiority margin of
15%. Therefore, non-inferiority would be established by showing that the upper limit of a 90% CI for
Intervention – Control is < 15%.
A secondary comparison of the primary and other binary outcomes between the two groups was
investigated using logistic regression, adjusting for covariates (such as extent of neutropenia).
Comparison of continuous outcomes between the two groups was investigated using independent
t-tests or Mann–Whitney. Statistical diagnostic methods were used to check for violations of the
assumptions, and transformations were performed where required.
Baseline characteristics, follow-up measurements and safety data were described using appropriate
descriptive summary measures depending on the scale of measurement and distribution.
Subgroup analyses
Exploratory subgroup analyses were pre-specified using 99% CI. Logistic regression was used with
interaction terms (treatment group by subgroup) for the following subgroups:
An additional post hoc subgroup analysis was requested for those patients who had a positive blood
culture versus those who did not at baseline.
A series of surveys were undertaken to obtain stakeholder feedback on important questions relating to
the trial. All electronic surveys were conducted using the SurveyMonkey tool (www.surveymonkey.co.uk).
Ethical approval was not required for these projects as they sought only to define clinicians’ current standard
of care and were categorised as service evaluation rather than research according to UK Health Research
Authority definitions. All were designed pragmatically for data collection and to encourage responses.
They were piloted informally by clinical and PPI colleagues at the lead site prior to wider dissemination to
improve clarity and understanding but did not undergo formal reliability or validity testing. Participation was
voluntary, with potential responders assured that no site or personal information would be publicly shared.
Onward e-mail circulation to appropriate colleagues was encouraged to maximise responses, accepting this
makes estimation of response rates challenging. At least one e-mail reminder was sent also to encourage
responses, with all surveys open for completion for at least 8 weeks in total.
The analyses of the survey responses are presented descriptively, with percentages rounded to
the nearest 1%. If the survey contained questions where respondents had the opportunity to leave
comments, these are presented thematically, with representative illustrative quotes.
Site interviews
To understand factors impacting trial recruitment at sites, a series of purposeful semistructured interviews
with key personnel at each site, including PIs and lead RNs, were conducted by the trial Clinical Research
Fellow over a 2-month period (April to May 2018). Qualitative research has previously been demonstrated
16
as one of the most helpful tools in identifying and overcoming barriers to recruitment.48,49 The aim of
the interviews was to explore clinician’s experience of recruiting and delivering the trial at their site and
identify barriers to recruitment.
An initial e-mail invitation describing the nature and purpose of the interviews was sent to all PIs
and lead RNs at all 12 open sites in March 2018. Participation was voluntary, and participants were
reassured that no individual or site-specific information would be identified in summary reports.
Interviews could be conducted either face to face or via telephone depending on participant preference.
On receipt of a positive response, an interview was arranged and all were conducted in April and May
2018. Verbal consent was confirmed at the commencement of each interview. A short interview guide
was prepared based on broad themes that had already emerged from previous discussions about
the trial’s progress and difficulty recruiting. Participants were first asked in an open-ended question
to simply comment on their experience recruiting to the trial and then highlight any challenges
encountered. If not already discussed, they were then prompted to provide feedback on the trial’s
screening and recruitment processes, including eligibility criteria. They were also prompted to comment
on any issues encountered with local support for the study, research capacity, participant follow-up
and data collection. Finally, interviewees were asked to highlight any strategies they felt had facilitated
recruitment at their individual site. Interviews ranged from 15 to 50 minutes in length.
With the participant’s permission field notes were taken during the interview to capture key responses.
A summary of the main findings was then verbally confirmed by the participant at the end of each
interview to ensure content validation. Data saturation (i.e. no new information raised in later
interviews) was reached during the interviews.
Thematic analysis of the qualitative data was then undertaken50 to generate a summary list of reported
barriers to trial recruitment. The field notes for each interview were first scrutinised individually and
organised into themes relating to barriers to recruitment. This systematic process was repeated for all
interviews and then combined to produce a final group analysis summary list. Post analysis of the data,
the co-chief investigators reviewed the data for completeness, reporting coherence between the data
and reported themes to ensure robustness of the interpretation of the data.
The trial has benefitted from having an experienced PPI member in the team, Mrs Margaret Grayson,
from study conception to completion. The trial was developed in response to a commissioned call,
meaning the main research question was pre-defined; however, input from the Northern Ireland
Cancer Research Consumer Forum (NICRCF) via Mrs Grayson was that this was an important research
question of value to patients where potential overtreatment and prolonged hospital admission may
negatively impact upon quality of life. From this position, Mrs Grayson contributed to the trial design
with particular input in the following areas: (1) helping to define the composite outcome measure and
define secondary outcome measures important to patients and the health service; (2) defining the non-
inferiority margin to incorporate patients’ views on acceptable trade-offs for treatment de-escalation;
and (3) providing the patient viewpoint on the most appropriate method to obtain day 14 outcome data
balancing the need for data quality with burden on patients. Additional support was given by the readers
panel of the NICRCF at this stage through development and review of the trial protocol, the patient
information sheet, the informed consent form and other patient-facing materials, for example brief
summary flyers and posters for sites to use in SACT treatment units to make patients aware of the trial.
As the trial progressed, there was ongoing input from Mrs Grayson through both her membership of the
TSC and participation in the TMG. Her input was critical when the overall study design was reviewed
during the course of the trial, co-ordinating PPI opinion on the proposed changes and contributing to
the final amended design. Through her linkages with the NICRCF and nationally (with the Independent
Copyright © 2024 Coyle et al. This work was produced by Coyle et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care.
This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction 17
and adaptation in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the title, original
author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
Methods
Cancer Patient Voice group) she sought opinion on the ongoing importance of the research question
and whether there was support for continuation of the trial with changes to the study design. As part
of this process, she co-developed with the study team a PPI survey outlining proposed changes to the
study design with particular focus on whether additional uncertainty around treatment effectiveness
arising from a change in the non-inferiority margin and sample size would be acceptable to patients.
She then collated responses, reporting to the study team the support of the majority of respondents
and providing written and verbal communication with the funder in decision-making about these
proposed changes.
The trial was also supported by additional independent PPI representation on the TSC and DMEC. Input
from these representatives in review of trial data and progress was critical at decision-making points
relating to trial progression and potential amendments to study procedures. Dissemination of results is
an ongoing area of activity for all of the PPI team trial team members.
18
The aim of the internal pilot study was to carefully evaluate the recruitment and adherence assumptions
underpinning the main study design. The main parameters of interest were:
• recruitment rates
• adherence to the protocol-specified treatment
• separation in terms of timing of the antibiotic switch between the two arms.
These criteria were set to guide trial progress and inform the procedures to be utilised in the delivery of
the main trial.
Recruitment rates
A target recruitment rate of 1.7 patients per site per month was set based on historical published data30
and service evaluation data from two of the pilot sites. Progression of the trial without modification
beyond the embedded pilot study was contingent upon at least 75% of this recruitment target being
met. It was otherwise pre-specified that progression would continue with the addition of further trial
sites if 50–75% of this target was met but that progression at a recruitment rate lower than 50% of
this target rate would require review of the trial and discussion with oversight committees, funder
and sponsor for trial progression. The embedded pilot study was intended to last 6 months with 4
participating sites but was extended to 17 months and 10 sites in total, as summarised in Table 3.
The internal four site pilot study was expected to run for 6 months. It commenced on the 17 February
2016, when Site 1 opened and completed on the 21 July 2016. Progress is summarised in Table 4.
Copyright © 2024 Coyle et al. This work was produced by Coyle et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care.
This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction 19
and adaptation in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the title, original
author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
Pilot study results and review of study design
Total 22 7
Recruitment of 31 patients was originally projected if all four sites had been open to recruitment for the
full 6 months. This was based on a recruitment rate of 1.7 patients per month per site, allowing for a 50%
reduction in recruitment at each site during the first 3 months as sites became established. However, delays
encountered at site level resulted in only one of the four sites being open for the full 6 month period. Taking
this into account recruitment of 22 patients was anticipated, but only 7 were recruited. In view of this, the
study was halted to enable review of screening and recruitment activity and recruitment target.
The original accrual target was based on historically published NS surveys and audit data from two
sites, suggesting approximately 20 patients were admitted per month with NS in 2011 and 2013. This
was consistent with the NICE guidance,3 which suggested active specialist units admitted at least 20
patients with NS per month. Allowing for exclusion of high-risk patients (approximately 30%51) and trial
ineligibility it was assumed that 10 patients per month at each site would be eligible and recruitment of
two of these appeared an achievable target.
On review of screening and recruitment logs the number of NS admissions was lower than expected. This
was consistent with updated audit data from sites and may reflect changes in standard care relating to
growing use of targeted therapies and immunotherapies in place of cytotoxic chemotherapy and continued
improvements in the care of patients with suspected sepsis, including NS. However, even within this it was
clear that the majority of patients screened for study entry were considered ineligible, as highlighted by
activity at Sites 1 and 2 in the previous table where 1 of 32 patients and 2 of 26 patients were screened
and recruited, respectively. The reasons for exclusion are summarised in Table 5; as expected around 30%
of patients were high risk based on MASCC score, but for the remainder it seemed that the eligibility
criteria did not reflect the patient population receiving treatment for NS in routine care pathways.
From discussion with the clinical and research teams at study sites, specific issues with the trial eligibility
criteria mainly related to the stringent requirements for fever, neutropenia, use of other antimicrobials
and organ function, summarised in Table 6.
Penicillin allergy 6 3
20
TABLE 6 Summary of difficulties encountered with the original trial eligibility criteria used during the initial pilot phase
1. Neutrophil criteria • Although NICE defines neutropenia as < 0.5 × 109/l, at three of the four pilot sites,
similar to other centres, patients with a neutrophil count of < 1.0 × 1 09/l rather than
< 0.5 × 109/l were routinely commenced on empirical treatment for NS.
2. Fever criteria • Number of scenarios encountered where patients treated for low-risk NS did not meet
the fever criteria (hospital-documented temperature of > 38°C for the trial):
– hospital-documented temperature of 38°C but no recordings > 38°C as paracetamol
had been administered
– self-reported pyrexia at home but apyrexial on presentation and no further fever in
hospital
– low-grade temperature at home/hospital for example 37.8°C, paracetamol admin-
istered and other signs or symptoms suggestive of infection or sepsis
– no home/hospital-documented fever but other signs/symptoms suggestive of
infection or sepsis
– hypothermia recorded and other signs/symptoms suggestive of localising infection
or sepsis.
4. Organ function • Conservative estimates set for organ function including hepatic function, which result-
ed in the upper limit for liver function being lower that those advised in the reference
safety information for all of the antibiotics and more cautious than what is employed in
routine practice.
5. Hypotension • Hypotension incorporated into patients’ MASCC scores but also an independent trial
exclusion criterion, as it is felt to represent potentially haemodynamically unstable
patients, unsuitable for early oral antibiotic treatment.
• Numerous approaches to defining hypotension, some of which take into account pa-
tients’ baseline blood pressure, but it was felt initially this information may not always
be readily available.
• It was evident, however, that an isolated systolic blood pressure measurement of
< 90 mmHg on a single measurement may not represent concerning hypotension, par-
ticularly in for example, otherwise fit, young breast cancer patients with a low baseline
blood pressure.
On initial trial design, the fever and neutrophil thresholds had been aligned with the objective elements
of the NICE definitions of NS with the rationale that it might be difficult to define the non-objective
elements of the NICE definition in which a diagnosis of NS may be appropriate in patients without
documented fever but with other ‘signs or symptoms consistent with clinically significant sepsis’. It was
clear this excluded a significant number of patients commencing treatment for NS.
Copyright © 2024 Coyle et al. This work was produced by Coyle et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care.
This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction 21
and adaptation in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the title, original
author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
Pilot study results and review of study design
Adjustments to the eligibility criteria were therefore proposed focused on ensuring they were less
stringent and more pragmatic, as summarised in Table 7. These adjustments would widen the pool of
eligible patients and ensure the trial population more accurately reflected patients being commenced
on NS pathways in standard clinical practice, providing a more realistic evaluation of the intervention in
routine care.
With the adjusted eligibility criteria, a further 15 patients at Site 1 and 14 patients at Site 2 would have
been potentially suitable during this 6 month pilot phase. It was therefore expected the revised eligibility
criteria would increase the number of eligible patients to 1–2 patients per site per month. A 6-month
extension to the pilot phase was proposed to assess the impact of the adjusted eligibility criteria
on recruitment.
A 3-month, four-site extension to the pilot study was delivered from 1 December 2016 to 28 February
2017, using the adjusted eligibility criteria, summarised in Table 8.
The expected recruitment rate was 1.7 patients per site per month, with again a 50% reduction
permitted for the first 3 months of site opening. With recruitment on hold from 21 July 2016 until
1 December 2016 there was significant loss of momentum at sites, which was difficult to recover
and combined with local site capacity issues resulted in a very short window of potential recruitment
at two sites. Consequently, both of these sites failed to recruit during this extension phase, despite
having been active in screening and recruitment during the first phase of the pilot study. The other
two sites achieved an average monthly recruitment between the two sites of 1.8 patients per month,
similar to the predicted recruitment rate, with review of screening data suggesting a positive impact
Absolute neutrophil count < 0.5 × 109/l Absolute neutrophil count ≤ 1.0 × 109/l with either
– a temperature of at least 38°C
Fever > 38°C – or other signs or symptoms consistent with clinically significant
sepsis for example hypothermia.
Received i.v. piperacillin/tazobactam or mero- Systemic antibiotic administered prior to randomisation is not a
penem for < 24 hours reason for exclusion
Patients who have been started on additional antimicrobial drugs
(e.g. gentamicin or teicoplanin) are eligible provided the physician in
charge of their care is willing to stop this additional antimicrobial at
the time of enrolment
Adequate hepatic (AST and/or ALT < 2.5 × ULN) Adequate hepatic (AST and/or ALT < 5 × ULN) function within
function within 24 hours prior to randomisation 24 hours prior to randomisation
Physician in charge of care willing to follow Highlighted that prophylactic use of CSF is not an exclusion criterion
either the intervention or standard care protocol
per randomisation at enrolment, including not
treating with CSF
Hypotension (systolic pressure < 90 mmHg) Hypotension (systolic pressure < 90 mmHg on greater than one
within 24 hours of randomisation measurement) within 24 hours of randomisation
22
TABLE 8 Summary of extended pilot phase (I) (December 2016 to February 2017)
4 1 February 2017 1 1 0 0 0
of the adjusted eligibility criteria on recruitment. It was, however, again noted that the number of NS
admissions remained lower than historical data, with an average of six admissions per month.
Due to the longer than anticipated pilot phase, under-recruitment was now inevitable if the project
timeline was not modified, even if the number of recruiting sites for the main trial was expanded
significantly from 12 to 20. To maximise the potential for successful completion of the trial, with the
research question as fully addressed as possible, the preferred option was to increase the number of
recruiting sites to 20 and extend the project timeline by approximately 1 year. To mitigate risk, it was
agreed first to further extend the pilot phase until November 2017, aiming to open an additional seven
sites during this period. This would allow an assessment of the potential recruitment at a broader
selection of sites. A revised recruitment target was set of one patient per month per site to account for
the lower frequency of neutropenic admissions.
A further 8 month period of recruitment to the pilot phase of the trial occurred between April and
November 2017. Six additional sites were opened during this phase and a summary of recruitment by
site is shown in Table 9. Even with the revised recruitment target of one patient per site per month, only
50% of the expected recruitment was met, with 24 patients recruited compared with the predicted 49
(average monthly recruitment rate across all sites was 0.4 patients).
TABLE 9 Recruitment activity in the extended pilot phase (II) (April 17 to November 17)
Site Start date Target recruitment Total recruitment Recruitment rate (patients/site/month)
6 17 July 2017 4 0 0
9 18 September 2017 2 0 0
10 28 September 2017 2 0 0
11 13 November 2017 0 0 0
Total 49 24 0.4
Copyright © 2024 Coyle et al. This work was produced by Coyle et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care.
This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction 23
and adaptation in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the title, original
author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
Pilot study results and review of study design
By 30 November 2017, there had been 17 months of active recruitment to the study, with as planned
10 sites open to recruitment and an eleventh due to open shortly. Forty-two patients had been
recruited compared with a revised target of 68 patients as summarised in Figure 1.
The final criteria for trial progression was evidence of adequate separation in terms of the timing of
antibiotic switch of at least 24 hours between the trial arms. The time on i.v. antibiotics was calculated
for each patient and then the mean calculated for each trial arm and the difference between the two
arms assessed. The mean duration of i.v. antibiotics was 19 hours in the intervention arm and 48 hours
in the control arm; hence, mean separation in terms of timing of antibiotic switch was acceptable at
29 hours.
The internal pilot phase of the EASI-SWITCH trial demonstrated that while recruitment was challenging
there were no other concerns relating to treatment failure, protocol adherence or safety concerns.
Based on recruitment between April and November 2017, it was likely that on average each site would
only be able to recruit one patient every 2 months. The pilot phase had demonstrated that recruitment
to the original proposed sample size of 628 patients for the main trial was not going to be achievable.
Recruitment had originally been scheduled to complete at the end of December 2018. With 10 sites
open and recruiting on average one patient every 2 months, based on current recruitment activity total
recruitment was estimated to complete at approximately 100 patients. This would result in a significantly
80
70
60
Actual cumulative total
50
Initial cumulative target total
40 (1.7 patient/site/month)
30 Revised cumulative target total
(1 patient/site/month)
20
10
0
Jan-16 May-16 Sep-16 Jan-17 May-17 Sep-17
FIGURE 1 Summary of recruitment activity at the end of the pilot phase (February 2016 to November 2017): total
recruitment of 42 patients.
24
underpowered study, with results unlikely to have any significant impact and the evidence gap for
an early oral switch identified by NICE remaining unanswered. It was clear important assumptions
underpinning the trial design would have to be urgently reviewed to decide about whether to progress
beyond the pilot phase to main trial delivery.
In view of the recruitment difficulties and the longer than anticipated pilot phase, an updated
understanding of how low-risk NS patients were currently being managed across the UK was critical to
assess the continued importance of the research question and assess whether there remained equipoise
between the trial arms.
Between January and June 2018, NS management policies were reviewed and a survey of practice
was undertaken nationally. Local NS policies from throughout the UK were sought via an e-mail
request distributed to acute oncology nurse specialists within United Kingdom Oncology Nursing
Society (UKONS) and EASI-SWITCH team members. Policies were reviewed for compliance with NICE
recommendations, with particular focus on those advocated as key priorities for implementation in the
guideline and their approach to low-risk management.
It is likely that a wide range of factors, including awareness of guidance, personal treatment preferences
and clinical experience, will influence individual compliance with local policies when delivering NS care.
A complementary electronic survey aimed to more fully reflect clinicians’ daily clinical practice, attitudes
and preferences when managing NS. The survey link was disseminated via the UKONS, Royal College
of Pathologists’ electronic newsletter and the clinicians involved in the EASI-SWITCH trial with onward
dissemination to colleagues encouraged. In the survey, respondents were encouraged to reflect on their
individual routine practice, rather than what their local institution’s NS policy or national guidelines
might recommend.
A review of standard practice, completed for NICE in 2012, suggested approximately a third of 51
English and Welsh centres surveyed included the option of empirical oral antibiotics for lower-risk adult
patients, with the intention of immediate discharge or earlier discharge compared with i.v. inpatient
antibiotics.3 It was unknown if this remained the status quo in the years following the publication
of NICE guidance, with no national data available regarding centres’ standard approach to low-risk
NS patients.
A total of 53 adult NS policies were returned and reviewed: six cancer network policies and 47 acute
trust policies, with representation from all four UK nations. As the request for policies was often
forwarded to colleagues within a healthcare trust, it was not possible to determine an overall response
rate. Most policies (94%) provided advice for both oncology and haematology patients. All policies,
which were dated, had been updated post 2012, with no policy obviously issued before the NICE
guidance was published and 57% specifically referenced that guideline.
A total of 235 responses were received from the electronic survey of individual practice. After excluding
those containing only demographic data or minimal responses, there were 217 evaluable surveys. Again,
Copyright © 2024 Coyle et al. This work was produced by Coyle et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care.
This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction 25
and adaptation in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the title, original
author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
Pilot study results and review of study design
there was representation from all four nations, with 69% of respondents based in England. The majority
(72%) worked in oncology (predominantly as oncology consultants, acute oncology specialist nurses
and advanced nurse practitioners), 23% worked in haematology and the remaining 5% were consultants
mainly based in EDs or acute or general medicine. Forty-three per cent worked in university hospitals
or regional cancer centres, 52% worked in acute hospitals with SACT day case units on site, and the
remaining 5% worked in smaller acute hospitals which did not deliver SACT.
Of major interest was understanding current practice regarding routine risk stratification and any specific
low-risk protocols or practices. The policies varied in their adoption of the NICE recommendations focused
on assessing patients’ risk of septic complications and in decision-making about when, or if, to switch to
oral antibiotics and about hospital discharge.
When practice was reviewed in 2012 by the NICE GDG, approximately a third of adult policies included
the option of empirical oral antibiotics for lower-risk patients, with the intention of immediate discharge
or earlier discharge compared with i.v. inpatient antibiotics (NICE30). In contrast, approximately half of
current polices (53%) encourage identification of low-risk patients, with potential discharge on oral
antibiotics within 48 hours after hospital admission. Almost half the policies (45%) suggest stratification
based on MASCC score. Risk stratification is often only performed by senior oncology/haematology
doctors or acute oncology specialists, if available.
Only 40% of clinicians reported routinely risk-stratifying patients within 24 hours of presentation. The
MASCC score was most commonly used (by 70%), with the remaining 30% of clinicians using a local
institutional risk-scoring system, a Modified Early Warning Score (EWS; Subbe et al.53) or the Clinical
Index of Stable Febrile Neutropenia (CISNE; Carmona-Bayonas et al.54).
A wide range of approaches to early oral antibiotics and outpatient management are described in policies
and by clinicians. Only 9% of policies clearly describe the option of starting empirical oral antibiotics for
low-risk patients from the outset and most of these admit patients for 24–48 hours before discharge.
Similarly, only a small number of survey respondents (5%) suggested they would start upfront oral
antibiotics rather than i.v. antibiotics initially for low-risk patients. A further three haematology consultants
suggested this would be considered for patients with difficult i.v. access or who were in the terminal
phase of illness. Most policies do not define a period of observation following the start of oral antibiotics,
although 13% of policies specify at least a 24-hour admission to hospital. The most common ‘low-risk’ oral
antibiotic regimen is co-amoxiclav (625 mg three times daily) and ciprofloxacin, (either 500 mg or 750 mg
twice daily; 16 of 20 policies specifying a regimen) for 5 to 10 days in duration.
A number of the policies referred to the extensive additional clinical criteria that the American Society
of Clinical Oncology (ASCO) suggest should exclude patients from outpatient management, including
ensuring patients do not live alone, they have access to a telephone and transport and can return to
hospital promptly.7,29
NICE commented in 2012 that the criteria for considering either stopping or switching from i.v. to oral
antibiotics greatly varied. This work showed continuing variation in ongoing inpatient management of
uncomplicated NS. Sixty-eight per cent of policies provided advice about when it might be suitable
to switch from i.v. to oral antibiotics, in addition to guidance about early oral antibiotics. The majority
(57%) recommend considering a switch from i.v. to oral antibiotics at 48 hours. The European Society
for Medical Oncology (ESMO) guideline offers further advice about a range of factors to consider at
48 hours for switching to oral antibiotics and duration of treatment, which have been incorporated into
many policies.28 This includes whether the patient is still febrile and the neutrophil count is > 0.5 × 109/l.
One hundred and sixty-three survey respondents provided some indication as to when they would
routinely switch low-risk uncomplicated patients to oral antibiotics and discharge home. These
questions were not answered by clinicians who treat with oral antibiotics from the outset. Thirty-seven
26
per cent reported switching to oral antibiotics typically within 24 hours of admission, 44% within or
at 48 hours and 20% after 48 hours of admission. Various standard times to discharge after switching
patients to oral antibiotics were also reported, ranging from immediate discharge in 27% to after at least
24 hours of observation in 53%.
It was evident that clinicians generally do not recalculate MASCC scores after admission. They confirmed,
however, that the most important criteria, apart from initial risk scores, for determining when to switch
to oral antibiotics are duration of apyrexia (70%) and if symptoms are improving (62%). Over half the
respondents consider the patient’s neutrophil count (56%) and availability of microbiology results (52%) as
important. Fewer consider the duration of i.v. antibiotics the patient received (31%) and expected duration
of neutropenia (12%).
Survey respondents highlighted common reasons preventing early discharge of low-risk patients
before 48 hours of hospitalisation (see Table 10), most commonly a clinically well patient experiencing
ongoing fever.
It would therefore seem that despite the introduction of NICE guidance risk stratification is not routine
practice for many NHS centres or clinicians. A small number of specialist teams are prescribing upfront
oral antibiotics for low-risk patients, but this practice appears limited. There has been some increase in
the number of policies which include the option of discharging low-risk patients on oral antibiotics before
48 hours but approximately half of policies still advise initial i.v. antibiotics and subsequent oral switch
after 48 hours or later. Even more clinicians, approximately two-thirds, in their routine practice choose to
switch from i.v. to oral antibiotics at 48 hours or later. It is therefore evident that for at least half of centres
and clinicians surveyed routine practice is in accordance with the standard care arm in the EASI-SWITCH
trial. There has not yet been widespread adoption of risk stratification tools or routine early oral antibiotics
in low-risk patients. A number of factors appear to have slowed progress, including the limited evidence
base highlighted in the NICE guidance and in some cases dissatisfaction with current risk stratification
tools, which has resulted in centre, clinician and patient hesitance about early oral switch approaches.
The majority of policies encourage initial investigations and empirical antibiotic regimens that accurately
reflect NICE recommendations and therefore the initial management approach assumed in the EASI-
SWITCH trial. Eighty-five per cent of polices promote initial beta-lactam monotherapy, compared to
only 36% in NICE’s 2012 review. There has been a general reduction in the routine use of empirical
aminoglycosides and glycopeptides for patients with central lines: 13% of current policies include
gentamicin as part of an empirical dual antibiotic regimen, compared with 63% in 2012. Four of the
current policies suggest initial doses of gentamicin but that these only be continued if there are signs
of severe sepsis or for haematology patients. Local organism antibiotic resistance patterns are likely to
TABLE 10 Common reasons cited by survey respondents preventing early discharge of uncomplicated low-risk patients
(before 48 hours of hospitalisation)
Patients have other clinical issues keeping them in hospital, for example, other anticancer treatment toxicities 45 (97)
The centre does not have an agreed protocol for early discharge of low-risk patients 30 (66)
The centre does not have an agreed pathway for follow-up of low-risk patients discharged early 26 (56)
Patients’ initial microbiology results are not available, for example, blood cultures 24 (52)
Copyright © 2024 Coyle et al. This work was produced by Coyle et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care.
This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction 27
and adaptation in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the title, original
author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
Pilot study results and review of study design
be a contributing factor for those policies where gentamicin is routinely administered to all patients and
is permitted under NICE guidance. Only 4% of current policies suggest empiric use of glycopeptides if
a central line is present but a line infection not suspected, compared to 15% in 2012. Clinical practice
therefore supported the standard care i.v. antibiotics being utilised in the EASI-SWITCH trial.
Finally, comparing diagnostic thresholds to the NICE guidance, only 19% of policies and 24% of survey
respondents define neutropenia as a neutrophil count of ≤ 0.5 × 109/l as suggested by NICE, with most
employing a broader definition. While there has been a reduction in policies simply defining neutropenia
as < 1.0 × 109/l (51% compared with approximately 70% of adult policies in 2012) this is offset by
those that include patients whose neutrophil count is < 1 × 109/l and expected to fall. More policies
now encourage starting empirical treatment in patients who have had a single temperature ≥ 38°C
(78% compared with 50% in 2012), in keeping with NICE criteria. Similarly, a patient presenting with
a single temperature of 38°C or above would meet the temperature criteria used by 96% of clinicians
and just over a third (36%) of these clinicians would start empirical treatment if lower temperature
thresholds were recorded (e.g. single/sustained temperature of ≥ 37.5°C/≥ 37.7°C). The importance of
considering NS in patients who are generally unwell, irrespective of their temperature, was stressed in
the majority of policies, including prompts for signs and symptoms such as rigors, altered mental state
and haemodynamic instability. Overall the review of current policy and practice supported the proposed
adjustments to the eligibility criteria to the trial.
The review of current NS practice confirmed the continued importance of the research question
nationally and the potential impact the trial could have on routine NS management in the UK. A careful
review of the assumptions underpinning the original trial design and sample size calculation was
therefore undertaken to determine whether the delivery of a smaller study could still have a meaningful
clinical impact.
On initial design, the trial was powered at 90% and with a one-sided 97.5% CI, to detect non-inferiority
of the early antibiotic intervention within a margin of 10%, assuming a 15% treatment failure rate in the
standard care arm. This would require 269 patients per group. Allowing for a 5% dropout rate and up to
10% crossover from control to intervention, 314 participants would be required for each group, resulting
in an overall target sample size of 628 patients.
The assumed 15% treatment failure rate for patients receiving standard care was derived from the three
studies thought to best reflect the proposed control arm in relation to the populations included and
duration of i.v. antibiotic treatment administered.36,55,56
The pilot results raised no concerns regarding treatment adherence, separation between the treatment
arms or the observed treatment failure rates in each arm. It was therefore presumed that the
assumptions relating to those sample size parameters remain valid but, in retrospect, the choice of
non-inferiority margin and statistical analysis may have been too stringent for a pragmatic trial where
treatments were being used within their licensed indications or established clinical practice and where
the risk of treatment failure was unlikely to result in serious risk to patients (in particular critical care
admission or death).
1. A historical consensus guideline advocating the use of a 10% margin in trials of antibiotic treatment
among patients with NS.47
28
2. Advice from the trial’s PPI co-applicant and representatives that this was an acceptable trade-off,
for the potential overall gain in quality of life expected within this margin of uncertainty for clinical
effectiveness.
It is important to note the consensus recommendation for a 10% margin relates to the overall NS
population, with no consideration for stratification by risk of septic complications. This approach may
be over-simplistic given the significant differences in clinical outcomes in low- and high-risk patients.
The EASI-SWITCH target population are patients at low risk of septic complications, selected through
their MASCC score and additional study eligibility criteria. Treatment failure in this population, as
highlighted in two Cochrane reviews, therefore typically results in persistence or recurrence of fever,
leading to prolongation of admission or re-admission for further i.v. antibiotic treatment. There has
been no association noted between mortality and oral antibiotic treatment in low-risk patients.37,57
This contrasts sharply with patients classified at high risk of complications at presentation, where
treatment failure is likely to have more significant consequences and potentially result in organ failure,
critical care admission or even death.
It was therefore felt appropriate to explore the acceptability of a larger non-inferiority margin
considering the low-risk patient population, as this could maintain an acceptable trade-off between
the possibility and consequences of treatment failure versus the potential quality of life and economic
benefits associated with early switch. Therefore, the opinions of PPI and clinician stakeholders was
sought on whether a review of design including widening of the non-inferiority margin would remain
acceptable for assessment of the primary outcome.
Input was sought from a range of PPI representatives. A summary of the study design and progress,
including the rationale and implications for reviewing the sample size and specifically the non-inferiority
margin, was prepared and distributed via e-mail to the membership of two PPI forums (see Appendix 1):
(1) the Northern Ireland Cancer Research Consumer Forum, which has a range of patient and carer
members from across Northern Ireland who work in partnership with cancer researchers; and (2) the
Independent Cancer Patient Voice (ICPV), a national independent patient advocate group.
Respondents were requested to reply via e-mail as to whether they supported the proposed change in
non-inferiority margin or not, with additional comments also welcome. Consent was obtained from all
respondents for their comments to be made publicly available.
Twenty-one survey replies from patient and public representatives were received, with the majority
of these supportive of increasing the non-inferiority margin from 10% to 15% (n = 19). Additional
comments from seven of these respondents along with comments from one uncertain respondent
and one who was not supportive are detailed in Appendix 1. Respondents’ comments demonstrated a
good understanding of the key issues. They highlighted that earlier discharge if feasible is an important
quality-of-life issue for many patients. The concerns raised about patients having adequate support at
home and being able to be re-admitted quickly again if required, as well as the small risk of an adverse
clinical outcome, are extremely appropriate.
2. UK clinicians’ opinion
Opinion was also sought from clinicians nationally regarding the proposed widening of the non-inferiority
margin. A short description of the trial, key study design considerations and feedback to date on the
proposed revisions from PPI representatives was summarised for clinicians. Again, respondents were asked
a simple yes/no question, with additional comments welcome (see Appendix 2). Trial co-investigators and
site PIs disseminated the survey via e-mail throughout their clinical networks. Attendees at a Scottish
Clinical Trials showcase meeting (January 2018) were also surveyed using a paper copy of the questionnaire.
Copyright © 2024 Coyle et al. This work was produced by Coyle et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care.
This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction 29
and adaptation in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the title, original
author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
Pilot study results and review of study design
Almost all clinicians who provided feedback were supportive of widening the non-inferiority margin
from 10% to 15% and continuing the study. In total, 50 responses were received from 39 consultants,
9 clinical fellows/speciality trainees and 2 RNs, with representation from the four UK nations. All but
one of the respondents were supportive of the revision. Anonymised clinician comments in support of
widening the non-inferiority are detailed in Appendix 2, and typically highlighted the continued validity
of the research question and the potential impact upon practice. Notably, clinicians within centres that
consider early/upfront oral antibiotics were supportive of continuation of a smaller achievable study;
although this would involve altering the current standard of care in these centres, this would be an
acceptable approach for the proposed time period given the potential to generate results that could
make a compelling argument for further acute oncology service development. The cost-effectiveness
analysis to be undertaken within the study was also perceived to be important, with the potential to
show a reduction in length of stay cited in support of study continuation.
Additionally, the EASI-SWITCH trial is part of the National Cancer Research Institute’s Colorectal Cancer
Clinical Studies Group (CSG) portfolio; hence, the proposed change to study design was presented
at the Adjuvant and Advanced Disease CSG Subgroup meeting in January 2018. Membership of this
group includes UK-wide representation from oncology (nine consultant medical oncologists) and other
disciplines, including a statistician and clinical trials unit director. This group was also unanimously
supportive of the proposed revision to the non-inferiority margin.
The EASI-SWITCH DMEC and TSC (met 22 November 2017 and 1 December 2017, respectively) both
supported this approach and recommended continuing the study with a revised non-inferiority margin.
The TSC were influenced in particular by the continued importance of the research question to the NHS
and the strong support from PPI respondents when making their recommendation.
The revised sample size calculation with a 15% non-inferiority margin and one-sided 95% CI requires
230 patients with retention of 90% power, a 5% dropout rate and a 10% crossover rate from control
to intervention.
In addition to this stakeholder support, the study sponsor and HTA programme director were also
supportive of continuation with the proposed revisions in study design. Based on the recruitment during
the pilot phase, the revised target recruitment rate was 0.5 patients per site per month. Accrual of the
revised sample size of 230 based on this target would be achieved by increasing the number of trial
sites (to a total of 20) and the duration of recruitment to allow for the halt during the pilot phase and its
subsequent prolongation.
30
The internal pilot phase of EASI-SWITCH highlighted lower than anticipated recruitment rates, even
with the revision of eligibility criteria and associated positive impact on recruitment. Further revision
to study design was deemed acceptable to the trial stakeholders with the aim of delivering a clinically
meaningful study. On review of updated audit data from two study sites, it was clear there was a
sustained downward trend in NS admissions, consequently a revised recruitment target of 0.5 patients
per site per month was set with an accompanying increase in number of recruiting sites to 20.
Post pilot phase, the EASI-SWITCH trial continued recruitment for another 24 months. In total, 19 out
of a planned 20 sites opened to recruitment, which were a combination of cancer centres and units.
This included 14 sites in England, 3 in Northern Ireland, 1 in Scotland and 1 in Wales (see Appendix 3,
Table 37). In April and May 2019, 4 sites requested closure due to inactivity, leaving 15 active sites at
the time of trial closure.
Identification of interested and appropriate sites was challenging. A range of methods were employed
to promote the trial including the NIHR clinical research networks, relevant professional groups and
national meetings. NIHR regulations around TSC and DMEC independence precluded participation
of some interested sites because of associations with TSC and DMEC members. Table 11 summarises
reasons for site non-participation.
In total, 827 patients were screened for trial entry. The main reasons for exclusion (in order of frequency)
were patients not fulfilling the diagnostic criteria of NS, a diagnosis of acute leukaemia, deemed at high
risk of complications using the MASCC score (score < 21), history of penicillin (or other IMP) allergy, the
physician in charge was not willing to support entry into either trial arm or not treat with CSFs, signs of
severe localising infection present or the patient had already received > 24 hours of i.v. antibiotics. In
total, 129 participants were recruited out of the target sample size of 230. In November 2019, the TSC
recommended trial closure due to under-recruitment. A summary of recruitment activity across the trial
phases is provided in Table 12 and Figure 2.
In view of the lower than anticipated target population, there was a need to understand the barriers
to recruitment experienced by sites as the trial progressed and identify potential solutions in order to
maximise the likelihood of successful trial delivery. This was particularly important in recognition of the
narrow window of opportunity for patients to be recruited, whereby screening and recruitment both had
to occur within 24 hours of commencing i.v. antibiotics for NS.
Copyright © 2024 Coyle et al. This work was produced by Coyle et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care.
This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction 31
and adaptation in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the title, original
author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
Main trial progression
Cumulative 7 18 42 129
recruitment
To understand factors impacting recruitment at sites, two approaches were taken as the trial progressed
post pilot phase. These were (1) semistructured interviews with key site personnel and (2) an investigator
survey of barriers to recruitment.
All clinicians who were invited to take part via e-mail agreed to participate with representation from
all 12 sites open to recruitment, including 12 PIs and 11 RNs (one open site had no RN in post due to
illness). A summary list of reported barriers to trial recruitment is presented in Table 13.
The most common barrier consistently noted by all sites unsurprisingly was the lower than anticipated
number of patients being admitted with NS and therefore reduced pool of potentially eligible patients. It
was noted at several sites that some patients required repeated hospitalisation with NS and other SACT-
related toxicities during treatment, further reducing the number of potentially eligible patients.
Logistical issues at the site were more frequently identified as barriers compared to individual clinician
barriers. It was noted that this trial, as an acute oncology trial across multiple tumour types, differed
from the majority of oncology/haematology trials in their research portfolio, where patients were
identified and managed as outpatients by tumour site-specific research teams, meaning the daily
250
0
Apr-17 Aug-17 Dec-17 Apr-18 Aug-18 Dec-18 Apr-19 Aug-19
FIGURE 2 Cumulative actual recruitment vs. predicted recruitment for the EASI-SWITCH trial (April 2017 to November
2019 inclusive). Total recruitment of 129 patients (November 2019). With the adjusted recruitment rate of 0.5 patients per
site per month from January 2018 predicted recruitment was 216 patients by November 2019, based on the number of
open sites.
32
TABLE 13 Summary of barriers to recruitment encountered in the EASI-SWITCH trial, as reported by interviewed
clinicians (n = 23)
Investigator
requirement for screening and patient identification could be challenging. Recruitment was also more
challenging if the RNs were solely responsible for screening with minimal engagement or support from
front-line clinical staff. The unpredictable nature of NS admissions and the requirement to be available at
short notice made it difficult to plan workload.
Clinical and research team members’ interest in the study and the perceived importance of the trial and the
research question it is trying to address were cited as an important barrier. While enthusiasm was often
noted to be high when the trial opened, long periods of actively screening but not recruiting impacted morale
and general willingness to continue to actively screen, refer and recruit patients. Maintaining prioritisation
and interest in the study was reported as challenging with short-term clinical staff, for example, rotating
junior medical staff or changes in inpatient nursing staff. Research teams therefore needed to regularly
promote the trial and train new staff. Specialist registrars or clinical fellows, if available at sites, were noted
to be well placed to help with consent, confirm eligibility and institute the allocated management plan but
needed responsive site training and delegation to be available given typically short-term rotations.
The experience and confidence of the team member first introducing the study to patients was
also noted to be important. RNs in particular noted recruitment was easiest when experienced and
enthusiastic senior clinicians, for example senior acute oncology nurse specialists, consultants or
clinical fellows, promptly reviewed patients post admission and considered their suitability for the trial,
introducing trial participation as a treatment option from the outset for patients. Several RNs highlighted
their limited experience reviewing inpatients, including patients with NS.
Three of the 12 sites (predominantly PIs) also importantly noted a preference by some clinicians for
the intervention arm compared with standard care. All of the these sites prior to trial opening had
utilised MASCC scoring and had a specific low-risk policy in place. They had, however, been supportive
of the trial being undertaken and agreeable to recruit patients. Undoubtedly, some of the low-risk
NS admissions have been treated with an approach similar to the intervention arm, rather than being
offered the EASI-SWITCH trial. One site described how ‘bed pressures’ had resulted in some patients
being managed with what they perceived to be an intermediate approach between the intervention and
standard care trial arms. Conversely, some RNs indicated that certain clinicians were less supportive of
certain groups of patients participating, whom they viewed as ‘higher risk’. This included certain tumour
types, for example haematology and sarcoma patients or patients presenting with severe neutropenia
(ANC < 0.1 × 109/l), despite there being no clear evidence to support this approach.
While barriers related to trial design were infrequently cited, these related to the inability to recruit
penicillin-allergic patients and the sponsor requirement for confirmation of eligibility and prescription of
Copyright © 2024 Coyle et al. This work was produced by Coyle et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care.
This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction 33
and adaptation in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the title, original
author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
Main trial progression
protocolised therapy by a medical professional. Otherwise, it appeared that the previous revisions to the
eligibility criteria had facilitated recruitment and the trial population was now reflective of the low-risk NS
population seen in routine practice. While patient follow-up was viewed favourably, it was noted that the
28-day follow-up could be difficult to achieve if patients had received a further cycle of SACT within this
period, particularly if toxicities related to this were experienced and/or re-admission with a new episode
of NS or other SACT toxicity occurred, as this tended to impact patients’ recall of the NS episode related
to the preceding cycle of treatment. Reporting of AEs beyond the day 14 primary outcome measure was
felt to be not clinically relevant to the episode of NS in view of this and, along with capturing concomitant
medications which could be multiple in this patient population, was a potential burden.
Site staff felt that the trial was well received by the majority of patients but, as anticipated, the short
time to consider participation and consult with family or friends was the most common barrier for
patients. Otherwise, patients’ previous experiences with SACT toxicity (and unscheduled care
admissions arising from this) and symptom burden were also relevant – previous experiences, other
toxicities, lack of improvement in symptoms from initial admission and difficulty coping with existing
burden of information and uncertainty from an individual patient’s cancer care plan even prior to
considering trial entry were all considered barriers to recruitment.
Overall, the interviews provided a clearer, in-depth understanding of the perspectives of key site
personnel trying to recruit patients to the EASI-SWITCH trial. With equal representation from all sites,
selection and non-respondent bias was avoided. It was evident a range of barriers to recruitment were
present at several levels at trial design, site, individual clinician and patient levels, some of which could
potentially be addressed.
Forty complete responses were obtained with representation from all active sites except one (i.e. 15 of 16
open sites). Forty-eight per cent were RNs, 18% were site PIs and 33% were subinvestigators; 90% had
been involved in the trial since it opened and 83% had been actively involved in recruiting participants.
Table 14 details the factors identified as barriers to recruitment by 30% or more of respondents. They
are listed in order of their weighted score, providing an indication as to which barriers were felt most
significant. The percentage of respondents who considered it a barrier at all (from somewhat to highly
significant) is also provided.
The most commonly reported barriers of reduced NS admissions, the unscheduled patient
population and short window for recruitment, were the same as those that had been identified in the
semistructured interviews:
I think that we have a motivated team who are keen to recruit but we have very few numbers actually
coming into our oncology assessment unit and ED with neutropenic sepsis (far smaller numbers than I
had realised).
A small number have been missed due to lack of availability of research nurses within the time frame.
34
TABLE 14 Most frequent barriers to recruitment as reported in the electronic survey (n = 40 survey responses)
The trial’s eligibility criteria were also highly ranked as a barrier, more prominently than had emerged
in the interviews. Apart from inability to recruit penicillin-allergic patients, this probably refers to CSFs
being prohibited once on study. There is expert national and international consensus that this is not an
indicated intervention in low-risk patients but nevertheless remains common practice. While survey
respondents continued to express their enthusiasm and commitment to the trial it is interesting that
the lack of engagement and enthusiasm of other colleagues was felt to be more significant at this stage
of the trial than previously had been reported through the interviews. Table 15 summarises the results
reported for all of the listed barriers categorised according to the ORCA key recruitment domains.
In general, the electronic survey further supported the multiple barriers that had emerged from the
semistructured interviews, confirming that they were ongoing issues, which continued to impact
recruitment. No new barriers were identified that had not previously been present. The variation
in equipoise between the trial arms experienced by different clinicians and patients was, however,
more prominently described in the survey than in the interviews. While the interviews had alluded to
preferences for the intervention or standard care arms, it was clearer from the survey that there could
in fact be significant preferences from investigators, clinical colleagues and patients for one arm over
the other, impacting recruitment. Thirty per cent of survey respondents were inclined to prefer the
intervention (early antibiotic switch), whereas clinical colleagues could prefer either standard care (cited
by 49% respondents) or the intervention arm (cited by 38% respondents), hindering recruitment. Similarly,
Copyright © 2024 Coyle et al. This work was produced by Coyle et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care.
This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction 35
and adaptation in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the title, original
author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
Main trial progression
TABLE 15 Survey respondents’ impression of listed potential barriers to recruitment in relation to their experience of the
EASI-SWITCH trial (n = 40 survey responses)
24-hour window Potential participants are Training respondent Which recruiter approaches
for recruitment and unscheduled inpatients (68%) received on the study the potential patient about
randomisation (62%) protocol (8%) the trial (22%)
Respondent prefers
standard care (14%)
Notes
≥ 50% of respondents identified factor as barrier to recruitment.
≥ 30–49% of respondents identified factor as barrier to recruitment.
≤ 29% of respondents identified factor as barrier to recruitment.
36
some patients’ strong preference for standard care (cited by 43% respondents) and others for the early oral
intervention (cited by 38% respondents) had the potential to prevent trial recruitment:
The only barrier has been eligible patients declining entry to the study as their preference was inpatient
antibiotic treatment.
Sometimes patients have turned down the study because they did not want a 50:50 chance of having to
stay in on i.v. for 48 hrs if low risk.
The electronic survey was a quicker and easier strategy to obtain feedback about recruitment from
a wider range of responders with different roles across different sites with variable recruitment
performances. The ORCA recruitment domains provided a framework to guide the survey’s questions
and ensure key barriers were not missed, although not all listed factors were overly applicable, and
some benefitted from tailoring to the individual EASI-SWITCH setting. The survey importantly avoided
interviewer bias and allowed respondents to express their views freely and anonymously. As a result
of this a greater understanding of the variation in preference for one trial arm across the study was
obtained. Despite a good response rate, potential limitations of the survey were obviously respondent
non-response, selective responder bias and misinterpretation of questions.
As the trial progressed and recruitment failed to meet expectations, a pragmatic shift in recruitment
strategies occurred, with additional approaches added to try and address the modifiable barriers
identified. As previously discussed, revision of eligibility criteria was made during and after the pilot
phase to ensure the study was pragmatic and reflected the patient population routinely treated for
NS. Further minor adjustments were made based on investigator interview feedback in May 2018,
including: (1) recruitment of patients given additional systemic antibiotics at the time of presentation
(such as a single dose of gentamicin) provided it was clinically appropriate to discontinue these at the
time of enrolment, to include patients presenting to non-specialist units; (2) addition of suspension
oral antibiotics to protocolised antibiotic therapy for patients unable to swallow tablets; (3) clarification
of use of short-acting CSF to include patients who had a course of short-acting prophylactic CSFs
prescribed as part of their SACT regimen but continuing to exclude those commenced on CSF as
treatment for the presenting episode of NS.
In response to feedback about clinical workload, AE reporting was simplified, reducing the reporting
period from 28 days to 14 days, with reporting of AEs beyond the 14-day primary outcome follow-up
felt unlikely to add anything additional, in terms of understanding AEs related to the early switch
antibiotic intervention. Shortening the reporting period was felt to benefit research teams, as it was not
uncommon for patients to be re-admitted to hospital again within the current 28-day reporting period,
once they had received a further cycle of chemotherapy. These hospital admissions were unrelated to
the patient’s EASI-SWITCH episode and treatment but required research teams to report them as a
serious AE within 24 hours of becoming aware. By shortening the reporting period to just the primary
follow-up period of interest, it was hoped it would allow teams to prioritise time for recruiting new
patients by reducing the intensity of patient follow-up required.
In the electronic survey distributed in March 2019, investigators were also asked to share any strategies
they had found useful at their site in facilitating recruitment, so they could be shared with other sites.
All comments related to optimising awareness of the trial, with clinical staff first assessing and managing
new admissions and trying to create a suitable pool of staff who could provide consistent screening of
patients and perform research-related tasks.
Copyright © 2024 Coyle et al. This work was produced by Coyle et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care.
This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction 37
and adaptation in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the title, original
author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
Main trial progression
While revisions to the eligibility criteria and trial design appeared to have a positive impact on
recruitment initially, it is apparent from the recruitment graph in Figure 2 that, by the end of 2018,
recruitment was consistently falling behind target and appeared to be plateauing thereafter, suggesting
achieving even a smaller study in a timely manner would be challenging. Consequently, the DMEC
recommended study closure on grounds of under-recruitment in November 2019. Despite clinician
and researcher support for the study, persistent challenges to recruitment in relation to the numbers of
potential patients and the challenges of identifying and enrolling patients within a narrow time window
following admission remained. It is also possible that as time progressed, the variation in equipoise
between trial arms demonstrated in the investigators’ survey (March 2019) in comparison to the site
team interviews (April 2018) became more prominent and was potentially accompanied by changes in
clinicians’ treatment approaches.
38
Recruitment
One hundred and twenty-nine patients were enrolled in EASI-SWITCH when trial closure was recommended
by the DMEC in November 2019. In total, 827 patients were screened for study entry; the most common
reasons for screen failure are described in the previous chapter and listed in Appendix 5. Recruitment
numbers by site are summarised in Table 16 with a list of sites provided in Appendix 3, Table 37.
In total, 129 patients were randomised from 19 sites. Sixty-five patients were randomised to the early
switch intervention and 64 to the standard care control arm (see Figure 3, CONSORT diagram). Of these,
125 patients were included in the primary ITT analysis (comprising 61 patients allocated to intervention
and the 64 patients allocated to control). Four patients were excluded (all allocated to intervention) for
the following reasons: one patient was randomised in error, one withdrew from continued participation
and two patients were lost to follow-up. Twelve patients included in the primary ITT analysis were
s01 50 (38.8)
s02 4 (3.1)
s03 15 (11.6)
s04 13 (10.1)
s05 2 (1.6)
s06 5 (3.9)
s07 5 (3.9)
s09 9 (7.0)
s10 1 (0.8)
s11 7 (5.4)
s12 7 (5.4)
s13 3 (2.3)
s15 1 (0.8)
s16 4 (3.1)
s17 2 (1.6)
s19 1 (0.8)
Copyright © 2024 Coyle et al. This work was produced by Coyle et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care.
This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction 39
and adaptation in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the title, original
author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
Clinical effectiveness of early oral switch
Excluded (n = 698)
• Did not meet eligibility criteria, n = 581
• Unable to provide informed
consent, n = 6
• Other, n = 111
Randomised
n = 129
excluded from the PP analysis; consequently, the primary PP population comprised 53 patients in the
intervention group and 60 in the standard care group. The reasons for exclusion of the eight patients
in the intervention group were: premature discontinuation of antibiotic treatment (n = 4), interruption
40
to antibiotic treatment involving at least two consecutive missed doses (n = 2) and insufficient initial
i.v. antibiotic treatment (n = 1). All four excluded patients in the standard care group had received
< 48 hours of i.v. antibiotic treatment.
Baseline characteristics
Table 17 describes the patient, tumour and treatment characteristics in the intervention and control
groups. As anticipated, only a minority of participants had a haematological malignancy (6.2%) in
comparison with solid tumours (93.8%), of which the most common cancer type was breast cancer
(54.6%). The majority of patients were receiving treatment in the neoadjuvant or adjuvant setting
(60.4%) rather than palliative setting (27.9%). In general, baseline characteristics were well balanced
across the intervention and control groups in relation to cancer type, anticancer treatment and
symptoms and signs of infection (including fever, absolute neutrophil count and MASCC score). Use
of prophylactic Granulocyte colony stimulating factor (GCSF) support was noted to be higher in the
standard care arm (34.4%) in comparison to the intervention arm (15.6%).
TABLE 17 Baseline characteristics. Data presented as mean (SD) for continuous data and number (%) for categorical data
Treatment group
Gender:
Malignancy:
continued
Copyright © 2024 Coyle et al. This work was produced by Coyle et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care.
This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction 41
and adaptation in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the title, original
author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
Clinical effectiveness of early oral switch
TABLE 17 Baseline characteristics. Data presented as mean (SD) for continuous data and number (%) for
categorical data (continued)
Treatment group
Blood cultures:
All patients (n = 64) randomised to the standard care arm commenced allocated study treatment; however,
four patients did not complete allocated treatment, receiving < 48 hours of i.v. antibiotic therapy. Two
patients randomised to the early switch intervention (n = 65) did not proceed to allocated study treatment
due to ineligibility (n = 1) and withdrawal of consent (n = 1). Therefore, 63 patients in the intervention arm
commenced allocated treatment; however, protocolised treatment was not completed in eight patients for
a number of reasons. These included premature switch to oral antibiotics (after < 12 hours of i.v. antibiotic
therapy; n = 1); late switch to oral antibiotics (after 24 hours of i.v. therapy; n = 2); completion of < 5 days
42
antibiotic treatment in total (n = 1) and a combination of late oral switch (after 12 hours) and short duration
(< 5 days) of treatment in total (n = 2).
The mean duration of i.v. antibiotic therapy (and SD) was 54.8 hours (24.2) and 22.6 hours (26.9) in the
standard care and early switch intervention groups, respectively.
No patients in the standard care arm were lost to follow-up for the day 14 primary outcome measure.
Three patients is the intervention arm were lost to follow-up at day 14; however, it was still possible to
determine the primary outcome for one of these patients, who had a treatment failure before the day 14
time point.
In total, of 65 patients allocated to intervention, 61 were included in the primary outcome ITT analysis
and 53 in the PP analysis. Of the 64 patients allocated to standard care, all were included in the ITT
analysis and 60 included in the PP analysis.
Protocol deviations
In total, 93 protocol deviations were reported. The most common reason for these was assessments
taking place outside of schedule (45.2%). These typically related to the timing of study questionnaires
at baseline, day 14 and day 28 of follow-up. This might be anticipated, particularly for the follow-up
questionnaires, given this patient population are likely to have multiple hospital attendances related to
continued SACT or management of complications arising from treatment or their underlying disease.
Protocol deviations by number and type across treatment groups are listed in Table 18.
Treatment outcomes
Primary outcome
Both ITT and PP analyses were conducted for the primary outcome measure of treatment failure. It was
pre-specified that equal weighting would be given to both analyses such that a definitive conclusion of
non-inferiority required both analyses to concur. A one-sided 95% confidence limit placed about the
difference in treatment failure rate was compared to the non-inferiority margin of 15%. Conclusion
of non-inferiority required that the upper bound of the one-sided 95% CI placed about the difference
in treatment failure rates (intervention minus control) should not exceed 15% (see Figure 4). The 95%
one-sided confidence limit was derived from the upper bound of a two-sided 90% CI. The Pearson
Treatment group
Total 44 49 93
Copyright © 2024 Coyle et al. This work was produced by Coyle et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care.
This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction 43
and adaptation in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the title, original
author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
Clinical effectiveness of early oral switch
chi-square test was used to test significance of observed differences between trial arms. Table 19
presents the number (%) and the differences in proportions (95% CI) in relation to the primary outcome
in the ITT and PP analyses.
In the ITT analysis, 9 of the 64 patients (14.1%) in the standard care arm met the primary end point of
treatment failure, compared with 15 of 61 (24.6%) in the early oral switch arm. Based on the pre-specified
15% non-inferiority margin, the risk difference of 10.5% (one-sided 95% CI −1% to 22%; p = 0.14) was
such that the intervention was not found to be non-inferior to standard care in the ITT population.
The result of the PP analysis was not consistent with the ITT analysis. In the PP population, 8 of the
60 patients (13.3%) in the standard care arm met the primary end point of treatment failure, compared
with 9 of 53 (17%) in the early oral switch arm. The risk difference of 3.7% (one-sided 95% CI −7% to
14.8%; p = 0.59) was such that the intervention was found to be non-inferior to standard care in the
PP population.
Non-inferiority for the early switch intervention could not be concluded in the absence of concurrence
of both the ITT and PP analyses and, even if concurrence had been demonstrated, findings would remain
TABLE 19 Analyses for the primary outcome in the ITT and PP populations
Standard care (n = 64) Intervention (n = 61) Risk difference (90% CI) p-value
No 55 (85.9%) 46 (75.4%)
No 52 (86.7%) 44 (83.0%)
44
limited due to relative under-powering of the analyses. The main constituents of the composite primary
outcome measure that accounted for patients reaching the treatment failure end point by day 14 were
persistence/recurrence of fever and/or physician-directed escalation from the protocolised antibiotic
regimen. None of the treatment failure events recorded in either arm were attributable to the need for
critical care support or death before day 14. Tables 20 and 21 present the constituents of the primary
outcome measure in the ITT and PP populations, respectively. The number of patients for whom each
component of the composite outcome measure was available is expressed, by trial arm, for that measure
and the p-value given is from significance testing of observed differences between trial arms using the
Pearson chi-square test.
A post hoc exploratory analysis using generalised estimating equations (GEE) to account for possible
clustering of observations within participating centres produced a risk difference (RD; 95% CI) of
0.106 (−0.032 to 0.244); p = 0.13, indicating no significant difference in risk of treatment failure when
examining study site as a random effect.
Secondary outcomes
Among patients for whom secondary outcome data were available, there was a reduction in median duration
of inpatient admission. Time to fever resolution, re-admission to hospital to day 28, survival to day 28, or
changes to the originally intended SACT regimen appeared similar between the two arms (see Table 22).
TABLE 20 Constituents of the composite primary outcome measure leading to patients reaching the treatment failure end
point in the ITT population
No 55 (85.9%) 46 (75.4%)
Persistence/recurrence of fever n = 62 n = 60
(T ≥ 38°C) after 72 hours
of i.v. antibiotic initiation
No 58 (93.6%) 50 (83.3%)
No 58 (90.6%) 51 (83.6%)
No 62 (100%) 61 (100%)
No 60 (96.8%) 59 (96.7%)
Copyright © 2024 Coyle et al. This work was produced by Coyle et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care.
This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction 45
and adaptation in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the title, original
author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
Clinical effectiveness of early oral switch
TABLE 21 Constituents of the composite primary outcome measure leading to patients reaching the treatment failure end
point in the PP population
a Median and interquartile range presented and p-value from Wilcoxon rank-sum test.
b p-value from Pearson chi-square test.
Note
Frequency and percentage presented for treatment arms.
46
Subgroup analyses
Subgroup analyses were pre-planned in the ITT population in the following subgroups: (1) tumour type
(solid tumour vs. haematological malignancy); (2) neutrophil count at randomisation (≤ 0.5 × 109/l vs.
> 0.5 × 109/l) and (3) maximum temperature on the day of presentation (< 38°C vs. > 38°C). A post hoc
subgroup analysis based on blood culture results (positive or negative) was also performed. The first
pre-specified analysis was not undertaken due to the small number of patients with haematological
malignancy enrolled in the study. Risk differences and 99% CI from the treatment × subgroup interaction
models are presented in Table 23 for the remaining subgroups for the primary outcome of TFR. The
p-values presented are from a global test for interaction and indicate no significant interactions.
Safety
Adverse events
In total, 106 AEs were observed from randomisation to the day 14 primary outcome measure end point.
Of these, 46 occurred in the intervention arm. As might be anticipated, gastrointestinal disorders were
the most commonly reported AEs, occurring in 33 patients (25.6%), of whom 12 patients were in the
intervention arm.
There were 29 serious AEs, 12 of which occurred in the intervention arm. Of these, one was fatal but
deemed unrelated to protocolised treatment. Eleven SAEs (8.5%) were due to blood and lymphatic
system disorders, which may have reflected complications arising in patients who received a further
cycle of SACT within the study reporting period.
Overall the AE profiles were similar between intervention and control groups. Table 24 summarises the
total number of AEs, ARs, SAEs, serious adverse reactions (SARs) and SUSARs according to the number
of events/patients by treatment group.
Treatment group
Treatment failure rate n (%) Standard care Intervention RD (99% CI) Interaction p-value
Copyright © 2024 Coyle et al. This work was produced by Coyle et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care.
This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction 47
and adaptation in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the title, original
author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
48
AE/AR, Total number of AEs 106 60 46 56 (43.4) 30 (46.9) 26 (40.0) 0.85 (0.57 to 1.27) 0.48
SAE/SAR and
SUSAR Total number of ARs 40 24 16 23 (17.8) 14 (21.9) 9 (13.9) 0.63 (0.30 to 1.36) 0.26
Total number of SAEs 29 12 17 28 (21.7) 12 (18.8) 16 (24.6) 1.31 (0.68 to 2.55) 0.52
AEs Blood and lymphatic system 12 6 6 12 (9.3) 6 (9.4) 6 (9.2) 0.98 (0.34 to 2.89) 1.00
disorders
General disorders and administration 15 7 8 14 (10.9) 6 (9.4) 8 (12.3) 1.31 (0.48 to 3.57) 0.78
site conditions
Infections and infestations 6 3 3 6 (4.7) 3 (4.7) 3 (4.6) 0.98 (0.21 to 4.70) 1.00
Nervous system disorders 5 2 3 5 (3.9) 2 (3.1) 3 (4.6) 1.48 (0.26 to 8.55) 1.00
Respiratory, thoracic and mediastinal 4 2 2 3 (2.3) 1 (1.6) 2 (3.1) 1.97 (0.18 to 21.18) 1.00
disorders
Skin and subcutaneous tissue 3 2 1 3 (2.3) 2 (3.1) 1 (1.5) 0.49 (0.05 to 5.30) 0.62
disorders
DOI: 10.3310/RGTP7112
TABLE 24 Adverse events by treatment group (continued)
SAEs Blood and lymphatic system 11 6 5 11 (8.5) 6 (9.4) 5 (7.7) 0.82 (0.26 to 2.55) 0.76
disorders
General disorders and administration 9 3 6 9 (7.0) 3 (4.7) 6 (9.2) 1.97 (0.51 to 7.54) 0.49
site conditions
Background
A within-trial economic evaluation was performed to assess the cost-effectiveness of early switch to oral
antibiotics compared with usual care in the treatment of NS in patients with cancer. This included a cost-
effectiveness analysis (CEA) consistent with the primary outcome measure to estimate the cost per treatment
failure avoided at day 14 and a CUA to estimate the cost per QALY at day 14. The primary measure used in
these analyses was the QALY, estimated from the EQ-5D-5L questionnaire administered at baseline and at day
14 of follow-up (either in person or using the validated telephone version). In recognition that the EQ-5D-5L
only measures the potential effect on health of an early switch from i.v. to oral antibiotics and does not reflect
patients’ preferences for non-health effects of the intervention, such as early discharge from hospital, a Patient
Follow-up Questionnaire was used to collect additional information on this.
Methods
As the study treatments are for infection, not cancer, a short-term time horizon reduced the chance of
costs and effects being contaminated by the impact of underlying disease or cancer therapy. A 14-day time
horizon was adopted and the analysis was performed from a hospital perspective. Discounting of costs and
outcomes was not necessary due to the time horizon being < 1 year. Patients’ use of hospital resources was
collected over the study period on the case-report form using data from the day 14 interview and review
of medical records, including treatments and medication received during the primary admission and any
associated re-admissions. Costs were calculated by attaching appropriate unit costs from publicly available
sources59–61 (e.g. Department of Health National Schedule of Reference Costs) and are listed in Appendix 6,
Table 38. The final year of data collection was taken as the cost year (2018/2019).
For the CUA patients’ HRQoLs were measured at baseline and at day 14 of follow-up using the EQ-5D-5L
(either in person or using the validated telephone version) and the 3L mapping function62 was used to
convert responses into a single utility value, as currently recommended by NICE.63 The area-under-the-
curve method was used to estimate patient-specific QALYs accrued over the study duration. For the
cost-effectiveness analysis, treatment failures were categorised as described in the previous chapter.
Since the EQ-5D-5L only measures the potential effect on health of an early switch from i.v. to oral
antibiotics and does not reflect patients’ preferences for non-health effects of the intervention, such as early
discharge from hospital, a Patient Follow-up Questionnaire was used to collect additional information on this.
Following database lock, individual patient data were evaluated to measure costs and QALYs related to
early oral switch and standard care. Descriptive statistics were used to summarise the hospital resource
use, associated costs and outcomes as means with 95% CIs for each group. Significance was judged
where the CIs of differential means excluded zero or p < 0.05. The study was powered for the primary
outcome of treatment failure but not for costs, QALYs or cost effectiveness.
The mean differences in costs, treatment failures and QALYs between groups were estimated and
incremental cost-effectiveness ratios (ICERs) were calculated to estimate the cost per QALY gained
Copyright © 2024 Coyle et al. This work was produced by Coyle et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care.
This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction 51
and adaptation in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the title, original
author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
Health economic and patient preference analyses
(CUA) and the cost per treatment failure avoided (CEA) and the non-parametric bootstrapping was
used to resample with replacement the cost and outcome data from the original sample to generate
1000 replicate ICERs. These were then plotted on the cost-effectiveness plane to display their joint
distribution. Cost-effectiveness acceptability curves (CEAC) were constructed from the data by
calculating the proportion of the ICER replicates which would be considered cost-effective at various
thresholds of willingness-to-pay (WTP) for an additional QALY and to avoid a treatment failure. In
general NICE consider interventions with an ICER of < £20,000/QALY to be cost-effective;64 however,
no such threshold exists for treatment failures avoided.
The net monetary benefit (NMB) was also used to aid interpretation. The NMB is a summary statistic
representing the value of an intervention in monetary terms when a WTP threshold for a unit of benefit
is known. A positive NMB indicates the intervention is cost-effective. A range of threshold values were
used for each analysis. All analysis was carried out using Stata 15/IC (StatCorp) for Windows®.
Sensitivity analyses
The following sensitivity analyses were performed:
1. In both the CUA and CEA costs and outcomes were adjusted for baseline age, gender and EQ-5D-5L
score using multiple regression.
2. Where missing data levels were > 5% multiple imputation was used to predict missing values. As the
levels of missing data in the CUA for QALYs were 13% (16% intervention, 9% control), QALY data
points were filled using multiple imputation by chained equations and predictive mean matching to
generate 20 imputed data sets. Treatment group, baseline EQ-5D-5L score, age and gender were
entered into the model as predictors of missing data. Multiple imputation was not required for the
CEA as missing data for treatment failures were under 2%.
3. PP analyses were carried out for both the CUA and CEA, including only patients who received treat-
ment as detailed in the protocol and excluding those who did not.
4. An unplanned sensitivity analysis was conducted to exclude a patient in the CEA who had a prolonged
ICU admission.
Non-health outcomes
A follow-up questionnaire was designed to determine what participants thought about the antibiotic
treatment they received and also to find about their hypothetical preferences for future antibiotic
treatment should they develop NS again (see Appendix 7). The questionnaire contained 14 questions,
including questions to measure agreement towards specific statements (agree/disagree/uncertain),
closed questions about treatment choice and home care, and one open-ended question to gather
rationale for preferred treatment method. The number (%) of patients who agree or disagree with each
statement in the questionnaire is presented and analysed.
Results
One hundred and twenty-six patients were eligible for the economic analysis; 62 in the intervention
group and 64 in the standard care group. The results are presented in two parts: the CUA based on
using the QALY as the outcome using complete data; and the cost effectiveness using treatment failures
avoided, also only using complete data. Results using all available data are included in Appendix 8,
Tables 39–41.
Cost–utility analysis
To maintain the correlation structure of the data the primary CUA analysis only included those
participants with complete cost and QALY data, therefore if EQ-5D-5L data were not collected
at baseline and day 14, or cost data were missing, they were excluded. These data were available
for 110 patients (52 in the intervention group and 58 in the standard care group), with a higher
52
proportion in the intervention arm having missing data (16% vs. 9%). Use of hospital services within
14 days of randomisation, including the primary admission and any subsequent re-admission(s), is
presented in Table 25. The mean length of stay in participants’ primary admission was 0.52 days
longer for standard care, as might have been anticipated from an early oral switch intervention. The
mean length of stay during re-admission was less than half for standard care patients compared to
those in the intervention arm. None of the differences between groups were statistically significant.
The corresponding costs of these services, along with drug costs, are presented in Table 26. The additional
time spent as an inpatient led to a mean difference in cost of £250. The mean cost of study drugs was over
TABLE 25 Hospital service use by group with complete cost and QALY data. Values are number (percentages) of patients
using the service and mean (95% CI) use
Primary admission
Ward days 52 (100.00) 2.62 (1.99 to 3.24) 58 (100.00) 3.14 (2.71 to 3.57) −0.52 (−1.26 to 0.22)
Emergency- 2 (3.85) 0.04 (−0.02 to 0.09) 2 (3.45) 0.03 (−0.01 to 0.08) 0.00 (−0.07 to 0.08)
department
attendancea
Re-admission
Ward days 4 (7.69) 0.46 (−0.13 to 1.06) 2 (3.45) 0.19 (−0.08 to 0.46) 0.27 (−0.35 to 0.89)
Emergency- 4 (7.69) 0.08 (0.00 to 0.15) 2 (3.45) 0.03 (−0.01 to 0.08) 0.04 (−0.04 to 0.13)
department visits
Outpatient visits 2 (3.85) 0.04 (−0.02 to 0.09) 2 (3.45) 0.03 (−0.01 to 0.08) 0.00 (−0.07 to 0.08)
TABLE 26 Cost (£UK) of hospital service use by group inpatients with complete cost and QALY data. Values are mean
(95% CI) costs
Mean cost £ (95% CI) Mean cost £ (95% CI) Mean difference (95% CI)
Primary admission
Ward days 1250.81 (951.16 to 1550.46) 1500.72 (1294.76 to 1706.67) −249.91 (−603.17 to 103.35)
Emergency- 7.54 (−3.06 to 18.13) 6.76 (−2.73 to 16.24) 0.78 (−13.24 to 14.80)
department attendance
Re-admission
Ward days 220.73 (−63.81 to 505.27) 90.70 (−37.14 to 218.55) 130.03 (−167.57 to 427.63)
Emergency- 15.08 (0.39 to 29.76) 6.76 (−2.73 to 16.24) 8.32 (−8.61 to 25.25)
department visits
Outpatient visits 5.19 (−2.11 to 12.49) 4.66 (−1.88 to 11.19) 0.54 (−9.12 to 10.19)
Medication
Study drug 52.18 (44.00 to 60.35) 83.19 (68.68 to 97.70) −31.01 (−48.00 to −14.02)
Concomitant 13.34 (2.33 to 24.35) 33.40 (2.02 to 64.77) −20.06 (−54.44 to 14.33)
medication
Total 1564.86 (1171.52 to 1958.21) 1726.18 (1453.16 to 1999.19) −161.31 (−626.74 to 304.11)
Copyright © 2024 Coyle et al. This work was produced by Coyle et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care.
This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction 53
and adaptation in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the title, original
author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
Health economic and patient preference analyses
£30 higher in the standard care arm, due to the lower unit cost of ciprofloxacin and co-amoxiclav, and the
difference was statistically significant. The mean total cost was £1726 in the standard care arm compared
to £1565 for intervention, a mean difference of £161, which was not statistically significant.
Mean HRQoL scores are reported in Table 27. There were no significant differences in baseline or
follow-up scores in EQ-5D-5L or visual analogue scale. Both measures showed increases in both groups
by similar amounts, with the base figure being higher in the intervention arm for each method. The
incremental QALY gain was small and not statistically significant: 0.002 QALYs is equivalent to 0.73 days
in full health per year, but given that the follow-up period was 14 days, any difference would be small.
Although the differences are small, in cases such as this where the intervention is cost-saving and leads
to more positive outcomes the intervention is said to be the dominant strategy (see Table 28). The ICER
is not calculated as it would be a negative and would not convey any meaning.65 Figure 5 demonstrates
the result of the bootstrapped ICERs and the majority of points fall in the south-east quadrant, indicating
that in the majority of cases the intervention is associated with cost savings and QALY gains, albeit small
and not statistically significant. The CEAC in Figure 6 shows at a WTP threshold of £20,000/QALY there
is a 78% probability the intervention is cost-effective compared to standard care. The NMB was positive
TABLE 27 Health-related quality-of-life scores by group (patients with complete cost and QALY data). Values are mean
(95% CI) scores
Variable Mean (95% CI) Mean (95% CI) Difference (95% CI)
EQ-5D-5L utilities
Baseline 0.78 (0.71 to 0.84) 0.74 (0.68 to 0.80) 0.03 (−0.05 to 0.12)
14 days 0.82 (0.77 to 0.87) 0.77 (0.72 to 0.82) 0.05 (−0.03 to 0.12)
EQ-5D VAS
Baseline 65.94 (59.99 to 71.90) 59.31 (53.97 to 64.65) 6.63 (−1.25 to 14.52)
14 days 76.12 (71.13 to 81.10) 69.98 (65.37 to 74.60) 6.13 (−0.58 to 12.84)
Primary analysis −161.31 (−630.59 to 307.96) 0.002 (−0.001 to 0.004) Dominant strategy
(nI = 52, nSC = 58)
Sensitivity analysis – controlling −125.45 (−612.33 to 361.44) 0.001 (−0.000 to 0.002) Dominant strategy
baseline characteristics
(nI = 52, nSC = 58)
Sensitivity analysis – multiple 18.42 (−520.09 to 556.93) 0.001 (−0.001 to 0.004) £11,437.45
imputation of QALY values
(nI = 62, nSC = 64)
nC, number analysed in standard care arm; nI, number analysed in intervention arm.
a Values not presented for negative ICERs.
54
0.005
Incremental QALYs
-
costly and less effective
NW: Intervention more
–0.005
than standard care
–0.010
£1500
£1250
£1000
£750
£500
£250
£0
–£250
–£500
–£750
–£1000
–£1250
–£1500
threshold of £20,000/QALY.
Incremental costs
Copyright © 2024 Coyle et al. This work was produced by Coyle et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care.
This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction 55
and adaptation in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the title, original
author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
Health economic and patient preference analyses
100%
90%
80%
Probability that intervention is cost-effective
70%
60%
Primary analysis
Controlled for baseline
50%
Multiple imputation
30%
20%
10%
0%
£0 £5000 £10,000 £15,000 £20,000 £25,000 £30,000 £35,000 £40,000 £45,000 £50,000
Willingness to pay per QALY gain (£)
FIGURE 6 Cost-effectiveness acceptability curves showing the probability of intervention being cost-effective compared
to standard care for the primary and sensitivity analyses using QALYs as the outcome.
for all WTP thresholds (see Table 29), indicating the intervention was cost-effective compared to standard
care, while the CEAC constructed (see Figure 7) from this method showed a marginal difference in cost-
effectiveness probability (79%).
Using multiple imputation to estimate QALY scores for those not completing the EQ-5D-5L at day
14 resulted in the intervention arm’s mean cost being more than £18 higher than standard care and
a slight increase in QALYs. This generated an ICER of £11,437/QALY, and a 54% probability of being
cost-effective at a ceiling ratio of £20,000/QALY, much lower than the primary analysis, which can be
partly attributed to the reversal in total costs. Those receiving the intervention who were missing these
follow-up data were much heavier resource users than their counterparts and due to incomplete data
were not included in the primary analysis.
TABLE 29 Incremental net benefit at various willingness-to-pay thresholds per QALY gained
Willingness to pay per additional QALY Incremental net benefit (mean, 95% CI)
56
100%
90%
80%
Probability that intervention is cost-effective
70%
60%
40%
30%
20%
10%
0%
£0 £5000 £10,000 £15,000 £20,000 £25,000 £30,000 £35,000 £40,000 £45,000 £50,000
Willingness to pay per QALY gain (£)
FIGURE 7 Cost-effectiveness acceptability curve showing the probability of intervention being cost-effective compared to
standard care using the net monetary benefit method.
The PP analysis showed the intervention to once again be the dominant option. The difference in QALYs
remained small but the intervention was shown to be almost £320 less costly than standard care, with
the revised CEAC estimating a 93% probability of the intervention being cost-effective (see Figure 6).
Cost-effectiveness analysis
Complete data were available for 124 patients (98%) for this analysis (100% standard care, 97%
intervention), resulting in a slightly different population to the CUA. Table 30 shows the use of hospital
resources. For those re-admitted to ward, the mean length of stay was more than double for intervention
patients, 0.4 compared to 0.17 days, in part due to two of these patients both remaining hospitalised
for 11 days. Notably in the intervention arm, one patient was transferred to critical care 5 days after
starting antibiotics and was still there at the 14 day follow-up. This patient was excluded from the CUA
as they did not complete the EQ-5D-5L at day 14.
Costs of hospital resources and drugs are illustrated in Table 31. As was the case in the CUA, the
difference in cost of study drug is statistically significant. Total costs were on average £22 higher in the
intervention arm using these data – a difference that was not statistically significant.
In contrast to the CUA, these data have shown the cost to be marginally greater in the intervention
arm, and the outcome to be negative due to higher treatment failure rate (see Table 32), although no
differences were statistically significant. When this occurs the intervention is dominated by standard
care. Figure 8 shows a large percentage of the bootstrapped ICERs in the north-west quadrant with
higher costs and negative outcomes. As before, negative ICERs have not been calculated.
There is no generally accepted WTP threshold for treatment failure avoided but the CEAC (see
Figure 9) shows the probability of being cost-effective at varying amounts: at £1000 it was 36%,
decreasing to 13% at £10,000. The CEAC does not cut the y-axis as some of the joint density includes
cost savings (SE and SW quadrants of Figure 8) and asymptotes to zero because the density does not
involve health gains.66
Copyright © 2024 Coyle et al. This work was produced by Coyle et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care.
This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction 57
and adaptation in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the title, original
author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
58
NIHR Journals Library www.journalslibrary.nihr.ac.uk
Service n (%) Mean (95% CI) n (%) Mean (95% CI) Mean difference (95% CI)
Primary admission
Ward days 60 (100.00) 2.78 (2.18 to 3.38) 64 (100.00) 3.17 (2.73 to 3.61) −0.39 (−1.12 to 0.34)
Critical care days 1 (1.67) 0.15 (−0.15 to 0.45) 0 (0) - 0.15 (−0.14 to 0.44)
Emergency department 2 (3.33) 0.03 (−0.01 to 0.08) 2 (3.13) 0.03 (−0.01 to 0.08) 0.00 (−0.06 to 0.07)
Re-admission
Ward days 4 (6.67) 0.40 (−0.11 to 0.91) 2 (3.13) 0.17 (−0.07 to 0.41) 0.23 (−0.32 to 0.78)
Emergency-department visits 4 (6.67) 0.07 (0.00 to 0.13) 2 (3.13) 0.03 (−0.01 to 0.08) 0.04 (−0.04 to 0.11)
Outpatient visits 2 (3.13) 0.03 (−0.01 to 0.08) 2 (3.13) 0.03 (−0.01 to 0.08) 0.00 (−0.06 to 0.07)
author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
and adaptation in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the title, original
This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction
Copyright © 2024 Coyle et al. This work was produced by Coyle et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care.
DOI: 10.3310/RGTP7112
TABLE 31 Cost of hospital service use by group in patients (complete cost and treatment failure data). Values are mean (95% CI) costs
Mean cost £ (95% CI) Mean cost £ (95% CI) Mean difference (95% CI)
Primary admission
Ward days 1331.13 (1044.22 to 1618.03) 1516.95 (1307.80 to 1726.10) −185.82 (−534.10 to 162.46)
Emergency department 6.53 (−2.63 to 15.70) 6.13 (−2.46 to 14.71) 0.41 (−12.01 to 12.83)
Re-admission
Ward days 191.30 (−54.95 to 437.55) 82.20 (−33.52 to 197.91) 109.10 (−154.78 to 372.98)
Outpatient visits 4.50 (−1.81 to 10.81) 4.22 (−1.70 to 10.13) 0.28 (−8.27 to 8.84)
Medication
Study drug 52.28 (44.83 to 59.73) 80.81 (67.45 to 94.16) −28.52 (−43.94 to −13.11)
Concomitant medication 20.29 (3.54 to 37.05) 40.26 (7.84 to 72.68) −19.97 (−56.83 to 16.89)
Total 1759.08 (1283.51 to 2234.65) 1736.68 (1466.92 to 2006.44) 22.40 (−510.16 to 554.96)
59
Health economic and patient preference analyses
Treatment failure avoided – 22.40 (−508.92 to 553.71) −0.09 (−0.23 to 0.05) Dominated by
primary analysis standard care
(nI = 60, nSC = 64)
Sensitivity analysis – controlling 122.87 (−461.66 to 707.41) −0.10 (−0.25 to 0.04) Dominated by
baseline characteristics standard care
(nI = 60, nSC = 64)
Sensitivity analysis – excluding −131.57 (−579.67 to 316.53) −0.08 (−0.22 to 0.06) £1650.22
patient who had prolonged
ICU admission
(nI = 59, nSC = 64)
nC, number analysed in standard care arm; nI, number analysed in intervention arm.
a Negative ICER values not presented.
£1000
NW: Intervention more
costly and less effective NE: Intervention
£800 more costly and
than standard care
more effective than
£600 standard care
£400
£200
Incremental costs
£0
–£200
–£400
–£600
–£1200
–0.40 –0.35 –0.30 –0.25 –0.20 –0.15 –0.10 –0.05 0.00 0.05 0.10 0.15
Incremental treatment failures avoided
FIGURE 8 Cost-effectiveness plane for the primary cost-effectiveness analysis showing 1000 bootstrapped replications of
mean incremental costs and treatment failures avoided.
When using NMB at varying thresholds of WTP, the result was positive (meaning the intervention is
cost-effective) for values up to £240/treatment failure avoided, and negative from £250 and above (see
Table 33). The CEAC using NMB data (see Figure 10) showed a 39% probability of the intervention being
cost-effective over standard care at a WTP threshold of £1000/treatment failure avoided.
60
100%
90%
Probability that intervention is cost-effective
80%
70%
30%
20%
10%
0%
£0 £5000 £10,000 £15,000 £20,000 £25,000 £30,000 £35,000 £40,000 £45,000 £50,000
Willingness to pay per treatment failure avoided (£)
FIGURE 9 Cost-effectiveness acceptability curves showing the probability of intervention being cost-effective compared
to standard care for the primary and sensitivity analyses, using treatment failure rate as the outcome.
TABLE 33 Incremental net benefit at various willingness-to-pay thresholds per treatment failure avoided
Willingness to pay for treatment failure avoided Incremental net benefit (mean, 95% CI)
The PP analysis also showed the intervention arm to be less expensive by almost £150 per patient and
although there were still on average more treatment failures in this arm (0.02), it was less than in the
primary analysis. The probability of the intervention being cost-effective increased to 68% at a threshold
of £1000/treatment failure avoided.
Copyright © 2024 Coyle et al. This work was produced by Coyle et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care.
This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction 61
and adaptation in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the title, original
author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
Health economic and patient preference analyses
100%
90%
80%
Probability that intervention is cost-effective
70%
60%
40%
30%
20%
10%
0%
£0 £5000 £10,000 £15,000 £20,000 £25,000 £30,000 £35,000 £40,000 £45,000 £50,000
Willingness to pay per treatment failure avoided (£)
FIGURE 10 Cost-effectiveness acceptability curve showing the probability of intervention being cost-effective compared
to standard care using the net monetary benefit method.
Patient preferences
A total of 114 patients (60 in the standard care group and 54 in the intervention group) provided responses,
with slightly fewer for probability-based questions. The overwhelming majority of patients (95%) in
both arms were satisfied with the care received and level of hospital support, and were happy with their
method of treatment, believing it to be effective (see Table 34). Approximately, 70% of patients in each arm
disagreed that they were concerned their treatment would not work beforehand and a total of 16 patients
were concerned about how treatment for NS would affect family and friends (intervention 15%; standard
care 13%). Of these 16, 88% would be willing to accept the risk of re-admission (15%) for early discharge,
and 81% said they would still accept the risk even if this doubled to 30%, indicating a strong preference to
be discharged as soon as possible.
A greater proportion of those in the intervention arm thought it was important to be discharged 1–2 days
earlier, 59% in comparison to 35% in the control arm (see Table 35). This shows a tendency for patients to
choose the response in keeping with the treatment they actually received. Patients in both arms agreed
it was important not to be re-admitted to hospital although with slightly more in the intervention group
agreeing this (85% vs. 72%). The majority of patients in both groups agreed they would accept some risk of
re-admission in order to be discharged early (72% in the intervention group and 65% in the control group).
When asked which treatment they would choose, 71% of patients in the intervention arm said they would
choose the early switch to oral antibiotics, compared with 46% of standard care patients, again suggesting
allegiance to the treatment received.
When presented with the hypothetical scenario of risk of re-admission doubling from 15% to 30%, 74%
and 64% of intervention and standard care patients respectively would still opt for early discharge.
62
There was some evidence of completion errors regarding these hypothetical risk-based questions
observed in a small number of responses, showing some difficulty in understanding and interpreting
these scenarios.
In both groups, the bulk of respondents did not receive home care on a daily basis or have
dependents, as shown in Table 36. Of the 24 participants who stated they receive daily care at home,
there was a strong inclination to get home: 22 (92%) would accept the risk to be discharged early;
19/22 (86%) would accept the higher risk of re-admission in order to be discharged early. There
were seven patients who said they received daily care at home as well as having to care for children
or dependents.
Copyright © 2024 Coyle et al. This work was produced by Coyle et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care.
This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction 63
and adaptation in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the title, original
author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
Health economic and patient preference analyses
i.v. in hospital for at least 48 hours then switch to oral 15 (28.85) 31 (54.39)
i.v. in hospital for 12–24 hours then switch to oral 37 (71.15) 26 (45.61)
No 14 (26.42) 20 (35.71)
No 41 (75.93) 49 (81.67)
No 38 (70.37) 45 (75.00)
Conclusion
The primary CUA showed that although the early switch to oral antibiotics led to small gains in HRQoL
and small cost savings the differences were not statistically significant. The probability of the intervention
being cost-effective was highest for all WTP thresholds in the PP sensitivity analysis. Although two
subsequent sensitivity analyses estimated the intervention as slightly more costly than standard care, the
ICERs were favourable (well under £20,000/QALY). There was a higher number of treatment failures in the
intervention group within the CEA, meaning the intervention was dominated by standard care. However,
64
subsequent analysis removing a high resource outlier showed a small and not statistically significant cost
saving for those receiving the intervention. This one patient, who had a prolonged ICU episode for an
uncommon condition that was not related to treatment allocation in this trial, appeared to bias the costs
allocated to the intervention arm. Given that this patient was not representative of patients with low-risk
NS, it was felt appropriate to consider the effect of removing this patient’s data.
The results of the CUA and CEA are not consistent, which may reflect the difference in individual
patient data used in the analyses as a result of missing data. While the CEA showed a greater number of
treatment failures in the intervention arm, there was a small but not statistically significant gain in QALYs
for this arm. This can be seen by the large number of bootstrapped ICERs in the NE and SE quadrants
of Figure 5, suggesting the intervention did indeed impact on patient HRQoL, albeit in a small way.
Interestingly the incremental QALYs went in the opposite direction to incremental treatment failures.
Although the trial was unable to conclude that the intervention is non-inferior to standard care, the CUA
showed both treatments had a similar impact on HRQoL. Therefore, although treatment failures as the
primary outcome are clinically important and relate to the intended purpose of treatment for NS, these
are not synonymous with HRQoL, as reflected in patient EQ-5D-5L responses, presenting a disparity
between what is valued by clinicians and patients.
The aim of the patient preference questionnaire was to elicit preferences for non-health outcomes,
and the responses showed the majority of patients were content with the treatment they received,
regardless of the group they were randomised to. This suggests both treatment options for NS are
acceptable to patients, and could support clinicians in helping patients make choices. Patients who were
worried about how their treatment would affect family and those receiving care at home were found to
be more prepared to accept higher levels of risk of re-admission in order to have an earlier discharge.
These data were particularly revealing since they indicate that patients have a much higher tolerance for
the possibility of treatment failure in order to enable early discharge for their primary admission.
A major strength of these analyses was the choice of perspective. By taking a hospital perspective, it
meant there was the ability to collect daily data and details of any re-admissions using hospital records.
The short follow-up duration also meant less of a burden for research staff and resulted in complete
cost data for all patients. There was complete QALY data for 87% of patients and over 90% of patients
provided responses to the patient preference questionnaire.
The health economics analysis had some limitations. Firstly, due to the challenges of collecting outcome
measures from patient questionnaires versus routine data retrieval from hospital records, there was a
higher number of patients with complete data for analysis in the CEA compared to the CUA (n = 124 and
n = 110, respectively). The impact on staff time reduction for administration of oral versus i.v. antibiotics
was not assessed, as given the time difference of only 24 hours, differences would be small. However, the
additional time spent in hospital and associated costs per hospital bed already includes staff costs. The
preferences questionnaire was administered mostly over the phone at day 14 (unless the patient had not
been discharged or had a visit), and given the complexity of some of the questions, processing them could
understandably lead to completion errors. To minimise error and increase acceptability, there is a need to
aid patients’ understanding of risk. This may have wider implications in relation to the consent process
in trials and practice, and considering whether or not risk has been satisfactorily explained to patients or
those consenting on their behalf. Furthermore, it would be preferable if patients were asked for treatment
preference before allocation as the results showed an allegiance to the assigned method and may have
been biased by patients’ experience of treatment.
Copyright © 2024 Coyle et al. This work was produced by Coyle et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care.
This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction 65
and adaptation in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the title, original
author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
DOI: 10.3310/RGTP7112 Health Technology Assessment 2024 Vol. 28 No. 14
Chapter 7 Discussion
Aim of the study
The NICE guidance in 2012 provided the first UK consensus guideline for treatment of NS while also
highlighting a number of outstanding questions regarding optimal management. NICE were unable to
recommend switching from empirical i.v. to oral antibiotics at < 48 hours even in patients at low risk
of infective complications because of uncertainty about whether this achieved comparable outcomes
to standard practice of longer-duration i.v. antibiotics. To bridge this evidence gap, the EASI-SWITCH
trial, commissioned by the UK NIHR, aimed to provide a definitive randomised trial evaluating the
effectiveness of early oral switch in low-risk NS patients.
Despite this support, recruitment remained challenging, resulting in early termination of the trial.
Multisite trial activity in the area of low-risk NS has been challenging to deliver in the UK. Prior to the
EASI-SWITCH trial, the ORANGE trial (ORal Antibiotics for Neutropenic sepsis Giving Early hospital
discharge), which opened in August 2007, aimed to evaluate immediate upfront oral antibiotic therapy
in low-risk NS patients,67 but closed in 2009 due to poor recruitment (27 patients registered and 12
randomised). The trial team reported that recruitment of investigator sites and patients was extremely
difficult, with sites unable to participate due to local admission and care pathways and conflicting clinical
management and local antibiotic protocols.68 While these barriers were overcome to some degree within
EASI-SWITCH, similar themes emerged from the surveys and interviews undertaken during the trial and
it is likely that a combination of these challenges and a shift in equipoise as the trial progressed towards
upfront or early oral therapy for patients with NS resulted in the plateau in accrual seen prior to closure.
The consequence of the smaller than anticipated sample size is that non-inferiority for early oral switch
cannot be proven. The conflicting results of the ITT and PP analyses for the primary outcome may
reflect this but also highlight the potential for analysis of different patient data sets to deliver conflicting
results. Because of this potential, we determined a priori that a firm conclusion on the non-inferiority
of the intervention would be reached only if both the ITT and PP analyses were in agreement. While
analysis of either population alone may lead to bias, there is particular potential for increased risk of
bias in ITT analyses due to non-adherence to treatment or deviations from the protocol resulting in a
higher likelihood of concluding non-inferiority incorrectly.69,70 Within our data set, of the 11 ITT patients
who were excluded from the PP population, 8 had been allocated to the intervention arm; of these,
4 had their antibiotic treatment stopped prematurely, 2 had substantial interruption to treatment (at
Copyright © 2024 Coyle et al. This work was produced by Coyle et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care.
This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction 67
and adaptation in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the title, original
author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
Discussion
least two consecutive missed doses), and 1 had less than the minimum of 12 hours initial i.v. treatment.
The three excluded patients in the standard care arm had received < 48 hours of i.v. antibiotics. As the
ITT population included these patients, who did not receive the complete protocolised intervention,
an ITT analysis risks underestimating the efficacy of the intervention; by comparison a PP analysis may
overcome this issue.
The trial was pragmatic in design; decisions such as non-blinding of patients and staff were guided by
the opportunity to assess the effect of early switch on timing of hospital discharge as well as advice
from our patient representatives that blinding was unlikely to be maintained in the course of patient
care. Open-label treatment has the potential to introduce performance bias; in this instance it may be
that physicians have a lower threshold for antibiotic escalation from oral therapy, resulting in treatment
failure and risk of bias towards concluding inferiority of the intervention. Similarly, non-blinding of
outcome assessment risks introduction of detection bias; however, the components of the composite
outcome measure were largely objective measurements of treatment failure rather than subjective
components or qualitative measures.
While non-inferiority of early switch could not be proven within this trial, it may be that an early switch
approach results in a shorter initial admission for treatment of NS although with the trade-off that the
risk of re-admission for treatment failure is more likely than with standard care therapy. Reassuringly,
and accepting the smaller than anticipated sample size, the risk of treatment failure and requirement
for antibiotic treatment escalation or re-admission with early switch was not associated with serious
consequences in terms of critical care admission or death. AEs were generally as anticipated in this
patient population and were reported at similar rates between the early oral switch and standard care
groups. Overall, therefore, it would seem that early switch could be a safe management option for
selected patients with low-risk NS.
Although the results did not permit a definitive conclusion on clinical efficacy of early oral switch in
relation to treatment failure, there were small, albeit not significant, gains in HRQoL and patients found
it an acceptable treatment approach. While the primary outcome measure of treatment failure is clearly
an important efficacy outcome for clinicians and patients, the observed increased rate of treatment
failure in the early switch arm was not reflected in the HRQoL results, highlighting the differences in
outcome measures valued by clinicians and patients.
The results suggest that early oral switch may be a cost-effective approach within existing NHS NS care
pathways. The primary CUA showed the early switch to oral antibiotics led to small, non-significant cost
savings and improvements in HRQoL compared to standard care. The probability of the intervention
being cost-effective was highest for all WTP thresholds in the PP sensitivity analysis. Although two
subsequent sensitivity analyses estimated the intervention as slightly more costly than standard care,
the ICERs were favourable (well under £20,000/QALY). There was a higher number of treatment
failures in the intervention group within the CEA, meaning the intervention was dominated by standard
care. However, subsequent analysis removing a high resource outlier showed a small, non-significant
cost saving for those receiving the intervention. A major strength of these analyses was the choice of
perspective. By taking a hospital perspective, it meant there was the ability to collect daily data and
details of any re-admissions using hospital records. The short follow-up duration also meant less of
a burden for research staff and resulted in complete cost data for all patients. However, due to the
challenges of collecting outcome measures from patient questionnaires versus routine data retrieval
from hospital records, there was a higher number of patients with complete data for analysis in the CEA
compared to the CUA (n = 124 and n = 110, respectively), with complete QALY data for 87% of patients.
In addition to global HRQoL, a patient preference questionnaire was used to better understand the
non-health outcome measures that are important to patients and their willingness to accept different
treatment approaches in NS management. Over 90% of patients provided responses to the patient
preference questionnaire, and the responses showed the majority of patients were content with the
68
treatment they received, regardless of the group they were randomised to. Patients who were worried
about how their treatment would affect family and those receiving care at home were found to be
more prepared to accept higher levels of risk of re-admission in order to have an earlier discharge. This
approach did have some limitations. The preferences questionnaire was administered mostly over the
phone at day 14 (unless the patient had not been discharged or had a visit), and given the complexity of
some of the questions, processing them could understandably lead to completion errors. To minimise
error and increase acceptability, there is a need to aid patients’ understanding of risk. This may have
wider implications in relation to the consent process in trials and practice, and considering whether or
not risk has been satisfactorily explained to patients or those consenting on their behalf. Furthermore, it
would preferable if patients were asked for treatment preference before allocation as the results showed
an allegiance to the assigned method and may have been biased by patients’ experience of treatment.
However, overall the data are revealing, indicating that patients have a much higher acceptance of the
possibility of treatment failure in order to enable early discharge for their primary admission than might
have been anticipated by clinicians.
Conclusion
A definitive conclusion about the clinical effectiveness of early switch to oral antibiotics in low-risk NS
was unable to be reached from the study findings due to the limited sample size.
While non-inferiority of early oral switch could not be definitively concluded, it may be that early switch
results in a shorter initial duration of hospitalisation for treatment of low-risk NS. However, it is uncertain
whether there is a consequent increased likelihood of re-admission to hospital compared to standard
care treatment.
Treatment failure or requirement for antibiotic escalation or re-admission was not associated with
serious outcomes such as critical care admission or death. There was no unexpected or increased risk of
AEs observed with early switch compared to standard care.
There were small, non-significant gains in HRQoL for early oral switch and patients found it acceptable.
Patients, particularly those with caregiver roles, were more prepared to accept the higher levels of risk of
re-admission in order to have an earlier discharge.
Given the findings, early oral switch may be an acceptable strategy for some patients who can adhere
to such a regimen and would prefer reduced duration of hospitalisation while accepting a potentially
increased risk of treatment failure, resulting in re-admission to hospital.
EASI-SWITCH is the first UK multicentre RCT comparing early oral switch to the NICE recommendation
of 48 hours i.v. antibiotic therapy in low-risk NS. Delivery of the trial has highlighted the difficulties
with recruitment of patients to trials in the unscheduled care setting. Evidence supporting specific
interventions to improve recruitment in this setting is lacking71 and further work evaluating strategies
such as verbal provision of trial information and obtaining verbal consent is warranted across supportive
care trials in cancer patients, not just in the setting of NS.
A number of specialist cancer centres in the NHS have already established acute oncology services and/
or ambulatory care pathways to deliver early oral switch or upfront oral antibiotics.39–41 This results in
tension between delivering prospective trials evaluating management approaches for NS and accepting
that current ambulatory care pathways or antimicrobial strategies utilising upfront or early switch to
oral antibiotics are typically applied to highly selected patient populations. This shift in practice and our
Copyright © 2024 Coyle et al. This work was produced by Coyle et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care.
This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction 69
and adaptation in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the title, original
author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
Discussion
experience in delivering this trial, accompanied by the declining NS rates, suggest further randomised
trials in this patient population will remain challenging to recruit to. However, it is clear there remains
scope to optimise and unify management strategies for low-risk NS, in particular how best to identify
patients suitable for a de-escalation or ambulatory care approach from initial presentation. While the
MASCC score remains the most widely used within specialist cancer centres, others have reported that
stratification tools such as MASCC score or CISNE are too cumbersome to be applied in real-life ED
practice.46 Other scores that encompass ‘clinical judgement’ are similarly felt less applicable in ED or
acute medical settings than validated decision rules or algorithms. Further research should explore tools
for patient stratification for low-risk de-escalation or ambulatory pathways, including use of biomarkers
and/or point-of-care rapid viral, bacterial and fungal testing as an adjunct to clinical decision-making
tools. This could include application to shorter-duration antimicrobial therapy in line with antimicrobial
stewardship studies in other settings.
Evaluation of any future stratification tools, treatment strategies or ambulatory care pathways should
include a formal economic analysis in addition to assessment of clinical efficacy. This is particularly
important where novel algorithms or ambulatory care pathways are established but restricted to
specialist oncology services rather than general acute care or ED settings.
The EASI-SWITCH trial has highlighted the importance of patients’ perspectives in setting research
questions that encompass patients’ willingness to accept risk of treatment failure as a trade-off for
less intensive treatment and shorter duration of admission. The results of the patient preference
questionnaire could be used as a precursor for designing a future discrete-choice experiment to assess
patient preferences for treatment for NS. This method is used in eliciting strength of preferences in
health care by presenting hypothetical choices varying treatment options and levels of key attributes
(e.g. life expectancy, side effects), and in doing so respondents make trade-offs.72 They have been
effectively used in other cancer populations73 and it has been long thought by experts that NICE should
recommend their use in incorporating patient preferences,74 but while their US counterparts the FDA
have endorsed their use, NICE have yet to do so.
70
Acknowledgements
T he authors would like to thank all of the patients who took part in the EASI-SWITCH trial. They also wish
to thank all of the research and clinical team members at each of the trial sites for screening, recruitment,
management and follow-up of patients within the trial. Thanks are also extended to the staff of NICTU who
contributed to trial management and the Belfast HSC Trust Research Office for undertaking trial sponsorship.
Particular thanks are extended to Mrs Margaret Grayson, patient and public representative, who has been
an integral member of the study team from conception through to delivery and dissemination. Mrs Grayson’s
input was particularly invaluable in collating wider PPI opinion on the study design and continued importance
of the research question as the study progressed and the design revised. Additional thanks are extended to
Dr Caroline Forde, Clinical Research Fellow, who contributed significantly to study set-up and day-to-day trial
management and to Mrs Margaret McFarland for pharmacovigilance support.
The authors are also very grateful to the independent TSC and DMEC members for their continued
advice and guidance throughout the trial:
TSC:
Professor Kathy Bamford (chairperson, Imperial College Healthcare Trust, London, UK)
DMEC:
Dr Mark Saunders (chairperson, The Christie NHS Foundation Trust, Manchester, UK)
Professor Paul Dark (Salford Royal NHS Foundation Trust, Salford, UK)
The authors would also like to acknowledge the site investigators and their teams from 19 sites across
the UK who enrolled patients in the trial:
Belfast Health and Social Care Trust Professor Richard Wilson, Dr Audrey Fenton
The Newcastle Upon Tyne Hospitals NHS Foundation Trust Professor Ruth Plummer
continued
Copyright © 2024 Coyle et al. This work was produced by Coyle et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care.
This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction 71
and adaptation in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the title, original
author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
Acknowledgements
Contributions of authors
72
Data-sharing statement
Requests for access to de-identified patient data can be made by researchers to the chief investigators,
and data will be shared subject to any constraints. Requests for access should be accompanied by a
proposal describing the aims and scope of the research, details of the data requested and data analysis
plan. Proposals will be considered by the Trial Management Group, co-investigators and sponsor who
will make a decision regarding data access. A data-sharing agreement will be signed between the
researchers, principal investigators and sponsor.
Patient data
This work uses data provided by patients and collected by the NHS as part of their care and support.
Using patient data is vital to improve health and care for everyone. There is huge potential to make
better use of information from people’s patient records, to understand more about disease, develop
new treatments, monitor safety, and plan NHS services. Patient data should be kept safe and secure,
to protect everyone’s privacy, and it is important that there are safeguards to make sure that they
are stored and used responsibly. Everyone should be able to find out about how patient data are
used. #datasaveslives. You can find out more about the background to this citation here: https://
understandingpatientdata.org.uk/data-citation.
Copyright © 2024 Coyle et al. This work was produced by Coyle et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care.
This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction 73
and adaptation in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the title, original
author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
DOI: 10.3310/RGTP7112 Health Technology Assessment 2024 Vol. 28 No. 14
References
1. Forde C, McMullan R, Clarke M, Wilson RH, Plummer R, Grayson M, et al. Early switch from
intravenous to oral antibiotic therapy in patients with cancer who have low-risk neutropenic
sepsis (the EASI-SWITCH trial): study protocol for a randomized controlled trial. Trials
2020;21(1):431. https://doi.org/10.1186/s13063-020-04241-1
2. Schimpff S, Satterlee W, Young VM, Serpick A. Empiric therapy with carbenicillin and gentamicin
for febrile patients with cancer and granulocytopenia. N Engl J Med 1971;284(19):1061–5.
https://doi.org./10.1056/NEJM197105132841904
3. NICE, Clinical Guideline, Neutropenic Sepsis: Prevention and Management of Neutropenic Sepsis in
Cancer Patients; Sept 2012. URL: www.nice.org.uk/guidance/cg151/resources/neutropenic-sep-
sis-prevention-and-management-in-people-with-cancer-pdf-35109626262469 (accessed
20 July 2020).
4. Holmes FA, Jones SE, O’Shaughnessy J, Vukelja S, George T, Savin M, et al. Comparable
efficacy and safety profiles of once-per-cycle pegfilgrastim and daily injection filgrastim in
chemotherapy-induced neutropenia: a multicenter dose-finding study in women with breast
cancer. Ann Oncol 2002;13(6):903–9. https://doi.org/10.1093/annonc/mdf130
5. de Naurois J, Novitzky-Basso I, Gill MJ, Marti Marti F, Cullen MH, Roila F. Management of
febrile neutropenia: ESMO Clinical Practice Guidelines. Ann Oncol 2010;21(Suppl 5):v252–6.
https://doi.org/10.1093/annonc/mdq196
6. Clarke RT, Warnick J, Stretton K, Littlewood TJ. Improving the immediate management of
neutropenic sepsis in the UK: lessons from a national audit. Br J Haematol 2011;153(6):773–9.
https://doi.org/10.1111/j.1365-2141.2011.08693.x
7. Flowers CR, Seidenfeld J, Bow EJ, Karten C, Gleason C, Hawley DK, et al. Antimicrobial
prophylaxis and outpatient management of fever and neutropenia in adults treated for
malignancy: American Society of Clinical Oncology Clinical Practice Guideline. J Clin Oncol
2013;31(6):794–810. https://doi.org/10.1200/JCO.2012.45.8661
8. Ammann RA, Hirt A, Lüthy AR, Aebi C. Identification of children presenting with fever in
chemotherapy-induced neutropenia at low risk for severe bacterial infection. Med Pediatr Oncol
2003;41(5):436–43. https://doi.org/10.1002/mpo.10320
9. Apostolopoulou E, Raftopoulos V, Terzis K, Elefsiniotis I. Infection Probability Score, APACHE II and
KARNOFSKY scoring systems as predictors of bloodstream infection onset in hematology-oncology
patients. BMC Infect Dis 2010;10:135. https://doi.org/10.1186/1471-2334-10-135
10. Ha YE, Song J-H, Kang WK, Peck KR, Chung DR, Kang C-I, et al. Clinical factors predicting
bacteremia in low-risk febrile neutropenia after anti-cancer chemotherapy. Support Care Cancer
2011;19:1761–7. https://doi.org/10.1007/s00520-010-1017-4
11. Hakim H, Flynn PM, Srivastava DK, Knapp KM, Li C, Okuma J, Gaur AH. Risk prediction in
pediatric cancer patients with fever and neutropenia. Paediatr Infect Dis. 2010;29:53–9. https://
doi.org/10.1097/INF.0b013e3181c3f6f0
12. Klaassen RJ, Goodman TR, Pham B, Doyle JJ. ‘Low-risk’ prediction rule for pediatric oncology
patients presenting with fever and neutropenia. J Clin Oncol 2000;18:1012–9. https://doi.
org/10.1200/JCO.2000.18.5.1012
13. Santolaya ME, Alvarez AM, Becker A, Cofré J, Enríquez N, O’Ryan M, et al. Prospective,
multicentre evaluation of risk factors associated with invasive bacterial infection in children
with cancer, neutropenia and fever. J Clin Oncol 2001;19:3415–21. https://doi.org/10.1200/
JCO.2001.19.14.3415
Copyright © 2024 Coyle et al. This work was produced by Coyle et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care.
This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction 75
and adaptation in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the title, original
author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
References
14. Tezcan G, Kupesiz A, Ozturk F, Ogunc D, Gultekin M, Yesilipek A, Hazar V. Episodes of fever and
neutropenia in children with cancer in a tertiary medical care center in Turkey. Pediatr Hematol
Oncol 2006;23:217–29. https://doi.org/10.1080/08880010500506719
15. West DC, Marcin JP, Mawis R, He J, Nagle A, Dimand R. Children with cancer, fever and
treatment-induced neutropenia: risk factors associated with illness requiring the administration
of critical care therapies. Pediatr Emerg Care 2004;20:79–84. https://doi.org/10.1097/01.
pec.0000113875.10140.40
16. Lyman GH, Lyman CH, Agboola O. Risk models for predicting chemotherapy-induced neutrope-
nia. Oncologist 2005;10:427–37. https://doi.org/10.1634/theoncologist.10-6-427
17. Martin M, Pienkowski T, Mackey J, Pawlicki M, Guastalla JP, Weaver C, et al. Adjuvant docetaxel
for node-positive breast cancer. N Engl J Med 2005;22:2302–13. https://doi.org/10.1056/
NEJMoa043681
18. Head J, Archer C, Harper-Wynne C, Sinha R, Ring A, Banner R, Sutherland S, Johnston S. Rates
of neutropaenic sepsis with the use of adjuvant FEC100-Docetaxel (FEC100-T) chemotherapy in
high-risk node-positive patients with early breast cancer; A UK perspective. Poster Abstract; 2008.
URL: www.ncri.org.uk/ncriconference/2008abstracts/abstracts/B64.htm (accessed
9 September 2021).
19. Kuderer NM, Dale DC, Crawford J, Cosler LE, Lyman GH. Mortality, morbidity, and cost
associated with febrile neutropenia in cancer patients. Cancer 2006;106:2258–66. https://doi.
org/10.1002/cncr.21847
20. Legrand M, Max A, Peigne V, Mariotte E, Canet E, Debrumetz A, et al. Survival in neutropenic
patients with severe sepsis or septic shock. Crit Care Med 2012;40(1):43–9. https://doi.
org/10.1097/CCM.0b013e31822b50c2
21. NCAG (National Chemotherapy Advisory Group). Chemotherapy Services in England: Ensuring
Quality and Safety. London: Department of Health; 2009. URL: https://webarchive.nation-
alarchives.gov.uk/20130104173757/http://www.dh.gov.uk/en/Publicationsandstatistics/
Publications/DH_104500 (accessed 1 August 2020).
22. Clarke R, Bird S, Kakuchi I, Littlewood TJ, van Hamel Parsons V. The signs, symptoms
and help-seeking experiences of neutropenic sepsis patients before they reach hospital:
a qualitative study. Support Care Cancer 2015;23(9):2687–94. https://doi.org/10.1007/
s00520-015-2631-y
23. Chirivella I, Bermejo B, Insa A, Pérez-Fidalgo A, Magro A, Rosello S, et al. Optimal delivery
of anthracycline-based chemotherapy in the adjuvant setting improves outcome of breast
cancer patients. Breast Cancer Res Treat 2009;114(3):479–84. https://doi.org/10.1007/
s10549-008-0018-1
24. Herbst C, Naumann F, Kruse E-B, Monsef I, Bohlius J, Schulz H, Engert A. Prophylactic antibi-
otics or G-CSF for the prevention of infections and improvement of survival in cancer patients
undergoing chemotherapy. Cochrane Database Syst Rev 2009; Issue 1, Art No. CD007107.
https://doi.org/10.1002/14651858.CD007107.pub2
25. Lalami Y, Klastersky J. Impact of chemotherapy-induced neutropenia (CIN) and febrile neutro-
penia (FN) on cancer treatment outcomes: An overview about well-established and recently
emerging clinical data. Crit Rev Oncol Hematol 2017;120:163–79. https://doi.org/10.1016/j.
critrevonc.2017.11.005
26. Morgan A, Sutton A, Wailoo A. The Risk and Costs of Febrile Neutropenia in Patients With Non-
Small Cell Lung Cancer Treated With Docetaxel. Sheffield: NICE Decision Support Unit; 2007.
URL: http://nicedsu.org.uk/wp-content/uploads/2016/03/Erlotinib-DSU-final-report1.pdf
(accessed 1 August 2020).
76
27. Talbot T, Dangoor A, Shah R, Naik J, Talbot D, Lester JF, et al. The burden of neutropenic
sepsis in patients with advanced non-small cell lung cancer treated with single-agent
docetaxel: A retrospective study. Lung Cancer 2017;113:115–20. https://doi.org/10.1016/j.
lungcan.2017.09.014
28. Klastersky J, de Naurois J, Rolston K, Rapoport B, Maschmeyer G, Aapro M, Herrstedt
J. Management of febrile neutropaenia: ESMO clinical practice guidelines. Ann Oncol
2016;27:v111–8. https://doi.org/10.1093/annonc/mdw325
29. Taplitz R, Kennedy EB, Bow EJ, Crews J, Gleason C, Hawley DK, et al. Outpatient management
of fever and neutropenia in adults treated for malignancy: American Society of Clinical
Oncology and Infectious Diseases Society of America Clinical Practice Guideline Update.
J Clin Oncol 2018;36(14):1443–53. https://doi.org/10.1200/JCO.2017.77.6211
30. Simmons T. Prevention and Management of Neutropenic Sepsis in Cancer Patients: Full Needs
Assessment Report. London: NICE; 2012. URL: www.nice.org.uk/guidance/cg151/evidence/
needs-assessment-pdf-188303583 (accessed 1 August 2020).
31. Bate J, Gibson F, Selwood K, Skinner R, Phillips B, Chisholm JC. A reaudit of current febrile
neutropenia practice in UK paediatric oncology centres prior to implementation of NICE
guidance. Arch Dis Child 2013;98:315–6. https://doi.org/10.1136/archdischild-2013-303810
32. Phillips B, Selwood K, Lane SM, Skinner R, Gibson F, Chisholm JC; United Kingdom Children's
Cancer Study Group. Variation in policies for the management of febrile neutropenia in United
Kingdom Children’s Cancer Study Group centres. Arch Dis Child 2007;92:495–8. https://doi.
org/10.1136/adc.2006.102699
33. Klastersky J, Paesmans M. The Multinational Association for Supportive Care in Cancer
(MASCC) risk index score: 10 years of use for identifying low-risk febrile neutropenic
cancer patients. Support Care Cancer 2013;21(5):1487–95. https://doi.org/10.1007/
s00520-013-1758-y
34. Rubenstein EB, Rolston K, Benjamin RS, Loewy J, Escalante C, Manzullo E, et al. Outpatient treat-
ment of febrile episodes in low-risk neutropenic patients with cancer. Cancer 1993;71:3640–6.
https://doi.org/10.1002/1097-0142(19930601)71:11<3640::aid-cncr2820711128>3.0.co;2-h
35. Klastersky J, Paesmans M, Rubenstein EB, Boyer M, Elting L, Feld R, Talcott J. The Multinational
Association for Supportive Care in Cancer risk index: a multinational scoring system for iden-
tifying low-risk febrile neutropenic cancer patients. J Clin Oncol 2000;18:3038–51. https://doi.
org/10.1200/JCO.2000.18.16.3038
36. Innes H, Smith DB, O’Reilly SM, Clark PI, Kelly V, Marshall E . Oral antibiotics with early hospital
discharge compared with in-patient intravenous antibiotics for low-risk febrile neutropenia in
patients with cancer: a prospective randomised controlled single centre study. Brit J Cancer.
2003;89:43–9. https://doi.org/10.1038/sj.bjc.6600993
37. Vidal L, Ben Dor I, Paul M, Eliakim-Raz N, Pokroy E, Soares-Weiser K, et al. Oral versus
intravenous antibiotic treatment for febrile neutropenia in cancer patients. Cochrane Database
of Systematic Reviews 2013; Issue 10, Art No CD003992. https://doi.org/10.1002/14651858.
CD003992.pub3
38. Talcott J, Yeap BY, Clark JA, Siegel RD, Loggers ET, Lu C, Godley PA. Safety of early discharge for
low-risk patients with febrile neutropenia: a multicenter randomized controlled trial. J Clin Oncol
2011;29(30):3977–83. https://doi.org/10.1200/JCO.2011.35.0884
39. Cooksley T, Rice T. Emergency oncology: development, current position and future
direction in the USA and UK. Support Care Cancer 2017;25:3–7. https://doi.org/10.1007/
s00520-016-3470-1
Copyright © 2024 Coyle et al. This work was produced by Coyle et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care.
This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction 77
and adaptation in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the title, original
author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
References
40. Cooksley, T, Holland M, Klastersky, J. Ambulatory outpatient management of patients with low
risk febrile neutropenia. Acute Medicine 2015;14(4):178–81.
41. Cooksley T, Marshall W, Ahn S, Lasserson DS, Marshall E, Rice TW, Klotz A. Ambulatory
emergency oncology: a key tenet of future emergency oncology care. Int J Clin Pract
2020;74(1):e13436. https://doi.org/10.1111/ijcp.13436
42. Marshall W, Campbell G, Knight T, Al-Sayed T, Cooksley T. Emergency ambulatory management
of low-risk febrile neutropenia: Multinational Association for Supportive Care in Cancer fits
real-world experience from a UK cancer center. J Emerg Med 2020;58(3):444–8. https://doi.
org/10.1016/j.jemermed.2019.09.032
43. Brunner C, Botten J, Wennike N, Ford L, Michaels K, Stephens A, Baker R. Early supported
discharge for patients with febrile neutropenia – experience at a large district hospital in the
UK. Acute Medicine 2019;18(1):14–9. PMID: 32608388.
44. Dzienis M, Shahidzadeh Mahani A. Report on outpatient management of patients with
neutropenic fever in a tertiary hospital. Intern Med J 2017;47(1):122–3. https://doi.
org/10.1111/imj.13313
45. Baugh CW, Wang TJ, Caterino JM, Baker ON, Brooks GA, Reust AC, Pallin DJ. Emergency
department management of patients with febrile neutropenia: guideline concordant or overly
aggressive?. Acad Emerg Med 2017;24(1):83–91. https://doi.org/10.1111/acem.13079
46. Baugh CW, Faridi MK, Mueller EL, Camargo CA, Pallin DJ. Near-universal hospitalization of US
emergency department patients with cancer and febrile neutropenia. PLoS One 2019;14(5):e0216835.
https://doi.org/10.1371/journal.pone.0216835
47. Feld R, Paesmans M, Freifeld AG, Klastersky J, Pizzo PA, Rolston KVI, et al. Methodology for
clinical trials involving patients with cancer who have febrile neutropenia: updated guidelines
of the Immunocompromised Host Society/Multinational Association for Supportive Care in
Cancer, with Emphasis on Outpatient Studies. Clin Infect Dis 2002;35(12):1463–8. https://doi.
org/10.1086/344650
48. Donovan J, Mills N, Smith M, Brindle L, Jacoby A, Peters T, et al. Quality improvement report:
improving design and conduct of randomised trials by embedding them in qualitative research:
ProtecT (prostate testing for cancer and treatment) study. Commentary: presenting unbiased
information to patients can be difficult. BMJ 2002;325(7367):766–70. https://doi.org/10.1136/
bmj.325.7367.766
49. Fletcher B, Gheorghe A, Moore D, Wilson S, Damery S. Improving the recruitment activity of
clinicians in randomised controlled trials: a systematic review. BMJ 2012;2:e000496.
50. Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol 2006;3(2):77–101.
https://doi.org/10.1191/1478088706qp063oa
51. Okera M, Chan S, Dernede U, Larkin J, Popat S, Gilbert D, et al. A prospective study
of chemotherapy-induced febrile neutropenia in the South West London Cancer
Network. Interpretation of study results in light of NCAG/NCEPOD findings. Br J Cancer
2011;104(3):407–12. https://doi.org/10.1038/sj.bjc.6606059
52. Herd F, Bate J, Chisholm J, Johnson E, Phillips B. Variation in practice remains in the UK
management of paediatric febrile neutropenia. Arch Dis Child 2016;101:410–1. https://doi.
org/10.1136/archdischild-2015-310294
53. Subbe C, Kruger M, Rutherford P, Gemmel L. Validation of a modified Early Warning Score in
medical admissions. QJM 2001;94(10):521–6. https://doi.org/10.1093/qjmed/94.10.521
78
Copyright © 2024 Coyle et al. This work was produced by Coyle et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care.
This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction 79
and adaptation in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the title, original
author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
References
69. European Medicines Agency. ICH Topic E 9 Statistical Principles for Clinical Trials; September
1998. URL: www.ema.europa.eu/en/documents/scientific-guideline/ich-e-9-statistical-princi-
ples-clinical-trials-step-5_en.pdf (accessed 25 March 2020).
70. U.S. Department of Health and Human Services Food and Drug Administration. Non-Inferiority
Clinical Trials to Establish Effectiveness Guidance for Industry, November 2016. URL: www.fda.gov/
media/78504/download (accessed 25 March 2020).
71. Rowlands C, Rooshenas L, Fairhurst K, Rees J, Gamble C, Blazeby JM. Detailed systematic analysis
of recruitment strategies in randomised controlled trials in patients with an unscheduled admission
to hospital. BMJ Open 2018;8(2):e018581. https://doi.org/10.1136/bmjopen-2017-018581
72. Ryan M. Discrete choice experiments in health care. BMJ 2004;328(7436):360–1. https://doi.
org/10.1136/bmj.328.7436.360
73. Sculpher M, Bryan S, Fry P, de Winter P, Payne H, Emberton M. Patients’ preferences for the
management of non-metastatic prostate cancer: discrete choice experiment. BMJ (Clinical
research ed.) 2004;328(7436):382. https://doi.org/10.1136/bmj.37972.497234.44
74. Johnson FR, Zhou M. Patient preferences in regulatory benefit-risk assessments: a US perspec-
tive. Value Health 2016;19(6):741–5. https://doi.org/10.1016/j.jval.2016.04.008
80
Neutropenic sepsis (NS), or infection that develops in the setting of a low white blood cell count, is a
complication of chemotherapy treatment in patients with cancer. The ability to identify patients at low
risk of complication from infection offers the opportunity to avoid unnecessary treatment and hospital
stay which disadvantages both patients and the NHS.
We are carrying out a trial of patients at low risk of complications, to evaluate whether changing
from intravenous (i.v.) to oral antibiotics on the first day of treatment is clinically and cost-effective in
comparison with standard longer-duration i.v. antibiotics. The trial will study two patient groups: one
group will switch from i.v. to oral antibiotics 24 hours after i.v. treatment commences; in the other
group, patients will receive standard care i.v. antibiotic for at least 48 hours with subsequent antibiotic
continuation or switch to oral therapy at physician discretion based on their usual practice. We will then
compare the groups to see how effective the two different treatment strategies are.
The outcome that we will use to assess how well each treatment strategy works is ‘failure of treatment’ and
we will measure this on day 14 of follow-up. This is defined by the occurrence of one of several undesirable
outcomes that are all of importance to patients. These include: recurrence of fever; re-admission to hospital;
antibiotic side-effects; quality of life and death. However, the most common way that patients’ treatment
fails is that their fever comes back and they may need to be admitted to hospital again; by comparison,
death is uncommon in patients with NS who are at low risk of complications (the group we are studying).
We have designed this trial based on the findings of other small studies. These indicate that it is reasonable
to assume that early switch to oral treatment would have similar effectiveness to continuing on i.v. treatment
for longer. We are thinking about the number of patients we might need to include in a large trial to confirm
these findings. For example, with only one patient in each group, even if both had successful treatment, we
would not be confident that this would be reproduced if all patients received this treatment across the NHS.
By comparison, if we studied 10,000 patients in each group and found both treatments to be the same, we
would be highly certain that this would be reproduced in NHS practice – but the trial would be impossible to
do and cost tens of millions of pounds.
We are not trying to show that early oral switch is more effective than usual i.v. antibiotic treatment but
are focusing on whether it is not much less effective treatment. This type of trial design is a ‘non-inferiority’
design in which there are statistical rules and tests to show how certain we are that the new treatment
being tested is not much less effective than the usual treatment. Statisticians express how certain they are
about study results using a 95% confidence range either side of the result. This means that researchers
have very high certainty (95% certainty) that the true effectiveness of treatment lies within that range.
We are asking you to help us agree how wide this confidence range should be – or in other words what
level of trade-off between the benefits of shorter duration of treatment and the risk of treatment failure
is acceptable for patients. We also need to balance having enough patients to obtain meaningful results
and not having so many patients that the study is not achievable.
We propose setting the limit of the 95% confidence range for this at 15%. This means that, if we show that
both early oral antibiotic switch and longer courses of i.v. treatment effectively treat 85% of patients, we
Copyright © 2024 Coyle et al. This work was produced by Coyle et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care.
This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction 81
and adaptation in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the title, original
author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
Appendix 1
would have very high certainty (95% certainty) that the early oral switch approach had a ‘true’ effectiveness
of between 70% and 100%. In other words, the study might conclude that the two treatments are similar but
acknowledge that early oral switch is at least 70% effective while standard i.v. treatment is 85% effective.
In other words, for every 100 patients treated with an early oral switch strategy, all would benefit from
early discharge home. However, while 15 would be expected to need re-admission (whether they had
early switch or not), we would be acknowledging that early oral switch could lead to an extra 15 patients
needing re-admission (in comparison with those who receive prolonged i.v. treatment in the first
instance). Therefore, the trade-off we are asking you to consider is whether the possibility that an extra
15 patients may need re-admission is out-weighed by the advantage of the 100 patients receiving oral
switch and being discharged early.
The main question is whether this possible difference in effectiveness between the two treatment options is
acceptable. We had initially planned the study to assess whether the difference in effectiveness was no more
than 10%; however, we have found that recruiting the number of patients needed to do this makes the study
infeasible. Therefore, we are considering making a change to assess whether the difference in treatment
effectiveness is no more than 15%, since that requires fewer patients and makes the study achievable.
We need to decide whether it is better to continue the study using the 15% confidence range or
abandon the study altogether.
The main question is whether in your opinion it would still be useful to do the study if the confidence
range is increased from 10% to 15%. In other words, do you think patients would be similarly convinced
that switching to oral treatment earlier (to allow them to go home sooner) is a good idea if the additional
risk of needing re-admission may be up to 15%, rather than 10%?
Given that the advantage of early oral switch is likely to be early discharge from hospital and the main
consequence of the treatment being ineffective is re-admission we would like you to consider whether
this trade-off would be to patients’ advantage overall.
Input from a range of PPI representatives was sought on this proposed change via our PPI co-applicant,
Mrs Margaret Grayson, who distributed a summary of the study design and study progress including the
rationale for reviewing the sample size and specifically the NI margin. The information was distributed
to the Northern Ireland Cancer Consumer Forum and the Independent Cancer Patient Voice (a national
independent patient advocate group which has the support of the professional members of the NCRI
breast cancer Clinical Study Group).
Respondents were posed the question that if the NI margin was increased to 15% whether this level
of trade-off between the benefit of less intensive treatment and the risk of treatment failure would be
acceptable to patients; comments on the change were also welcomed.
There were 21 replies received and the majority of these supported this change (n = 19) with additional
comments received from seven of these respondents included below. One respondent did not support
this change and one was uncertain (comments from both included below).
PPI comments:
• We all know that there is a finite amount of funding and that the professionals are trying to do the
best for all within these limits. The fact that those who would require re-admission are being closely
monitored is very positive so having considered the points made in your paper I feel that 15%
re-admissions would be an acceptable level.
82
• Very interesting study and I think well worth doing. I believe that for most patients going home early
is key. Recovery at home is almost always preferably to being in hospital and I would definitely accept
the very small extra risk providing good home back-up is in place.
• I would recommend this study even if the risk of re-admission may be up to 15%. Having personally
seen this condition with my daughter when she had become neutropenic when she was being treated
for breast cancer. I believe she would have much preferred the oral method of treatment and getting
home sooner. As in her case she had to spend 2/3 days in hospital. She did not like this. But I must
add as only one person’s experience she may or may not have had to go back into hospital perhaps to
have i.v. treatment. Personally as her mother and carer I can see that it would be a very good study.
• This seems like a hard decision as it boils down to either doing the study or not doing the study. I
wonder why recruitment was such a problem for the original study. I suppose we just have to accept
that the study in its original form is not possible.
• It would certainly be advantageous for patients to be discharged early as no one wants to spend
any more time than necessary as an inpatient. My husband hated it and was always agitating to get
home! However, doubling the percentage of patients that then need re-admitted, seems, on the
face of it, rather a high number. Do these patients then need more protracted treatment, will their
sepsis be more difficult to treat, are they at risk of becoming more seriously ill? In essence, how much
additional danger are patients facing if such a change in treatment is implemented? Does it mean that
we would be content for 30% of patients to need re-admission? Sorry, I seem to be asking questions
rather than giving an opinion – but this is what is going around in my mind as I read the description.
Maybe it’s only after a study that such questions can be answered. For that reason alone, I would
tend to be supportive of the trial going ahead, though with reservations. I would expect that, should
the results begin to show a greater risk to patients, that the study would be stopped. Sorry if these
thoughts are not particularly helpful.
• I think it would be useful to proceed with the trial if the confidence range is increased from 10% to
15%. Switching to oral treatment earlier will allow the patient to go home earlier and this in itself
could aid recovery (psychological benefit) and reduce the risk of infection (less exposure to a wider
population at home than in hospital). I would assume patients on oral treatment will be closely
monitored at home with an identifiable easy/quick pathway for re-admission and i.v. antibiotics
if necessary, as opposed to being processed through A&E. The patient’s home situation would be
conducive to enabling close monitoring for indicators of infection occurring (maybe the presence of a
carer?) and that there are no concerns regarding the home situation itself or quality of care at home.
My feeling is that this study would be worthwhile.
• Margaret, I have read this and think that, on balance, it IS worth while making the change and trying
for the lower level but I honestly feel that there is really a decision for the researcher and the ethics
committee rather than a PPI decision.
• As you know I’m a fan of EASI-SWITCH, and believe that even with the increase in confidence range
it is worth continuing the Trial.
• Very difficult. Clearly good to reduce the amount of i.v. chemotherapy, but what would spook me is
the, albeit remote, possibility of death (certainly an ‘undesirable outcome’), for the sake of cutting the
stay in hospital by a day. But I can see that for someone with family responsibilities, the reduction in
the time in hospital might outweigh that risk. I don’t think that the switch to 85% confidence, rather
than 90%, would make any difference – but is it not possible to continue with the trial and as long
as the risks are clearly explained, give patients the choice? If the take-up is low, then the trial would
have to be abandoned.
• I am not convinced that the gains to be had here are worth the trial. I would also want to see a health
economic argument as re-admission to hospital may be more costly than reducing the initial stay by
a day. But then this may be one of the trial outcomes. People who have sepsis are often very poorly
for a long time and don’t always fully recover. I would want the treatment that’s going to give me the
best chance of recovery.
Copyright © 2024 Coyle et al. This work was produced by Coyle et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care.
This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction 83
and adaptation in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the title, original
author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
DOI: 10.3310/RGTP7112 Health Technology Assessment 2024 Vol. 28 No. 14
Overall, almost all clinicians surveyed were supportive of extending the non-inferiority margin and
continuing the study. In total, responses were received from 38 consultants, 9 clinical fellows/specialty
trainees and 2 RNs. All but one of the respondents were supportive of the proposed revision. The
proposal was also discussed at the Adjuvant and Advanced Disease CSG Subgroup meeting on 16
January 2018. Membership of this group includes UK-wide representation from oncology and other
disciplines (including a statistician/CTU director). This group was also supportive of this revision to study
design and a letter of support from the Chair is also included.
Copyright © 2024 Coyle et al. This work was produced by Coyle et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care.
This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction 85
and adaptation in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the title, original
author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
DOI: 10.3310/RGTP7112 Health Technology Assessment 2024 Vol. 28 No. 14
03 The Newcastle Upon Tyne Hospitals NHS Foundation Trust 4 May 2016 15 (11.6)
07 South Eastern Health and Social Care Trust 26 June 2017 5 (3.9)
Copyright © 2024 Coyle et al. This work was produced by Coyle et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care.
This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction 87
and adaptation in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the title, original
author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
DOI: 10.3310/RGTP7112 Health Technology Assessment 2024 Vol. 28 No. 14
Prompts:
Copyright © 2024 Coyle et al. This work was produced by Coyle et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care.
This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction 89
and adaptation in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the title, original
author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
DOI: 10.3310/RGTP7112 Health Technology Assessment 2024 Vol. 28 No. 14
Copyright © 2024 Coyle et al. This work was produced by Coyle et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care.
This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction 91
and adaptation in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the title, original
author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
DOI: 10.3310/RGTP7112 Health Technology Assessment 2024 Vol. 28 No. 14
Ward bed-day 478.25 Department of Health Weighted average length of stay and cost of
NHS Costs 2018/19 non-elective long stays (WJ06A–WJ06J)
Critical care bed-day 933.19 Department of Health Adult Critical Care (XC06Z)
NHS Costs 2018/19
Piperacillin/tazobac- 7.65 BNF Drug Tariff Powder for solution for infusion vials
tam (2 g/250 mg) March 2020 (pack of one)
Meropenem (1 g) 17.78 BNF Drug Tariff Powder for solution for infusion vials. Cost per
March 2020 unit based on a pack of 10 (£177.80/10 = 17.78)
Ciprofloxacin 0.80 BNF Drug Tariff Cost per 750 mg tablet based on a pack of 10
(750 mg) March 2020 (£8.00/10 = £0.80)
(£8.00/10)
Co-amoxiclav 0.12 BNF Drug Tariff Cost per 500 mg/125 mg tablet based on a pack
(500 mg/125 mg) March 2020 of 21 (£2.50/21 = £0.12)
(£2.50/21)
Copyright © 2024 Coyle et al. This work was produced by Coyle et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care.
This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction 93
and adaptation in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the title, original
author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
DOI: 10.3310/RGTP7112 Health Technology Assessment 2024 Vol. 28 No. 14
Interviewer
You were recently admitted to hospital with NS – an infection you developed during your anticancer
treatment. You kindly agreed to take part in the EASI-SWITCH trial. We would now like to ask you some
questions to find out what you think about the method of antibiotic treatment you received and also
find out your hypothetical preferences for future antibiotic treatment should you develop NS again. The
information you give us will be confidential and will only be used for the EASI-SWITCH trial. Your answers
will not influence the health care you are receiving now or any health care you might receive in the future.
I am now going to read out some statements to you about the most recent treatment for NS you
received. For each one, I would like you say whether you AGREE or DISAGREE with the statement, or if
you are UNCERTAIN about it. Please think about each one carefully.
Please read out each statement and ask the respondent ‘Do you Agree or Disagree with this statement or are you UNCERTAIN?’
When you agreed to take part in the EASI-SWITCH trial you were told about the possible advantages
and disadvantages of each method of antibiotic treatment. Just to remind you of them – when patients
are switched early from i.v. to oral antibiotics, they may be discharged from hospital 1 to 2 days earlier
than those who continue on i.v. antibiotics. However, there is also a small risk that their infection
may not clear up as quickly as those who continue on i.v. antibiotics. As a result, they may need to be
re-admitted to hospital for further i.v. antibiotics.
Please keep this information in mind as I read out some statements about any future treatment for
NS you may need. Please remember, your responses will not influence the treatment you may actually
receive. Like before, I would like you to say whether you AGREE or DISAGREE with the statement, or if
you are UNCERTAIN about it. Please think about each one carefully.
Copyright © 2024 Coyle et al. This work was produced by Coyle et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care.
This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction 95
and adaptation in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the title, original
author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
Appendix 7
Please read out each statement and ask the respondent ‘Do you Agree or Disagree with this statement or are you UNCERTAIN?’
10. If patients were to be offered a choice about which way they could be treated for NS in future,
which antibiotic treatment would you choose?
❑ Intravenously in hospital for at least 48 hours and then switching to oral antibiotics if necessary
❑ Intravenously in hospital for 12–24 hours and then switching to oral antibiotics
11. Can you tell us why you would choose this method?
There is a small risk of hospital re-admission for patients who have i.v. antibiotics (1–2 patients for
every 10 treated). The risk of hospital re-admission for patients who are switched early may be the same
as this or slightly higher but we will not know what this risk level really is until the EASI-SWITCH trial
is finished.
12. If the risk of re-admission was three in every 10 patients switched early (30%) instead of 1–2
patients (15%) would you choose to be discharged home on oral antibiotics 1–2 days sooner?
❑ Yes
❑ No
Finally, the last two questions will help us to understand the care situation in your home.
❑ Yes
❑ No
❑ Yes
❑ No
Thank you very much for taking the time to answer these questions for us today.
96
Please write down in the box below any feedback which will help us improve this questionnaire. E.g. did the respondent find
any question difficult to understand? Did they question why they were being asked the information?
Copyright © 2024 Coyle et al. This work was produced by Coyle et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care.
This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction 97
and adaptation in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the title, original
author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
DOI: 10.3310/RGTP7112 Health Technology Assessment 2024 Vol. 28 No. 14
Variable n Mean (95% CI) n Mean (95% CI) Difference (95% CI)
EQ-5D-5L utilities
Baseline 59 0.77 (0.72 to 0.83) 62 0.74 (0.68 to 0.79) 0.04 (−0.04 to 0.11)
14 days 54 0.81 (0.76 to 0.86) 59 0.77 (0.72 to 0.83) 0.04 (−0.04 to 0.11)
EQ-VAS
Baseline 59 64.14 (58.59 to 69.68) 62 58.95 (53.82 to 64.08) 5.18 (−2.28 to 12.65)
14 days 56 74.70 (69.71 to 79.69) 59 70.32 (65.74 to 74.91) 4.37 (−2.32 to 11.07)
QALYs 52 0.03 (0.03 to 0.03) 58 0.03 (0.03 to 0.03) < 0.00 (−0.00 to 0.00)
Copyright © 2024 Coyle et al. This work was produced by Coyle et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care.
This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction 99
and adaptation in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the title, original
author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
100
NIHR Journals Library www.journalslibrary.nihr.ac.uk
Appendix 8
TABLE 40 Hospital resource use by group using all available data
Service n (%) Mean (95% CI) n (%) Mean (95% CI) Mean difference (95% CI)
Primary admission
Ward days 62 (100.00) 2.73 (2.14 to 3.31) 64 (100.00) 3.17 (2.73 to 3.61) −0.45 (−1.17 to 0.27)
Critical care days 1 (1.61) 0.15 (−0.15 to 0.44) 0 (0) n/a 0.15 (−0.14 to 0.43)
Emergency department 2 (3.23) 0.03 (−0.01 to 0.08) 2 (3.13) 0.03 (−0.01 to 0.08) 0.00 (−0.06 to 0.06)
Re-admission
Ward days 4 (6.45) 0.39 (−0.11 to 0.89) 2 (3.13) 0.17 (−0.07 to 0.41) 0.22 (−0.33 to 0.76)
Emergency department visits 4 (6.45) 0.06 (0.00 to 0.13) 2 (3.13) 0.03 (−0.01 to 0.08) 0.03 (−0.04 to 0.11)
Outpatient visits 2 (3.23) 0.03 (−0.01 to 0.08) 2 (3.13) 0.03 (−0.01 to 0.08) 0.00 (−0.06 to 0.06)
author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
and adaptation in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the title, original
This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction
Copyright © 2024 Coyle et al. This work was produced by Coyle et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care.
DOI: 10.3310/RGTP7112
TABLE 41 Cost of hospital service use by group (all available data)
Mean cost £ (95% CI) Mean cost £ (95% CI) Mean difference (95% CI)
Primary admission
Ward days 1303.62 (1023.56 to 1583.67) 1516.95 (1307.80 to 1726.10) −213.33 (−557.91 to 131.24)
Emergency department 6.32 (−2.54 to 15.19) 6.13 (−2.46 to 14.71) 0.20 (−12.02 to 12.41)
Re-admission
Ward days 185.13 (−53.11 to 423.37) 82.20 (−33.52 to 197.91) 102.93 (−156.72 to 362.58)
Outpatient visits 4.35 (−1.75 to 10.46) 4.22 (−1.70 to 10.13) 0.14 (−8.28 to 8.55)
Medication
Study drug 51.09 (43.66 to 58.52) 80.81 (67.45 to 94.16) −29.72 (−44.98 to −14.45)
Concomitant medication 19.64 (3.41 to 35.87) 40.26 (7.84 to 72.68) −20.62 (−56.88 to 15.64)
Total 1718.26 (1254.92 to 2181.60) 1736.68 (1466.92 to 2006.44) −18.42 (−545.13 to 508.28)
101
EME
HSDR
HTA
PGfAR
PHR
Part of the NIHR Journals Library
www.journalslibrary.nihr.ac.uk
This report presents independent research funded by the National Institute for Health and Care Research (NIHR).
The views expressed are those of the author(s) and not necessarily those of the NHS, the NIHR or the
Department of Health and Social Care