Sensory Integration Therapy For Children With Autism and Sensory Processing Difficulties: The Senita RCT
Sensory Integration Therapy For Children With Autism and Sensory Processing Difficulties: The Senita RCT
Sensory Integration Therapy For Children With Autism and Sensory Processing Difficulties: The Senita RCT
DOI 10.3310/TQGE0020
Sensory integration therapy for children with
autism and sensory processing difficulties:
the SenITA RCT
London, UK
4Aneurin Bevan University Health Board, Newport, UK
5Division of Population Medicine, School of Medicine, Cardiff University, Cardiff, UK
6School of Healthcare Sciences, Cardiff University, Cardiff, UK
Declared competing interests of authors: David Gillespie was an associate member of the National
Institute for Health and Care Research (NIHR) Health Technology Assessment (HTA) General
Committee (2019 to September 2021) and is a member of the NIHR HTA Commissioning Committee
(September 2021 to present).
Disclaimer: This report contains transcripts of interviews conducted in the course of the research and
contains language that may offend some readers.
Health Technology Assessment is indexed in MEDLINE, CINAHL, EMBASE, the Cochrane Library and Clarivate Analytics
Science Citation Index.
This journal is a member of and subscribes to the principles of the Committee on Publication Ethics (COPE)
(www.publicationethics.org/).
The full HTA archive is freely available to view online at www.journalslibrary.nihr.ac.uk/hta. Print-on-demand copies can be
purchased from the report pages of the NIHR Journals Library website: www.journalslibrary.nihr.ac.uk
Reviews in Health Technology Assessment are termed ‘systematic’ when the account of the search appraisal and synthesis
methods (to minimise biases and random errors) would, in theory, permit the replication of the review by others.
HTA programme
Health Technology Assessment (HTA) research is undertaken where some evidence already exists to show that a technology can
be effective and this needs to be compared to the current standard intervention to see which works best. Research can evaluate
any intervention used in the treatment, prevention or diagnosis of disease, provided the study outcomes lead to findings that
have the potential to be of direct benefit to NHS patients. Technologies in this context mean any method used to promote
health; prevent and treat disease; and improve rehabilitation or long-term care. They are not confined to new drugs and include
any intervention used in the treatment, prevention or diagnosis of disease.
The journal is indexed in NHS Evidence via its abstracts included in MEDLINE and its Technology Assessment Reports inform
National Institute for Health and Care Excellence (NICE) guidance. HTA research is also an important source of evidence for
National Screening Committee (NSC) policy decisions.
This report
The research reported in this issue of the journal was funded by the HTA programme as project number 15/106/04. The
contractual start date was in January 2017. The draft report began editorial review in June 2021 and was accepted for publication
in March 2022. The authors have been wholly responsible for all data collection, analysis and interpretation, and for writing up
their work. The HTA editors and publisher have tried to ensure the accuracy of the authors’ report and would like to thank the
reviewers for their constructive comments on the draft document. However, they do not accept liability for damages or losses
arising from material published in this report.
This report presents independent research funded by the National Institute for Health and Care Research (NIHR). The views
and opinions expressed by authors in this publication are those of the authors and do not necessarily reflect those of the NHS,
the NIHR, the HTA programme or the Department of Health and Social Care. If there are verbatim quotations included in this
publication the views and opinions expressed by the interviewees are those of the interviewees and do not necessarily reflect
those of the authors, those of the NHS, the NIHR, the HTA programme or the Department of Health and Social Care.
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued
by the Secretary of State for Health and Social Care. This is an Open Access publication distributed under the terms of the
Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction and adaption in
any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication
must be cited.
Published by the NIHR Journals Library (www.journalslibrary.nihr.ac.uk), produced by Prepress Projects Ltd, Perth, Scotland
(www.prepress-projects.co.uk).
NIHR Journals Library Editor-in-Chief
Professor Ken Stein Professor of Public Health, University of Exeter Medical School, UK
Professor John Powell Consultant Clinical Adviser, National Institute for Health and Care Excellence (NICE), UK,
and Professor of Digital Health Care, Nuffield Department of Primary Care Health Sciences, University of Oxford, UK
Professor Andrée Le May Chair of NIHR Journals Library Editorial Group (HSDR, PGfAR, PHR journals) and
Editor-in-Chief of HSDR, PGfAR, PHR journals
Professor Matthias Beck Professor of Management, Cork University Business School, Department of Management
and Marketing, University College Cork, Ireland
Dr Eugenia Cronin Consultant in Public Health, Delta Public Health Consulting Ltd, UK
Dr Peter Davidson Interim Chair of HTA and EME Editorial Board. Consultant Advisor, Wessex Institute,
University of Southampton, UK
Professor William McGuire Professor of Child Health, Hull York Medical School, University of York, UK
Professor James Raftery Professor of Health Technology Assessment, Wessex Institute, Faculty of Medicine,
University of Southampton, UK
Dr Rob Riemsma Consultant Advisor, School of Healthcare Enterprise and Innovation, University of
Southampton, UK
Professor Helen Roberts Professor of Child Health Research, Child and Adolescent Mental Health, Palliative Care
and Paediatrics Unit, Population Policy and Practice Programme, UCL Great Ormond Street Institute of Child Health,
London, UK
Professor Jonathan Ross Professor of Sexual Health and HIV, University Hospital Birmingham, UK
Professor Helen Snooks Professor of Health Services Research, Institute of Life Science, College of Medicine,
Swansea University, UK
Professor Ken Stein Professor of Public Health, University of Exeter Medical School, UK
Professor Jim Thornton Professor of Obstetrics and Gynaecology, Faculty of Medicine and Health Sciences,
University of Nottingham, UK
Abstract
Background: Carers report unmet need for occupational therapy services addressing sensory
difficulties in autism, yet insufficient evidence exists to recommend a therapeutic approach.
Objectives: Our aim was to determine the clinical effectiveness and cost-effectiveness of sensory
integration therapy for children with autism and sensory difficulties across behavioural, functional and
quality-of-life outcomes.
Design: We carried out a parallel-group randomised controlled trial, incorporating an internal pilot and
a process evaluation. Randomisation utilised random permuted blocks.
Setting and participants: Children were recruited via services and self-referral in Wales and England.
Inclusion criteria were having an autism diagnosis, being in mainstream primary education and having
definite/probable sensory processing difficulties. Exclusion criteria were having current/previous
sensory integration therapy and current applied behaviour analysis therapy.
Intervention: The intervention was manualised sensory integration therapy delivered over 26 weeks
and the comparator was usual care.
Outcomes: The primary outcome was problem behaviours (determined using the Aberrant Behavior
Checklist), including irritability/agitation, at 6 months. Secondary outcomes were adaptive behaviour,
functioning and socialisation (using the Vineland Adaptive Behavior Scales); carer stress (measured
using the Autism Parenting Stress Index); quality of life (measured using the EuroQol-5 Dimensions
and Carer Quality of Life); functional change (according to the Canadian Occupational Performance
Measure); sensory processing (determined using the Sensory Processing Measure™ at screening and
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
vii
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
ABSTRACT
at 6 months to examine mediation effects); and cost-effectiveness (assessed using the Client Service
Receipt Inventory). Every effort was made to ensure that outcome assessors were blind to allocation.
Results: A total of 138 participants were randomised (n = 69 per group). Usual care was significantly
different from the intervention, which was delivered with good fidelity and adherence and minimal
contamination, and was associated with no adverse effects. Trial procedures and outcome measures
were acceptable. Carers and therapists reported improvement in daily functioning. The primary analysis
included 106 participants. There were no significant main effects of the intervention at 6 or 12 months.
The adjusted mean difference between groups on the Aberrant Behavior Checklist – irritability at
6 months post randomisation was 0.40 (95% confidence interval –2.33 to 3.14; p = 0.77). Subgroup
differences in irritability/agitation at 6 months were observed for sex of child (intervention × female =
6.42, 95% confidence interval 0.00 to 12.85; p = 0.050) and attention deficit hyperactivity disorder
(intervention × attention deficit hyperactivity disorder = –6.77, 95% confidence interval –13.55 to
–0.01; p = 0.050). There was an effect on carer stress at 6 months by region (intervention × South
England = 7.01, 95% confidence interval 0.45 to 13.56; p = 0.04) and other neurodevelopmental/
genetic conditions (intervention × neurodevelopmental/genetic condition = –9.53, 95% confidence
interval –18.08 to –0.98; p = 0.030). Carer-rated goal performance and satisfaction increased
across sessions (p < 0.001), with a mean change of 2.75 (95% confidence interval 2.14 to 3.37) for
performance and a mean change of 3.34 (95% confidence interval 2.63 to 4.40) for satisfaction.
Health economic evaluation suggests that sensory integration therapy is not cost-effective compared
with usual care alone.
Limitations: Limitations included variability of the intervention setting (i.e. NHS vs. private), delay for
some receiving therapy, an error in administration of Vineland Adaptive Behavior Scales and no
measurement of comparator arm goal performance.
Conclusions: The intervention did not demonstrate clinical benefit above standard care. Subgroup
effects are hypothesis-generating only. The intervention is likely to be effective for individualised
performance goals, although it is unclear whether effects were in addition to standard care or
were maintained.
Future work: Further investigation of subgroup effects is needed.
Trial registration: This trial is registered as ISRCTN14716440.
Funding: This project was funded by the National Institute for Health and Care Research (NIHR)
Health Technology Assessment programme and will be published in full in Health Technology
Assessment; Vol. 26, No. 29. See the NIHR Journals Library website for further project information.
viii
Contents
List of tables xv
Chapter 1 Introduction 1
Prevalence and impact of autism 1
Prevalence and impact of sensory processing difficulties in autism 1
Therapeutic approaches to treating sensory difficulties 1
Sensory-based interventions 2
Sensory integration therapy 3
Current evidence gaps and research priorities 3
The SenITA trial 4
Chapter 2 Usual care for children with autism and sensory processing difficulties 5
Aim 5
Methods 5
Recruitment and sampling 5
Carer participants 5
Occupational therapist participants 5
Data collection 6
Ethics approval and data management 7
Analyses 7
Online questionnaires 7
Focus groups and interviews 7
Results 7
Carers’ views of usual occupational therapy for children with autism and sensory
processing difficulties 7
Nature of reported difficulties 8
Carers’ views on contact with services 9
Carers’ views on occupational therapy assessments and treatment 10
Occupational therapist views of usual care 13
Questionnaire responses by occupational therapists 13
Focus groups and interviews with occupational therapists 13
Discussion 18
Representativeness of views 18
Theoretical approaches to intervention 18
Accessing services and the referral process 18
Assessment process 19
Intervention 19
Summary 20
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
ix
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
CONTENTS
Chapter 3 Methods 21
Design 21
Objectives 21
Primary objective 21
Secondary objectives 21
Site selection 22
Participants 23
Inclusion criteria 23
Exclusion criteria 23
Recruitment process 23
Informed consent 23
Risk assessment 24
Intervention 24
Sensory integration therapy 24
Comparator 24
Outcomes 24
Screening and baseline measures 24
Primary outcome measure 25
Secondary outcome measures 25
Randomisation 26
Sample size 26
Procedures 27
Trial oversight and patient and public involvement 27
Staff training 27
Sensory integration therapy sessions 27
Assessment time points 27
Data collection 28
Screening and baseline visit 28
Follow-up data collection 29
Intervention data collection 31
Qualitative data collection 33
Data management 33
Safety reporting 33
Analyses 33
Analysis population 33
Main analysis 34
Subgroup analysis 34
Sensitivity and exploratory analysis 34
Health economic analysis 35
Qualitative analysis 35
Process evaluation 35
Outcomes 38
Primary outcome 38
Secondary outcomes 38
Progression criteria 39
Methods 39
Results: primary outcomes 39
Usual care 40
Recruitment 41
Retention 41
Results: secondary outcomes 42
Contamination 42
Adherence/acceptability 42
Fidelity 42
Other sample size assumptions 42
Adverse effects 42
Summary of progress against progression criteria 42
Proposed modifications to design 43
Sample size implications 43
Discussion 43
Chapter 5 Intervention 45
Overview: sensory integration therapy 45
Therapists 45
Fidelity assessment tool 46
Fidelity principles 46
Initial assessment 47
Initial greeting and scene-setting 47
Clinical observations 47
The Sensory Integration and Praxis Tests 47
Occupational profile 48
Sensory Processing Measure 48
Canadian Occupational Performance Measure 48
Interpretation of assessment 48
Hypothesis development 49
Goal development 49
Summary of strengths, participation challenges and goals 49
Mentoring 49
Intervention session content 50
Session 1 50
Intervention sessions 2–20 51
Intervention sessions 21–23 52
Intervention session 24 52
Intervention session 25 52
Intervention session 26 52
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
xi
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
CONTENTS
Secondary outcomes 64
Behavioural measures 64
Adaptive behaviour measures 65
Parenting stress 66
Health utility and quality of life 66
Teacher-assessed Aberrant Behavior Checklist – irritability 66
Canadian Occupational Performance Measure 67
Subgroup analysis 67
Subgroup effects for the Aberrant Behavior Checklist – irritability 67
Subgroup effects for the Autism Parenting Stress Index 68
Additional sensitivity analyses 70
Accounting for intervention receipt 70
Impact of the COVID-19 pandemic 70
Adverse events 72
xii
Adherence 95
Adverse effects 95
Contamination 96
Qualitative data collection 96
Data analysis 96
Quantitative analysis 96
Qualitative analysis 96
Results 97
Recruitment of participants and therapists 97
Retention 99
Fidelity of the intervention 99
Acceptability 101
Adherence 108
Adverse events 108
Contamination 108
Contextual factors 108
Conclusions 110
Chapter 9 Carer experiences of usual care, and carer and therapist experiences of
the intervention 111
Methods 111
Overview 111
Participants 111
Sampling and recruitment 112
Study materials 112
Data collection 112
Analysis 112
Results: part 1 – support experiences of families 113
Support provision 114
Usefulness of support 115
Unmet support needs 116
Results: part 2 – perceived impact of sensory integration therapy 118
Effect on the child 118
Effect on family and school life 120
Limitations 121
Summary 123
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
xiii
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
CONTENTS
Acknowledgements 131
References 133
xiv
List of tables
TABLE 1 Respondents by geographic region/university health board 9
TABLE 14 Required sample size accounting for correlation between baseline and
6-month ABC-I scores 44
TABLE 21 Regression analysis comparing the intervention arm with the control arm,
adjusting for baseline score, sex of child, SPM category and region: 6 months 65
TABLE 22 Regression analysis comparing the intervention group with the control
group, adjusting for baseline score, sex of child, SPM category and region: 12 months 66
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
xv
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
LIST OF TABLES
TABLE 26 Sensitivity analysis of the primary outcome accounting for intervention receipt 71
TABLE 27 Comparison of primary analysis and primary analysis in those with primary
outcome data available prior to the COVID-19 pandemic (pre 23 March 2020) 71
TABLE 35 Total costs (£) at 6-month follow-up by arm (for previous 6 months) 83
TABLE 36 Total costs (£) at 12-month follow-up by arm (for previous 6 months) 84
xvi
List of figures
FIGURE 1 Routes of support described by occupational therapists 8
FIGURE 10 Distribution of ABC-I scores at 6 months in those who did and did not
initiate SIT 70
FIGURE 11 Distribution of ABC-I scores at 6 months in those who did and did not
receive at least 13 SIT sessions during the intensive phase 70
FIGURE 12 Box plot of ABC-I scores at 6 months for those who received differing
levels of SIT 71
FIGURE 13 Box plots of ABC-I scores at 6 months by arm and by time period 72
FIGURE 14 Bootstrapped mean differences in health and social care costs and
effects (6-month ABC-I total score): cost-effectiveness plane – SIT vs. usual care
(NHS/PSS perspective) 85
FIGURE 16 Health-care and social care costs and effects (6-month ABC-I scores): CEAC 86
FIGURE 18 Bootstrapped mean differences in health-care and social care costs and
effects (12-month ABC-I total score): cost-effectiveness plane – SIT vs. usual care
(NHS/PSS perspective) 87
FIGURE 19 Bootstrapped mean differences in societal costs and effects (ABC-I total
score: 12-month complete-case analysis): cost-effectiveness plane – SIT vs. usual care
(NHS/PSS perspective) 88
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
xvii
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
LIST OF FIGURES
FIGURE 22 Imputed data set: NHS/PSS perspective (6-month ABC-I scores) – CEAC 90
FIGURE 23 Imputed data set: societal perspective (6-month ABC-I scores) – CEAC 91
FIGURE 24 Imputed data set: NHS/PSS perspective (12-month ABC-I scores) – CEAC 91
FIGURE 25 Imputed data set: societal perspective (12-month ABC-I scores) – CEAC 91
xviii
List of abbreviations
ABC Aberrant Behavior Checklist ICC intracluster correlation
coefficient
ABC-I Aberrant Behavior Checklist –
irritability ICER incremental cost-effectiveness
ratio
ADHD attention deficit hyperactivity
disorder ID intellectual disability
ADOS Autism Diagnostic Observation IQR interquartile range
Schedule
IT information technology
AE adverse event
NAS National Autistic Society
APSI Autism Parenting Stress Index
NICE National Institute for Health
ASD autism spectrum disorder and Care Excellence
ASI Ayres Sensory Integration OT occupational therapy
CAMHS Child and Adolescent Mental PI principal investigator
Health Services
PIS participant information sheet
CarerQol Carer Quality of Life
PSS Personal Social Services
CarerQol-7D Carer Quality of Life –
RCT randomised controlled trial
7 Dimensions
SAE serious adverse event
CarerQol-VAS Carer Quality of Life – visual
analogue scale SD standard deviation
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
xix
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
DOI: 10.3310/TQGE0020 Health Technology Assessment 2022 Vol. 26 No. 29
Therapists delivered the sensory integration therapy well. Carers and therapists said that they saw
some improvements. However, sensory integration therapy was not significantly better than the usual
care and is a more expensive option. We cannot say that sensory integration therapy is helpful for all
children with autism and different sensory processing difficulties; however, it might be helpful for some
children to focus on specific problems. Future work could focus on which children and problems it
would help the most.
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
xxi
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
DOI: 10.3310/TQGE0020 Health Technology Assessment 2022 Vol. 26 No. 29
Scientific summary
Background
Approximately 1–2% of children have a diagnosis of autism in the UK, of whom ≥ 90% also experience
at least moderate sensory processing difficulty (SPD), which can have an impact on their daily life and
well-being. Addressing SPDs using specific interventions, which are typically delivered by occupational
therapists, could lead to improvements across behavioural, social and educational domains. The National
Institute for Health and Care Excellence (NICE) guidelines on the management of and support for
children and young people with autism highlight parental perceptions of unmet need for occupational
therapy (OT) input to address sensory and functional difficulties. However, despite unmet need, there
is insufficient evidence to recommend any one therapeutic approach. NICE has recommended further
research to establish whether or not sensory integration therapy (SIT) improves SPDs in children with
autism across a range of contexts. Several systematic reviews have identified only two randomised
studies of SIT. Both reported good fidelity of delivery; however, the intervention protocols were variable
in terms of dose and delivery period, and both studies are limited by small convenience samples, poorly
described comparators and only short-term follow-up. The SenITA (SENsory Integration Therapy for
sensory processing difficulties in children with Autism spectrum disorder) randomised controlled trial
(RCT) tested the clinical effectiveness and cost-effectiveness of SIT, which is a manualised play-based
intervention delivered by occupational therapists to address specific sensory difficulties. SIT was
compared with usual care for children aged 4–11 years with autism and SPDs. Outcomes, which were
assessed at 6 and 12 months, included behavioural, functional and socialisation outcomes, quality of life,
well-being and cost-effectiveness.
Objectives
l To describe current usual care in trial regions and clearly differentiate this from the
trial intervention.
l To evaluate the clinical effectiveness of manualised SIT for SPDs in young children with autism in
terms of impact on behavioural problems and adaptive skills, socialisation, carer stress, quality of life
and cost-effectiveness.
l To explore recruitment, retention, fidelity of delivery, adherence, acceptability, adverse effects and
contamination in a process evaluation conducted alongside the main trial.
Methods
Design
The SenITA trial was a two-arm individual RCT of SIT for children with autism and SPDs.
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
xxiii
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
SCIENTIFIC SUMMARY
Statistical analyses
The main analyses were modified intention to treat, with those participants providing outcome data
included. A full intention-to-treat analysis comprised all participants in the group to which they were
randomised, with missing outcome data imputed using multiple imputation. This analysis set served
as a sensitivity analysis to the primary outcome. Finally, a complier-average causal effect population
comprised participants with outcome data in the group to which they were randomised, accounting
for those participants who received the intervention as intended. This analysis set also served as a
sensitivity analysis to the primary outcome. Primary outcome analysis compared trial arms by fitting
linear regression to irritability/agitation scores 6 months post randomisation, adjusting for baseline
scores, recruitment region, severity of sensory difficulty and sex of the child. Findings are reported as
adjusted mean differences with associated 95% confidence intervals (CIs) and p-values. Most secondary
outcomes were analysed similarly.
We explored differential intervention effects on the primary outcome by age, severity of SPD and
comorbid conditions [i.e. attention deficit hyperactivity disorder (ADHD), intellectual disability (ID)
and other neurodevelopmental/genetic condition], site, region and sex of the child. Our primary model
was extended by including subgroup × trial arm interaction terms. Subgroup effects were also explored
for carer stress scores 6 months post randomisation. We used multiple imputation to investigate
the potential influence of missing data on the primary outcome. Sensitivity analyses adjusted for
intervention receipt, impact of the COVID-19 pandemic and the correlated nature of repeated
observations within individuals. Models adjusted for baseline measures and variables balanced
at randomisation. We planned to conduct mediation analyses to explore whether or not any
intervention effects at 12 months were mediated through an effect on sensory sensitivities post
intervention. Agreement between parent- and teacher-reported Aberrant Behavior Checklist –
irritability (ABC-I) scores was assessed using a Bland–Altman plot. Performance on carer-reported
goals was compared between sessions 1 and 24 using paired t-tests for participants allocated to the
intervention only.
xxiv
Cost-effectiveness
A cost-effectiveness evaluation assessed intervention, NHS, social and education service costs, as well
as carer costs. The main cost-effectiveness measure was the incremental cost per point improvement in
irritability/agitation at the primary outcome time point.
Results
Trial procedures and outcome measures were acceptable to carers, and therapists generally found
involvement in the trial to be a positive experience. Carers in the intervention arm reported high
levels of satisfaction and benefit of SIT, although no statistically significant change in carer stress was
observed. Both carers and therapists tended to report improvements in well-being and daily functioning,
although there is no evidence to suggest that these effects were maintained following completion of
therapy. Therapists’ experience of delivering sensory integration was generally positive, and most felt
that it could offer benefit to some children, depending on their need.
Clinical effectiveness
There were, however, no statistically significant effects of the intervention on the primary outcome
of irritability/agitation at 6 months {mean score: usual care 18.8 [standard deviation (SD) 10.48];
intervention 18.5 (SD 9.33)}. Adjusted mean difference between groups on the ABC-I at 6 months
post randomisation was 0.40 (95% CI –2.33 to 3.14; p = 0.77). The correlation between baseline
and 6-month scores was 0.698 (95% CI 0.585 to 0.784). Teacher-rated irritability/agitation scores at
6 months, where available, were typically lower than carer ratings [i.e. the mean difference between
carer-rated and teacher-rated scores at 6 months was 10.28 (SD 14.48), with a 95% limit of agreement
of –18.12 to 38.68]. There was strong evidence of a difference between the two measures (p < 0.001),
indicating that, on average, carer ratings were higher. Conclusions drawn from primary analyses were
unaffected by sensitivity analyses accounting for missing data, intervention receipt (i.e. dose) or the
COVID-19 pandemic. No evidence of meaningful intervention effects was found at 6 or 12 months
across behavioural, adaptive functioning, socialisation, carer stress, health utility or quality-of-life
measures. Carer-rated goal performance and satisfaction data were available for a subset of participants
allocated to receive the intervention. There was strong evidence of an increase in scores on both
measures between session 1 and session 24 [i.e. a mean change in score of 2.75 (95% CI 2.14 to 3.37)
for carer-rated performance and of 3.34 (95% CI 2.63 to 4.40) for satisfaction; p < 0.001].
There was a differential effect of the intervention on irritability/agitation at 6 months by region (intervention
arm × South England = 9.77, 95% CI 4.04 to 15.49; p = 0.001). The results also indicate a differential
effect of the intervention on the primary outcome at 6 months by sex of child (intervention × female = 6.42,
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
xxv
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
SCIENTIFIC SUMMARY
95% CI 0.00 to 12.85; p = 0.050) and those with ADHD (intervention × ADHD = –6.77, 95% CI –13.55
to –0.01; p = 0.050). Similarly, there was a differential effect of the intervention on carer stress at
6 months by region (intervention arm × South England = 7.01, 95% CI 0.45 to 13.56; p = 0.04) and presence
of other neurodevelopmental or genetic conditions (intervention × neurodevelopmental/genetic condition
present = –9.53, 95% CI –18.08 to –0.98; p = 0.030). No differential effects were observed at 6 months
for severity of SPD, general comorbidity, ID or other specific neurodevelopmental or genetic condition.
Cost-effectiveness
The delivery of SIT incurred significant additional costs. When intervention costs were not included in
total NHS/Personal Social Services (PSS) costs, NHS/PSS costs of care for usual care-only participants
were significantly higher than NHS/PSS costs for SIT participants. Economic evidence suggests, however,
that SIT has a low probability of being a cost-effective option compared with usual care.
Conclusions
The SenITA trial was a robust evaluation of the clinical effectiveness and cost-effectiveness of sensory
integration for behavioural, functional and quality-of-life outcomes. Targets for recruitment, retention
and other key parameters used to estimate sample size were met, and usual care for the trial
population was described in detail and found to be significantly different from the sensory integration
intervention offered as part of the trial. SIT was delivered with fidelity and adherence was generally
high, with no evidence of significant contamination. No adverse effects were reported. The population
recruited were probably representative of children within autism services, although girls and minority
ethnic boys are likely to be under-represented in both the current study and the wider population of
children diagnosed with autism. Acceptability was high among carers and therapists, in terms of both
study participation and intervention receipt and delivery, and therapists generally felt that SIT could
offer benefit to some children, depending on their needs.
No main intervention effects were observed, and sensitivity analyses did not alter the interpretation
of results. Subgroup analyses suggest that SIT may work better for boys and those with a comorbid
diagnosis of ADHD. However, these subgroup analyses were exploratory analyses and, although the
results were statistically significant and indicative of clinical importance, were not powered to detect
effects. Therefore, the results may be reflective of multiple testing and need to be confirmed in a
subsequent study. Carer-rated goal performance and satisfaction did increase significantly with exposure
to the intervention, and carers and therapists generally reported improvements in well-being and
functioning following intervention receipt. However, there is no evidence to suggest any improvements
were maintained in the longer term, that is, following completion of therapy. Economic evaluation also
suggests that SIT is not cost-effective compared with usual care.
There are a number of limitations of the current trial, however, including variability of intervention
provision across regions (i.e. NHS delivery in Wales and delivery by private practitioners in England),
underestimation of intervention delivery costs (i.e. time allowed for initial assessment and clinical
reasoning) and delay for some participants allocated to intervention in receiving therapy (although
sensitivity analyses do not suggest any differential effect). In addition, there was an error in
xxvi
administration of the Vineland Adaptive Behavior Scales, creating a ceiling effect, although, similarly,
given the pattern of results across other outcomes, it is not likely that this would have altered the
interpretation of the results. Interpretation of the positive effect of therapy on carer-reported goal
performance is also limited in that it was not possible to measure this outcome in the control arm,
as families were not generally under the care of OT services.
Taken together, the results suggest that SIT did not demonstrate clinical benefit across a range of
outcomes (i.e. behavioural, functional, social, quality of life and well-being) over and above standard
care for young children with autism and SPDs. Although statistically significant intervention effects
were observed for some subgroups (i.e. boys and children with comorbid ADHD), these findings should
be considered as hypothesis-generating only and require further confirmation. It is also likely that
SIT is effective for individualised (carer-reported) performance goals, although it was not possible to
compare goals set in the intervention arm with standard care in the current trial, and it is not clear
whether or not perceived improvements are maintained in the longer term.
Trial registration
Funding
This project was funded by the National Institute for Health and Care Research (NIHR) Health
Technology Assessment programme and will be published in full in Health Technology Assessment;
Vol. 26, No. 29. See the NIHR Journals Library website for further project information.
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
xxvii
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
DOI: 10.3310/TQGE0020 Health Technology Assessment 2022 Vol. 26 No. 29
Chapter 1 Introduction
The prevalence of autism in UK primary school-aged children is approximately 1–2%1 and the effects of
autism are well documented, including increased incidence of mental health disorders, most commonly
anxiety. Approximately 40–90% of children with a diagnosis of autism spectrum disorder (ASD) also
meet the criteria for at least one anxiety disorder.2,3 The impacts on family life are significant. Parents
report higher levels of stress4 and loss of earnings,5 and the lifetime cost to the UK economy of supporting
an autistic individual is estimated at £0.92–1.5M.5 Relationship difficulties, particularly at school, are
also commonly reported. Children with autism are significantly more likely than neurotypical peers to
experience bullying6 and tend to have fewer friendships.7
Sensory modulation difficulties (i.e. difficulty recognising and/or integrating sensory information) in
children with autism probably pose substantial burden to children and families, limiting participation in
leisure activities,14,15 and are linked to problems with activities of daily living, such as eating, sleeping,
dressing, toileting and personal hygiene.16 Such difficulties represent a long-term challenge for health
services in terms of treating potential consequences, such as behaviours that challenge and mental
health disorders. Awareness and management of sensory difficulties in mainstream educational settings
is also likely to affect peer relationships and educational outcomes. The potential pathway of effect is
unconfirmed [i.e. the mechanism(s) by which sensory difficulties affect key outcomes], but it is plausible
that reducing sensory processing difficulties (SPDs) could lead to improvements across behavioural,
social and educational domains.
The National Institute for Health and Care Excellence (NICE) guidelines on the management and
support of children and young people with autism17 highlight parental perceptions of unmet need for
occupational therapy (OT) input to address sensory and functional difficulties as part of the wider
supportive network spanning education, health and social care. However, despite this clear unmet
need, there is insufficient evidence to recommend any single therapeutic approach for SPDs. The
NICE Guideline Development Group recommended further research to establish whether or not
sensory integration therapy (SIT) improves SPDs in children and young people with autism across a
range of contexts.
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
1
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
INTRODUCTION
Sensory-based interventions
Case-Smith et al.13 systematically reviewed evidence (from 2000 to 2012) of sensory-based interventions
and SIT for children with autism and SPDs. Nineteen studies were included in the review, including
14 studies of sensory-based interventions. Sensory-based interventions were defined as those that were
based on individual assessment of the child’s sensory needs and functional performance, included explicit
self-regulation goals and associated behavioural outcomes, and required the child to actively participate.
Few positive effects were reported for studies evaluating sensory-based interventions.13 Thirteen of
14 studies eligible for review were multiple baseline single-case evaluations of weighted vests, therapy
balls and different types of vestibular stimulation (e.g. swinging and bouncing). One study25 found a
positive effect for weighted vests on attention. There was limited evidence to support the use of therapy
balls to increase sitting behaviours.26,27 A further study28 demonstrated a positive effect of a sensory diet
(e.g. brushing, swinging and jumping) on self-regulation behaviours. Only one study29 was a randomised
controlled trial (RCT) (n = 30) of a ‘sensory diet’ protocol (i.e. exposure to a variety of different sensory
experiences and practice of specific activities), which found positive effects in terms of a reduction in
sensory difficulties overall, but did not assess fidelity or blind outcome assessors. The intervention also
included several behavioural techniques (e.g. modelling, prompting and cueing) and, therefore, it is not
possible to isolate the effects of sensory-based approaches.13 In summary, evidence to support the use of
sensory-based interventions is limited in scope, methodology and generalisability.
Sensory integration therapy is a clinic-based approach that focuses on the therapist–child relationship
and uses play-based sensory motor activities to address sensory–motor factors specific to the child to
improve their ability to process and integrate sensation.30 To distinguish SIT from other sensory-based
interventions, a set of fidelity principles to guide delivery was developed and registered as ASI.31,32
A fidelity measure has also been developed for use in research.23 These principles ensure that underlying
sensory–motor difficulties affecting activities of daily living are addressed through presenting a range of
sensory opportunities and active engagement of the child in sensory–motor play at the ‘just-right’ level
of challenge, within the context of a collaborative therapist–child relationship. Studies meeting ASI
fidelity principles have been shown to lead to improvement in client-oriented goals,33,34 but research
is limited and, in some cases, interventions are poorly defined.13 Case-Smith et al.13 identified five
studies specifically examining SIT, of which only two33,34 were RCTs. SIT was described in these studies
as ‘ . . . clinic-based interventions that use sensory-rich, child-directed activities to improve a child’s
adaptive responses to sensory experiences’.13
Both RCTs33,34 included in the review13 demonstrated positive effects of SIT on the Goal Attainment
Scale (GAS). There were, however, methodological issues with both trials, including small sample sizes
[i.e. no formal sample size calculation and use of convenience samples (n = 3733 and n = 3234)], lack
of long-term follow-up33,34 and limited description of usual care.34 There are also well-documented
methodological problems (with validity and reliability) related to the use of GAS as an outcome measure
in clinical trials,35,36 particularly in paediatric contexts.37 However, more recent research indicates that
GAS may be a promising approach to measuring effectiveness of psychosocial interventions in autism
and some recommendations for optimising reliability, including the use of a standardised approach to
writing GAS goals, have been made.38 Nonetheless, uncertainty remains about the use of GAS as an
objective outcome measure in the context of a clinical trial, despite the appeal of an individualised
approach to measurement of what could be considered an individualised form of therapy.
The three remaining studies assessing the efficacy of SIT reported positive effects on behavioural
outcomes linked to sensory difficulties, although it is difficult to draw meaningful conclusions given
the use of non-randomised designs, very small sample sizes and insufficient descriptions of outcome
measures.13 More recent systematic reviews39,40 did not identify any additional RCTs, but reported
positive effects on several functional, developmental40,41 and play outcomes39,42 in two small non-
randomised pilot studies (n = 842 and n = 2041) in which SIT was delivered with adequate fidelity.
The current evidence base to support use of SIT for children with autism is of low quality and
insufficient to recommend treatment.17 Significant methodological issues are evident from studies
conducted to date, including poorly described interventions that are unlikely to meet fidelity standards.
Even in randomised studies with good fidelity of intervention delivery, of which several systematic
reviews13,39,40 have identified only two (i.e. Pfeiffer et al.33 and Schaaf et al.34), intervention protocols
were variable in terms of dose and delivery period (e.g. 18 45-minute sessions delivered over 6 weeks
in the Pfeiffer et al.33 RCT and 30 sessions delivered three times per week for 10 weeks in the Schaaf
et al.34 RCT). Conclusions from all studies to date are limited by small convenience samples, poorly
described comparators or definitions of what constitutes ‘usual care’ and a lack of long-term follow-up.
The latter may be particularly important, given the focus of SIT on attention and learning rather than
repetition of specific behaviours. Post-intervention treatment effects may be less specific, and we do
not yet know whether or not SIT demonstrates sustained effects.13
There is also uncertainty around appropriate intervention targets and associated outcome measurement,
given the focus of previous trials on goal attainment as the primary outcome of interest and associated
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
3
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
INTRODUCTION
psychometric challenges. Furthermore, aside from considerable variation in the intervention protocols,
SIT is resource intensive and would require significant investment to be rolled out as a potential
treatment option within the NHS. It is critical, therefore, to evaluate both the clinical effectiveness and
the cost-effectiveness of SIT for children with autism and SPDs across a range of key outcomes, and to
determine whether or not any effects are sustained in the longer term.
The main aims of the SenITA (SENsory Integration Therapy for sensory processing difficulties in
children with Autism spectrum disorder) trial (see Chapter 3 for methods) were to (1) describe usual
care in trial regions and clearly differentiate this from the proposed intervention (see Chapter 2);
and (2) evaluate the clinical effectiveness of manualised ASI therapy (see Chapter 5) in a two-arm RCT
for SPDs in young children with autism. The intervention was evaluated in terms of the impact on
behavioural problems and adaptive skills, socialisation, carer stress and quality of life (see Chapter 6),
and in terms of cost-effectiveness (see Chapter 7).
Participants with a range of autism and sensory symptom severity, as well as functional and cognitive
ability, were recruited from NHS, educational and third-sector settings. The primary outcome time
point was 6 months post randomisation, and was reassessed at 12 months to determine whether
or not any observed effects were maintained in the longer term. An internal pilot (see Chapter 4)
examined whether or not the intervention differed significantly in content or intensity from usual care
and assessed recruitment and retention. Contamination, adherence and fidelity of intervention delivery
were measured as part of the process evaluation (see Chapter 8). Experiences of the intervention and
usual care were also explored via semistructured interviews with carers and therapists (see Chapter 9).
Aim
Prior to delivering SIT to trial participants, it was important to describe the scope of usual care for
children with autism and SPDs (as per the commissioning brief). This would ensure that the therapy
offered to the intervention group was clearly different from any treatment offered to the usual-care
group. We aimed to explore the role of OT in the management and support of primary school-aged
children (i.e. children aged 4–11 years) with autism and associated SPDs living in the UK. We wanted
to know how carers and children with autism and SPDs accessed OT services, the nature of any
assessments and whether or not specific interventions and/or support were received along the clinical
pathway. In addition, we wanted to establish the most common behaviour or occupational performance
issues and the profile of associated interventions used for children with autism and SPDs.
Methods
Carer participants
An online questionnaire was distributed to carers of children with autism and SPDs aged 4–11 years
and in mainstream education. The questionnaire was made available via the National Autistic Society
(NAS) website, local NAS groups, social media [Facebook (Meta Platforms, Inc., Menlo Park, CA, USA;
www.facebook.com) and Twitter (Twitter, Inc., San Francisco, CA, USA; www.twitter.com)], flyers at
public events and through the Royal College of Occupational Therapists specialist section on children,
young people and their families.
Online questionnaires
An online questionnaire was distributed to occupational therapists working with, or who had previously
worked with, children with autism and SPDs aged 4–11 years and in mainstream education. The
questionnaire was first distributed via the Welsh children’s OT network, the occupational advisory
forum in Wales and the head of the children’s OT service in Cornwall. Occupational therapists
from only the original trial recruitment areas (i.e. Wales and Cornwall) were asked to complete the
questionnaire in this first phase and information was also collected on willingness to participate in
focus groups/interviews. The questionnaire was then more widely distributed across the UK through
the Royal College of Occupational Therapists.
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
5
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
USUAL CARE FOR CHILDREN WITH AUTISM AND SENSORY PROCESSING DIFFICULTIES
previously worked, with children with autism and SPDs aged 4–11 years and in mainstream education.
Focus groups were conducted in Wales (group 1 had two participants and group 2 had three participants).
Six occupational therapists in Wales and Cornwall were unable to take part in the focus groups and,
therefore, were interviewed via telephone. Recruitment took place in February 2017, with the aim of
carrying out focus groups before trial recruitment began.
Data collection
Data were merged following completion of all questionnaire phases. Questions to occupational
therapists were split into two broad sections: (1) their role in the work setting and (2) their specific
experience with this population. Occupational therapists were asked about their qualifications and
years of experience; how many children with autism they saw; the type of assessments they completed
and the type and extent of therapy delivered, including theoretical underpinnings for therapy to
address SPDs; the type of occupational performance issues they associated with SPDs; the type of
support and advice they offered children with autism and their families; and whether or not they
would be interested in being contacted to take part in an interview or a focus group.
Analyses
Online questionnaires
Descriptive analyses were used in the form of frequency tables for the quantitative data, and included
summaries of the geographical area of respondents, nature of reported difficulties and contact with
services, and information on OT assessment and treatment received. Free-text comments within
questionnaires provided context and additional explanation for some responses. Examples have been
included to give meaning and carers’ lived experience of services received. Free-text comments within
questionnaires completed by occupational therapists were incorporated into the thematic analysis of
focus group and interview data.
We carried out a thematic analysis using deductive methods to identify themes reflecting reality
as reported across the whole data set. We initially coded data within six overarching themes (i.e.
referral, initial assessment, initial management, further assessment, treatment plan/intervention,
feedback and future plans) relating to the different phases of OT support for children with autism
and SPDs. In addition, we used an inductive thematic approach to identify occupational therapists’
views, experiences and challenges relating to these processes, moving towards a more contextualist
approach and ensuring that subthemes, which had not been pre-empted and initiated from occupational
therapists themselves, were identified. These subthemes were factors influencing decisions around
which assessment occupational therapists used (at child, OT and system level), factors influencing
the location of assessment, the multifaceted nature of interventions, empowering others, and making
interventions achievable for parents and schools. This analysis was then integrated with the results of
the questionnaires. While interpreting the qualitative data we produced a visual map of the different
phases of management of children with autism and SPDs (Figure 1). We developed this map this in a
phased way, starting with one account in an interview and building on this with each new transcript,
revising and incorporating as we progressed. In this way, data were constantly compared and contrasted.
Developments in the analytic process were recorded through researcher memos and version control
of the visual maps. The first transcript was discussed in detail and themes developed by a group of
qualitative researchers and occupational therapists. Themes were then applied to the next transcript
and discussed again. The research team were encouraged to reflect on their own professional role in
asking and interpreting interview questions.
Results
Carers’ views of usual occupational therapy for children with autism and sensory
processing difficulties
A total of 159 carers responded to the questionnaire. Most (n = 149, 93.7%) carers were mothers.
We received six (3.8%) responses from fathers, two from grandmothers (1.3%), one from a kinship
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
7
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
USUAL CARE FOR CHILDREN WITH AUTISM AND SENSORY PROCESSING DIFFICULTIES
FIGURE 1 Routes of support described by occupational therapists. ITP, individualised therapy programme/treatment
plan; SP, sensory processing; SPM, Sensory Processing Measure.
carer (0.6%) and one from an educational visitor (0.6%). The spread of respondents across geographical
regions is shown in Table 1. Thirty-two (20.1%) respondents were from Wales, 115 (72.3%) were from
England, 11 (6.9%) were from Scotland and one (0.6%) was listed as ‘other’ (location not specified).
Cornwall 11 (26.4)
Dorset 2 (1.3)
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
9
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
USUAL CARE FOR CHILDREN WITH AUTISM AND SENSORY PROCESSING DIFFICULTIES
Ninety (56.5%) carers received information and advice on how to manage their child’s difficulties, such
as anxiety, behavioural and sensory difficulties. Although 68 (42.8%) carers received specific advice on
sensory information from services, a further 46 (28.9%) carers would have liked more information on
these aspects of their child’s difficulties. Where advice and information on sensory issues had been
given, this was most commonly by OT services. However, sometimes other NHS and third-sector
organisations provided similar information. Information was typically in leaflet form and included
information on sensory processing, exercises/programmes to do at home, social stories and contact
information/websites for parent courses.
Of those carers who had ever received OT input, 15 (16.8%) reported that they had received weekly
input and most visits were clinic based (n = 57, 35.8%), with intervention varying from sensory based
(not SIT), parent-directed programmes, functional skills training, sensory diets and behavioural
programmes. Most carers (n = 58, 36.5%) stated that the intervention that they received focused on
sensory modulation. Fewer carers (n = 22, 13.8%) received intervention for both sensory modulation
and dyspraxia, and an even smaller number of carers (n = 9, 5.7%) received intervention for dyspraxia
alone. Forty-three (27.0%) carers reported that the intervention focused on other aspects, such as
anger management, behavioural difficulties, speech and sleep. Carers were asked further details about
specific interventions that their child received in terms of whether or not they felt that the therapy
helped their child, how satisfied they were with the intervention received and whether or not they
would recommend any changes to intervention delivery.
10
more access to OT and speech and language therapy (SLT) support through the NHS. Several carers
specifically requested training and support into schools to manage sensory difficulties (n = 11), as they
felt that the school was not able to carry out the sensory support required. Some carers would have
liked more specific advice for their child, including follow-up and monitoring visits, rather than generic
information that was not personalised:
I would love for this intervention to be available as more than a one-off appointment with me as a
parent. I would love to be able to access sensory support/therapy for my children on a regular basis.
Carer 66
Specific advice from a qualified OT [occupational therapist] specialising in sensory difficulties not just a
parent googling what to try – trial and error as totally without support from NHS.
Carer 9
Make it available to everyone via the NHS. NHS input was limited and generalised, we had excellent input
from a private OT [occupational therapist].
Carer 155
NAS website and research online; family and friends particularly those with children who have autism;
colleagues at work.
Carer 145
continued
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
11
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
USUAL CARE FOR CHILDREN WITH AUTISM AND SENSORY PROCESSING DIFFICULTIES
Finally, when asked what types of intervention would be the most useful, the most common carer
responses were additional support for social communication (n = 16), desensitisation and other sensory
issues (n = 15), support for managing behaviour, including aggression, anger and anxiety (n = 14), and
specific SIT (n = 12). A significant number of carers reported having to source support via independently
accessed behaviour training (n = 81, 50.9%) and regular contact with support groups (n = 87, 54.7%),
and 81 respondents (50.9%) received informal support from family and friends:
More help with socialising with his peers so that he does not become socially isolated.
Carer 25
12
Someone to work with my child teaching them about their sensory differences and how to manage them
whilst exploring what works/doesn’t and teaching them coping techniques at their own pace.
Carer 77
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
13
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
USUAL CARE FOR CHILDREN WITH AUTISM AND SENSORY PROCESSING DIFFICULTIES
Occupational therapists described that a triage meeting would take place at which occupational
therapists and colleagues determined the appropriateness of a referral. Occupational therapists
describe using clinical reasoning and professional experience to consider the information:
So it’s difficult to say whether people meet criteria because our criteria is still, it’s not always clear;
it’s a little bit woolly but I think that’s quite historically common for OT that the criteria for a service
for OT is generally quite woolly because we do cover such a wide remit.
Interviewee 4
Yes, there are a few of us here that are trained in using SIPT [Sensory Integration and Praxis Test],
so sometimes we will do that for the children that are more highly functioning ASD, and that’s quite
good because it gives us a really good profile on what their skills are, and their things to work on.
Interviewee 5
Assessment process
Most OT survey respondents reported using informal or structured clinical observations within the
home, school or clinic setting (n = 68, 86%). In the focus groups/interviews, occupational therapists also
talked about the value of observing informal activity. One occupational therapist compared informal
and formal clinical observations and the different ways of thinking required for occupational therapists
to process information. Occupational therapists also talked about sensory play as a way to practically
demonstrate the challenges that the child and carer(s) face.
Occupational therapists reported that this observation was carried out alongside interviews/questionnaires
and a developmental history with carers (n = 45, 57%), teachers (n = 22, 27.9%) and the child (n = 12,
15.1%). In addition, 33 (41%) survey respondents reported using a specific OT assessment of functional
daily life skills. Forty-five (57%) respondents reported using a specific measure to assess SPDs [e.g. Sensory
Profile 224 and the Sensory Processing Measure™ (SPM)44]. Fewer (n = 15, 19%) survey respondents
reported using measures to assess motor difficulties (e.g. Movement Assessment Battery for Children-2
and Bruininks–Oseretsky Test of Motor Proficiency-245).
Occupational therapists also mentioned other measures [e.g. the Peabody Developmental Motor
Scales,46 clinical observations assessment,47 the Canadian Occupational Performance Measure48
(COPM), Movement Assessment Battery for Children,49 The Roll Evaluation of Activities of Life
Occupational Therapy assessment,50 Beery Visual Motor Integration51 and Kate Malcomess’ Care
Aims Framework52]. Occupational therapists in the diagnostic assessment team and one other core
service reported that they might use the Autism Diagnostic Observation Schedule (ADOS)53 or specific
SLT assessments. Some occupational therapists used the Sensory Integration and Praxis Test54 (SIPT)
in case studies if they had undertaken training in sensory integration (but did not then use this
therapy in usual care), whereas others said that they did not have access to SIPT equipment.
Only one occupational therapist said that they used the SIPT routinely.
In focus groups/interviews, occupational therapists reported that they talk with carers and schools/
nurseries to set goals. Older children will discuss goals too. Occupational therapists described
instruments used to support goal-setting [e.g. the Perceived Efficacy in Goal Setting Approach,55,56
14
Child Occupation Self-Assessment,57 SMART (Specific, Measurable, Achievable, Relevant, Time bound)
goals58 and Kate Malcomess’ Care Aims Framework52]. However, one occupational therapist explained
that they do not always have to use formal assessment/goals if sufficient information is gained through
observation or is offered by the carer or child.
Again, reason for referral was also considered. Some occupational therapists said that they would see
the child in their usual environment where difficulties presented and/or in another environment with
carers (e.g. school/nursery). One occupational therapist also explained that the child would usually
come to the children’s centre, as there was equipment there that could be tried out. If the child was
to receive the intervention, then they would often be seen on several occasions in different locations.
The location of assessment was also influenced by the ability of the carer to visit the clinic owing to,
for example, socioeconomic status or learning difficulties:
Well I think in the battery of assessments that you have, and the observations that you can do it very
much depends on the child because a lot of the children with autism they would get freaked out with
maybe doing standardised assessments and you can’t, you have to do it by observation and play then.
You’re very much guided when you meet the child on the day really . . .
Participant 1, focus group 1
. . . so we use a sensory profile, but it’s again down to the individual therapist, it’s not something that we
necessarily do for everyone every time. We use just clinical observations and observing them in their home
environment and their school environment, so that’s our main, I would say that’s our main first contact is
just clinical obs [observations] and chatting to the parents and seeing how they are and then we may
decide to use a sensory profile if we need to get a clearer picture.
Interviewee 4
If the child is going to be put in distress through coming to a new environment and a strange environment,
and would be distressed in that setting, then you’re not going to get the best thing from that child, so that
would influence my clinical decision of where I carried that out.
Interviewee 3
We then used interview and focus group data to understand the different phases of OT support and
interventions for children (see Figure 1).
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
15
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
USUAL CARE FOR CHILDREN WITH AUTISM AND SENSORY PROCESSING DIFFICULTIES
Desensitisation 32 (40.5)
Education 56 (70.9)
SIT 5 (6.3)
Occupational therapists reported (in focus groups/interviews) that, based on observation, assessment
and goal-setting, they would develop an individualised therapy programme/treatment plan with
carers and the school/nursery. This would often involve multiple sessions (around four to six). A wide
range of strategies might be drawn on and a plan provided for an individual child to try at home or at
school/nursery. These strategies might include sensory movement-based strategies (e.g. vestibular and
proprioceptive activities, such as heavy muscle work, yoga-type movement, peanut roll, scooter board,
lycra blanket, soft play and sensory-weighted equipment) and may also include deep touch pressure,
16
massage and brushing for alerting and desensitising, calming strategies and mindfulness, and swimming.
Some equipment might be used for assessment/observations and treatment, for example therapy
rooms with a smartboard, Wii Fit (Nintendo Co., Ltd, Kyoto, Japan), weighted blankets, supportive
chairs or trampolines (interview 1). Another occupational therapist (interviewee 3) mentioned that
they had a loan system for sensory items (e.g. weighted products, dance mats, vibrating items, seating
and lap pad). Carers might have delivered strategies themselves or a technician/occupational therapist
would offer a demonstration. One occupational therapist reported that they also offered groups that
families can link into, such as bike skills groups, gymnastics and social skills groups.
Occupational therapists might also advise group interventions (e.g. The Alert Programme and Sequential
Oral Sensory approach) or multidisciplinary team working/referral to other services [e.g. a portage
worker, a specialist health visitor, a neurodevelopmental team, NAS, Barnardos (London, UK), primary
mental health, a specialist autism service in the school, Autism Puzzles (Cardiff, UK) and a disability
sports officer]. Occupational therapists also spoke of linking and contributing to transdisciplinary groups,
including Next Steps, Early Bird, Early Bird Plus and Cygnets.
We have a very positive response to it. And the number of parents that say oh if only we had known this.
So yeah, it’s a very positive way of meeting a lot of people’s needs. And it also saves the therapist’s time,
because otherwise what we feel is that those parents that then seek further intervention, they have a
baseline of knowledge. And we all know what that level of knowledge is, so that we can start working at
that higher level rather than having to cover the same groundwork individually with each child.
Interviewee 2
We don’t provide it, we don’t have any funding to provide that type of sensory equipment, but we do
have access to them to be able to trial them for a 2-week period. After the trial we then make a decision
whether we suggest that for the parents or the schools, or nursery or wherever that child is, to purchase
that piece of equipment. But we don’t have funding to provide that.
Interviewee 3
In the house, and in the centre, we use a lot of suspended type equipment, so we’ve got things like T-bars,
we have platform swings, and we have bolster swings. We have climbing frames, tyre swings, all that type
of stuff.
Interviewee 5
Multifaceted interventions
Occupational therapists tended to describe the interventions that they offered as varied and
multifaceted. Some occupational therapists highlighted the non-standardised nature of developing
and delivering interventions. However, occupational therapists described using an evidence base,
their clinical experience and the needs of the individual child to guide intervention/strategies.
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
17
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
USUAL CARE FOR CHILDREN WITH AUTISM AND SENSORY PROCESSING DIFFICULTIES
In isolation it means nothing. You can carry out 30-odd sessions, but once that intervention finished it’s
finished, unless the parent and the child . . . For me, the powerful bit is carrying that over into the child’s
everyday life so it continues.
Participant 2, focus group 2
So I think for me it feels like it’s empowering others to do this work and then to understand what
it is to provide it every day for the child feels more normal than going to a clinic setting all the time.
Less medical. Nobody wants to be going somewhere . . . Children have got lives to live themselves and
fun to have.
Participant 2, focus group 2
Discussion
Representativeness of views
The views reflected within our data were collated from survey responses from occupational therapists
and carers in Wales, England and Scotland, and from interviews/focus groups conducted with
occupational therapists in South Wales and Cornwall. The purpose was to determine how carers and
children with autism and SPDs access OT services, the assessment process and what interventions
and/or support are commonly provided. Determining the nature of usual care within trial areas and
the wider UK context would ensure that our comparator was sufficiently different from SIT delivered
in the intervention arm of the trial.
18
activities. Many services would not accept a referral unless there were clear occupational performance
difficulties in self-care, play or school-related activities. It is likely that this more focused approach
has been driven by increasing waiting lists for access to OT,62 ensuring that only the most appropriate
children received therapy. There have also been government drivers to ensure that children are
seen within 14 weeks of referral (e.g. the NHS Wales Delivery Framework and Reporting Guidance
2019–202063). From the carers’ perspective, understanding of what OT services could offer their
child was less clear cut. Carers wanted support for their child’s social interaction, help with dealing
with aggressive outbursts/frustration, help with understanding autism and help with siblings. Fewer
carers listed functional skills, such as toileting, feeding, dressing and sleeping, as behavioural issues
seemed to have a greater impact on quality of life. Respondents were, therefore, frustrated because
they felt that they could not always access the service that they perceived would help them and their
child, and expressed disappointment that services were not always offered by the NHS.
Assessment process
Both occupational therapists and carers reported that initial assessment included observations,
interviewing the caregiver, questionnaires and, sometimes, more formal assessments. Observations of
the child’s behaviour and performance were typically within the clinic setting and, to a lesser extent,
within the school or home environment. Standardised assessments were not used routinely. Although
most therapists reported using a sensory integrative approach, only very few reported using the SIPT
to formally identify the nature of the sensory integration difficulty.
Some settings used structured goal-setting with carers to establish the child’s needs. There has
been a consistent drive in recent years to develop family-centred practice, with services working in
partnership to address concerns and goals.64 From this survey, it appears that some carer concerns
were addressed and that most were satisfied with the advice given, but many would have liked more
input. After initial assessment, most services generated a report with advice on strategies for managing
SPDs in everyday life. For some parents, contact with services ended at this point or they were
referred to a workshop/training group. For others, additional OT support was received with further
discussion and advice, the offer of loan of suitable equipment to support their child’s needs or some
sessions of one-to-one intervention.
Intervention
Therapists appeared to have a two-pronged approach: (1) giving strategies and advice to support
carers to manage their child’s SPDs to improve self-regulation, and (2) attempting to address SPDs
directly with the aim of remediation of the dysfunction and underlying nervous system.65
Direct intervention
Carers and some occupational therapists expressed frustration that direct hands-on therapy was not
always possible because of resource constraints. Carers particularly felt that they were missing out on
intervention and that they had to seek support privately. Respondents whose children had received
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
19
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
USUAL CARE FOR CHILDREN WITH AUTISM AND SENSORY PROCESSING DIFFICULTIES
SIT were extremely satisfied and all felt that it had helped their child. Very few therapists in the NHS
reported using SIT meeting fidelity criteria,23 but some were using sensory-based interventions, applying
theory and principles of sensory integration and delivered less intensively for shorter periods. These
interventions included activities applied to the child to improve behaviour associated with modulation
disorders,13 such as massage, brushing, wearing a weighted vest or sitting on a gym ball.
Summary
Sensory-based difficulties are commonly reported in this population, and there is a clearly expressed
demand from carers for additional contact and support from OT services. Current provision of usual
care and most services offered focus on delivering sensory strategies and advice. This may be in the
form of generic written information that is web based or a bespoke leaflet, or through parent groups
or one-to-one consultation with carers. Some direct therapy may be offered using a sensory integration
approach, but this usually comprised fewer than 10 sessions. Intensive treatment offered by a therapist
with SIT training is available within the private sector and so is inaccessible for many carers.
20
Chapter 3 Methods
Design
The SenITA trial was an individually randomised two-arm effectiveness trial that compared manualised
SIT with usual care for children of primary school age with autism and SPDs. Randomisation was in
a 1 : 1 ratio and was minimised by site, severity of SPDs (i.e. probable/definite) and sex of the child
(i.e. male/female). The target was to recruit 138 children aged between 4 and 11 years in primary education.
Children were recruited from a variety of sources, including CAMHS, OT services, paediatric clinics, support
and/or social services and primary schools, and via self-referral. The intervention was delivered in OT
clinics that were rated to ensure that they met full structural fidelity criteria for manualised SIT.
Children allocated to receive the intervention were provided with SIT in 26 1-hour sessions (Figure 2),
that is face-to-face sessions twice per week for 10 weeks, tapering to twice per month for 2 months,
and a telephone call once per month for 2 months. Where consent was provided, sessions were video-
recorded, with a sample of recordings assessed for fidelity of delivery.23 The comparator was usual
care, which was defined as awaiting services or sensory-based intervention not meeting fidelity criteria
for SIT (e.g. at least one face-to-face session per week).
The trial also included an internal pilot (see Chapter 4) with progression criteria to assess recruitment
and retention rates and whether or not usual care differed from expected provision.
Qualitative work included therapist and carer interviews to explore (1) the support experienced by
families (outside the trial, i.e. usual care) and (2) the perceived impact and effectiveness of SIT for
children with autism and SPDs. Interview and focus group data were double coded and analysed using
a framework approach.66 Ethics approval was granted by Wales Research Ethics Committee 3.
Objectives
The overarching objective was to answer the following research question: ‘what is the clinical
effectiveness and cost-effectiveness of SIT for children with autism?’.
Primary objective
The primary objective was to determine the impact of SIT on irritability and agitation, as measured by
the corresponding subscale of the Aberrant Behavior Checklist (ABC).67
Secondary objectives
Secondary objectives were included to examine:
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
21
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
METHODS
FIGURE 2 The SenITA trial participant flow diagram. APSI, Autism Parenting Stress Index; CarerQol, Carer Quality of
Life; CSRI, Client Service Receipt Inventory; EQ-5D, EuroQol-5 Dimensions.
Site selection
Secondary care NHS and private OT treatment settings (where NHS capacity was insufficient to
support the trial or no appropriate NHS treatment setting was available) across South Wales and
South England were included as research sites. Sites evidenced that they met structural fidelity criteria
for intervention delivery.
22
Participants
Inclusion criteria
Participants were eligible to take part if they:
l had a diagnosis of autism (as documented on medical and/or educational records) or had probable
or likely autism (defined as undergoing assessment within the local autism pathway)
l were aged 4–11 years at the start of the trial
l planned to remain in mainstream primary education until the primary outcome time point
(i.e. 6 months post randomisation)
l had definite or probable SPDs defined as (1) definite dysfunction on at least one sensory dimension
(defined as all domains except social participation) and the total score on the SPM44 or (2) at least a
probable dysfunction on two or more sensory dimensions and the total score
l provided carer consent/child assent.
Exclusion criteria
Participants were excluded if they were:
Recruitment process
Children were recruited from CAMHS, paediatrics, OT, schools and support or social services. Services
sent carers of children referred into their service a letter informing them about the trial, as well as a
participant information sheet (PIS) and details of how to express an interest in taking part. Details of
the study were also posted on relevant websites (e.g. related charities’ websites) and via social media.
A trial-specific website [URL: http://senitastudy.weebly.com (accessed 7 April 2022)] was also created
as a place where individuals could get more information on the trial and could download information
sheets. Carers were also able to self-refer into the study.
Informed consent
It was likely that potentially eligible children could have a range of impairments, including a degree of
intellectual disability (ID). Provided that all inclusion criteria were met and exclusion criteria were not
met, no child was excluded for this reason or for other comorbid conditions. In accordance with good
clinical practice (GCP), written informed consent was taken from each child’s carer (i.e. their parent or
legal guardian) and assent from children before any trial-related activities were undertaken. In signing
the consent form, carers also consented to their participation in the trial (including completion of some
outcome measures) and for the study team to contact the child’s school to ask for feedback on the
child’s behaviour if necessary. Schools were also asked to complete the Aberrant Behavior Checklist –
irritability (ABC-I) at the 6-month time point. Consent could be withdrawn by carers at any time.
To complement the carers information sheet, age-appropriate information was presented to the child
where appropriate and the views of children capable of expressing an opinion considered. Children
deemed to have capacity and who were able to write were asked to sign an age-appropriate assent form.
Consent was sought from carers to video-record intervention sessions to assess fidelity of intervention
delivery and for supervision feedback. Carers could also consent to video-recordings being used in
future research or for training opportunities. In addition to intervention sessions, ADOS53 assessments
were video-recorded to evaluate consistency among ADOS assessors. Refusal of consent to any video-
recording did not affect the participants’ eligibility to otherwise take part in the trial. Carers received a
copy of any consent form that they signed, with the original filed in the site file and a further copy held
with participants’ clinical notes.
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
23
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
METHODS
Once recruited to the trial, treating therapists remained free to give participants alternative treatment
to that specified in the protocol if it was in the child’s best interest; however, the child would remain a
participant in the trial for the purpose of follow-up and data analysis according to original treatment
allocation. Further informed consent was taken from a small number of carers for participation in
qualitative interviews. In compliance with Welsh-language requirements, the PIS, consent form and
any other required participant documentation were available in Welsh. However, all outcome measures
were available in English only, as none was validated in Welsh.
Risk assessment
A trial risk assessment was completed to assess:
The SenITA trial was categorised as low risk (i.e. no higher risk than standard medical care).
This categorisation was used to inform the level and focus of monitoring activity undertaken
during the trial.
Intervention
Comparator
To define usual care, scoping work in the form of a short survey, interviews and focus groups with
therapists and carers was completed before the trial opened to recruitment (see Chapter 2). Carers also
recorded usual care using a diary that was specifically designed for the trial. This could be completed
either on paper or electronically. Usual care for autism was also recorded more generally, including
any contact with NHS services (e.g. SLT, paediatrics and CAMHS). Therapists recorded usual care in
accordance with local policy.
Outcomes
Screening measure
Sensory processing difficulties were assessed at screening using the SPM Home Form.44 This version
of the SPM provides eight standard scores: (1) social participation, (2) vision, (3) hearing, (4) touch,
(5) body awareness (proprioception), (6) balance and motion (vestibular function), (7) planning and
ideas (praxis), and (8) a total sensory symptoms score. Scores on each of these dimensions are
classified as typical, some problems or definite dysfunction. To be eligible, participants’ SPD was
defined as either (1) definite dysfunction on at least one sensory dimension (defined as all domains
except social participation) and the total score or (2) at least probable dysfunction on two or more
sensory dimensions and the total score. Participants scores on this measure were made available to
treating SIT therapists to aid planning of intervention delivery.
24
Baseline-only measure
An ADOS assessment was completed at baseline to characterise the sample according to autism
symptoms. Results of the ADOS were not shared with carers or therapists and it was not used as
a diagnostic tool to determine eligibility. Members of the study team attended research reliability
training for the ADOS and cascaded essential training to other members of the study team
undertaking assessments. Reliability and consensus of administration and scoring was assessed
as per the ADOS manual. A sample of video-recorded ADOS administrations were also used to
facilitate assessment of reliability.
Problem behaviours
Other problem behaviours were measured at baseline and at 6 and 12 months using the remaining
four ABC subscales: (1) lethargy/social withdrawal (16 items), (2) stereotypic behaviour (seven items),
(3) hyperactivity/non-compliance (16 items) and (4) inappropriate speech (four items). Although
moderate correlations between subscales are generally observed, researchers are advised not to
use a total score, as construct validity is poor.69 For all ABC subscales, items were rated on four-point
Likert scales, ranging from 0 (not at all a problem) to 3 (the problem is severe in degree).
Carer stress
Carer stress was assessed using the Autism Parenting Stress Index (APSI)71 at baseline and at
6 and 12 months. The APSI is a 13-item measure of parental stress, covering the social, physical
and behavioural issues that characterise autism. Each item is scored according to five categories:
(1) ‘not at all stressful’, (2) ‘sometimes creates stress’, (3) ‘often creates stress’, (4) ‘very stressful on
a daily basis’ and (5) ‘so stressful that sometimes I/we feel we cannot cope’.
Quality of life
Carer quality of life was measured using two measures: (1) the EuroQol-5 Dimensions, five-level
version (EQ-5D-5L),72 scale and (2) the Carer Quality of Life (CarerQol).73 EuroQol-5 Dimensions
(EQ-5D) is a health-related quality-of-life scale that is made up of five dimensions: (1) mobility,
(2) self-care, (3) usual activities, (4) pain/discomfort and (5) anxiety/depression. The EQ-5D is
assessed via single items with a five-category response option. These five dimensions are scored
and combined into an index value using an algorithm. The EQ-5D is recommended for use in health
technology assessments and includes a measure of general self-rated health on a vertical visual
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
25
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
METHODS
analogue scale with end points labelled ‘best imaginable health state’ and ‘worst imaginable health
state’. The CarerQol instrument was used to measure and value the impact of providing informal
care on carers. It combines a subjective burden measure that provides a comprehensive description
of the caregiving situation using the Carer Quality of Life – 7 Dimensions (CarerQol-7D), with a
valuation of informal care in terms of well-being [i.e. the Carer Quality of Life – visual analogue scale
(CarerQol-VAS)].73 The CarerQol has been shown to be valid in populations of caregivers of children
with autism.74
Functional change
The COPM48 was used to measure functional change in the intervention arm only, as participants
assigned to usual care were not routinely seen by services. High scores on the COPM indicate higher
performance and satisfaction. If the average pre- and post-intervention difference was more than
2 points, this was regarded as clinically important.
Mediators
In addition to screening, SPM scores were assessed at 6 months to determine whether or not any
effects of the intervention on the primary outcome at 12 months were mediated by severity of SPDs
post intervention.
Cost-effectiveness outcomes
Staff and non-staff inputs directly associated with the intervention and usual care were recorded
during the intervention period for each participant. Data were collected on services and support
external to the intervention at baseline (covering the previous 6 months) and at 6 and 12 months post
randomisation. The Client Service Receipt Inventory (CSRI)75 was adapted based on expert opinion for
use in this study. It was used to collect service and support data for participants and data on health-
care and social care services used by the child’s main carer, including out-of-pocket expenses incurred
by the carer and time taken off work because of SPDs and autism difficulties experienced by the child
they care for.
Randomisation
Using an online system, participants were randomly allocated to usual care or SIT in a 1 : 1 ratio.
Randomisation utilised minimisation with a random component, which allocated participants to the
group that caused the least imbalance. Minimisation included region (i.e. Wales or England), severity
of SPD (i.e. SPM score) and sex of child.
Sample size
The initial aim was to recruit 216 participants in total (i.e. 108 participants allocated to usual care and
108 participants allocated to the intervention), which was based on 90% power at the 5% significance
level to detect a standardised effect size of 0.5, allowing for 20% loss to follow-up.
The standardised effect size of 0.5 was arrived at by considering mean scores on the ABC-I found in
the literature. Mean scores in control/untreated groups of between 12 and 24 were quoted, as well as
standard deviations (SDs) of between 6 and 10. It is suggested that a 25% relative difference/effect
size of between 0.4 and 1.0 represented a clinically meaningful difference on ABC subscales. We chose
a conservative effect size of 0.5. The calculation was carried out using nQuery v3.0 (Statistical
Solutions, Saugus, MA, USA).
26
However, following the internal pilot (see Chapter 4), an aim of which was to check assumptions used
for the sample size calculation, a high correlation was found between baseline and 6-month ABC-I
scores [0.86, 95% confidence interval (CI) 0.60 to 0.96]. Accounting for this result led to a revised
sample size of 138 (usual care, n = 69; SIT intervention, n = 69) by applying a deflation factor.76
This target assumed a correlation of 0.6, which was a conservative estimate to allow for the potential
of a lower correlation at the end of the study, any therapist clustering and any reduction in retention
as the study progressed. This target assumed that correlation was also consistent with previous RCTs77
in this field that used the ABC-I (which found correlations in ABC-I scores of 0.647 and 0.599 between
baseline and 16 weeks post randomisation and between baseline and 10 months post randomisation,
respectively).
Procedures
Staff training
Good clinical practice training was provided to staff carrying out trial-specific procedures (e.g. recruitment/
consent, data collection and intervention delivery). Tailored training materials were created for all aspects
of intervention delivery and data collection (see Intervention data collection). Principal investigators
(PIs) and intervention therapists received an individualised session on delivering the intervention in
accordance with the study protocol, following the detailed description in the intervention handbook
(see Chapter 5). Therapists clearly marked participant consent on their clinical notes.
For each session, therapists documented and video-recorded (where consent was given) the
intervention delivered. Video-recordings were uploaded to password-protected secure OneDrive
(Microsoft Corporation, Redmond, WA, USA) folders for fidelity analysis. Once uploaded, video-
recordings were deleted from the recording device.
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
27
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
METHODS
Visit
Follow-up
Informed consent ✗
Demographics ✗
Randomisation ✗
ABC ✗ ✗ ✗
APSI ✗ ✗ ✗
CarerQol ✗ ✗ ✗
CSRI ✗ ✗ ✗
VABS II ✗ ✗ ✗
Diary completion ✗
SAEs As necessary
Withdrawals As necessary
SAE, serious adverse event.
Data collection
A manual (Table 7) was created for research assistants carrying out any data collection. The document
was created to ensure consistency of data collection from different research assistants and research
network staff. Data were entered directly into the trial SQL (Structured Query Language) database via
an online link, with the exception of the ADOS and VABS II, which were scored on paper first and then
relevant total scores entered online.
The study team contacted carers to rearrange any missed follow-up data collection appointments
as soon as possible. For those carers who were unable to attend appointments in person (or stay for
the duration), there was the option to complete any remaining measures at home using a booklet that
was to be returned to the study team. Those carers who were unable or unwilling to take the booklet
home were given the option of answering key questions over the telephone. All individuals carrying
out data collection (i.e. research assistants and clinical study officers from research networks) were
appropriately qualified and completed relevant training. Clarification of any clinical questions relating
to SIT that arose during appointments was deferred to the co-chief investigator.
28
Section Content
1 Introduction
l Participant eligibility
l Recruitment
l Screening and consent
l Randomisation
3 Informed consent
4 Study procedures:
l Equipment
l Collecting participant appointment information
l Checking eligibility
l Study explanation and taking consent
l Adding participant to database
l SPM screening
l Baseline assessments
l Contact information
l Administering VABS
l Scoring VABS
l End of session 1 – explanation to carer of next session
l Beginning of session 2 – explanation to child of study
l ADOS assessment
l Uploading VABS and ADOS scores
l Making recordings
l Importing session recordings from the camera
6 Withdrawals
7 GCP
8 AE (safety) reporting
10 Key contacts
AE, adverse event.
measures (see Table 6). If not eligible, the carer was thanked for their interest and no further trial
involvement took place. If the carer could not complete the baseline assessment immediately, then it
was arranged for a convenient time.
The second meeting was held during the following week to complete an ADOS assessment (video-
recorded where consent was given) with the child and to carry out randomisation. Carers in both
arms were given access to a diary at this point to report health professional contacts and any home
programmes or self-initiated activities for their child (Figure 3).
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
29
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
METHODS
Participant referred
for screening
Explain study
Prepare room
Complete SPM before arrival of
assessment – show parent and child
video if not seen
No
Session 2 (ADOS
assessment)
SPM eligible
While parent is
Ask parent to completing form,
complete contact highlight areas to be Administer ADOS
information form completed on VABS assessment
paper form
Ask parent to
Thank parent and child
complete VABS
for their time and explain
paper form
next steps
Check scoring of
VABS paper form
and go through any
questions
30
Once a participant had been randomised to receive the intervention, the next available therapist in
their area was sent an e-mail to notify the therapist that a child had been allocated to them. The
therapist then logged into their personal OneDrive space to pick up contact details for the participant
and to arrange their first appointment. During the initial assessment, the therapist used their personal
log-in details to access the secure trial database. The therapist completed online forms for the COPM48
and clinical observations. Therapists also completed the SIPT54 with each child. The SIPT was not
available electronically and, therefore, therapists filled out a paper booklet with the child. To score the
test, the booklet was sent to the trial team, who held the scoring software. To ensure that data were
sent securely, therapists uploaded scans of each page of the booklet to their OneDrive account for the
trial team to score. The SIPT report was then sent back to the therapist via OneDrive.
Section Content
1 Introduction
l Participant eligibility
l Recruitment
l Screening and consent
l Randomisation
3 Intervention
4 Study procedures:
l Withdrawals
5 GCP
6 AE (safety) reporting
7 Monitoring and ethics
8 Key contacts
AE, adverse event.
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
31
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
METHODS
At the start of each intervention session, the therapist set up the camera and tripod to record the
session. All recordings were transferred from the camera to the iPad and were uploaded to OneDrive.
Recorded sessions could then be shared via OneDrive with relevant mentors and fidelity assessors,
who were also given university-allocated single-use OneDrive log-in details. The manual included a
flow diagram that each therapist could refer to (Figure 4).
Guidance for
Get participant
participant
information from
allocation on
OneDrive
page 8
Complete SIPT,
Non-therapist tasks
COPM and clinical
Guidance for
observations
SIPT upload on
assessments and
page 14
upload SIPT to
CTR staff score OneDrive
SIPT and upload
results
Complete COPM Guidance for
and clinical completing
observations online online forms
forms on page 18
Plan intervention
Process during session
sessions and goals
Feedback from and review with
Sue Delport/ Guidance for
Sue Delport/ recording
Kath Smith Kath Smith Video session
sessions on
page 26
Sessions 1–20
(intensive phase)
Complete sensory Guidance for
integration checklist completing
online form online forms
on page 18
Sessions 21–24
(tailoring phase)
Guidance for
Upload session
uploading
video
video on page 28
Sessions 25 and 26
(telephone phase)
FIGURE 4 Flow diagram for therapist data collection. CTR, Centre for Trials Research.
32
There were occasions when technology failed (e.g. when camera batteries ran out and when the
camera failed to record), which led to some missing recordings. Intervention therapists received
detailed training alongside the manual; however, there were several occasions where the trial team
had to go out to site to help with technical issues. All data transfer and storage strictly adhered to
GCP data handling and security specifications.
Interviews with carers and therapists (carried out during the trial)
Interviews took place either face to face or over the telephone. Interviews were audio-recorded and
transcribed verbatim, with references to identifiable personal details, such as name, address and date
of birth, removed (see Chapter 9 for full details).
Data management
Data collection was via a web-based SQL database. This secure encrypted system was accessed by
username and password, complying with General Data Protection Regulations.78 Back-up paper case
report forms were available in the event that the web-based system was not accessible. A full data
management plan was signed off prior to data collection.
Safety reporting
All serious adverse events (SAE) were reported immediately (and within 24 hours of knowledge of the
event) to the study team by the PI at the participating site. The PI assessed each SAE to determine the
causal relationship, which could not be downgraded by the chief investigator. The chief investigator
then assessed expectedness of the event. There were no expected adverse events (AEs) or SAEs for
the SenITA trial. Any planned treatments at the start of the study were not considered as AEs or SAEs.
Serious adverse events were reported from time of signature of informed consent, throughout the
intervention period and then for a further month. All other AEs not classified as serious were not
routinely collected, although none was reported.
Analyses
Analysis population
Participants were analysed based on the arm to which they were randomised. Main analyses were
based on a modified intention-to-treat population, with those providing outcome data included in the
analysis. A full intention-to-treat analysis set comprised all participants in the group to which they
were randomised, with missing outcome data imputed using multiple imputation. This analysis set
served as a sensitivity analysis to the primary outcome. Finally, a complier-average causal effect
population comprised participants with outcome data in the group to which they were randomised,
accounting for those who received the intervention as intended. This analysis set also served as a
sensitivity analysis to the primary outcome.
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
33
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
METHODS
Main analysis
The primary outcome analysis compared trial arms by fitting a linear regression to ABC-I scores at
6 months post randomisation, including a trial arm indicator (i.e. usual care/intervention), adjusting for
baseline ABC-I, recruitment region (i.e. South Wales/South England region), severity of SPD (i.e. some
problems/definite dysfunction) and sex of the child (i.e. male/female). We found no evidence of therapist
clustering and, therefore, fitted single-level models only. Findings are reported as adjusted mean
differences with associated 95% CIs and p-values.
Most secondary outcomes were analysed similarly. Teacher-assessed ABC-I was collected at 6 months
only and, therefore, no baseline ABC-I adjustment was made for this analysis.
Subgroup analysis
We explored differential intervention effects on the ABC-I at the 6-month post-randomisation time
point by age, severity of SPDs and comorbid conditions [i.e. attention deficit hyperactivity disorder
(ADHD), ID or other neurodevelopmental/genetic conditions], site (n = 7), region (n = 2) and sex
of the child. Our primary model was extended by including subgroup × trial arm interaction terms.
These subgroup effects were also explored for APSI scores at 6 months post randomisation.
For the last definition, our model coefficients provided an estimate of intervention effectiveness per
session received. Therefore, we multiplied coefficients by 26 to provide an estimate of the intervention
effectiveness in those who received the intervention in its entirety.
l We re-fitted our primary analysis for participants followed up during the pre-pandemic period
(i.e. pre 23 March 2020).
l We considered intervention effects in a hypothetical pandemic-free world, whereby any outcomes
measured where intervention receipt (at least 13/20 intensive sessions attended prior to follow-up)
34
was affected by the pandemic were set to missing and multiple imputation used to impute all
missing values. The imputation model was similar to the original imputation model, with the addition
of an indicator variable for whether the outcome was measured or should have been measured
during the intrapandemic period.
l We considered intervention effects in a world including a pandemic, where outcome data relating to
participants who did not receive the intervention (as per our definition) were retained, and if the
outcome was measured (or should have been measured) during the intrapandemic period was
conditioned on in both imputation and analysis models.
Mediation analysis
We planned to conduct mediation analyses to explore whether or not any effect of the intervention
on behavioural problems at 1 year (on all ABC subscales) was mediated through an effect on sensory
sensitivities immediately post intervention.
Qualitative analysis
Qualitative data were analysed using thematic analysis43 to search across the data set to find repeated
patterns of meaning and to identify key themes and subthemes. Double coding was carried out until
consensus was reached. The qualitative component was designed using the principles of the Critical
Appraisal Skills Programme qualitative checklist to ensure the quality of qualitative research.79
Additional detail regarding qualitative methods is provided in Chapters 8 and 9.
Process evaluation
A process evaluation (see Chapters 8 and 9) was conducted to examine (1) recruitment, (2) retention,
(3) fidelity, (4) acceptability, (5) adherence, (6) adverse effects and (7) contamination of intervention
delivery within the trial. Recruitment rates/patterns, attendance and intervention fidelity were
assessed quantitatively, whereas the acceptability of study processes and measures, intervention
implementation and acceptability, and the role of contextual factors were examined through the
qualitative interviews with therapists and carers.
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
35
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
DOI: 10.3310/TQGE0020 Health Technology Assessment 2022 Vol. 26 No. 29
The aim of the internal pilot was to assess the feasibility of recruitment and retention, and to gauge
the nature of usual care provided for SPDs (in the control arm). Specific objectives centred on
providing early evidence of whether or not the study could be delivered in its entirety and covered
the following elements.
Usual care
Usual care was expected to comprise use of sensory-based strategies not meeting fidelity criteria for
SIT and no treatment at all in a significant proportion of cases (established via methods described in
Chapter 2 and from carer diaries).
Recruitment of participants
Recruitment feasibility criteria would be met if at least 70% of those approached were eligible and at
least 50% of those eligible were willing to be randomised.
Contamination (i.e. the extent to which participants allocated to the control arm received
treatment/therapy similar to that in the intervention arm)
Carer-completed diaries were qualitatively assessed to determine whether or not usual care was
sufficiently different from the intervention. Broadly defined, this criterion would be considered met
if carers in the control arm did not receive any intervention meeting criteria for full SIT.
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
37
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
INTERNAL PILOT EVALUATION
Adverse effects
We studied any adverse effects of study participation.
Outcomes
Primary outcome
The primary outcome for the internal pilot comprised those with prespecified progression criteria,
as set out below.
Usual care
A key progression criterion was to demonstrate that the intervention and comparator were sufficiently
different. To determine this we:
l investigated pre-trial service provision in trial regions, as determined from interviews, focus groups
and survey data from therapists and carers (see Chapter 2)
l qualitatively assessed carer-completed diaries at the 6-month time point.
Recruitment
We calculated the number of children who were:
Retention
We calculated the number of children with missing outcome data at 6 months post randomisation
(expressed as a proportion of those who were randomised and had reached that time point).
Secondary outcomes
Secondary outcomes comprised outcomes without formal progression criteria (see Results:
secondary outcomes).
Contamination
We calculated the number of children allocated to the control arm who received any intervention
meeting criteria for full SIT (as per the fidelity checklist23) and/or more than one face-to-face session
per week, and this is expressed as a proportion of those allocated to the control arm.
Adherence/acceptability
We calculated the number of children allocated to the intervention arm who received at least 13 out
of 20 intervention sessions during the intensive phase (expressed as a proportion of those allocated
to the intervention arm who had reached the less intensive phase) (see Chapter 5 for further
intervention details).
Fidelity
The following fidelity measures were determined:
l structural fidelity, that is the suitability of the clinic environment and equipment (scored as at least
85/110 on the structural fidelity checklist)
l the number of therapists scoring at least 80 out of 100 on the process fidelity measure for at
least 80% of sessions rated (expressed as a proportion of therapists who provide at least one
video session).
38
l SD of the primary outcome measure (i.e. carer-reported ABC-I at 6 months post randomisation)
l correlation between baseline and 6-month post-randomisation carer-reported ABC-I scores.
Adverse effects
We calculated the number of:
Progression criteria
Methods
Statistical methods were descriptive in nature, with continuous data reported as means and SDs or as
medians and interquartile ranges (IQRs), as appropriate, and categorical data reported as frequencies
and proportions. Outcomes were estimated and reported alongside 95% CIs. Correlation coefficients
were calculated (Pearson’s or Spearman’s, depending on distribution) and are presented with
associated 95% CIs.
Qualitative methods employed to establish what was delivered and received as usual care in the trial
regions (prior to the start of the SenITA trial) are described in Chapter 2. The aim of data collection
was to gain a detailed understanding of the usual care provided by occupational therapists for children
with autism and SPDs. This was not intended to be an exhaustive description or generalisable to all
services in the UK.
Primary outcomes were those with specific progression criteria and are detailed below.
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
39
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
INTERNAL PILOT EVALUATION
Usual care
A specific requirement of the commissioning brief for this trial was to demonstrate that the
intervention was sufficiently different from usual care. At the point at which we reported on the pilot
evaluation, that is after the first 40 participants were recruited, survey data had been received from
39 therapists and 131 carers with regard to their experiences of delivery and receipt of usual care.
At this stage of the trial, we had also undertaken two face-to-face focus groups (group 1 had two
participants and group 2 had three participants) and six (five individual and one shared) telephone
interviews with therapists (n = 7) in trial regions only. The final survey results and a detailed qualitative
exploration of usual care are provided in Chapter 2; however, characteristics of those who responded
during the pilot evaluation period are given in Results: secondary outcomes, as is a brief summary
of findings.
Therapist characteristics
A total of 39 therapists responded to the survey. Twenty-five therapists were from trial regions
(Wales, n = 22; England, n = 3). Therapists were generally very experienced. In total, 24 out of the
39 (61.5%) therapists reported having at least 10 years’ post-qualification experience and only three
(7.7%) reported having < 5 years’ experience. Most (37/39, 94.9%) therapists reported having seen
one or more child with autism and SPDs in the last 6 months; however, only six (15.4%) therapists
were based within a specialist autism/neurodevelopmental service.
Carer characteristics
A total of 131 carers responded to the survey. Most (124/131, 94.7%) carers were mothers.
We received four (3.1%) responses from fathers, two from grandmothers (1.5%) and one from a
kinship carer (0.8%). The spread of respondents across geographical regions is shown in Table 10.
Scotland 9 (6.9)
40
Recruitment
We planned to recruit participants from a wide variety of sources, namely via secondary care services
(e.g. OT, paediatrics, CAMHS and specialist autism/neurodevelopmental services), schools, third-sector
organisations and self-referral. We anticipated that most referrals would come from OT and/or specialist
neurodevelopmental services. However, most expressions of interest came from third-sector organisations
(e.g. local NAS support groups) and via self-referral. Reasons for this are likely to be complex, but might
include, for example, the length of time from discharge from OT or specialist autism/neurodevelopmental
services. Some specialist teams also expressed concerns about recruiting participants who were yet to
receive a diagnosis (i.e. children were deemed eligible once they were on the local neurodevelopmental
pathway provided that all other eligibility criteria were met; see Chapter 3 for inclusion criteria).
In England, in particular, some OT services expressed concern that referring patients to the trial could
have raised expectations of families in the area with regard to availability of interventional services,
which they were not currently commissioned to deliver.
Telephone screening
At the pilot evaluation analysis time point, expressions of interest had been received from 97 people.
Following receipt of an expression of interest, the study team contacted each individual to carry out an
initial telephone screening to confirm potential eligibility. Of the 97 people, 26 had yet to respond to a
request for a telephone screening appointment, six were not interested following our response to their
expression of interest and 14 were ineligible at referral.
Screening assessment
Following the telephone screening, 44 out of 97 potential participants who expressed an interest
completed a screening assessment (with a further seven participants booked for assessment), of whom
42 were eligible (43.3%, 95% CI 33.9% to 53.2%).
Retention
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
41
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
INTERNAL PILOT EVALUATION
Contamination
We received 58 diaries and 107 SMS text messages (i.e. via the text service used to collect diary
information; see Chapter 3 for a full description) from participants regarding their use of other services
following randomisation. In the control arm, no participant indicated that they had received any
intervention meeting criteria for SIT (i.e. according to fidelity criteria23 and/or face-to-face therapy
more than once per week).
Adherence/acceptability
Of the 20 participants randomised to receive the intervention, eight participants were expected to
have completed the intervention by the analysis time point, and we received attendance data for
seven of these participants. All seven participants attended at least 13 of the 20 intensive sessions.
Fidelity
All trial clinics were assessed as having met structural fidelity criteria23 prior to opening for recruitment
(see Chapter 8). Our outcome of interest was the number of therapists scoring at least 80 out of 100 on
the process fidelity measure for at least 80% of sessions rated (expressed as a proportion of therapists
who provide at least one video session). Fidelity scores were available for a total of 24 session recordings
across six therapists. The mean fidelity score was 81.8 (SD 12.84). In total, 15 out of 24 (62.5%) sessions
were scored at least 80 out of 100. The general impression score (measured via a single question that
indicates whether or not the therapist intentionally applied ASI intervention theory and methods)
was scored ‘no’ for one session only. The corresponding fidelity score for this session was 45 out of
100. All other sessions were scored ‘yes’. Complete fidelity ratings across all therapists are presented
in Chapter 8.
Adverse effects
No adverse effects were reported.
42
Percentage of participants with missing 20 7 High levels of retention from trial participants
outcome data at 6 months post
randomisation
Adherence (number of SIT participants N/A 100 High levels of intervention receipt
receiving at least 13/20 intensive
sessions)
Fidelity (number of therapists scoring N/A Lower than expected. Assessing only
at least 80/100 for at least 80% of 15–20 minutes of each session may have
sessions rated) skewed this score, considering that the
global impression score for 23/24 sessions
reflected that the therapists intentionally
applied ASI intervention
N/A, not applicable.
At the request of the Health Technology Assessment programme and as advised by the Independent Data
Monitoring and Ethics Committee, this correlation was revisited at two further time points: (1) when
primary outcome time point data were available for 38 participants (correlation between baseline and
6-month ABC-I scores 0.806, 95% CI 0.654 to 0.895) and (2) when outcome data were available for
53 participants (correlation between baseline and 6-month ABC-I scores 0.69, 95% CI 0.52 to 0.80).
This high level of correlation supported a reduction in the target sample size from 216 to 138 (a correlation
of ≥ 0.6 indicates a sample size of ≤ 138 with 90% power).
Discussion
Formal progression criteria relating to recruitment and retention were met. Although the proportion
of participants recruited via the various recruitment routes differed from that anticipated (i.e. there
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
43
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
INTERNAL PILOT EVALUATION
0 216
0.1 214
0.2 207
0.3 197
0.4 181
0.5 162
0.6 138
0.7 110
0.8 78
0.9 41
1 0
were more self-referrals and third-sector referrals) we did not encounter any difficulties in generating
expressions of interest. Given the large number of self-referrals, the proportion of those eligible from
initial expressions of interest was inevitably lower than anticipated. However, the proportion of those
participants randomised from those eligible was much higher than originally estimated.
We clearly demonstrated that the intervention was significantly different from usual care within trial
sites, and more widely within the NHS (see Chapter 2). Carer responses to the survey also suggested
that there is significant need and demand for additional occupational intervention for sensory difficulties.
There was no evidence of contamination, and all participants randomised to receive the intervention at
this point had received our prespecified minimum number of intensive sessions.
In terms of fidelity, the measure used to assess this has six contextual elements and four sensory–motor
factors addressing the child’s sensory–motor strengths and challenges (each element is rated on a scale
of 1–4, with 4 being ‘certainly, the therapist intentionally used this strategy’, 3 being ‘probably’, 2 being
‘doubtful’ and 1 being ‘no, the therapist did not use this strategy’). We stated that an independent
SIT-trained therapist would view 15–20 minutes of a session to determine fidelity. However, it is
possible that some of the fidelity elements may not have been present in the video clip selected.
This is particularly relevant when treating children with autism, as some of the elements of fidelity
(e.g. ‘collaborates in activity choice’, ‘challenges praxis and organisation of behaviour’) may be particularly
challenging to demonstrate without the assessor being privy to the goals and particular areas of
difficulty of the child. Therefore, we refined the fidelity protocol to explicitly define how fidelity was
recorded to ensure that it was reliable and consistent. This included using an additional assessor and
checking inter-rater reliability (see Chapter 8). Continued mentoring, as well as peer support, was also
in place to support fidelity adherence for treating therapists.
44
Chapter 5 Intervention
Sensory integration therapy, as delivered in the SenITA trial, was consistent with manualised ASI and
established fidelity criteria.23,31,32 Participants allocated to the intervention arm received 26 1-hour
sessions of therapy, delivered over 26 weeks [i.e. two sessions per week for 10 weeks (intensive
phase), followed by two sessions per month for 8 weeks and then one telephone session per month
for 8 weeks (tailoring phase)]. An ‘effective’ dose for SIT had not been established prior to the current
trial. However, based on clinical experience and available evidence,13,33,34,80 attending 13 of a possible
20 sessions delivered during the intensive intervention phase (two-thirds) was felt likely to indicate
sufficient exposure.
A detailed assessment of sensory processing deficit was undertaken by treating therapists (i.e. SIPT54),
along with clinical observations post randomisation, to inform intervention planning (intervention
arm only). This detailed assessment facilitated the development of a hypothesis for each child as to the
nature of the underlying sensory difficulty affecting function. To further inform hypothesis development,
therapists were given access to participants’ scores on the SPM44 (which was used as a screening tool
to assess the level of SPD prior to enrolment in the trial; see Chapter 3). In addition to considering
background history (assessed via completion of an Occupational Profile assessment with carers30),
the COPM48 was conducted. This allowed the sensory–motor content of the SIT (i.e. proprioceptive,
vestibular or tactile) to be individualised to meet the specific sensory needs hypothesised to underlie
the functional goals of the participant. SIT uses the ‘just-right’ challenge for each child and therapy is
adjusted to functional ability (as assessed by therapists using the tools and measures described above,
prior to initiating treatment).
Carers were encouraged to observe or actively participate in sessions to facilitate engagement. Specific
sensory–motor activities to support their child’s sensory integration, guided by clinical assessment,
were discussed with carers to incorporate into family routines between sessions. Written guidelines
were included where appropriate. Success of these strategies was discussed at subsequent sessions.
A detailed intervention handbook was developed to guide therapists during intervention delivery and
a summary of key content is presented in this chapter.
Therapists
The intervention was delivered by 16 occupational therapists (typically NHS band 7) in regional clinics.
All therapists were trained in SIT with training meeting fidelity criteria (see Fidelity assessment tool).
Clinics were in localities covered by five university health boards in South Wales (i.e. Cardiff and
Vale, Aneurin Bevan, Cwm Taf Morgannwg, Swansea Bay and Hywel Dda) and two localities in
South England (i.e. Cornwall and North Buckinghamshire) (eight sites in total). Intervention therapists
were mentored prior to, and during, the trial by an independent sensory integration-trained therapist.
Intervention therapists provided therapy to participants randomised to the intervention arm only
(i.e. participants in the control arm who did have face-to-face contact with OT services were treated
by different therapists). However, most families in the control arm were not receiving direct OT input.
Where face-to-face therapy was provided as part of usual care, frequency of contact was typically less
than once per week and the intervention received did not meet SIT fidelity criteria.
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
45
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
INTERVENTION
Fidelity of intervention delivery was assessed using the ASI intervention fidelity measure,23 which
included essential, structural and process fidelity elements. An independent fidelity assessor visited
sites in South Wales and an experienced therapist visited sites in South England and scored each site
for the essential element, according to level of therapist training/qualifications. Following this scoring,
a structural fidelity assessment was carried out, for which a minimum score of 85 out of 110 for the
following four areas was required: (1) safety of the environment; (2) assessment details and content of
therapist-held records, including therapist–carer collaboration in relation to goals set during therapy;
(3) physical space and equipment; and (4) communication with carers. In addition, the intervention
sessions were measured for process fidelity to determine whether or not the therapist ensured
physical safety; provided sensory opportunities; helped the child to maintain an appropriate level of
alertness; challenged postural, ocular, oral or bilateral motor control; challenged praxis and behavioural
organisation; collaborated in activity choice; tailored activity to provide appropriate challenge; ensured
activities were successful; supported intrinsic motivation to play; and established therapeutic alliance.
The scale demonstrates high content validity according to expert ratings and high reliability for process
elements (total score ICC 0.99; Crohnbach’s α = 0.99).23
Following provision of consent, face-to-face sessions were video-recorded. Fidelity of delivery was
discussed with mentors through viewing video-recorded face-to-face sessions delivered to a participant
for individual therapists early in the treatment series. A sample of recorded sessions in the intensive
phase were also rated for fidelity by independent sensory integration-trained therapists who had
successfully passed fidelity training (based on a randomly selected sample of the full sessions, of a
minimum of 15–20 minutes in duration). Demonstration of adequate fidelity of intervention delivery
was defined as scoring at least 80 out of 100 on the fidelity measure23 across at least 80% of sessions
sampled (see Chapter 8 for fidelity outcome data).
Fidelity principles
The key ingredients of the intervention can be described as the contextual elements that detailed the
interactive context between the therapist and the child, and the therapeutic alliance that occurred.
These elements delineated the playful and supportive atmosphere in which the intervention took
place and the strategies that ensured that the child’s motivation and interest were maintained
through play, that is, the ‘just-right’ challenge. Next, the specific sensory–motor therapeutic activities
that were individually tailored for each child were delineated. These activities were grouped into
four areas:
1. sensory perception (with special emphasis on tactile, proprioceptive and vestibular systems)
2. postural and ocular control and bilateral integration
3. praxis
4. sensory reactivity (with particular emphasis on hyper-reactivity to tactile, vestibular, visual and
auditory, and olfactory and gustatory sensation, and hyporeactivity to tactile, proprioceptive and
vestibular sensation).
These elements were dynamic, that is they did not necessarily occur in sequential order, but were fluid
and interacted with each other. The intervention involved systematic decision–making in the context
of a safe, playful, collaborative and therapeutic environment that focused on the ‘just-right’ challenge
and targeted the sensory and motor factors that facilitate skills and abilities needed for participation
in daily activities. These specific therapeutic activities were designed based on initial and ongoing
assessment data about the child and family, analysed in moment-to-moment interactions and interpreted
though the lens of knowledge and skills of the therapist.
46
Initial assessment
The initial assessment for participants randomised to the intervention arm was carried out over two sessions,
which were 1–2 hours in length and no more than 2 weeks apart. The assessment comprised the following.
Clinical observations
Unstructured observations, including descriptive assessment of level of arousal, postural control,
organisation of behaviour and motor planning ability, were carried out. In addition, a set of structured
observations based on sensory integration principles, covering an assessment of performance/difficulties
in proprioception, vestibular processing, motor planning and postural and ocular control, were carried
out. Specific guidelines on administration, interpretation and scoring were written in the intervention
handbook to ensure consistency between therapists.
l motor-free visual perception (i.e. the ability to visually perceive and discriminate form and space
without involving motor co-ordination), including –
¢ space visualisation
¢ figure-ground perception.
l somatosensory perception (i.e. tactile, muscle and joint perception, encouraging the child to ‘feel’
rather than to ‘see’), including –
¢ design copying
¢ postural praxis
¢ bilateral motor control
¢ praxis on verbal command
¢ constructional praxis
¢ motor accuracy
¢ sequencing praxis
¢ oral praxis.
¢ standing/walking balance
¢ postrotary nystagmus.
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
47
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
INTERVENTION
Occupational profile
The occupational profile questions were given to the carer to complete between assessment sessions.
The occupational profile questions also included information about the child’s play preferences and
strengths, their school, their medical and developmental history, and infant and current behavioural
patterns. The therapist encouraged the carer to think of functional issues that were affecting their
child’s performance for discussion at the next session.
Problem definition
Defining the problem involved identifying occupational performance and participation problems.
Interpretation of assessment
All assessment scores (i.e. SIPT, SPM and clinical observations) were interpreted using the ASI
Assessment® Interpretation Tool©. The ASI Assessment Interpretation Tool is intended for use in
conjunction with the instructional information provided in the clinician’s guide for implementing ASI30
and in specialised ASI training programmes (adapted for the SenITA trial by Kath Smith and SD).
48
Hypothesis development
Using the assessment data as indicated on the interpretation tool, therapists developed a hypothesis
about which areas of dysfunction were particularly influencing the child’s performance and participation.
Goal development
Therapists were encouraged to use the FEAST (Functional, Expectation, Action, Specific condition,
Timeline) model to assist in articulating the specific goals identified by the child/carer in the COPM.
The functional element asks ‘why’ a goal is required (i.e. the area of occupation to be addressed, such
as to dress himself/herself). The expectation element specifies ‘who’ (i.e. ‘X will . . . ’). The action element
looks at ‘what’ is to be undertaken (e.g. ‘X will put his/her shirt and shorts on’). The specific condition
element considers ‘how’ this will be carried out (e.g. with three verbal prompts once the clothes have
been laid out). Finally, the timeline element considers ‘when’ this will be carried out (e.g. by the end
of session 24).
Mentoring
All therapists were assigned a mentor. Mentors were senior occupational therapists who were fully
trained and experienced in the delivery of SIT (note that a separate pool of independent and sensory
integration-trained therapists rated sessions for fidelity, as described in Chapter 5). Therapists discussed
the first two sessions that they delivered with mentors to confirm their hypothesis and direction of
therapy. Fidelity of delivery was discussed with mentors early in the series of treatment, once rapport
between the child and the therapist was established, to support therapists. Mentoring sessions of
approximately 1 hour in length were provided monthly (or more often within the first 2 months of the
intervention delivery phase if the therapist requested this), tapering to once per month or at least once
every 6 weeks thereafter. A Facebook (Meta Platforms, Inc., Menlo Park, CA, USA; www.facebook.com)
group was also set up for treating therapists and mentors to join, should they wish; 17 members used
this facility. This was a forum for therapists to support each other in the trial and to share ideas. The group
was active throughout the trial, although not all participants contributed. In addition, all therapists had a
joint training session (including fidelity training) at the start of the trial before recruitment of participants.
This was followed by a 2-hour individual therapist training session to confirm the therapy protocol and
explain the detail in the intervention handbook, followed by an additional training session on saving and
uploading data. Further support was offered during the trial, including two face-to-face half-day events to
share ideas, challenges and solutions.
Following assessment and interpretation, therapists were encouraged to contact their mentor. Mentors
were given access to a shared folder that allowed therapists to share specific information with them,
including SIPT scores (uploaded by the research team), interpretation summaries, assessment videos
(where available) and the summary of participation strengths, challenges, goals and hypotheses.
Mentors were also able to access SPM data and clinical observations as required. Therapists were
given detailed guidance on how to share information with mentors, and discussed hypotheses and
goals with them, allowing any changes to goals or hypotheses to be made at this stage, before
contacting the carer to complete the COPM rating of performance and satisfaction.
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
49
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
INTERVENTION
Mentors were given a manual that detailed key elements of the study, therapist requirements and
expected timelines for mentoring sessions. Although therapists were all trained in SIT, most therapists
carried a varied caseload of children with a range of difficulties and, therefore, would typically use a
range of treatment approaches. Therefore, a list of watch points/common errors was also provided to
mentors, which included the following:
l Therapists may need to break eclectic habits (as this was a research study of SIT and not a standard
NHS intervention).
l Therapists may find it difficult to swap from therapist- to child-directed play.
l Therapists may not be used to treating for this many sessions. Therefore, therapists may be anxious
by sessions 7 or 8 and may need support to continue to challenge their participant. Grading will
become increasingly important and experience indicates that changes start to occur by about weeks
8–10 and, therefore, therapists are encouraged to keep going.
l Therapists may need support to be playful, as this may not be the style of their traditional therapy.
l Therapists may need reminders that they should not work only on modulation. Praxis may be quite
markedly poor and overlooked with other concerns taking precedence.
l Therapists should keep data and hypotheses in mind for each session.
Session 1
Key steps and activities were as follows:
l Goals and hypotheses for underlying sensory–motor difficulties were checked prior to the session.
l The room was set up with provisional equipment and toys that were in keeping with hypothesis
from assessment data, considering strengths, challenges and needs.
l The video camera was checked and switched on.
l Carer and participant were greeted. The child was made comfortable with a simple explanation of
the activities that they would be doing and how these games would help them.
l The therapist used their professional and clinical reasoning to apply each of the ASI fidelity
principles to ensure that the challenges were appropriate for the child’s age, ability levels
and needs.
l The carer was encouraged to participate in the session or to watch as they felt comfortable.
The level of carer engagement was negotiated with the carer during the telephone call (see Fidelity
assessment tool).
l There was no set sequence, manner or format for incorporating all of the key principles and implementing
tailored activities. However, the flow of the session could be divided into three phases of beginning,
middle and end. Sessions lasted about 50–55 minutes, including 5–10 minutes to have a short discussion
with the carer about activities or strategies to try at home. Advice sheets may have been given at this
point, if appropriate.
50
The affordances of different pieces of equipment needed to be considered (e.g. a platform swing could
be used in sitting in a linear direction, or prone lying and rotating, or even in an orbital arc while
upright kneeling). The therapy required creative flexible thinking and clinical reasoning informed by
the underpinning goals.
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
51
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
INTERVENTION
Intervention session 24
For session 24, the SIPT or clinical observation items identified as proximal outcome measures were
reassessed. The COPM was re-administered to determine how the carer (and the child if they had
capacity to do this) initially rated the five goals for performance and satisfaction with that performance.
The therapist then explained to the participant that there would be two follow-up telephone calls to
monitor progress and to problem-solve any issues that might arise. Strategies and advice for continuing
the progress made during the face-to-face sessions were discussed.
Intervention session 25
Session 25 comprised a telephone call, which was carried out 1 month following the last intervention
session. The purpose of the telephone call was to:
Intervention session 26
Session 26 was the same as session 25, but with the additional purpose of closure, as this was the final
contact with the carer. The purpose of this telephone call was twofold. First, to follow up (as in the
previous telephone call) and discuss any changes to behaviour and to determine whether or not any
advice and strategies were carried out. Second, to consider the goals chosen at the beginning of
therapy and informally discuss the progress of the child, and, finally, to thank the carer for their
engagement in the process (prompt questions were provided to be used as needed).
A brief written summary of the intervention was provided to carers/schools if requested. The summary
did not include the outcome of intervention, as this was not appropriate within the research trial;
however, it did include the goals that were set prior to intervention, including the specific target
areas that were concentrated on.
Information regarding fidelity of intervention delivery, participant adherence and therapist experience
of therapy and of trial participation is provided in Chapter 8.
52
Between August 2017 and June 2020, we screened 150 individuals, of whom 142 (94.7%) were
eligible and consented. Of the 142 consented participants, 138 (97.2%) were randomised. Of those
randomised, 107 (77.5%) provided data at 6 months post randomisation. Two participants withdrew
from the study prior to this time point and 29 participants were lost to follow-up. Data were provided
at 12 months post randomisation by 96 (69.6%) participants. There were no further withdrawals
between 6 and 12 months, but 40 participants were lost to follow-up (Figure 5).
Expression of interest
(n = 258)
Not screened
(n = 108)
• No further responses, n = 61
• Not eligible at referral, n = 24
• Not interested in participating, n = 23
Baseline
Referral and screening
(n = 150)
Excluded
(n = 12)
• No further response, n = 4
• Not meeting inclusion criteria, n = 3
• Not interested in participating, n = 1
• Recruited but withdrew, n = 4
Randomised
(n = 138)
Follow-up
• Lost to follow-up, n = 29
• Discontinued study, n = 2 6 months after randomisation
(n = 107)
Follow-up
• Lost to follow-up, n = 40
12 months after randomisation • Discontinued study, n = 2
(n = 96)
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
53
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
QUANTITATIVE RESULTS
Baseline characteristics
Participant characteristics at baseline were reasonably well balanced between trial arms. Differences
of note were present for the sex of child [i.e. male participants represented 57/69 (82.6%) control
arm participants vs. 52/69 (75.4%) intervention arm participants], statement status [27/69 (39.1%)
participants had a statement in the control arm vs. 32/69 (46.4%) participants in the intervention arm]
and EuroQol visual analogue scale (EQ-VAS) [the control arm had a median EQ-VAS score of 80
(IQR 70–87) vs. a median EQ-VAS score of 75 (IQR 70–80) in the intervention arm].
Overall, participants had a mean age of 7.87 (SD 1.73) years, 99 out of 138 (71.7%) participants were
recruited from South Wales and, based on their SPM results, 107 out of 138 (77.5%) had scores
indicative of ‘definitive dysfunction’ (Table 16).
Autism Diagnostic Observation Schedule assessments were carried out at baseline to characterise
the sample in terms of autism symptoms, but not as a diagnostic measure. A summary is presented in
Table 17 for each assessment module spilt by arm. Data are presented for 135 out of 138 participants.
It was not possible to obtain ADOS scores for three participants who were unable to engage with this
aspect of the assessment process.
Study arm
Region, n (%)
54
Study arm
1 18 20 38
2 4 7 11
3 1 1
ADHD, n (%)
Yes 10 (20) 17 (29) 27 (25)
ID, n (%)
SPM, n (%)
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
55
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
56
NIHR Journals Library www.journalslibrary.nihr.ac.uk
QUANTITATIVE RESULTS
TABLE 17 Summary of baseline ADOS scores by trial arm
Communication Three items: maximum score = 6 Two items: maximum score = 4 Three items: maximum score = 6
Scored 2 on all items (100%) 11 (18.6) 6 (10.5) 17 (14.7) 2 (40) 1 (12.5) 3 (23.1) 2 (50) 2 (100) 4 (66.7)
Scored 2 on 50–99% of items 23 (38.9) 27 (47.4) 50 (43.1) 2 (40) 6 (75) 8 (61.5) 1 (25) 0 (0) 1 (16.7)
Scored 2 on < 50% of items 25 (42.4) 24 (42.1) 49 (42.2) 1 (20) 1 (12.5) 2 (15.4) 1 (25) 0 (0) 1 (16.7)
Reciprocal social interaction Seven items: maximum score = 14 Eight items: maximum score = 16 Eight items: maximum score = 16
Scored 2 on all items (100%) 2 (3.4) 2 (3.5) 4 (3.4) 0 (0) 2 (25) 2 (15.4) 0 (0) 0 (0) 0 (0)
Scored 2 on 50–99% of items 25 (42.4) 21 (36.8) 46 (39.7) 4 (80) 3 (37.5) 7 (53.8) 2 (50) 2 (100) 4 (66.7)
Scored 2 on < 50% of items 32 (54.2) 34 (59.6) 66 (56.9) 1 (20) 3 (37.5) 4 (30.8) 2 (50) 0 (0) 2 (33.3)
Restricted and repetitive Four items: maximum score = 8 Four items: maximum score = 8 Four items: maximum score = 8
behaviours
Scored 2 on all items (100%) 2 (3.4) 1 (1.75) 3 (2.6) 0 (0) 0 (0) 0 (0) 0 (0) 0 (0) 0 (0)
Scored 2 on 50–99% of items 12 (20.3) 7 (12.3) 19 (16.4) 3 (60) 3 (37.5) 6 (46.2) 0 (0) 1 (50) 1 (16.7)
Scored 2 on < 50% of items 45 (76.3) 49 (85.9) 94 (81) 2 (40) 5 (62.5) 7 (53.8) 3 1 (50) 5 (83.3)
DOI: 10.3310/TQGE0020 Health Technology Assessment 2022 Vol. 26 No. 29
Average scores on clinical measures at baseline were generally within the middle of the score range,
with exceptions being for ABC lethargy/social withdrawal (lower end of the scale, indicating lower
levels of lethargy/social withdrawal), ABC stereotypic behaviour (lower end of the scale, indicating
lower levels of stereotypic behaviour) and EQ-5D (higher end of the scale, indicating higher levels
of health utility and quality of life). However, the range of scores spanned most of the scale for all
measures (see Tables 19 and 20).
Receipt of SIT sessions varied considerably between participants. Figure 7 highlights different patterns
of SIT session receipt for six participants, with Table 18 providing summary statistics for each
participant. Participants A, B and C display typical patterns of participants who initiated SIT early
(i.e. between 20 and 48 days post randomisation) and attended most of their sessions. Participant A
received two SIT sessions after their primary outcome data were collected. Participant D initiated SIT
late (i.e. at 119 days post randomisation) and shows a typical pattern of someone who attended most
of their sessions, but received a substantial number of them after their primary outcome data were
collected. Participant E displays a pattern of someone who started SIT but who stopped early on.
Participant F is a participant who started SIT 348 days post randomisation and, therefore, all sessions
received were after collection of their primary outcome data.
1.00
0.90
Proportion of individuals initiating SIT
0.80
0.70
0.60
0.50
0.40
0.30
0.20
0.10
0.00
0 25 50 75 100 125 150 175 200 225 250 275 300 325 350
Time from randomisation to initiation of SIT (days)a
FIGURE 6 Time from randomisation to initiation of SIT in days (for the 61 participants allocated to and initiating SIT).
a, Figure includes 61 out of 69 participants who initiated SIT.
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
57
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
QUANTITATIVE RESULTS
(a)
Attended session
Session attended prior
to 6-month follow-up
Session attended following
6-month follow-up
(b)
Attended session
(c)
Attended session
(d)
Attended session
FIGURE 7 Panel plot of session attendance for six different participants. (a) Participant A; (b) participant B; (c) participant C;
(d) participant D; (e) participant E; and (f) participant F. (continued )
58
(e)
Attended session
Session attended prior
to 6-month follow-up
Session attended following
6-month follow-up
(f)
Attended session
FIGURE 7 Panel plot of session attendance for six different participants. (a) Participant A; (b) participant B; (c) participant C;
(d) participant D; (e) participant E; and (f) participant F.
A 48 22 20
B 29 21 21
C 20 19 19
D 119 23 13
E 85 8 8
F 348 21 0
Outcome variables are summarised in Tables 19 and 20 at baseline and at 6 and 12 months post
randomisation. For the primary outcome (i.e. ABC-I), Figure 8 illustrates baseline and 6-month scores by
study site.
Our primary analysis included 106 participants. At 6 months post randomisation, the mean ABC-I score
was 18.8 (SD 10.48) in the control arm and 18.5 (SD 9.33) in the intervention arm. The correlation
between baseline and 6-month ABC-I score was 0.698 (95% CI 0.585 to 0.784). After adjusting for
baseline ABC-I, sex of child, SPM category and region, the between-arm difference was 0.40 points
higher in the intervention arm than in the control arm (95% CI –2.33 to 3.14; p = 0.77) (Table 21).
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
59
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
QUANTITATIVE RESULTS
Study arm
Intervention Control
VABS domain
APSI: range 0–65 (higher score indicates 69 24.59 (10.03) 3–48 69 24.43 (9.10) 8–49
more stress)
EQ-5D-5L
Accounting for repeated measures over time, the between-arm difference was 0.61 points lower in
the intervention arm than in the control arm (95% CI –3.13 to 1.92; p = 0.64). The conclusions drawn
from our primary analysis were also unaffected by sensitivity analyses accounting for missing data
(see Table 28), intervention receipt (see Table 28) or the COVID-19 pandemic (see Table 27).
At 12 months post randomisation, an ABC-I score was available for 96 participants. The mean ABC-I
score was 19.9 (SD 11.19) in the control arm and 17.7 (SD 9.33) in the intervention arm. After
adjusting for baseline ABC-I, sex of child, SPM category and region, the between-arm difference was
2.01 points lower in the intervention arm than in the control arm (95% CI –5.38 to 1.36; p = 0.24).
60
DOI: 10.3310/TQGE0020
TABLE 20 Outcome scores at 6 and 12 months
6 months 12 months
Measure n Mean (SD) Range n Mean (SD) Range n Mean (SD) Range n Mean (SD) Range
ABC-I: range 0–45 57 18.54a (9.33) 1–43 49 18.82a (10.48) 1–39 52 17.69 (9.00) 0–37 44 19.93 (11.19) 1–43
ABC-W: range 0–48 49 12.35 (8.09) 2–34 36 11.61 (5.93) 0–25 36 14 (7.75) 1–31 24 12.71 (6.52) 1–28
ABC-S: range 0–21 49 5.71 (4.45) 0–18 36 5.94 (4.60) 0–17 36 6.31 (4.40) 0–17 24 5.50 (3.97) 0–16
ABC-H: range 0–48 49 22.76 (9.42) 8–41 36 24.58 (11.71) 1–46 36 23.06 (10.59) 5–45 24 25.46 (11.84) 4–46
ABC-IS: range 0–12 49 4.51 (2.80) 0–12 36 4.81 (3.56) 0–12 36 5.17 (2.80) 1–12 24 5.25 (3.29) 0–11
Domain
Daily living skills 42 62 (8.06) 27–75 32 64 (6.44) 54–83 24 62 (5.75) 48–73 15 62 (4.25) 52–68
Socialisation 39 68 (6.87) 51–85 31 68 (10.63) 55–96 22 65 (7.28) 51–78 16 64 (8.62) 51–81
continued
61
62
NIHR Journals Library www.journalslibrary.nihr.ac.uk
QUANTITATIVE RESULTS
TABLE 20 Outcome scores at 6 and 12 months (continued )
6 months 12 months
Measure n Mean (SD) Range n Mean (SD) Range n Mean (SD) Range n Mean (SD) Range
APSI: range 0–65 (higher score 48 20.08 (8.11) 4–37 35 20.14 (8.91) 0–40 36 21.17 (8.76) 8–42 24 20.88 (8.79) 6–36
indicates more stress)
EQ-5D-5L
EQ-VAS: range from 0 (worst 48 75 (70–80)b 7–96 35 80 (75–85)b 50–100 36 72.5 (60, 82.5) 10–90 24 80 (65, 87.5) 45–95
health) to 100 (best health)
Index value: range from –0.28 48 0.77 (0.74–0.88)b 0.17–1 35 0.84 (0.73–0.88)b 0.17–1 36 0.84 (0.71, 0.88) –0.19–1 24 0.78 (0.69, 0.88) 0.11–1
to 1 (higher values indicate
better health)
CarerQoL (higher score reflects better care situation)
CarerQol-7D: range 0–14 48 8.02 (2.43) 3–12 35 8.31 (2.60) 3–13 36 7.67 (2.57) 2–12 24 7.63 (2.99) 3–13
CarerQol-VAS: range 0–10 48 6.71 (1.79) 2–10 35 7.15 (1.24) 5–9.3 36 6.60 (1.35) 2–10 24 7.08 (1.14) 5–9
ABC-H, Aberrant Behavior Checklist – hyperactivity/non-compliance; ABC-IS, Aberrant Behavior Checklist – inappropriate speech; ABC-S, Aberrant Behavior Checklist – stereotypic
behaviour; ABC-W, Aberrant Behavior Checklist – lethargy/social withdrawal.
a Primary outcome.
b Values in brackets are IQRs.
DOI: 10.3310/TQGE0020 Health Technology Assessment 2022 Vol. 26 No. 29
10
0
0 10 20 30 40
ABC-I score at baseline
(b)
Baseline: control arm mean = 17.67
40 Baseline: intervention arm mean = 17.05
ABC-I score at 6 months
10
0
0 10 20 30 40
ABC-I score at baseline
(c)
Baseline: control arm mean = 22.64
40
ABC-I score at 6 months
10
0
0 10 20 30 40
ABC-I score at baseline
(d)
Baseline: control arm mean = 25.63
40 Baseline: intervention arm mean = 30.50
ABC-I score at 6 months
10
0
0 10 20 30 40
ABC-I score at baseline
FIGURE 8 ABC-I scores at baseline and 6 months, by site. (a) Site 1, Aneurin Bevan; (b) site 2, Cardiff and Vale; (c) site 3,
Cornwall; (d) site 4, Cwm Taf; (e) site 5, Hywel Dda; (f) site 6, Pace Centre; and (g) site 7, Swansea Bay. (continued )
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
63
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
QUANTITATIVE RESULTS
(e)
Baseline: control arm mean = 24.60
40
10
0
0 10 20 30 40
ABC-I score at baseline
(f)
Baseline: control arm mean = 28.29
40 Baseline: intervention arm mean = 22.90
ABC-I score at 6 months
10
0
0 10 20 30 40
ABC-I score at baseline
(g)
Baseline: control arm mean = 17.00
40 Baseline: intervention arm mean = 28.00
ABC-I score at 6 months
10
0
0 10 20 30 40
ABC-I score at baseline
FIGURE 8 ABC-I scores at baseline and 6 months, by site. (a) Site 1, Aneurin Bevan; (b) site 2, Cardiff and Vale; (c) site 3,
Cornwall; (d) site 4, Cwm Taf; (e) site 5, Hywel Dda; (f) site 6, Pace Centre; and (g) site 7, Swansea Bay.
Secondary outcomes
Behavioural measures
At 6 months post randomisation, secondary outcomes relating to behaviour were available for
85 participants. There was no evidence of any differences between arms across the lethargy/social
withdrawal, stereotypic behaviour, hyperactivity or inappropriate speech domains of the ABC
(see Table 21).
64
TABLE 21 Regression analysis comparing the intervention arm with the control arm, adjusting for baseline score, sex of
child, SPM category and region: 6 months
ABC score
ABC-I 106 0.40 –2.33 to 3.14 0.77
VABS
EQ-5D-5L
At 12 months post randomisation, secondary outcomes relating to behaviour were available for
60 participants. Similarly, we found no evidence of any differences between arms across these
measures (Table 22).
However, an error in administration of this measure for the majority of participants meant that we had
introduced an artificial ceiling effect and scores were potentially less sensitive to change. Start points
of each subdomain depend on the child’s chronological age, and age ranges are given as indicators of
where performance might be expected to lie. Indicative upper limits are not intended to be used as
cut-off points during administration, but were, for most participants, potentially limiting the magnitude
of change that could be observed. It is uncertain whether or not this error masked any differences
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
65
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
QUANTITATIVE RESULTS
TABLE 22 Regression analysis comparing the intervention group with the control group, adjusting for baseline score,
sex of child, SPM category and region: 12 months
ABC score
VABS
EQ-5D-5L
CarerQol
between arms with regard to adaptive behaviour domains. However, given the absence of any marginal
effects (excepting a negative effect on communication at 12 months, which may also be reflective of
multiple testing) and an absence of effect across other outcomes, this is perhaps unlikely.
Parenting stress
At 6 months, APSI scores were available for 83 participants. We found no evidence of between-arm
differences for this measure. Similarly, we found no evidence of between-arm differences at 12 months.
66
40
20
10
–10
–20
–30
–40
0 10 20 30 40
Average of carer-assessed ABC-I and
teacher-assessed ABC-I at 6 months
FIGURE 9 Carer- and teacher-assessed ABC-I. Mean difference of 10.28; 95% limits of agreement of –18.12 to 38.68.
Subgroup analysis
There was some evidence suggesting that there was also a differential effect of SIT on the ABC-I at
6 months by sex of child (intervention arm × female = 6.42, 95% CI 0.00 to 12.85; p = 0.050), with the
intervention being less effective in girls than in boys.
Carer rated
Performance 43 3.29 (1.46) 6.04 (1.51) 2.75 (1.99) 2.14 to 3.37 < 0.001
Satisfaction 42 3.09 (1.54) 6.43 (1.75) 3.34 (2.27) 2.63 to 4.04 < 0.001
Child rated
Performance 12 4.30 (2.00) 6.78 (1.44) 2.48 (2.75) 0.73 to 4.22 0.01
Satisfaction 10 3.89 (1.95) 6.23 (0.94) 2.34 (2.27) 0.72 to 3.96 0.01
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
67
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
QUANTITATIVE RESULTS
There was also some evidence to suggest that the intervention was more effective in those with
ADHD (intervention arm × ADHD present = –6.77, 95% CI –13.55 to –0.01; p = 0.050). We found no
evidence of a differential effect of SIT on the ABC-I at 6 months by SPM range or general comorbidity,
or by ID and other neurodevelopmental or genetic condition specifically (Table 24).
Region (reference group = South Wales) SIT main effect –2.62 –5.77 to 0.53 0.10
S-WE region main effect –8.42 –12.72 to –4.12 < 0.001
SIT × S-WE region interaction 9.77 4.04 to 15.49 0.001
Age (continuous variable) SIT main effect –5.83 –18.52 to 6.85 0.36
Age main effect –0.50 –1.66 to 0.65 0.39
SIT × age interaction 0.81 –0.80 to 2.42 0.32
Sex (reference group = male) SIT main effect –1.08 –4.16 to 2.00 0.49
Female main effect –1.96 –6.79 to 2.87 0.42
SIT × female interaction 6.42 –0.00 to 12.85 0.05
SPM range (reference group = some SIT main effect 1.82 –4.17 to 7.81 0.55
problems)
Definite dysfunction main effect 0.75 –4.63 to 6.13 0.78
SIT × definite dysfunction –1.79 –8.54 to 4.96 0.60
interaction
Comorbiditya (reference group = no SIT main effect 0.73 –3.39 to 4.84 0.73
comorbidity)
Comorbidity present main effect 3.35 –1.09 to 7.79 0.14
SIT × comorbidity present –1.08 –6.92 to 4.75 0.71
interaction
ADHDa (reference group = no ADHD) SIT main effect 1.28 –2.01 to 4.58 0.44
ADHD present main effect 7.91 2.48 to 13.34 0.01
SIT × ADHD present interaction –6.77 –13.55 to –0.01 0.05
IDa (reference group = no ID) SIT main effect –0.09 –3.26 to 3.08 0.96
ID present main effect 3.88 –3.37 to 11.13 0.29
SIT × ID present interaction –1.03 –10.10 to 8.05 0.82
Other neurodevelopmental or genetica SIT main effect –0.66 –4.06 to 2.73 0.70
(reference group = not present)
Neurodevelopmental/genetic –0.87 –5.83 to 4.09 0.73
present main effect
SIT × neurodevelopmental/ 3.29 –4.05 to 10.64 0.38
genetic present interaction
S-WE, South-west England.
a In these instances, n = 89 because of missing data for comorbidities. For all other variables n = 106.
Note
Models were fitted separately for each subgroup and adjusted for baseline ABC-I, sex of child, SPM category and
region (where not a subgroup). Main effects for SIT can be interpreted as the intervention effect on ABC-I at 6 months
in the reference group for each subgroup explored. Main effects for the subgroup can be interpreted as the association
between the subgroup category and the ABC-I score at 6 months for participants in the control arm.
68
Region (reference group = South Wales) SIT main effect –2.25 –6.05 to 1.56 0.24
Age (continuous variable) SIT main effect 9.69 –4.79 to 24.18 0.19
SPM range (reference group = some SIT main effect 2.73 –3.58 to 9.04 0.39
problems)
Definite dysfunction main effect 1.21 –4.58 to 7.00 0.68
Comorbiditya (reference group = no SIT main effect 1.31 –3.45 to 6.08 0.58
comorbidity)
Comorbidity present main effect 3.65 –1.69 to 8.99 0.18
ADHDa (reference group = no ADHD) SIT main effect –0.19 –4.08 to 3.69 0.92
We found no evidence of a differential effect of SIT on the ABC-I at 6 months by sex of child, SPM
range or general comorbidity, or by ID and ADHD specifically (see Table 24).
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
69
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
QUANTITATIVE RESULTS
Table 26 provides results from the sensitivity analyses accounting for receipt of SIT. Although the point
estimates change slightly, the conclusions drawn from the primary analysis remain unaltered.
Although exclusion of those participants with primary outcome data available during the intrapandemic
period led to an increase in our point estimate (i.e. between-arm adjusted mean difference of the
ABC-I at 6 months), the CI remained wide and the conclusions drawn on our primary analysis remain
unaltered (Table 27). Baseline to 6-month follow-up ABC-I correlation was slightly higher following
exclusion of participants who provided 6-month data during the intrapandemic period. Figure 13
illustrates differences in ABC-I scores at 6 months by arm and by time period.
0.08
0.06
0.02
0.00
0 5 10 15 20 25 30 35 40 45
ABC-I at 6 months
FIGURE 10 Distribution of ABC-I scores at 6 months in those who did and did not initiate SIT.
0.08
0.06
ABC-I scores in those who did not
receive at least 13 SIT sessions
Density
0.00
0 5 10 15 20 25 30 35 40 45
ABC-I at 6 months
FIGURE 11 Distribution of ABC-I scores at 6 months in those who did and did not receive at least 13 SIT sessions during
the intensive phase.
70
45
40
35
ABC-I score at 6 months
30
25
20
15
10
0
0–10 11–20 > 21
Number of SIT sessions received
FIGURE 12 Box plot of ABC-I scores at 6 months for those who received differing levels of SIT.
TABLE 26 Sensitivity analysis of the primary outcome accounting for intervention receipt
Accounting for those who had not initiated SIT by 6 months 106 0.46 –2.56 to 3.48
Accounting for the number of sessions attended by 6 months (per session) 106 0.03 –0.15 to 0.20
Accounting for the number of sessions attended by 6 months (all sessions, 106 0.69 –3.82 to 5.19
i.e. row above multiplied by 26)
Accounting for those who did not attend at least 13 sessions during the 106 0.60 –3.31 to 4.50
intensive phase
MITT, modified intention to treat.
Note
All models adjust for baseline ABC-I score, sex of child, SPM category and region.
TABLE 27 Comparison of primary analysis and primary analysis in those with primary outcome data available prior to
the COVID-19 pandemic (pre 23 March 2020)
Original primary analysis 106 0.40 –2.33 to 3.14 0.770 0.698 (0.585 to 0.784)
Primary analysis on participants 95 0.50 –2.40 to 3.39 0.733 0.712 (0.596 to 0.799)
followed up pre pandemic
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
71
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
QUANTITATIVE RESULTS
45
40
35
30
ABC-I at 6 months
25
20
15
10
0
Control arm Intervention arm Control arm Intervention arm
Pre-pandemic period (n = 95) Intrapandemic period (n = 11)
FIGURE 13 Box plots of ABC-I scores at 6 months by arm and by time period.
Intervention receipt
In total, 57 participants allocated to the intervention arm provided primary outcome data. Of these
57 participants, 38 received at least 13 out of 20 intensive intervention sessions, but 19 did not.
Pandemic-related reasons were indicated for 11 out of 19 participants who did not receive an
adequate level of SIT.
Adverse events
There were no SAEs during the trial. One AE was reported to the trial team by a therapist as a SAE; however,
it was clear that this event did not meet the criteria of ‘serious’ as laid out in the reporting guidance.
Original full ITT analysis with multiple imputation 138 0.45 –2.36 to 3.27 0.751
Primary analysis on participants followed up pre pandemic 95 0.50 –2.40 to 3.39 0.733
72
The aim of the economic evaluation was to compare the cost-effectiveness of SIT with that of usual
care. The main evaluation took an NHS/PSS perspective81 and covered use of all hospital, community
health and social services. A secondary analysis explored the sensitivity of the results using a broader
societal perspective (including NHS/PSS costs, education costs, carer expenses and lost productivity).
The primary economic analysis was an available-case analysis for cost and cost-effectiveness at 6-month
follow-up of SIT compared with usual care, with outcome expressed as irritability/agitation (i.e. ABC-I).
ABC-I data were collected at baseline and at 6 and 12 months post randomisation. All unit costs were
for the financial year 2020/21 and updated where necessary.82
Identification of resources
¢ GP
¢ practice nurse
¢ speech and language therapist
¢ community paediatrician
¢ CAMHS psychiatrist
¢ clinical psychologist
¢ counsellor/psychotherapist
¢ behaviour support team
¢ social worker
¢ respite carer
¢ outreach/family support worker.
¢ GP
¢ practice nurse
¢ counsellor
¢ self-help/support group
¢ alternative therapist
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
73
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
HEALTH ECONOMICS
¢ telephone helpline
¢ hospital outpatient clinic
¢ inpatient admission (mental health and physical health)
¢ accident and emergency attendances (requiring/not requiring hospital stay).
Measure of resources
Intervention delivery
The intervention arm received 24 face-to-face and two telephone sessions, which were used as the
basis for calculation of intervention costs.
Usual care
Data on usual-care services and support were recorded using the CSRI,75 and were adapted to reflect
the type of data collected and to record service use that would facilitate cost estimation. Usual care
involved contact with OT, autism-specific services and any other NHS services.
Productivity losses
Data regarding the number of half-days taken off work by the main carer to provide support were
collected (last 6 months).
Valuation of resources
All resources were costed by applying a unit cost (GBP) for the financial year 2020–21. Total resource
use was calculated for each participant.
74
Costs per unit of measurement for each NHS/PSS service type were taken from the Personal Social
Services Research Unit Costs of Health and Social Care compendium.82 NHS reference costs84 were
used for inpatient and outpatient attendances and community-based services. Unit costs not obtained
from these sources were estimated directly based on salary of the professional delivering a service,
plus employer on-costs, overheads, costs of supervision and equipment/consumables.
Productivity costs
Productivity losses were calculated by multiplying time taken off work by carer’s wage rate. We calculated
the hourly rate for each carer by dividing their gross annual income by the number of weeks per year and
weekly working hours reported. We then multiplied rate per hour by number of hours in the half-days off
work reported at follow-up assessments (Table 30).
Autism-related therapies
Education-based services
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
75
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
HEALTH ECONOMICS
School counsellor (minute) 0.82 Prospects,96 PSSRU 2020, inflated to 2020/21 prices
Autism specialist teacher (minute) 0.61 Prospects,96 Curtis and Burns,82 inflated to
2020/21 prices
Autism champion (minute) 0.53 Curtis and Burns,82 inflated to 2020/21 prices
Community-based services
Practice nurse (minute) 0.71 Curtis and Burns,82 inflated to 2020/21 prices
Occupational therapist (minute) 0.83 Curtis and Burns,82 inflated to 2020/21 prices
Speech and language therapist (minute) 0.69 Curtis and Burns,82 inflated to 2020/21 prices
Behaviour support team (minute) 1.01 Netten and Curtis,98 inflated to 2020/21 prices
Social worker (minute) 1.30 Curtis and Burns,82 inflated to 2020/21 prices
Outreach worker (minute) 0.43 Curtis and Burns,82 inflated to 2020/21 prices
Endocrine consultant (minute) 2.00 Curtis and Burns,82 inflated to 2020/21 prices
Integrated Community Mental Health Teams 0.78 Curtis and Burns,101 inflated to 2020/21 prices
(minute)
Primary mental health worker (minute) 0.77 Curtis and Burns,99 inflated to 2020/21 prices
Continence nurse (minute) 1.38 Curtis and Burns,99 inflated to 2020/21 prices
Community paediatrician (contact) 157.00 Curtis and Burns,82 inflated to 2020/21 prices
Paediatric consultant (contact) 241.70 Curtis and Burns,82 inflated to 2020/21 prices
Optician (contact) 33.30 Curtis and Burns,104 inflated to 2020/21 prices
CBT therapist (session) 106.00 Curtis and Burns,82 inflated to 2020/21 prices
76
Hospital-based care
Inpatient admission: physical health 3440.16 Department of Health and Social Care,84 inflated to
(bed-days) 2020/21 prices
Accident and emergency: not admitted 145.21 Department of Health and Social Care,84 inflated to
(attendance) 2020/21 prices
Accident and emergency: admitted 174.46 Department of Health and Social Care,84 inflated to
(attendance) 2020/21 prices
Hospital outpatient clinic (appointments) 206.85 Department of Health and Social Care,84 inflated to
2020/21 prices
Day hospital (attendance) 785.61 Department of Health and Social Care,84 inflated to
2020/21 prices
CBT, cognitive–behavioural therapy; PSSRU, Personal Social Services Research Unit; SEN, special educational needs.
Data analysis
Resource use was reported as means by arm and as a percentage of the arm having at least one
contact. Differences in service use between arms (i.e. baseline, 6-month follow-up and 12-month
follow-up) were reported descriptively. All relevant data on service use and support were checked
for missing values and values outside an acceptable range. Missing data were imputed using
multiple imputation.
Analysis of costs
The health economic analysis was an available-case analysis. Costs were calculated using data on
the type, number and length of contacts. Mean costs were analysed using regression analysis and
bootstrapping. We analysed differences between arms in health-care (i.e. NHS/PSS) or societal costs
in secondary analyses at 6 months by regressing the total cost on treatment allocation, baseline ABC-I,
recruitment region, severity of SPDs, sex of child and baseline costs. To mitigate effects of data
skewness, non-parametric bootstrapping methods were used to estimate 95% CIs for mean costs with
10,000 resamples. No discounting was needed, as we assessed cost over periods of < 1 year.
Cost-effectiveness analysis
Cost-effectiveness analyses were conducted from an NHS/PSS perspective and a wider societal
perspective. The primary economic analysis focused on cost-effectiveness of SIT compared with
usual care, assessed in terms of cost per point improvement in carer-reported ABC-I. The incremental
cost-effectiveness ratio (ICER) was calculated as the difference in mean costs divided by difference in
mean ABC-I.108
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
77
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
HEALTH ECONOMICS
Cost-effectiveness acceptability curves (CEACs) were plotted to locate findings in their wider decision-
making context. Non-parametric bootstrapping from cost and effectiveness data generated a joint
distribution of incremental mean costs and effects for comparators to explore the probability that each
is the optimal choice, subject to a range of maximum values (i.e. a ceiling ratio) that a decision-maker
might be willing to pay for an additional point improvement in ABC-I. Each CEAC was derived using a
net benefit approach. Monetary values of incremental effects and incremental costs for each case were
combined, and net monetary benefit was derived as:
where λ is willingness to pay for a 1-point difference in ABC-I, and a and b denote SIT and usual care,
respectively. We explored a range of willingness-to-pay values for each outcome.
Sensitivity analyses
An intention-to-treat analysis was carried out (with missing data imputed using multiple imputation)
to explore the sensitivity of results using a broader societal perspective, including NHS/PSS costs,
education service costs, carer expenses and lost productivity.
Results
Data completeness
At baseline, service use data were available for 138 participants (intervention, n = 69; usual care,
n = 69). At 6-month follow-up, data were available for 60% of participants (intervention, n = 48;
usual care, n = 35). At 12-month follow-up, 23 and 36 participants provided data in the control arm
and intervention arm, respectively.
Resource use
The difference in service use between arms at baseline was broadly similar (Table 31). As shown in Table 32,
at 6-month-follow-up, usual-care participants reported considerably higher contact with education
services [mean 425.97 (SD 388.37) vs. mean 333.46 (SD 354.10)], slightly greater use of community-
based health and social care services and more accident and emergency unit attendances (14.29% vs.
6.25%) than participants in the intervention arm. However, carers in the intervention arm spent,
on average, more half-days off work [mean 18.19 (SD 37.22) days vs. mean 4.14 (SD 9.02) days].
At 12-month follow-up, modest but higher utilisation of health-care and social care resources was
reported by families in the intervention arm across all categories (Table 33).
Caregiver-reported gross income and the mean annual income was £17,537.31 (SD $15,909.86)
for SIT and £18,405.8 (SD £14,956.87) for usual care.
Total costs
The total costs for the child, sibling and carers by sector and perspective were reported as adjusted
mean differences with bias-corrected 95% CIs.
78
Study arm
Service use (unit) n (%) using Mean (SD) n (%) using Mean (SD)
Child
Autism intervention package (contact) 3 (4.35) 0.09 (0.54) 6 (8.70) 0.87 (5.01)
Service use by the child: education 61 (88.41) 332.59 (448.07) 64 (92.75) 302.51 (350.94)
(contact)
Inpatient stay: physical health 2 (2.90) 0.04 (0.27) 1 (1.45) 0.02 (0.12)
(bed-days)
Sibling
Carer
Accident and emergency: not 2 (2.90) 0.03 (0.17) 3 (4.35) 0.04 (0.21)
admitted (attendance)
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
79
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
HEALTH ECONOMICS
Study arm
Service use (unit) n (%) using Mean (SD) n (%) using Mean (SD)
Child
Autism intervention package (contact) 4 (8.33) 0.08 (0.45) 4 (11.43) 1.69 (6.74)
Service use by the child: education 41 (85.42) 333.46 (354.10) 32 (91.43) 425.97 (388.37)
(contact)
Sibling
Carer
80
Study arm
Service use (unit) n (%) using Mean (SD) n (%) using Mean (SD)
Child
Autism intervention package (contact) 4 (11.11) 0.33 (2.00) 3 (13.04) 0.87 (2.94)
Service use by the child: education 28 (77.78) 368.64 (379.77) 19 (82.61) 356.78 (447.21)
(contact)
Sibling
Carer
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
81
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
HEALTH ECONOMICS
Usual care
SIT (n = 69), (n = 69), Unadjusted mean difference Adjusted mean difference
Cost mean (SD) mean (SD) (95% CI) (£) (95% CI) (£)a,b
a. Child
Autism 1.46 (12.13) 45.6 (321.11) –44.14 (–120.64 to 32.36) –42.64 (–114.22 to 28.93)
intervention
package
Community- 426.99 (542.62) 409.24 (622.14) 17.76 (–178.77 to 214.29) 23.37 (–168.60 to 215.35)
based care
Hospital-based 181.14 (932.45) 81.42 (427.93) 99.71 (–144.54 to 343.97) 95.59 (–149.59 to 340.78)
care
Total health and 609.59 (1112.9) 536.26 (833.52) 73.34 (–257.69 to 404.36) 76.32 (–266.29 to 418.93)
social care (child)
b. Sibling
NHS/PSS 142.69 (452.48) 52.17 (161.33) 90.53 (–23.83 to 204.89) 89.96 (–19.98 to 199.92)
c. Carer
Autism-related 264.04 (806.26) 199.11 (543.17) 64.92 (–166.52 to 296.37) 47.86 (–165.08 to 260.79)
training
Community- 270.84 (784.84) 214.85 (548.35) 55.98 (–171.95 to 283.92) 59.99 (–162.39 to 282.37)
based care
Hospital-based 43.18 (142.74) 207.02 (834.00) –163.83 (–365.27 to 37.60) –167.58 (–361.59 to 26.42)
care
d. Out-of-pocket 1016.1 (3632.2) 234.43 (513.37) 781.64 (–91.67 to 1654.9) 804.14 (–132.81 to 1741.1)
expenses
(caregiver)
e. Unpaid care 478.33 (1354.2) 436.39 (2859.9) 41.94 (–711.40 to 795.29) 25.38 (–761.14 to 811.89)
f. Education 3465.6 (4573.5) 2982.7 (3336.8) 482.81 (–864.98 to 1830.6) 527.64 (–827.22 to 1882.5)
(child)
Total societal 6290.3 (6378.2) 4862.9 (5019.7) 1427.33 (–504.98 to 3359.6) 1463.7 (–488.33 to 3415.7)
(a–f)
a Bias-corrected 95% CIs.
b Adjusted for baseline ABC-I, recruitment region, severity of SPDs and sex of child.
Societal perspective
From a societal perspective, the mean total costs at baseline were £6290.30 and £4862.90 for SIT
and usual care, respectively. The adjusted mean difference in costs of £1463.70 was not statistically
significant (95% CI –£488.33 to £3415.70) (see Table 34). The mean total societal costs, including
intervention at 6 months, were £6784.2 and £6418.9 for the intervention arm and control arm,
respectively. The adjusted mean difference was not statistically significant (mean –£353.57, 95% CI
–£3518.9 to £2811.7). When intervention costs were excluded, the mean total societal cost at 6 months
was statistically higher for usual care than for SIT (mean –£1891.70, 95% CI –£5022.10 to £1238.70).
Costs measured at 12 months were higher overall in the intervention arm, with an adjusted difference
in total societal care cost of £1141.50 (95% CI £1333.4 to £3616.4); however, the adjusted mean difference
was not statistically significant (Table 36).
82
TABLE 35 Total costs (£) at 6-month follow-up by arm (for previous 6 months)
Usual care
SIT (n = 48), (n = 35), Unadjusted mean difference Adjusted mean difference
Cost mean (SD) mean (SD) (95% CI) (£) (95% CI) (£)a,b
b. Child
Autism 3.28 (17.43) 46.56 (188.79) –43.28 (–97.69 to 11.13) –46.40 (–110.83 to 18.02)
intervention
package
Community- 361.65 (449.41) 487.11 (675.27) –125.46 (–371.14 to 120.21) –218.26 (–432.68 to –3.85)
based care
Hospital- 12.10 (50.42) 20.74 (51.55) –8.64 (–31.15 to 13.87) –8.57 (–31.42 to 14.27)
based care
Total health and 377.04 (455.67) 554.42 (706.16) –177.38 (–431.36 to 76.59) –213.07 (–484.49 to 58.37)
social care
Total health and 1915.2 (455.67) 554.42 (706.16) 1360.8 (1106.8 to 1614.8) 1325.1 (1057.6 to 1592.6)
social care
(a + b)
c. Sibling
NHS/PSS 49.47 (144.32) 15.88 (49.56) 33.59 (–17.06 to 84.24) 19.91 (–18.27 to 58.09)
d. Carer
Autism- 180.79 (548.03) 145.67 (428.49) 35.12 (–186.59 to 256.84) 31.35 (–186.16 to 248.86)
related
training
Community- 179.99 (300.10) 118.26 (238.89) 61.73 (–60.36 to 183.82) 52.01 (–59.84 to 163.86)
based care
Hospital- 139.94 (570.36) 53.19 (220.64) 86.76 (–115.52 to 289.03) 96.86 (–71.63 to 265.35)
based care
e. Out-of-pocket 253.42 (782.64) 137.66 (359.87) 115.76 (–167.34 to 398.86) 154.68 (–133.29 to 442.66)
expenses
(caregiver)
f. Unpaid care 749.49 (2176.88) 72.66 (148.22) 676.83 (–57.74 to 1411.4) 77.34 (–233.47 to 388.16)
g. Education 3315.9 (3309.9) 5321.2 (8518.5) –2005.2 (–4688.7 to 678.17) –2150.3 (–5373.2 to 1072.5)
(child)
Total societal 5246.1 (3727.1) 6418.9 (8866.3) –1172.8 (–4006.6 to 1660.9) –1891.7 (–5022.1 to 1238.7)
without
intervention
(b–g)
Total societal 6784.2 (3727.1) 6418.9 (8866.3) 365.32 (–930.3 to 4737.3) –353.57 (–3518.9 to 2811.7)
with
intervention
(a–g)
a Bias-corrected 95% CIs.
b Adjusted for baseline ABC-I, recruitment region, severity of SPDs and sex of child.
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
83
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
HEALTH ECONOMICS
TABLE 36 Total costs (£) at 12-month follow-up by arm (for previous 6 months)
Usual care
SIT (n = 36), (n = 23), Unadjusted mean difference Adjusted mean difference
Cost mean (SD) mean (SD) (95% CI) (£) (95% CI) (£)a,b
b. Child
Autism 26.24 (120.47) 0.73 (3.50) 25.51 (–24.97 to 75.98) 26.68 (–19.67 to 73.02)
intervention
package
Community- 615.73 (1299) 229.79 (443.26) 385.93 (–177.73 to 949.60) 288.38 (–94.13 to 670.89)
based care
Hospital-based 16.13 (46.28) 6.31 (30.28) 9.82 (–12.02 to 31.66) 12.19 (–5.54 to 29.92)
care
Total health and 658.11 (1324.29) 236.84 (454.70) 421.27 (–153.62 to 996.15) 403.02 (–93.74 to 899.78)
social care
Total health and 2196.3 (1324.3) 236.84 (454.70) 1959.4 (1384.5 to 2534.3) 1941.1 (1476.3 to 2406)
social care (a + b)
c. Sibling
NHS/PSS 273.08 (922.12) 91.13 (273.20) 181.94 (–214.81 to 578.69) 103.03 (–247.77 to 453.82)
d. Carer
Autism-related 5.89 (25.96) 0.00 (–) 5.89 (–4.97 to 16.77) 6.75 (–3.71 to 17.22)
training
Community- 208.43 (476.77) 259.77 (754.44) –51.34 (–371.73 to 269.05) –75.43 (–424.1 to 273.25)
based care
Hospital-based 226.12 (913.45) 98.93 (291.66) 127.19 (–267.49 to 521.87) 182.40 (–216.71 to 581.51)
care
e. Out-of-pocket 92.92 (267.23) 51.35 (87.11) 41.56 (–74.04 to 157.18) 18.92 (–53.1 to 90.94)
expenses
(caregiver)
f. Unpaid care 369.26 (859.86) 159.91 (440.33) 209.35 (–179.37 to 598.06) 165.17 (–177.92 to 508.28)
g. Education (child) 3587.6 (3596.5) 3665.4 (4625.6) –77.89 (–2229.39 to 2073.6) –335.71 (–2241.6 to 1570.2)
Total societal 5421.4 (5153.2) 4563.4 (5190.5) 857.98 (–1904.3 to 3620.3) –396.65 (–2870.8 to 2077.5)
without
intervention (b–g)
Total societal with 6959.5 (5153.2) 4563.4 (5190.5) 2396.1 (–366.1 to 5158.4) 1141.5 (–1333.4 to 3616.4)
intervention (a–g)
a Bias-corrected 95% CIs,
b Adjusted for baseline ABC-I, recruitment region, severity of SPDs and sex of child.
Outcomes
84
It was not necessary to calculate ICERs, as there were no significant differences in costs and effects in
the primary outcome. However, there is uncertainty around these results. A Bayesian decision-making
approach was adopted, and available data on costs and effects were used to plot a CEAC. Non-parametric
bootstrapping generated a joint distribution of incremental mean costs and effects for SIT compared
with usual care to explore the probability of SIT being cost-effective subject to a range of values (λ) that
a decision-maker might be willing to pay for an improvement in outcomes.
Figures 14 and 15 present scatterplots of the bootstrapped cost and effectiveness of SIT compared
with usual care, from NHS/PSS and societal perspectives. Points in the scatterplot for the NHS/PSS
perspective fall in the north-east and north-west quadrants of the cost-effectiveness plane, suggesting
that SIT is more costly than usual care, with unclear conclusions regarding effectiveness. Points in the
scatterplot for the societal perspective fall in all four quadrants of the cost-effectiveness plane.
1800
1400
Incremental cost (£)
1000
600
200
–200
–4 –2 0 2 4 6
Incremental ABC-I score
FIGURE 14 Bootstrapped mean differences in health and social care costs and effects (6-month ABC-I total score):
cost-effectiveness plane – SIT vs. usual care (NHS/PSS perspective).
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
85
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
HEALTH ECONOMICS
6000
4000
2000
Incremental cost (£)
–2000
–4000
–6000
–8000
–10,000
–4 –2 0 2 4 6
Incremental ABC-I score
FIGURE 15 Bootstrapped mean differences in societal costs and effects (6-month ABC-I total score): cost-effectiveness
plane – SIT vs. usual care (societal perspective).
Statistical uncertainty around the ICER was explored using CEACs (Figures 16 and 17). Given the
lack of suggested monetary thresholds for assessing cost-effectiveness using ABC-I, we assumed a
willingness-to-pay threshold of £500. The probability that SIT is cost-effective from the NHS/PSS
perspective was < 10% (see Figure 16). From the wider societal perspective (including education services,
carers’ health-care use, out-of-pocket expenses and lost productivity, in addition to health and social
care costs), the probability that SIT is cost-effective increased to just under 60% for a willingness-to-pay
threshold of £500 (see Figure 17). At 6 months, the probability that SIT is cost-effectiveness rose from
10% under an NHS/PSS perspective to 60% under a societal perspective because of the higher cost
of education in the control arm. Higher education costs offset costs in NHS/PSS and in other sectors,
closing the gap in societal care costs at 6 months between arms (from £1360.80 under an NHS/PSS
perspective to £356.32 under a societal perspective; see Table 35).
1.0
0.9
Probability that SIT is cost-effective
0.8
0.7
0.6
0.5
0.4
0.3
0.2
0.1
0.0
0 100 200 300 400 500 600 700 800 900 1000
Willingness-to-pay threshold (£)
FIGURE 16 Health-care and social care costs and effects (6-month ABC-I scores): CEAC.
86
1.0
0.9
5000
4000
3000
Incremental cost (£)
2000
1000
–1000
–10 –5 0 5 10
Incremental ABC-I score
FIGURE 18 Bootstrapped mean differences in health-care and social care costs and effects (12-month ABC-I total score):
cost-effectiveness plane – SIT vs. usual care (NHS/PSS perspective).
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
87
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
HEALTH ECONOMICS
9000
7000
5000
Incremental cost (£)
3000
1000
–1000
–3000
–5000
–10 –5 0 5 10
Incremental ABC-I score
FIGURE 19 Bootstrapped mean differences in societal costs and effects (ABC-I total score: 12-month complete-case
analysis): cost-effectiveness plane – SIT vs. usual care (NHS/PSS perspective).
Cost-effectiveness acceptability curves for the 12-month follow-up showed similar results to the
6-month follow-up (Figures 20 and 21). The probability that SIT is cost-effective from the NHS/PSS
perspective was < 10% (see Figure 20). From the wider societal perspective, the probability that SIT is
cost-effective was just over 30% for a willingness-to-pay threshold of £500 (see Figure 21).
Impact of COVID-19
Follow-up resource use measures were collected via telephone, post and online. We expected minimal
impact of COVID-19 on the proportion of participants providing information on resource use data and
no meaningful difference between arms. However, we saw a reduction in overall service use owing to
limited access. To explore potential impact on results, an intention-to-treat analysis was conducted
1.0
0.9
Probability that SIT is cost-effective
0.8
0.7
0.6
0.5
0.4
0.3
0.2
0.1
0.0
0 100 200 300 400 500 600 700 800 900 1000
Willingness-to-pay threshold (£)
88
1.0
0.9
(with missing data imputed assumed missing at random). We used multiple imputation using chained
equations, fitting five imputations,109 assuming a predictive mean matching model with baseline ABC-I
scores, baseline total cost, severity of SPDs, region and sex of child. We then performed a parametric
bootstrap with the multiple imputed data set to obtain bias-corrected estimates of incremental cost
and effect. The results did not alter conclusions drawn from the main analysis (Table 38). Total health
and social care costs from an NHS/PSS perspective for 6 and 12 months were higher for SIT than for
usual care. The adjusted mean differences between SIT and usual care for 6- and 12-month follow-up
were statistically significant at 1317.2 (95% CI 1116.5 to 1517.9) and 2149.5 (95% CI 1807.8 to 2491.3),
Study arm
SIT (n = 69), Usual care (n = 69), Unadjusted mean difference Adjusted mean difference
Variable mean (SD) mean (SD) (95% CI) (95% CI)a,b
6 months
Total health- 1919.18 (66.03) 563.03 (112.78) 1356.15 (1087.58 to 1624.72) 1317.2 (1116.5 to 1517.9)
care and social
care cost (£)
Total societal 6799.9 (469.76) 5691.87 (839.09) 1108.1 (–836.03 to 3052.2) 1016.2 (–776.33 to 2808.8)
cost (£)
Outcome: 18.29 (1.12) 18.47 (1.47) –0.18 (–3.94 to 3.59) –0.38 (–3.59 to 3.52)
ABC-I
12 months
Total health- 2111.3 (146.63) 245.49 (80.90) 1865.8 (1519.5 to 2212.1) 2149.5 (1807.8 to 2491.3)
care and social
care cost (£)
Total societal 6585.3 (706.44) 4906.2 (991.4) 1679.1 (–1399.5 to 4757.7) 1844.7 (–73.63 to 3763.0)
cost (£)
Outcome: 17.73 (1.36) 19.44 (1.51) –1.70 (–6.08 to 2.68) –1.64 (–4.14 to 0.85)
ABC-I
a Bias-corrected 95% CIs.
b Adjusted for baseline ABC-I, recruitment region, severity of SPDs and sex of child.
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
89
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
HEALTH ECONOMICS
respectively. From a societal perspective, the adjusted mean difference between arms at 6 and 12 months
suggests that SIT was more costly than usual care; however, the mean difference was not statistically
significant (see Table 38). ICERs generated from an NHS/PSS perspective are shown in Table 39.
Statistical uncertainty around the ICER was explored for imputed data using CEACs (Figures 22–25).
Using a monetary threshold of £500, the probability that SIT is cost-effective, from the NHS/PSS
perspective at 6-month follow-up, was just over 0.2% and increased to just over 30% for a willingness-
to-pay threshold of £1000 (see Figure 22). From a wider societal perspective, the probability that the
intervention is cost-effective was just over 20% (see Figure 23). CEACs for the 12-month follow-up
concur with the conclusion that SIT has a low probability of cost-effectiveness from both the NHS/PSS
and the societal perspectives (see Figures 24 and 25).
Summary
Delivery of SIT incurred significant additional costs. When intervention costs were not included in total
NHS/PSS costs, NHS/PSS costs of care for usual care-only participants were significantly higher than
for SIT participants. The mean difference in ABC-I scores between arms did not achieve statistical
significance at 6 or 12 months, suggesting no additional clinical benefit of SIT. Economic evidence
suggests that SIT has a low probability of being a cost-effective option compared with usual care.
1.0
0.9
Probability that SIT is cost-effective
0.8
0.7
0.6
0.5
0.4
0.3
0.2
0.1
0.0
0 100 200 300 400 500 600 700 800 900 1000
Willingness-to-pay threshold (£)
FIGURE 22 Imputed data set: NHS/PSS perspective (6-month ABC-I scores) – CEAC.
90
1.0
0.9
FIGURE 23 Imputed data set: societal perspective (6-month ABC-I scores) – CEAC.
1.0
0.9
Probability that SIT is cost-effective
0.8
0.7
0.6
0.5
0.4
0.3
0.2
0.1
0.0
0 100 200 300 400 500 600 700 800 900 1000
Willingness-to-pay threshold (£)
FIGURE 24 Imputed data set: NHS/PSS perspective (12-month ABC-I scores) – CEAC.
1.0
0.9
Probability that SIT is cost-effective
0.8
0.7
0.6
0.5
0.4
0.3
0.2
0.1
0.0
0 100 200 300 400 500 600 700 800 900 1000
Willingness-to-pay threshold (£)
FIGURE 25 Imputed data set: societal perspective (12-month ABC-I scores) – CEAC.
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
91
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
DOI: 10.3310/TQGE0020 Health Technology Assessment 2022 Vol. 26 No. 29
These process evaluation components also formed part of the internal pilot (see Chapter 4). In addition,
the process evaluation sought to explore contextual factors that might have an effect on the outcome
of the intervention.
Research design
The process evaluation employed a mixed-methods approach. Quantitative methods were used to assess
recruitment rates/patterns, attendance and intervention fidelity. Qualitative interviews with therapists
involved in intervention delivery and carers of children enrolled in the trial examined experiences of the
trial recruitment process, the acceptability of trial processes and measures, intervention implementation
and acceptability, and the role of contextual factors. Methods for collecting data as part of the process
evaluation are described in the following sections. Table 40 summarises each set of data collected, the
method of data collection and the objectives addressed.
The number of people eligible (expressed as the proportion of those approached) and randomised
(expressed as the proportion of those eligible) were utilised within the process evaluation.
Sixteen therapists were recruited to deliver the intervention across eight sites/clinics.
Retention
The clinical database was used to capture retention data, that is the number of people with missing
outcome data at 6 and 12 months post randomisation (as a proportion of those who had been
randomised and reached the time point).
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
93
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
94
NIHR Journals Library www.journalslibrary.nihr.ac.uk
l the level of therapist training/qualifications, that is the occupational therapist providing the
intervention is certified in sensory integration/SIPT (with a minimum of 50 education hours in
sensory integration theory and practice)
l supervision, that is the therapist has a history of mentorship, with an equivalent of 1 hour per
month from an advanced therapist with 5 years’ experience of providing OT using ASI intervention
for a period of 1 year
l a score of 85 out of 110 across the following four areas – (1) safety of the environment; (2) detail
and content of therapist-held records, including therapist–carer collaboration in relation to goals
set during therapy; (3) physical space and equipment; and (4) communication with carers.
Process fidelity determines whether or not the therapist ensures physical safety; provides sensory
opportunities; helps the child to maintain an appropriate level of alertness; challenges postural, ocular,
oral or bilateral motor control; challenges praxis and behavioural organisation; collaborated in activity
choice; tailors activity to provide appropriate challenge; ensures that activities were successful; supports
intrinsic motivation to play; and establishes therapeutic alliance. This produces a process fidelity total
score out of 100. Each rating reflects the rater’s global impression of whether or not a particular
therapeutic strategy is an intentional part of the therapy being delivered within the observed sample
of SIT. Therapist mentors considered initial assessment, goal-setting and delivery of the intervention
for each therapist by reviewing and providing feedback on the first two video-recorded face-to-face
sessions delivered to any participant.
Where consent was provided, face-to-face sessions were video-recorded. A sample of recorded sessions
in the intensive phase were rated for process fidelity by at least one independent SIT-trained therapist
(based on a randomly selected sample of the full session, of a minimum of 15–20 minutes in duration).
To minimise bias through selecting ‘good’ sessions, the choice of which sessions to rate was made at
random. To ensure that participants had both earlier and later sessions rated, the first session to be rated
was randomly selected between session 6 and 12, and the second session was randomly selected between
session 13 and 20. In the event that a session allocated for fidelity rating was not available (e.g. owing
to the participant not attending), the next available session was rated. To ensure consistency of ratings,
a selection of sessions were rated by multiple independent SIT-trained therapists. Demonstration of
adequate fidelity of intervention delivery was defined as scoring ≥ 80 on the fidelity measure across at
least 80% of sessions sampled.
Adherence
This was the level of intervention received by participants allocated to the intervention arm. An ‘effective’
dose for SIT has yet to be definitively established. However, attending 13 of a possible 20 sessions
(i.e. two-thirds) delivered during the intensive intervention phase was felt likely to indicate sufficient
exposure (based on clinical experience and available literature).
Adverse effects
Serious adverse events were reported from the time of signature of informed consent, throughout the
treatment period up to, and including, 1 month after the participant received the intervention. A SAE is
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
95
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
PROCESS EVALUATION: RECRUITMENT, RETENTION, FIDELITY AND SAFETY
defined as any untoward medical occurrence in a participant who receives an intervention that was not
necessarily caused by, or related to, that intervention (i.e. an AE) and that:
l results in death
l is life-threatening (as defined by GCP)
l requires hospitalisation or prolongation of existing hospitalisation (as defined by GCP)
l results in persistent or significant disability or incapacity
l consists of a congenital anomaly or birth defect
l is a medically important condition (as defined by GCP).
Adverse events that did not meet the criteria of serious were not systematically recorded and none
was reported within the qualitative interviews.
Contamination
The potential for contamination, that is if participants recruited to the control arm received or sought
therapy consistent with SIT or received enhanced/additional support from clinicians aware of their
participation in the trial, is acknowledged. Therefore, there was an examination as to whether or not
the usual care received differed in any way from the expected provision mapped out as a result of the
scoping focus groups (see Chapter 2).
Semistructured interviews were conducted with 30 carers of children and 13 therapists involved in
intervention delivery (see Chapter 9 for full details of qualitative data collection methods). Carers were
purposively sampled to ensure representation of intervention and usual care-only participants, trial region
and a mix of child sex and age. All therapists involved in the trial were invited to take part in an interview.
Data analysis
Quantitative analysis
The approach taken to analyse quantitative data was described in a trial statistical analysis plan.
Recruitment, retention, adherence and safety data are descriptive, and categorical data are presented
using counts and percentages. Process fidelity ratings were completed in accordance with the categories
described in the fidelity tool.23 After viewing a short section of video from a session, raters gave a general
impression of the intervention delivered by responding with ‘yes’ or ‘no’ to the statement ‘This intervention
session is provided by a qualified therapist intentionally applying ASI intervention theory and methods’.
Raters then scored each of the 10 process fidelity items according to whether or not the therapist
demonstrated each item as a key therapeutic strategy in the session. Scores were from 1 to 4, representing:
Scores were then calculated to give a total score (Table 41). If the general impression was that the
session was delivered in accordance with ASI, then the expected total score would be ≥ 80%.
Qualitative analysis
Interviews were audio-recorded, transcribed verbatim and anonymised. Interview transcripts were
analysed thematically using a framework approach.66 Two thematic frameworks were created (one for
carer interviews and one for therapist interviews), drawing from the aims of the process evaluation
96
and a review of transcripts. Data from carer and therapist interviews were coded separately in NVivo
version 12 (QSR International, Warrington, UK). Thematic frameworks were discussed reflectively by
the trial qualitative researchers, and a sample of interviews double coded. For the process evaluation,
the viewpoints of carers and therapists have been collated and presented thematically (see Chapter 9
for full details of qualitative data analysis procedures).
Results
Screening appointments were held with 150 carers and children. Three children (2%) were screened as
ineligible after not meeting inclusion criteria (other than SPD). Nine children did not progress for the
following reasons:
l no further response (n = 4)
l not interested in participating (n = 1)
l eligible and consented but then withdrew immediately (n = 4).
A total of 138 children were randomised into the trial (i.e. 92% of those screened and 53.5% of those
who expressed an interest in taking part).
Participants were probably representative of the wider population of children in primary education
with a diagnosis of autism presenting to services. The majority of participants were male (79%) and
white British (88%) (see Chapter 6 for a description of baseline characteristics).
Recruitment of therapists to deliver the intervention occurred in stages as new health boards and clinic
sites were opened. From August 2017, just one therapist was delivering the intervention to participants
in South Wales (at a clinic in Cardiff University). By November 2017, a further five therapists across three
South Wales university health boards (i.e. Hywel Dda University Health Board, Aneurin Bevan University
Health Board and Cardiff and Vale University Health Board) started delivering the intervention. One
occupational therapist was available to start in Cwm Taf University Health Board in February 2018,
with another occupational therapist starting in May that year. A therapist at a private clinic in Cornwall
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
97
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
PROCESS EVALUATION: RECRUITMENT, RETENTION, FIDELITY AND SAFETY
started delivering the intervention in May 2018, with another therapist starting at the same clinic in
July 2018. Given that each therapist could deliver the intervention to only one or two children at a time
(given their NHS obligations), extra sites and therapists were recruited. In May 2019, a further therapist
was recruited in Swansea Bay University Health Board, another therapist in Aneurin Bevan University
Health Board and four were recruited at the Pace School in Buckinghamshire. Therapists’ capacity to
see multiple children simultaneously depended on their working hours, leave and other commitments.
Therapists were not directly involved in trial recruitment but did refer potential participants to
the trial team. Some therapists reported that they had difficulty identifying potentially eligible and
willing children to take part, despite some being involved in publicising the trial through schools or
presentations to professionals. One therapist thought that the trial criteria were too strict, particularly
relating to age, as children either side of the age range may have benefited from the intervention.
Carers were asked during interviews where they had heard about the trial. A variety of sources was
reported (Figure 26), most commonly via professional recommendation (note that one carer did not
provide this information).
The main reasons that carers gave for taking part in the trial were that they hoped that their child
would receive the intervention and that they wanted to improve support for children with autism and
SPDs in the future. Some parents specifically wanted to pursue SIT for their child (having heard about
it on courses, through their own research or via recommendations from friends), as they thought that
it would be beneficial. It was often mentioned that carers and their child had received little or no
support and, therefore, carers were happy to try anything that might help (carer interviews):
When we went in to [the trial it was] sort of like, not . . . a last resort, but like oh my God, something
has got to help . . . I just think it’s really sad that there’s just nothing out there . . . and . . . maybe, maybe
you know, in years to come, maybe this might be something that benefits everybody. So although it’s
benefitting you, you’re also helping to benefit others.
P219, intervention arm
Recommended by professional
Child’s school
Autism show
Recommended by friend
0 2 4 6 8 10 12
Number of carers
98
Most carers said that they had no concerns about their child taking part in the trial, although several
worried that their child might be allocated to the control arm, meaning that they would not get the
help that they needed. One carer was concerned that the intervention may not benefit their child, that
is they would have ‘put him through’ appointments for nothing. Another carer was worried in case
they were not allowed to stay with their child during appointments. One carer was concerned about
anonymity owing to their profession, but was reassured when they were told that data would be
labelled with participant numbers rather than names. Therapists did not report any concerns being
expressed directly to them by carers.
Retention
Participant retention
The primary outcome time point was 6 months post randomisation, and these visits were all completed
by 7 May 2020. Of 138 participants, 107 (77.5%) provided follow-up data at this time point. Twenty-nine
participants were lost to follow-up and there were two withdrawals. Twelve-month follow-ups were
completed on 17 December 2020. Of 138 participants, 96 (69.6%) provided data at this time point.
Forty participants were lost to follow-up and there were no additional withdrawals.
Therapist retention
Of the 16 therapists delivering intervention, two were able to see only one child each before having to
withdraw their involvement in the trial for personal reasons.
Structural fidelity
Structural fidelity includes the level of therapist training/qualifications and supervision, coupled with
achieving a score of 85 out of 110 across four areas (see Other areas).
Supervision
In the UK, there is no established SIT mentoring system. Therapists typically received mentoring of
at least four sessions for completion of their postgraduate modules, followed by monthly mentoring
sessions with an experienced occupational therapist. Therefore, we compensated by ensuring that
mentoring occurred throughout their intervention sessions.
Other areas
Other areas included:
Some clinics required additional equipment to be purchased to meet fidelity; however, all clinics met
structural fidelity criteria prior to initiating therapy (all scores were > 85, with a range from 96 to 110).
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
99
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
PROCESS EVALUATION: RECRUITMENT, RETENTION, FIDELITY AND SAFETY
Multiple ratings
Four independent raters scored process fidelity for 96 sessions. All raters scored the same 17 sessions
(17.7% where target had been between 15% and 20%) to assess the comparability of their ratings and
were then allocated more sessions on an individual basis. The majority of sessions were scored by one
rater (Table 42). Averages were taken where sessions were rated by more than one rater and,
therefore, had multiple scores.
Fidelity threshold
The SIT delivered in the SenITA trial met fidelity, with 10 out of 12 therapists scoring, on average, at
least 80 out of 100 on the process fidelity measure for at least 80% of each of their sessions. Two
therapists (i.e. therapists 7 and 8) scored below this threshold (Tables 43 and 44). Rater 2 consistently
scored both therapists lower than other raters for these sessions, which skewed the average. Both
therapists had mentors to support them further and improved in delivering the intervention. It was
noted that, although their clinic space met structural fidelity, it was also one that had limited flexibility.
1 73 76
2 2 2
3 4 4
4 17 18
402 6 49.25 79 1 20 0 55 ? 43 0
402 7 76.0 76 1
402 13 85 85 1
408 12 91 91 1
408 17 94 94 1
414 11 71.0 71 0
414 13 86 86 1
GIS, Global Impression Score; PID, participant identification number.
Note
? denotes score not provided by rater.
100
403 7 95.5 97 ? 94 1
411 6 64.0 64 0
411 19 53.0 53 0
GIS, Global Impression Score; PID, participant identification number.
Note
? denotes score not provided by rater.
Acceptability
Oh definitely yeah, definitely. Without a shadow of a doubt, like I’d love to take part again, I know I can’t
. . . honestly definitely it was totally worth it, I’d recommend it 100%.
P304, intervention arm
Carers reported that members of the trial team who they encountered were friendly and understanding.
Carers felt that the trial was explained very well and did not feel pressured to take part. The reminder text
messages were useful and trial appointments were flexible. Some carers explained that just being selected
to take part in the trial was positive, as they felt that their child’s difficulties had been acknowledged:
It’s been really good and [all the trial team have] been really kind and really understanding and really patient.
P514, intervention arm
However, some carers reported a lack of communication from the trial team. For example, one carer
in the control arm reported that they had not been told which group their child was in and did not
realise that their involvement in the trial had started until they got a reminder 4–5 months later to
fill in the diary. Another carer had been allocated to the intervention arm, but their child had received
no therapy after 6 months and they had not been told when it was going to start.
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
101
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
PROCESS EVALUATION: RECRUITMENT, RETENTION, FIDELITY AND SAFETY
Trial information
Carers felt that they were given the right information about the trial before taking part and had
the opportunity to ask questions. Some carers commented that there was plenty of information
provided and, therefore, they knew exactly what would happen and what would be expected of them.
Information was easily understood and well explained by trial staff. One carer felt that they had been
given too much information, but another carer said that the information did not fully explain what
would happen in the intervention sessions. Two carers had not immediately realised that they had
been allocated to usual care, which caused some confusion. One carer appreciated that plenty of time
was given to decide whether or not to participate and that consent was checked at several stages:
It’s been brilliant . . . I felt like I was always kept informed and really sort of, felt very much as though it
was my choice, like I was never sort of bullied into it, like you’ve been offered this, it’s a golden opportunity,
you should do it. It was never felt like that, it always felt like you know, you can stop this at any time . . .
So I felt like the overall explanation of it and what was going to be involved, was explained really well.
P514, intervention arm
Most carers said that taking part in the trial had met expectations or (for those in the intervention arm)
had been better than expected. The time commitment was mostly as anticipated. Two carers said that the
trial had taken more of their time than they expected in terms of travelling to appointment sessions.
Trial appointments
Convenient and flexible appointment times were offered when possible. Some carers in the intervention
arm mentioned having difficulty because all sessions were during school/working hours. In some cases,
schools were happy for children to attend intervention sessions during school time, as they felt that it
would benefit the child; however, other schools were less supportive. For example, one carer reported
that their child’s school felt that the intervention was responsible for a deterioration in behaviour and,
therefore, they had experienced issues with requesting time off school for trial appointments.
Although sessions were held in a convenient location for some carers, others found the trial to be a
big commitment that was difficult to fit into their lives, mostly owing to travelling times. However, all
carers were committed to attending appointments, as they felt that they were beneficial. Several
parents mentioned parking issues at appointments. One parent said that they had been given no
consistent time and date for sessions, and sometimes could not contact the therapist and, therefore,
had been unsure of what was happening:
It’s an hour and a half to the session . . . an hour and a half home, and that was twice a week. So it was
a big financial investment to, you know, fund the fuel alone, and then with my time . . . It was a massive
investment in family life . . . I would pick him up at 12 o’clock on the dot. He’d have lunch in the car,
and we’d just about get to [the session] for 1.30.
P112, intervention arm
Assessments
Two carers commented that assessments were a positive experience, as they were play based and the
assessor had a good rapport with their child. One carer found that their child had already completed
one of the tests and had remembered the answers, and so the results may not have accurately reflected
his ability. One carer said that it would have been helpful to have been given a report of the test results,
as this would have been useful for other professionals working with their child.
Several therapists found the SIPT demanding and difficult to conduct because of the length of the
assessment and the avoidance behaviours displayed by children, which mean that it was not always fully
achieved. One therapist was able to conduct the assessment jointly with a colleague, which was helpful.
102
Another therapist had to ask carers to help. Several therapists conducted the assessment over two or
more sessions, as they felt that it was too long for children to complete in one sitting. The following
specific problems were reported by individual therapists:
l Conducting the assessment at the end of the intervention was problematic, as children were
disappointed that they would not be having a therapy session, particularly where the assessment
was being conducted in the therapy room.
l Starting with a standardised assessment before building rapport with the child and parents
was unhelpful.
l Some children would not engage with the copying exercises, as they had been told at school that
it was wrong to copy and took this very literally and, therefore, the assessment may not have
accurately reflected their ability.
Despite these issues, one therapist reported that assessments provided a useful starting point for
planning the intervention.
Questionnaires
Carers found the questionnaires long, but relatively easy to complete. When carers did not understand
how to interpret some of the questions, trial staff provided an explanation. Carers commented that a
lot of questions seemed repetitive, with the same topic revisited several times with slightly different
wording. Some questions were not appropriate for the age of the child, for example asking whether or
not a 7-year-old took drugs. One carer found questions intrusive, for example those asking about their
own personal relationships and mental health.
Some carers found the questionnaires and assessments useful, as they highlighted their child’s needs.
Conversely, several carers found the questionnaires and assessments upsetting to complete, as they
focused on all the things their child could not do:
It was . . . really long winded . . . mentally and physically exhausting . . . It’s like when you go and do a
[Disability Living Allowance] application . . . you’ve got to take your child at their worst ever possible day
and write it down . . . you want to spend your life . . . focusing on what your child can [do], despite their
difficulties, not what they can’t do, and I think it is a bit depressing like that.
P609, intervention arm
Trial diary
Completing the trial diary was problematic for most carers. Some carers had difficulties logging on
to fill in the diary online and, therefore, did not fully complete it. Other carers forgot to complete it
regularly or did not have time to do so, and one carer commented that they did not seem to be able
to go back to fill in previous weeks that they had missed. Several carers did not realise that they
had to complete a diary. Some carers in the control arm felt that there was little incentive for diary
completion, particularly where their child had received few appointments and, therefore, there was
not much to fill in. Only a minority of carers completed the diary online with no issues.
Carers reported that it was useful having text reminders to complete the diary and found it much
easier replying to the texts than completing the diary. One carer suggested that it would have been
better if the information could all have been provided via text.
Data input
Therapists found filling in information after each session repetitive and ‘laborious’. One carer felt that
it was a ‘tick-box exercise’ that was not helpful with planning future sessions, although others found it
useful. Two therapists were not sure what to report under the different reflective headings and would
have found it helpful to have more guidance.
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
103
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
PROCESS EVALUATION: RECRUITMENT, RETENTION, FIDELITY AND SAFETY
Randomisation
Most carers had a good understanding of the purpose of randomisation. One carer had not initially
realised that there would be two groups of children and thought that all would receive the intervention.
Although all parents hoped that their child would be in the intervention arm, they appreciated the need
for randomisation. Those carers allocated to the control arm were disappointed, but happy to continue
their involvement in the trial. One carer suggested that the intervention could have been offered to
usual-care children after the trial had been completed so that all children would have had the chance
to benefit from it.
l The camera had limited memory and could store only 60 minutes of footage and, therefore,
videos often needed to be transferred onto the iPad, which was problematic. The 60-minute limit
meant that conversations after the session with carers (which would have been useful to capture)
were missed.
l The camera battery sometimes ran out during the sessions.
l Some mentors had difficulty accessing the session videos.
l There was no internet at one clinic and so information could not be input or accessed directly,
and data had to be uploaded offsite.
l The connection between the camera and the iPad sometimes did not work.
l Some iPads and cameras were shared between therapists, which caused difficulties with planning.
l The internet connection at one clinic was unreliable and uploads had to be repeated.
One therapist identified that recording the sessions using a static camera on a tripod meant that,
unless they had an assistant to move the camera around, parts of the sessions were not necessarily
visible on the recording. Several therapists reported that they needed an extra person to manage the
recording of sessions.
Intervention delivery
The OT [occupational therapist] was absolutely amazing. Like if I needed any advice on anything I could
do with the certain situations, she gave me a solution. Again she suggested books and different activities
I could do and that as well.
P109, intervention arm
104
Therapists were very engaging and positive, and the equipment was varied; therefore, children enjoyed
the intervention and were keen to go to the sessions. Carers were particularly positive about their
child being able to have direct one-to-one therapy, which they felt had been lacking in usual care.
Carers commented that this approach meant that their children fully engaged with the activities:
I didn’t expect to get so much out of it . . . or for [child] to enjoy it . . . I could hear from that room, sitting
outside and she was laughing, and it was an actual, it wasn’t a put-on laugh that she does sometimes.
So that was really nice just to hear her enjoying herself really, she was just so relaxed and comfortable,
it was lovely.
P309, intervention arm
One carer appreciated that the therapist spent time at the end of each session to ensure that their
child was calm when they left. One carer was pleased that their child had a certificate at the end of the
sessions, as he had never received one before and so it meant a lot to him.
Therapists enjoyed being able to spend longer with one child than would be possible in usual care.
This longer time enabled therapists to build a good relationship with children and carers. Most therapists
appreciated the opportunity to provide SIT, as it was rewarding to be able to deliver sessions that children
really enjoyed and engaged with. Several therapists mentioned that it was positive being able to provide a
therapy that was child led:
It’s wonderful to be able to . . . really get to know the child and the parents really, really well . . .
as part of my NHS [work], you’d be lucky if you saw a child once a week for a few weeks at a time.
T203
I think the fact that it’s child led makes it accessible, makes it engaging.
T206
Thinking on your feet constantly . . . you’d have to think in terms of what, what equipment you can maybe
adapt or change to make sure it’s just the right challenge so then they would achieve success in order for
them to be motivated in your session . . . You’re constantly thinking about that. You’re constantly analysing.
You’re constantly thinking ahead . . . it’s multitasking really.
T202
Some therapists found that they had insufficient time to engage with carers (e.g. some carers needed
help to learn how to play with their child, and others needed support themselves or the chance to
discuss issues arising). Therapists reported that in usual care they would typically have more time to
talk to carers and were also able to go into the child’s school.
Some therapists identified that using a pure sensory integration approach was restrictive, as they felt
that some goals could have been achieved more quickly via other more task-specific approaches.
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
105
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
PROCESS EVALUATION: RECRUITMENT, RETENTION, FIDELITY AND SAFETY
l a written report at the end of the intervention to pass onto their child’s school
l information on where to buy sensory equipment
l more suggestions of activities to do at home to help sustain their child’s progress
l more time after the sessions ended to be able to contact the therapist so that they could ask for
advice if things started to go wrong
l more clarity of what to focus on at home each week.
Therapists suggested that more time to engage with carers or being able to visit the child’s school
would have been helpful:
I think one of the things that . . . was tricky, because it didn’t feel like the circle had been closed really,
was not being able to go into schools. I know we could speak to schools over the phone, but I think
actually having someone from the school . . . coming on some of the sessions, or me to visit the school
[would be useful] . . . because some of the issues were with school.
T210
Length of intervention
Around half of therapists felt that the intervention was too long in terms of number of sessions,
as therapists struggled to come up with new ideas to fill all sessions and some children (particularly
those who were more able) made no more progress in the last few sessions. Other therapists felt that
it was the right number of sessions or that some children would have benefited from further sessions.
Some carers also felt that it would have been helpful if sessions had carried on for longer. For example,
one carer said that they were still seeing improvements when sessions finished and several carers
found that changes were not sustained once the intervention had been completed:
For me, as a therapist, it can feel like you’re . . . treading water for those last four sessions in a way.
But [with some children] I feel like they’re still making changes.
T211
Some therapists felt that having sessions twice per week was helpful in terms of consistency and
building rapport and enabled changes to be made more quickly. However, one therapist suggested
that this was too intense. Some therapists found that the transition to less-intensive sessions worked
well where children were ready for it, and that it was helpful in providing a more gradual end to the
intervention. However, other therapists found that it disrupted the flow and consistency of sessions
and was a big change that could have been more gradual. Several carers agreed that the ending of
regular sessions was too abrupt (e.g. going from two sessions per week to once per fortnight) and
difficult for their child to cope with. One carer suggested that sessions could have been tapered down
more gradually towards the end.
Most carers felt that they started to see changes in their child about halfway through the intervention
sessions. Other carers said that they felt that there was a more gradual change throughout the intervention.
Therapists agreed that changes seemed to occur around the halfway point.
106
anticipated, which made their workload difficult to manage. Some therapists had had to work unpaid
and one therapist found it stressful negotiating their time with their manager and the trial team.
For example, the technical aspects (e.g. recording and uploading the sessions) took up a lot of time,
sessions were time-consuming to plan and set up, and there was also administrative work, such as
booking appointments and inputting data, which some felt had not been fully accounted for. There
was also no time allocated for discussions with carers, which therapists felt would have been helpful.
Some therapists found that assessments took longer than allocated. This all meant that some therapists
had to complete trial-related work in their own time:
It was really difficult to manage kind of doing clinical research within the demands of . . . my NHS day
job . . . that was probably one of the hardest things I would say, being able to manage the time that the
study required, which was way above what I guess was ever anticipated or described to us.
T205
Goal-setting
Most carers found goal-setting straightforward, although some carers reported that, as there were
multiple issues that they wanted to tackle, it was difficult to prioritise which to focus on. One carer
found setting realistic goals difficult, as they were not sure how much their child would be able to
achieve in 6 months. Another carer pointed out that, as they had become so used to their child’s
difficulties in everyday life, it was difficult to identify what they needed to work on. Some children
were able to set realistic goals for themselves; however, one child wanted to set goals based on what
his peers were able to do, which he would have found difficult to achieve.
Therapists reported that carers needed prompting to set more specific goals that were functional,
measurable and realistic, as they tended to come up with general objectives, such as wanting their child
to be less aggressive. Children were mostly not able to be involved in goal-setting and, therefore, some
therapists did this over the telephone with carers. In some cases, goals set by carers did not necessarily
relate to what their child wanted to achieve. Some carers needed prompting to think of goals, and
therapists reported that the COPM was useful in helping them think through their child’s difficulties.
Most therapists felt that if there were sufficient resources, SIT (at the intensity offered during the trial)
should be available as usual care for children where appropriate. Therapists saw that SIT made a big
difference to some children and enjoyed being able to deliver one-to-one therapy tailored to the child:
[SIT is] really much more targeted and . . . it really felt as though we were getting to the bottom of and
really kind of problem-solving these . . . difficulties . . . with the child and with the family . . . I didn’t feel
as though these children are going to need much more beyond this, whereas the usual care feels like,
you kind of wonder when they’ll be back.
T210
However, some therapists felt that a sensory integration approach alongside other approaches would
be more helpful in achieving children’s goals:
I think that sensory integration therapy is just a tool in the occupational therapy toolbox . . .
I don’t think it’s the first port of call.
T212
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
107
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
PROCESS EVALUATION: RECRUITMENT, RETENTION, FIDELITY AND SAFETY
If the intervention were to be adopted as usual care, therapists identified that considerably greater
resources would be needed in terms of room capacity and funding for increased staff time and
specialist training. Therapists suggested that research demonstrating the effectiveness of SIT would
be needed to convince managers and funders that it should be implemented more widely. Therapists
anticipated that waiting lists for therapy would increase because there would be great demand for it.
Adherence
Overall, 54 (78.3%) participants allocated to the intervention arm received at least 13 SIT sessions
during the intensive stage. The median number of SIT sessions received was 20 (IQR 16–21). A full
breakdown can be found in Chapter 6.
Adverse events
There were no SAEs during the trial. One AE was reported to the trial team by a therapist as a SAE;
however, it was clear this did not meet the criteria of ‘serious’ as laid out in the reporting guidance.
Contamination
Contextual factors
Therapists appreciated having a variety of equipment to work with, which was helpful for intervention
delivery, as sessions could be adapted to challenge each child. However, sessions were time-consuming
to plan because they were tailored to individual children and intervention sessions took longer to set
up than usual-care sessions (typically 15–30 minutes to set up, with the same time required to put
the equipment away). Some therapists had a dedicated therapy room that was partially set up, which
enabled them to prepare for sessions more quickly, as only minor changes had to be made. However,
other therapists had to set the room up from scratch each time, which was physically challenging, for
108
example setting up heavy suspended equipment. Those therapists who had a technician to help them
set up said that this was extremely helpful and, in some cases, necessary:
[You need] time . . . as well to think . . . what am I hoping to achieve in this session and how am I going to
set the room up to achieve what I want to, so it’s all that mental thinking that you’re doing as well as just
putting the equipment up.
T203
Changeovers could also be problematic, for example the room had to be cleaned between sessions if
therapists used messy play.
She just loved all of it . . . because I think [the therapist] just worked really hard to get that, like that
connection with her.
P219, intervention arm
Therapists agreed that being able to see one child over a number of sessions enabled them to build
a good rapport. The fact that the intervention was enjoyable for children also helped with their
therapeutic relationship:
It’s a therapy that I feel is great because the kids love to engage in it and feel empowered by it . . .
when you’ve built up those relationships you get that ability to be able to push them a little bit, to
challenge . . . their sensory systems that particularly need to be challenged . . . if you’ve got the child on
your side then it feels like you can actually work with them and challenge them and move them forward.
T206
In general, therapists found that intervention training was sufficient. The session to observe therapy
and assess whether or not it met the fidelity measures was described by one therapist as particularly
useful. Some therapists already delivered SIT as part of their usual practice and it was felt that those
therapists who had not may have struggled. Some therapists felt that they were relative ‘novices’ in
delivering SIT and one therapist reported feeling out of their depth and lacking knowledge for the
more analytical aspects.
Mentorship was described as very helpful, with mentors providing advice and guidance to help with
the planning of future sessions, including discussing specific issues experienced. However, one therapist
did not receive mentorship and several therapists started mentorship sessions later than intended, for
example not until after they had seen their first child as part of the trial. Some therapists experienced
technical difficulties sharing session videos with their mentor. One therapist had useful support from
a colleague who was experienced in SIT and another therapist said that it would have been useful if
colleagues were delivering the therapy at the same time so that they could have discussed ideas.
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
109
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
PROCESS EVALUATION: RECRUITMENT, RETENTION, FIDELITY AND SAFETY
Not all therapists used the trial Facebook group, some because they were not confident in using IT
and others because they were not aware that there was one. For those therapists who did use it, they
reported that the group was not very active. Therapists suggested that it would have been helpful to
have group discussions with peers also delivering the intervention.
Conclusions
The process evaluation demonstrated that recruitment of participants and therapists and delivery of
intervention all met required thresholds. Recruited participants were also probably representative of
the population with autism presenting to services. Findings were consistent with those from the internal
pilot in that recruitment criteria were met and there was little difficulty in generating expressions of
interest. Participant recruitment into the study was, in part, tempered by therapist availability. Retention
of participants was good, as was retention of therapists, although practicalities of juggling NHS caseloads
with the trial meant that the overall trial recruitment period and, therefore, delivery of intervention was
longer than initially anticipated.
Data show that structural and process fidelity were high. In cases where process fidelity was lower
than anticipated, therapists were given extra support through mentoring. In these cases, it is possible
that some fidelity elements may not have been present in the video clip selected or reflected poor
agreement among raters.
Carers generally found trial processes acceptable and enjoyed being part of the trial. However, there
were areas where adaptations could be made. Both therapists and carers reported that entering data
online was not particularly easy. In the case of reporting diary data, carers generally struggled with this
and often forgot or had difficulty using the online system. In their normal practice, therapists were
used to taking hard-copy notes and, therefore, found an online system difficult to use during sessions.
Therapists felt that there were numerous technical processes involved as part of their role in collecting
data (e.g. setting up cameras, uploading data and finding WiFi), which added to their burden. However,
therapists generally felt well supported by the trial team who were able to resolve queries in real time.
Overall, adherence to the intervention was high, although, on a practical level, carers sometimes found
it difficult to fit the intensive phase of the intervention in with other events in their personal lives
(e.g. school, holidays and leave from work). The intervention was safe, with no SAEs reported. There
was minimal contamination in the control arm and families allocated to SIT did not report receipt of
any other significant intervention or contact with services.
110
Methods
Overview
Semistructured interviews were carried out with a sample of carers and therapists who delivered
the SIT intervention. Before taking part in an interview, carer participants were asked to complete a
timeline of the support that they and their child had received, which was used to facilitate discussion
of their experiences. The aims of the qualitative study were to explore the (1) support experiences of
families (outside the SenITA trial, i.e. usual care) and (2) perceived impact and clinical effectiveness
of the SIT intervention for children with autism and SPDs.
Participants
Interviews were conducted with 13 occupational therapists who delivered the SIT intervention and
carers of 30 children enrolled in the SenITA trial (Table 45).
Characteristic n
Sex of child
Male 23
Female 7
5–6 6
7–8 9
9–10 8
11 7
Child ethnicity
White British 23
White other 2
Not disclosed 3
Trial arm
Intervention 20
Control 10
Trial region
Wales 20
Cornwall 6
North Buckinghamshire 4
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
111
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
EXPERIENCES OF USUAL CARE AND OF THE INTERVENTION
Carers were invited to take part in an interview once their child had reached the 6-month follow-up
point of the SenITA trial. A qualitative researcher contacted carers by telephone or e-mail (in accordance
with their stated contact preferences) to ask if they would consider taking part in an interview. Those carers
who agreed were sent an information pack, which included a PIS, a template timeline with completion
instructions and several coloured pens. Potential participants were re-contacted after approximately 1 week
to check whether or not they would be willing to participate. Fifty carers were purposively sampled
from the trial database and 30 agreed to participate, giving a response rate of 60%. Of the 20 carers
who were sampled but did not participate, 15 could not be reached to discuss participation, three declined
to take part as they had insufficient time and two said that they did not wish to take part in an interview,
but did not give a reason.
All therapists (n = 16) who delivered the SIT intervention were e-mailed by the qualitative researcher
to ask if they would be willing to participate in an interview once they had delivered all intervention
sessions for at least one child as part of the trial. The e-mail included a participation information sheet
with details of the interview study. Thirteen therapists agreed to take part in an interview and three
could not be reached to discuss participation, giving a response rate of 81%.
Study materials
Separate sets of interview questions for carers and therapists were developed by qualitative researchers,
with input from the SenITA Trial Management Group and parent/carer advisory group. Carer interview
questions focused on experiences of the SIT intervention (for participants in the intervention arm only),
if and how the intervention had affected their child’s behaviour and the implementation of activities or
strategies suggested by the occupational therapist (for carers of children in the intervention group) and
experiences of support for their child’s autism outside the SenITA trial (for all carers). Therapist interview
questions focused on experiences of delivering the SIT intervention, perceptions of the impact of the
intervention and the receptiveness of carers to suggestions of activities or strategies. Both sets of
interview questions also covered carers’ and therapists’ experiences of trial processes (see Chapter 8 for
related findings).
Before taking part in an interview, carers were asked to complete a template timeline of the support
that they and their child had received. Carers were provided with timeline completion instructions
that requested them to include any key events in their child’s life and the different forms of support
experienced for their child.
Data collection
Interviews were conducted at a mutually convenient time and in accordance with participant preferences,
that is either face to face at the participant’s home/workplace or over the telephone. Most therapist
interviews took place over the telephone (n = 10), whereas most carer interviews were face to face (n = 19).
Therapist interviews lasted between 27 and 58 minutes (mean 40.2 minutes, SD 10.6 minutes). Parent/
carer interviews lasted between 12 and 86 minutes (mean 38.0 minutes, SD 17.6 minutes). With the
consent of participants, all interviews were audio-recorded. Around half (n = 13) of carers completed
the timeline template prior to the interview, whereas others said that they had insufficient time or had
not remembered to do so. Following the interview, all carer participants were given a £10 shopping
voucher to thank them for taking part.
Analysis
All interviews were transcribed verbatim and analysed using a framework approach66 by two qualitative
researchers. First, transcripts were read in full and key themes were identified in accordance with the aims
112
of the qualitative study. These key themes addressed both aspects of the study, that is the support
experiences of families (carer interviews only) and the perceived effectiveness of SIT (interviews with
therapists and carers of children in the intervention arm). Transcripts were then re-examined and
emergent subthemes were identified within each main theme by the first qualitative researcher. After
discussion with the second qualitative researcher, a thematic framework was developed and entered
into NVivo. All interviews were then coded in NVivo by the first qualitative researcher, with 10% of
transcripts coded by the second qualitative researcher to enhance reliability. Tables were created to
summarise the experiences of each interview participant, corresponding to each theme and subtheme.
The inclusion of illustrative quotes enabled the validity of findings to be reviewed. Both qualitative
researchers met to discuss the identified themes and discussion continued until consensus was reached.
Timelines completed by carers gave an overview of the support received by families. There was
wide variation in experiences. However, in the early years of children’s lives, the involvement of
professionals followed a similar pattern. Carers noted that they first became aware of signs that
their child might be autistic at the age of 1 or 2 years, when the main professional point of contact
was their health visitor. Early concerns were raised with the health visitor, but often dismissed.
Professionals tended to notice children’s speech difficulties at an early stage, resulting in support
from speech and language therapists and/or paediatricians. When children started formal education,
this appeared to initiate additional support, for example from psychologists, occupational therapists
and charitable organisations. However, in most cases, specialist autism support was not provided until
children reached the later years of primary school. Some support provision – for example the EarlyBird
programme (i.e. a specialist parental support programme) provided by NAS – could be accessed only
when a child had been diagnosed with autism. After receiving a diagnosis, there was much greater
variation in service provision and, aside from the EarlyBird programme, no clear pathway to support.
Three key themes were identified from interview transcripts and timelines, each with three emergent
subthemes (Table 46). Each theme is discussed in the following sections, supported by participant quotes,
which are labelled with participant identification numbers.
Gaps in support
Limits in support
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
113
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
EXPERIENCES OF USUAL CARE AND OF THE INTERVENTION
Support provision
[School] referred us to Team Around the Family, they came out, did an assessment . . . [that] led to
CAMHS . . . they led us to OT . . . then we were passed on . . . to neurodevelopmental.
P15
I wasn’t hanging around waiting for stuff to happen . . . Once you have official diagnosis . . . you’re in the
system and then suddenly everything kind of kicks in.
P6
I went off and did ASD parenting courses, as you do. And probably went into doing quite a lot of self-led
learning and finding support groups for me and for the children . . . Everything we’ve done, we’ve done ourselves.
P23
They just give you a book and . . . there we go, there’s nothing, there’s no therapy available or anything . . .
I thought they’d be like, he’s diagnosed, here are some therapies you can access . . . The only thing the
assessment changed is my peace of mind that it’s not me, it’s not my parenting . . . but that was the
only [benefit] because we haven’t got access to anything extra really . . . it’s pointless, well it’s hard.
P13
Some people say why would you want to put a label on it, it’s not about putting a label on her, but we
didn’t know if we were doing things correctly . . . because obviously looking back now, some of the things
that we were doing wasn’t helping, it was making things worse.
P16
Once their child had been diagnosed, many carers found local or online support groups and worked to
increase their own knowledge of autism. However, their ability to do this depended on the networks
and finance available to them. For example, some carers were able to pay for support, whereas others
attended relevant courses through their own work in a similar field and some were able to gain advice
from friends with specialist knowledge.
114
Usefulness of support
I had concerns from quite a young age, but the health visitor I felt dismissed my concerns, because I was
seeing lots of red flags and I think . . . they were thinking I was overanalysing.
P20
[CAMHS are] just . . . not equipped to deal with autism . . . she’s got severe, severe anxiety . . . but she’s not
being treated for it because they don’t know how . . . We did a bit of work with one lady, after 4 weeks,
she said ‘Oh I’m unable to help her . . . she just doesn’t understand it’ . . . Meanwhile . . . it’s getting a
whole lot worse and having a massive impact on her life.
P8
I’ve been on loads and loads of [parenting] training . . . the only course I can honestly say that I did enjoy
was the EarlyBird course. Now . . . that was a great help . . . more realistic . . . I really got on with the
parents there, they were in the same situation as me and that’s what I wanted . . . it opened my eyes,
I understand, understood a lot more.
P16
[A local] charity helping disabled children [learn] through play . . . has been a lifeline . . . [The psychologist]
is able to talk to him with the action figures, or with the Lego . . . they can talk about feelings through
that, which is a great asset because . . . empathy was really hard for him. He really struggled.
P9
The National Autistic Society . . . they’re really good. We . . . meet up with other families every now and
again so we go down to . . . an indoor play centre just down the road. Sometimes they rent it out for an
evening . . . we also go to the cinema . . . where they do . . . dimmed lights which is good.
P2
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
115
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
EXPERIENCES OF USUAL CARE AND OF THE INTERVENTION
(online or face to face) with other carers who were in a similar situation was valuable in allowing useful
ideas or strategies to be shared and provided a non-judgemental form of support:
You see it time and time again, it’s schools being unsupportive. Professionals saying, ‘There’s absolutely
nothing wrong’, even though it’s staring them in the face. It’s the parent, you know, the parental blame . . .
your parenting skills.
P29
She was very negative . . . towards [our] parenting . . . And I actually spoke to CAMHS after all this and
said, ‘I don’t want her coming back’, because . . . she made me, well she made us both feel like [we] haven’t
done enough really.
P24
You know that somewhere [on the Facebook group] there’ll be . . . someone saying, yeah I hear what
you’re saying, I’ve been there, I get it, you’re not the only one. And that can be a massive thing, because
obviously being a parent of a child who’s got extra needs, it can feel quite lonely . . . and it’s nice to know
that someone actually understands.
P29
I thought he was autistic for, you know, years now. But [school] weren’t bothered because he’s quite
compliant and no trouble. You know they wouldn’t refer us to the Ed Psych [educational psychologist]
because he’s not, his behaviours aren’t extreme or anything . . . they always refused to do anything really.
P13
He masks at school, he’s a complete masker at school . . . they love him, because he’s as good as gold.
He’s never broken a rule in his life . . . he doesn’t present in the way people think is autistic. And I keep
hearing, oh girls mask, girls mask, [but] boys do it too.
P23
At school he has a very strict rigid sensory timetable . . . six sensory breaks throughout the day . . .
[but] when . . . he’s good for a couple of weeks . . . they slack on [it] . . . and then he’ll start to kick off.
I’m like, ‘Well, are you doing all the sensory stuff?’. ’Oh no, because he’s been really good’.
P25
Gaps in support
A key gap in support was direct therapy for children, particularly OT addressing sensory issues. Some
carers noted that most services they had encountered appeared to focus on support for carers rather
than the child themselves, or that they were diagnostic rather than support services. Carers felt that
it would be useful to have one ongoing point of contact to provide ad hoc advice in relation to issues
arising and to signpost to relevant services. For several families, the main or only continuous support
that they received was from their child’s school. Specifically, carers identified an important unmet need
for mental health provision for children with autism. Some families had been unable to access CAMHS
116
because of high referral thresholds (with children not eligible for help even where there were incidences
of serious attempted self-harm), whereas others who did receive services found that provision was limited
or not helpful:
What I find now . . . if there’s an issue that crops up, because [three sources of support] have all finished,
[I’ve] only really got the school to deal with now, so if I have an issue, I have got I suppose the Autistic
Society . . . but I find I haven’t got anyone . . . like a professional I can actually ask . . . you know, what
could I do to help this sort of situation?
P2
[We put in] another CAMHS referral because he started self-harming, putting things around his neck and
that, but that got rejected.
P27
There’s no help . . . for these children at all . . . I think it took six referrals to CAMHS . . . she grabbed a
knife, tried to chop her own head off . . . they weren’t really worried about it . . . how bad do things have
to get before an intervention comes?
P8
Limits of support
Carers reported that the support their family received appeared to be time-limited or had stopped
once their child had received a diagnosis. In cases where support had helped their child, children found
the ending of services confusing and carers were frustrated. Limitations in funding or provision had
meant that some families had experienced long waiting lists for support or were unable to afford the
support that they felt their child needed. Carers living in Cornwall identified that local services were
limited or non-existent and, therefore, some families were not provided with specialist support or had
to travel long distances to access it:
I find the support have stopped . . . [the] occupational therapist has gone, it’s like everyone’s gone now.
So we’ve got no support . . . [and] he’s still struggling every day.
P14
He’s had so many like different departments involved in his care . . . Now . . . it’s like right . . . we’ve helped
you . . . we can’t do no more . . . so basically everybody’s signed him off. He’s confused because he now
thinks that everyone’s just dropped him and doesn’t care.
P17
I’ve looked into private SI [SIT], but I can’t afford it, it’s stupidly expensive . . . it’s like £50-odd a session.
I mean, I can’t afford that.
P13
We’ve been waiting about 8 months now for the next step [following diagnosis] and I don’t know when
that’s going to be.
P1
It’s very hard in Cornwall to get onto any parenting course that’s in the evening, and [the courses are
far away, so] I have to either catch the ferry . . . or drive the hour round trip, all around the coast . . .
It’s not practical and it, it puts you off, you think . . . what’s the point, and . . . try and battle on.
P24
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
117
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
EXPERIENCES OF USUAL CARE AND OF THE INTERVENTION
Three key themes were identified from interview transcripts in relation to the perceived impact of SIT
and within each key theme there were several emergent subthemes (Table 47). Each theme is discussed
below and is supported by participant quotes. Quotes from carers are labelled with ‘P’, followed by their
participant identification number. Quotes from therapists are labelled with ‘T’, followed by their participant
identification number.
Became calmer
Most carers identified that their child had become calmer following the intervention. For example,
meltdowns and instances of aggressive behaviour reduced, and concentration in school improved.
Some carers noted that their child remained calmer and more relaxed for several days after each
intervention session. Carers reported that children had learnt coping skills and techniques, which they
had been able to put into practice at home and at school. It was also identified by both carers and
therapists that children became more self-aware and, therefore, they were better able to recognise
their own feelings and sensory needs, enabling children to have more control over their behaviour:
[The sessions were] so good for him that . . . the rest of the day, well even the rest of the week . . . it made
a big difference to him, his behaviour was better, he could concentrate more.
P109
He learnt pretty quickly from the beginning the techniques to calm himself down. And so that was really
beneficial for him, to understand . . . what might make him feel better or what, what might make him
feel worse.
P308
I think she was able to understand and recognise her own needs . . . that was a big . . . learning curve for
her . . . understanding that when my body feels like this, this is what I need to do about it.
T210
That little bit of space in time, before the meltdown happens, she can actually say what she needs to
avoid the meltdown . . . [She] is now aware of her body and what she needs to keep things under control.
P514
Developed skills
118
Developed skills
While receiving the intervention, children’s fine and gross motor skills improved. For example, children
developed their ability to complete everyday tasks, such as getting washed and dressed, going to the
toilet unaided and using a knife and fork. Improved physical skills enabled some children to access
new activities, such as playing football, riding a bicycle and utilising a greater range of playground
equipment, meaning that some were more able to join in with their peers. Children’s awareness of,
and confidence in, their own body also improved, including through developments in co-ordination,
balance, spatial awareness and motor planning, and this increased physical confidence and meant that
some were more willing to attempt new activities:
One of the things that stood out for me . . . it might not seem like a big thing but for him it was . . .
we went to a park and he just sat on the swing upright instead of prone, and he was able to do that with
his friend, whereas before he would have just avoided it, because he wouldn’t have wanted to show his
friend that he didn’t sit on the swing.
P703
[One boy] loved football . . . and he was able to participate in playground football, having done this
intervention . . . He just wasn’t able to do it, for various reasons, before . . . in the playtimes he would go
to like a nurture class instead of going [outside].
T211
I feel that his confidence in his own body has increased. Before we would go to the park or something
and he wouldn’t really explore the apparatus and stuff, but now he can, I can see that he’s got confidence
to try things . . . I think he’s got more body awareness, and I think it’s just really increased his general
confidence in himself and his ability of what his body can do.
P703
For one child her self-esteem had really increased and [her] willingness to try new things . . . she went on a
school trip . . . [to] an activity centre . . . and her mum [said] . . . before she wouldn’t have attempted to go
on any of the equipment. But, but this time she tried absolutely everything . . . it’s just giving her that kind
of confidence about what she can do with her body.
T213
If you’ve got a child who is unable to tolerate water, and then . . . can’t go swimming, can’t access a splash
park, [or] can’t tolerate wearing a helmet . . . [and then] can’t do those lovely early childhood occupations,
like ride a scooter or a bike, then they’re missing out, aren’t they . . . The first child that I worked with . . .
[learnt] to tolerate those things . . . [and] he was able to ride a scooter, which he’d never done . . .
before because he wouldn’t wear a helmet.
T210
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
119
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
EXPERIENCES OF USUAL CARE AND OF THE INTERVENTION
Even [the therapist] saw a huge difference in him in the time that she’s been working with him, from a
boy who didn’t feel that he had the confidence to do anything to all of a sudden just waltzing in, going off
and doing his own thing.
P109
It’s really improved his confidence . . . he’s happy to go out in the community, he’s happy to try new things
. . . he’s been less anxious . . . His parents have noticed a massive difference in his behaviour at home and
he’s engaging in things that he never engaged in before, he’s doing things he’s never done before.
T207
Before the [intervention] I didn’t know what to do or where to go because he was struggling so much,
but it seems to have made him settle down a lot . . . It’s literally changed his life but changed our
life as well. You know, it’s only a short space of time but it has made so much difference to us . . .
I am just completely in awe of the differences in him.
P109
Before the [intervention] I used to question whether he would ever be independent enough to live on his
own. Whereas now I am starting to feel that maybe he would be OK.
P109
I’ve seen an improvement in [her] . . . and it’s not only me, it’s been school as well, they’ve noticed her
behaviour has improved . . . she’s overall calmer and she can cope with situations better.
P514
120
had previously perceived as negative were because of their child’s sensory difficulties. As a result
of this improved understanding, some carers became empowered to advocate for their child by, for
example, ensuring that they were appropriately supported in school:
It’s helped us understand him a little bit more . . . I hadn’t appreciated . . . that he doesn’t like tilting his
head backwards . . . and so we’re sort of working on ways . . . [to] try and help him . . . So that’s sort of
been quite interesting, realising, learning about that for him.
P609
I think it was a huge step for mum in a way, whereas [before] she felt so helpless . . . what’s going on with
my daughter and how can I help her, to the point of OK I can do this, that and the other . . . Definitely
empowered her.
T206
We couldn’t really understand why she did certain things . . . what [the intervention] did was identify what
she was doing and why . . . Just from learning why she does all the things she does . . . you just realise
actually that she’s not being awkward, she’s not being selfish or stroppy, she has to do it that way to
function and I think that’s the biggest thing we got from it, is maybe understanding her a little more.
P219
[The therapist] suggested an air cushion for him, for him to sit on in school and apparently it’s really good
for concentration and stuff. So she lent us one to try and it worked really well.
P109
We noticed car doors are a big thing, he won’t open the car door if it’s wet, but . . . [now] we tend
to give him a lot of pressure on his hands and things before he goes out, before he leaves the house.
And then he’ll open the door, without even thinking about it. So it’s just little things like that.
P308
Limitations
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
121
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
EXPERIENCES OF USUAL CARE AND OF THE INTERVENTION
would need therapy continuously, others suggested that lengthening the intervention could help to
bring about more lasting changes:
He will still wear his helmet [and go in] his car seat . . . it’s really lasted, it’s really desensitised him to
certain things, you know. I dread to think what he’d be like if we turn that back, oh God.
P304
I think it needs to be continuous input, [otherwise] it doesn’t really work . . . I don’t think it, it works and
then you’re cured as such. You need to continue to do it . . . But I think it’s helped him, because we’ve got
ideas at home that he can use.
P506
Out of the three children [I saw] . . . if I hadn’t been part of the research, probably only one of those
children I would have looked at using [SIT] for them. The other two children I would have used very
different mechanisms to achieve the goals . . . in a much shorter . . . time . . . There was one about cutlery
and I think if we [had] just looked at different adaptive cutlery, I think that they would have achieved
that goal.
T205
You had to write your hypothesis . . . so for instance, when the child set bottom-wiping as a goal . . . my
hypothesis was that because she had tactile issues and issues understanding where her body was in space . . .
as she became more aware of her environment, was able to process tactile information more readily . . . she
would have more success with bottom-wiping . . . It did work . . . But it’s an awful lot of input to give, to get
to that.
T212
Some families faced barriers to implementing the suggested activities at home. For example, some
families did not have the time to engage in one-to-one activities with their child, as they had other
children who also had additional needs, and some carers themselves had autism or sensory issues, which
affected their ability to understand SIT and to engage in sensory play with their child. For instance,
122
some carers did not realise the importance of play, did not understand how to play or had an aversion
to messy play:
The first child that I worked with . . . alongside the [intervention] the parents have made sure they’ve been
doing lots of [physical activity] with him outside, outside the sessions as well, and I’ve seen an absolutely
massive difference in him, he’s like a different child.
T207
Some have been very . . . on board and open to any suggestions . . . others I think [have] not fully understood
the commitment and found it quite hard and then that makes our life hard, because then we’re seeing
changes but we’re not able to progress them . . . because their parents are not taking them on.
T208
She’d missed out on a lot of sensory experiences . . . And, you know her mum and dad did recognise that.
So that was really interesting. And it was during some of the sessions where we used a lot of messy play
and worked on her tactile system, you know you could see the parents were horrified . . . and they were
able to recognise that they had some tactile issues themselves.
T201
It was a real challenge with the parents with autism to help them understand [the intervention] and I’m
really not sure that they did.
T212
Summary
Support provision for families varied widely, and there was no clear pathway of support for children
and families following autism diagnosis. In some cases, access to support was dependent on carers’
resources. Non-specialist services tended not to meet children’s needs. However, specialist provision
was generally not accessed until the later years of primary school. Key barriers to support included
professionals being dismissive of children’s needs, limited local service provision and lengthy waiting
lists. Unmet support needs included a need for direct therapy for children, specialist mental health
provision and ongoing information and advice for carers.
Following the SIT intervention, carers and therapists reported that children became calmer, developed
their physical skills, were better able to tolerate everyday tasks and increased in confidence and
independence, and this resulted in changes in day-to-day family and school life, making daily routines
and changes being easier to manage. Carers developed a better understanding of their child and were
able to implement strategies and activities suggested by the therapist. However, for some children,
changes in behaviour were not sustained following the intervention. A minority of therapists felt
that using SIT was not the right approach for all children who they provided therapy to. For example,
functional skills, such as toothbrushing, may be better addressed in the context of the child’s home.
It was also noted by therapists that therapy outcomes were dependent on the level of parental engagement
in the intervention.
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
123
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
DOI: 10.3310/TQGE0020 Health Technology Assessment 2022 Vol. 26 No. 29
Chapter 10 Discussion
Overview
In this chapter, a summary of the results is presented, with interpretation of findings discussed in the
context of previous research and the original commissioning brief for this study, which noted that,
although SIT is sometimes delivered in the NHS, there is limited evidence to support effectiveness
(as also stated in the NICE clinical guideline for children with autism17).
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
125
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
DISCUSSION
The pattern of intervention receipt was variable, although 78.3% of participants allocated to the
intervention arm had received 13 out of 20 SIT sessions during the intensive delivery phase (defined
as the target dose, of a possible 26 sessions overall). However, many participants received more than
13 sessions in total, with a median of 20 sessions received.
Acceptability
In terms of acceptability of trial procedures, most carers were very positive about their experience
of taking part in the trial. A significant proportion of carers allocated to receive the intervention,
however, reported some degree of difficulty or inconvenience in travelling to appointments, particularly
given the frequency of contact. Outcome measures were also felt to be acceptable. Diary completion
(detailing contact with other services) was poor, although the introduction of an automated text
reminder service did increase response rates. Therapists reported a degree of difficulty with some trial
processes and technology and were generally unfamiliar with the level of documentation required in
clinical trials. In addition, most therapists reported difficulty in completing assessments and paperwork
within the time estimated as per excess treatment costs.
Carers of children randomised to receive SIT reported high levels of satisfaction with the intervention,
and many carers felt that it had been of significant benefit to their child and often to the wider family,
in terms of facilitating activities it had not previously been possible to engage in. Carers and therapists
tended to report that children were calmer, more independent and better able to tolerate everyday
tasks following receipt of SIT. Carers also reported increased understanding of their child and felt able
to implement strategies suggested by the therapist. However, perceived positive changes in behaviour
were not necessarily sustained in all cases once therapy was complete.
Therapists’ experience of delivering SIT was also generally very positive. Many NHS therapists reported
being unused to offering treatment so intensively and, although some therapists had found the
experience challenging, felt that it had been professionally rewarding and was an approach that could
offer benefit to some children. However, most therapists viewed SIT as part of a range of treatment
options, the appropriate choice of which would depend on the child and their needs.
Behavioural outcomes
There was no evidence of a statistically significant difference between trial arms for the primary
outcome, that is irritability/agitation, which is a measure of challenging behaviour (as assessed by the
ABC-I67 at either 6 or 12 months). Parent-assessed ABC-I ratings at 6 months were, on average, higher
than teacher ratings (where available). It is likely, however, that this indicates a true difference in
behaviour and functioning in different settings, rather than a reporting bias on the part of either type
of participant. Exploratory subgroup analyses suggest a differential effect of SIT on ABC-I at 6 months
by sex of child, indicating that SIT was more effective for male participants. Subgroup analyses also
indicate that the intervention was more effective in participants with a comorbid ADHD diagnosis. It is
important to note, however, that even where statistically significant subgroup effects suggest clinically
relevant change, that these analyses are hypothesis-generating only and may reflect multiple testing.
We found no evidence of a differential effect of SIT on 6-month ABC-I scores by level of SPD, general
126
Additional sensitivity analyses suggest that scores on the ABC-I at 6 months were generally better
in those who initiated and received SIT. However, adjusting for the initiation of SIT did not alter the
conclusions drawn based on the primary analysis (i.e. there was no evidence of a difference between
the intervention arm and the control arm). Sensitivity analyses did not indicate any pandemic-related
effects on outcome. No between-arm differences were observed at 6 or 12 months for adaptive behaviour,
socialisation or daily living skills (using VABS domains). As detailed in Chapter 6, an error in administration
of the VABS measure resulted in the introduction of an artificial ‘ceiling effect’ for these subdomains,
meaning that it was less sensitive to change. A statistically significant between-arm difference was
observed for the communication domain (indicating a negative intervention effect), although this is felt
likely to reflect a combination of multiple testing, ceiling effects and an outlier in the control arm, rather
than a clinically meaningful difference. Further sensitivity analyses would be unlikely to add to the
interpretation of results, given that no other marginal effects were observed and the pattern of results
was similar to that observed for all other outcome measures.
Summary
In summary, the SenITA trial was a robustly conducted evaluation of the clinical effectiveness and
cost-effectiveness of SIT for behavioural, functional and quality-of-life outcomes. Targets for recruitment,
retention and other key parameters used to estimate sample size were met, maintaining 90% power at
the primary analysis time point. Usual care was significantly different from the intervention offered as
part of the trial and was delivered with good fidelity and adherence. In addition, there is no evidence of
significant contamination in the control arm or of those allocated to SIT receiving meaningful intervention
via other routes. No adverse effects were reported. The population recruited are likely to be representative
of young children with a diagnosis of autism and presenting to services, although this is distinct from
being truly representative of the target population, given the well-documented underdiagnosis of autism
in girls and minority ethnic children.
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
127
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
DISCUSSION
Trial procedures and outcome measures were acceptable to carers, and therapists generally found
involvement in the trial to be a positive experience. However, many therapists reported issues with
management of trial documentation and technology and many felt that the time allowed for assessment
and recording clinical notes was insufficient. Carers in the intervention arm reported high levels of
satisfaction and benefit of SIT, although no statistically significant quantitative change in carer stress was
observed. Both carers and therapists tended to report improvements in well-being and daily functioning,
although there is no evidence to suggest that these effects were maintained following the end of therapy.
Therapists’ experience of delivering SIT was also generally positive, and most felt it to be an approach that
could offer benefit to some children, depending on their needs.
There were, however, no statistically significant effects of SIT on any behavioural, functional, quality-
of-life or well-being outcomes at either 6 or 12 months (with the exception of the VABS communication
subdomain, as discussed above). Sensitivity analyses do suggest that scores on the ABC-I at 6 months
were generally better in participants who received SIT and that intervention may work better for boys
and participants with a comorbid ADHD diagnosis, although these were exploratory analyses and should
not be overinterpreted. Carer-rated goal performance and satisfaction did increase significantly with SIT
exposure. However, there is no evidence to suggest that improvements were maintained, and data were
available for only a subset of intervention arm participants. Health economic evaluation also indicates that
SIT is unlikely to represent a cost-effective treatment option when compared with usual care.
Strengths
The key strength of the SenITA trial is that it was adequately powered to answer the key question in
the original commissioning bid of ‘What is the effectiveness and cost-effectiveness of SIT for children
with autism?’. Important outcomes, as detailed in the commissioning brief, were challenging behaviours,
socialisation, engagement with activities and sensory sensitivities. Other potential outcomes listed
included adherence to the therapy manual, process indicators, health-related quality of life, carer burden,
adverse effects and cost-effectiveness. The trial was sufficiently powered to determine effectiveness of
manualised SIT on the primary outcome, that is, a measure of challenging behaviour. The intervention
was also delivered with good fidelity and adherence and was acceptable to both families and therapists;
no adverse effects were reported. Inclusion of longer-term (12-month) outcome assessment is also a
strength, as previous studies33,34 of SIT have assessed outcomes post intervention only (or at an equivalent
time point in the comparator arm).
This trial has also made a significant contribution to knowledge around what is generally delivered as
usual care to children with autism and SPDs. In addition, the trial has highlighted the gap between
services generally available to families (e.g. advice, strategies to improve functional/daily living skills)
and services that carers would most value (e.g. intervention to support behavioural problems).
Limitations
Although SIT was generally delivered with good fidelity and all therapists met the required minimum
threshold for training and experience, most therapists in Wales were employed by the NHS and had
little recent experience of delivering full-fidelity SIT within their NHS roles. In England, trial therapists
were working privately, as we were unable to recruit sufficiently trained and experienced therapists in
England for a variety of reasons, including a reluctance of therapists to offer therapy via participation
in the trial that was not otherwise available and, therefore, setting a level of expectation among families
that could not be sustained. Subsequently, therapists at English sites were more used to delivering SIT
with this population and did not have to juggle the competing demands of local service targets. Therapists
also reported that the time allowed for assessment and clinical reasoning was insufficient, particularly
at initiation of therapy, meaning that the total costs of intervention would probably be higher than
indicated in practice.
128
For a variety of pragmatic reasons, including therapist availability and workload, some participants
allocated to receive SIT did not start intervention within the intended time frame and had, therefore,
received a potentially lower dose of SIT by the primary outcome assessment time point. Sensitivity
analyses, however, indicate that this is highly unlikely to have significantly affected any key findings.
A further limitation is the artificial ceiling effect observed for domains of the VABS. Interpretation of
the positive effect on carer-reported goal performance is also limited by the fact that not all intervention
therapists reported this consistently and that it was not possible to measure this in the control arm, as
participants were not generally in contact with services.
The results of the SenITA trial indicate that SIT shows no clinical benefit across a range of outcomes
(i.e. behavioural, functional, social, quality of life and well-being) over and above standard care for
young children with autism and at least moderate SPDs. In addition, the results also indicate that SIT
is not a cost-effective treatment option in this population. Several subgroup effects were observed,
although these should be considered hypothesis-generating only and would require further exploration.
Subgroup effects are, however, consistent with qualitative data, indicating that therapists felt that SIT
could be of benefit to some, but not all, children with autism and sensory difficulties. It is likely that
SIT is effective for individualised (carer-reported) performance goals; however, it is not known if this
effect is observed over and above standard care and if improvements can be maintained following the
end of treatment.
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
129
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
DOI: 10.3310/TQGE0020 Health Technology Assessment 2022 Vol. 26 No. 29
Acknowledgements
W e would like to thank all of the children and parents/carers who took part in the SenITA trial.
Many thanks go to all SenITA trial therapists, mentors and parents/carers who contributed to
the study through the advisory group, and to all independent members of the Trial Steering Committee
and Data Monitoring Committee. Thanks to Jacqui Thornton and Dunla Gallagher for their input to
qualitative analysis of usual-care data (see Chapter 2) and to Kath Smith for input to the intervention
handbook and therapist training. Thanks also to Jade Williams at the Centre for Trials Research for
providing administrative support.
Contributions of authors
Melissa Wright (https://orcid.org/0000-0002-1011-4795) carried out the statistical analysis and wrote
up the results for publication.
Anne Marie McKigney provided clinical and research expertise in relation to children with autism.
Gemma Warren led the patient and public involvement component of the trial.
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
131
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
ACKNOWLEDGEMENTS
Data-sharing statement
All available data, study handbooks and the full trial protocol can be obtained by contacting the
corresponding author.
132
References
1. Baron-Cohen S, Scott FJ, Allison C, Williams J, Bolton P, Matthews FE, et al. Prevalence of
autism-spectrum conditions: UK school-based population study. Br J Psychiatry 2009;194:500–9.
https://doi.org/10.1192/bjp.bp.108.059345
2. Simonoff E, Pickles A, Charman T, Chandler S, Loucas T, Baird G. Psychiatric disorders in
children with autism spectrum disorders: prevalence, comorbidity, and associated factors in a
population-derived sample. J Am Acad Child Adolesc Psychiatry 2008;47:921–9. https://doi.org/
10.1097/CHI.0b013e318179964f
3. Ung D, Wood JJ, Ehrenreich-May J, Arnold EB, Fuji C, Renno P, et al. Clinical characteristics
of high-functioning youth with autism spectrum disorder and anxiety. Neuropsychiatry 2013;3.
https://doi.org/10.2217/npy.13.9
4. Hayes SA, Watson SL. The impact of parenting stress: a meta-analysis of studies comparing
the experience of parenting stress in parents of children with and without autism spectrum
disorder. J Autism Dev Disord 2013;43:629–42. https://doi.org/10.1007/s10803-012-1604-y
5. Buescher AV, Cidav Z, Knapp M, Mandell DS. Costs of autism spectrum disorders in the
United Kingdom and the United States. JAMA Pediatr 2014;168:721–8. https://doi.org/10.1001/
jamapediatrics.2014.210
6. Humphrey N, Hebron J. Bullying of children and adolescents with autism spectrum conditions:
a ‘state of the field’ review. Int J Inclusive Educ 2015;19:845–62. https://doi.org/10.1080/
13603116.2014.981602
7. Rowley E, Chandler S, Baird G, Simonoff E, Pickles A, Loucas T, et al. The experience of
friendship, victimization and bullying in children with an autism spectrum disorder: associations
with child characteristics and school placement. Res Autism Spectr Disord 2012;6:1126–34.
https://doi.org/10.1016/j.rasd.2012.03.004
8. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders.
5th edn. Arlington, VA: American Psychiatric Association; 2013. https://doi.org/10.1176/
appi.books.9780890425596
9. Chang YS, Owen JP, Desai SS, Hill SS, Arnett AB, Harris J, et al. Autism and sensory processing
disorders: shared white matter disruption in sensory pathways but divergent connectivity
in social-emotional pathways. PLOS ONE 2014;9:e103038. https://doi.org/10.1371/
journal.pone.0103038
10. Leekam SR, Nieto C, Libby SJ, Wing L, Gould J. Describing the sensory abnormalities of
children and adults with autism. J Autism Dev Disord 2007;37:894–910. https://doi.org/
10.1007/s10803-006-0218-7
11. Tomchek SD, Dunn W. Sensory processing in children with and without autism: a comparative
study using the short sensory profile. Am J Occup Ther 2007;61:190–200. https://doi.org/
10.5014/ajot.61.2.190
12. Baranek GT. Efficacy of sensory and motor interventions for children with autism. J Autism
Dev Disord 2002;32:397–422. https://doi.org/10.1023/a:1020541906063
13. Case-Smith J, Weaver LL, Fristad MA. A systematic review of sensory processing interventions
for children with autism spectrum disorders. Autism 2015;19:133–48. https://doi.org/10.1177/
1362361313517762
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
133
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
REFERENCES
14. Hochhauser M, Engel-Yeger B. Sensory processing abilities and their relation to participation
in leisure activities among children with high-functioning autism spectrum disorder (HFASD).
Res Autism Spectr Disord 2010;4:746–54. https://doi.org/10.1016/j.rasd.2010.01.015
15. Ismael N, Lawson LM, Hartwell J. Relationship between sensory processing and
participation in daily occupations for children with autism spectrum disorder: a systematic
review of studies that used Dunn’s sensory processing framework. Am J Occup Ther
2018;72:7203205030p1–p9. https://doi.org/10.5014/ajot.2018.024075
16. Schaaf RC, Toth-Cohen S, Johnson SL, Outten G, Benevides TW. The everyday routines of
families of children with autism: examining the impact of sensory processsing difficulties on
the family. Autism 2011;15:373–89. https://doi.org/10.1177/1362361310386505
17. National Collaborating Centre for Mental Health. Autism: The NICE Guideline on the Management
and Support of Children and Young People on the Autism Spectrum. London: National Collaborating
Centre for Mental Health; 2013.
18. World Federation of Occupational Therapists. Definitions of Occupational Therapy From
Member Organisations. 2012. URL: www.wfot.org/about/about-occupational-therapy
(accessed 28 May 2021).
19. Wilcock A, Hocking C. An Occupational Perspective of Health. 3rd edn. Thorofare, NJ: Slack; 2015.
20. Royal College of Occupational Therapists. RCOT Informed View: Sensory Integration and Sensory-
Based Interventions. 2021. URL: www.rcot.co.uk/about-occupational-therapy/rcot-informed-views
(accessed 28 May 2021).
21. Trombly C. Anticipating the future: assessment of occupational function. Am J Occup Ther
1993;47:253–7. https://doi.org/10.5014/ajot.47.3.253
22. Rodger S, Vishram A. Mastering social and organization goals: strategy use by two children
with Asperger syndrome during cognitive orientation to daily occupational performance.
Phys Occup Ther Pediatr 2010;30:264–76. https://doi.org/10.3109/01942638.2010.500893
23. Parham LD, Roley SS, May-Benson TA, Koomar J, Brett-Green B, Burke JP, et al. Development
of a fidelity measure for research on the effectiveness of the ayres sensory integration®
intervention. Am J Occup Ther 2011;65;133–42. https://doi.org/10.5014/ajot.2011.000745
24. Dunn W, Cox J, Foster L, Mische-Lawson L, Tanquary J. Impact of a contextual intervention on
child participation and parent competence among children with autism spectrum disorders:
a pretest–posttest repeated-measures design. Am J Occup Ther 2012;66:520–8. https://doi.org/
10.5014/ajot.2012.004119
25. Fertel-Daly D, Bedell G, Hinojosa J. Effects of a weighted vest on attention to task and
self-stimulatory behaviors in preschoolers with pervasive developmental disorders. Am J Occup
Ther 2001;55:629–40. https://doi.org/10.5014/ajot.55.6.629
26. Bagatell N, Mirigliani G, Patterson C, Reyes Y, Test L. Effectiveness of therapy ball chairs
on classroom participation in children with autism spectrum disorders. Am J Occup Ther
2010;64:895–903. https://doi.org/10.5014/ajot.2010.09149
27. Schilling DL, Schwartz IS. Alternative seating for young children with autism spectrum
disorder: effects on classroom behavior. J Autism Dev Disord 2004;34:423–32. https://doi.org/
10.1023/b:jadd.0000037418.48587.f4
28. Van Rie GL, Heflin LJ. The effect of sensory activities on correct responding for children with
autism spectrum disorders. Res Autism Spectr Disord 2009;3:783–96. https://doi.org/10.1016/
j.rasd.2009.03.001
134
29. Fazlioğlu Y, Baran G. A sensory integration therapy program on sensory problems for children
with autism. Percept Mot Skills 2008;106:415–22. https://doi.org/10.2466/pms.106.2.415-422
30. Schaaf RC, Mailloux Z. Clinician’s Guide for Implementing Ayres Sensory Integration®: Promoting
Participation for Children with Autism. Bethesda, MD: American Occupational Therapy
Association; 2015.
31. Ayres A. Sensory Integration and Learning Disorders. Los Angeles, CA: Western Psychological
Services; 1972.
32. Ayres A. Sensory Integration and the Child. Los Angeles, CA: Western Psychological Services; 2005.
33. Pfeiffer BA, Koenig K, Kinnealey M, Sheppard M, Henderson L. Effectiveness of sensory integration
interventions in children with autism spectrum disorders: a pilot study. Am J Occup Ther
2011;65:76–85. https://doi.org/10.5014/ajot.2011.09205
34. Schaaf RC, Benevides T, Mailloux Z, Faller P, Hunt J, van Hooydonk E, et al. An intervention
for sensory difficulties in children with autism: a randomized trial. J Autism Dev Disord
2014;44:1493–506. https://doi.org/10.1007/s10803-013-1983-8
35. Tennant A. Goal attainment scaling: current methodological challenges. Disabil Rehabil
2007;29:1583–8. https://doi.org/10.1080/09638280701618828
36. Krasny-Pacini A, Evans J, Sohlberg MM, Chevignard M. Proposed criteria for appraising goal
attainment scales used as outcome measures in rehabilitation research. Arch Phys Med Rehabil
2016;97:157–70. https://doi.org/10.1016/j.apmr.2015.08.424
37. Steenbeek D, Ketelaar M, Galama K, Gorter JW. Goal attainment scaling in paediatric
rehabilitation: a critical review of the literature. Dev Med Child Neurol 2007;49:550–6.
https://doi.org/10.1111/j.1469-8749.2007.00550.x
38. Ruble L, McGrew JH, Toland MD. Goal attainment scaling as an outcome measure in randomized
controlled trials of psychosocial interventions in autism. J Autism Dev Disord 2012;42:1974–83.
https://doi.org/10.1007/s10803-012-1446-7
39. Schaaf RC, Dumont RL, Arbesman M, May-Benson TA. Efficacy of occupational therapy using
Ayres Sensory Integration®: a systematic review. Am J Occup Ther 2018;72:7201190010p1–
7201190010p10. https://doi.org/10.5014/ajot.2018.028431
40. Schoen SA, Lane SJ, Mailloux Z, May-Benson T, Parham LD, Smith Roley S, Schaaf RC.
A systematic review of ayres sensory integration intervention for children with autism.
Autism Res 2019;12:6–19. https://doi.org/10.1002/aur.2046
41. Iwanaga R, Honda S, Nakane H, Tanaka K, Toeda H, Tanaka G. Pilot study: efficacy of sensory
integration therapy for Japanese children with high-functioning autism spectrum disorder.
Occup Ther Int 2014;21:4–11. https://doi.org/10.1002/oti.1357
42. Barker Dunbar S, Carr-Hertel J, Lieberman HA, Perez B, Ricks K. A pilot study comparison of
sensory integration treatment and integrated preschool activities for children with autism.
Internet J Allied Health Sci Pract 2012;10(3). https://doi.org/10.46743/1540-580X/2012.1407
43. Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol 2006;3:77–101.
https://doi.org/10.1191/1478088706qp063oa
44. Parham L, Ecker C, Miller Kuhaneck H, Henry D, Glennon T. SPM Sensory Processing Measure:
Manual. Torrance, CA: Western Psychological Services; 2007. https://doi.org/10.1037/t49671-000
45. South M, Palilla J. Bruininks–Oseretsky Test of Motor Proficiency. In Volmar FR, editor.
Encyclopedia of Autism Spectrum Disorders. New York, NY: Springer; 2021. https://doi.org/
10.1007/978-3-319-91280-6_1381
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
135
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
REFERENCES
46. Ulrich DA. Peabody developmental motor scales and activity cards. Adapt Phys Activ Q 2016;1.
https://doi.org/10.1123/apaq.1.2.173
47. Blanche EI, Bodison S, Chang MC, Reinoso G. Development of the comprehensive observations
of proprioception (COP): validity, reliability, and factor analysis. Am J Occup Ther 2012;66:691–8.
https://doi.org/10.5014/ajot.2012.003608
48. Law M, Baptiste S, McColl M, Opzoomer A, Polatajko H, Pollock N. The Canadian occupational
performance measure: an outcome measure for occupational therapy. Can J Occup Ther
1990;57:82–7. https://doi.org/10.1177/000841749005700207
49. Henderson ES, Sugden A, Barnett L. Movement Assessment Battery for Children – 2. London:
Pearson Education; 2007. https://doi.org/10.1037/t55281-000
50. Roll K, Roll W. Assessment of Activities of Daily Living (ADLs) and Independent Activities of Daily
Living (IADLs) in Children. London: Pearson Education; 2013.
51. Beery K, Beery N. The Beery–Buktenica Developmental Test of Visual–Motor Integration (Beery VMI)
with Supplemental Developmental Tests of Visual Perception and Motor Coordination and Stepping
Stones Age Norms: Administration, Scoring and Teaching Manual. Minneapolis, MN: NCS Pearson;
2010. https://doi.org/10.1037/t48947-000
52. Care Aims Framework. Care Aims. URL: https://careaims.com (accessed 7 April 2022).
53. Lord C, Rutter M, DiLavore P, Risi S, Gotham K, Bishop S. Autism Diagnostic Observation
Schedule, (ADOS-2) Modules 1–4. Los Angeles, CA: Western Psychological Services; 2012.
54. Ayres AJ. Sensory Integration and Praxis Tests: SIPT Manual. Los Angeles, CA: Western
Psychological Services; 1989.
55. Missiuna C, Pollock N. Perceived efficacy and goal setting in young children. Can J Occup Ther
2000;67:101–9. https://doi.org/10.1177/000841740006700303
56. Missiuna C, Pollock N, Law M, Walter S, Cavey N. Examination of the perceived efficacy
and goal setting system (PEGS) with children with disabilities, their parents, and teachers.
Am J Occup Ther 2006;60:204–14. https://doi.org/10.5014/ajot.60.2.204
57. Keller J, Kafkes A, Basu S, Federico J, Kielhofner G. The User’s Manual for Child Occupational
Self-Assessment (COSA). Chicago, IL: Model of Human Occupation Clearing House; 2006.
58. Rubin R. Will the real SMART goals please stand up. Ind Organ Psychol 2002;39. https://doi.org/
10.1037/e576932011-003
59. Drolet MJ. The axiological ontology of occupational therapy: a philosophical analysis. Scand J
Occup Ther 2014;21:2–10. https://doi.org/10.3109/11038128.2013.831118
60. Kadar M, McDonald R, Lentin P. Evidence-based practice in occupational therapy services for
children with autism spectrum disorders in Victoria, Australia. Aust Occup Ther J 2012;59:284–93.
https://doi.org/10.1111/j.1440-1630.2012.01015.x
61. Brown GT, Rodger S, Brown A, Roever C. A profile of Canadian pediatric occupational therapy
practice. Occup Ther Health Care 2007;21:39–69. https://doi.org/10.1080/J003v21n04_03
62. Dunford C, Richards S. ‘Doubly Disadvantaged’: Report of a Survey on Waiting Lists and Waiting
Times for Occupational Therapy Services for Children with Developmental Coordination Disorder.
London: College of Occupational Therapists; 2003.
63. NHS Wales. NHS Wales Delivery Framework and Reporting Guidance 2019–2020. Cardiff:
NHS Wales; 2019.
64. Rodger S, Kennedy-Behr A. Occupation-Centred Practice with Children: A Practical Guide for
Occupational Therapists. 2nd edn. Oxford: John Wiley & Sons; 2017.
136
65. Royal College of Occupational Therapists. RCOT Informed View: Sensory Integration and Sensory-
Based Interventions. URL: www.rcot.co.uk/about-occupational-therapy/rcot-informed-views
(accessed 6 April 2022).
66. Ritchie J, Spencer L. Qualitative data analysis for applied policy research. In Bryman A,
Burgess RG, editors. Analyzing Qualitative Data. London: Routledge; 1994. pp. 173–94.
https://doi.org/10.4324/9780203413081_chapter_9
67. Aman MG, Singh NN. Aberrant Behavior Checklist. New York, NY: Slosson Educational
Publications; 1986. https://doi.org/10.1037/t10453-000
68. Aman MG. Aberrant Behavior Checklist: current identity and future developments. Clin Exp
Pharmacol 2012;2. https://doi.org/10.4172/2161-1459.1000e114
69. Marshburn EC, Aman MG. Factor validity and norms for the aberrant behavior checklist in a
community sample of children with mental retardation. J Autism Dev Disord 1992;22:357–73.
https://doi.org/10.1007/BF01048240
70. Sparrow SS, Cicchetti DV, Balla DA. The Vineland Adaptive Behavior Scales. In Newmark C, editor.
Major Psychological Assessment Instruments. 2nd edn. Boston, MA: Allyn & Bacon; 1996. pp. 199–231.
71. Silva LM, Schalock M. Autism Parenting Stress Index: initial psychometric evidence. J Autism
Dev Disord 2012;42:566–74. https://doi.org/10.1007/s10803-011-1274-1
72. Herdman M, Gudex C, Lloyd A, Janssen M, Kind P, Parkin D, et al. Development and preliminary
testing of the new five-level version of EQ-5D (EQ-5D-5L). Qual Life Res 2011;20:1727–36.
https://doi.org/10.1007/s11136-011-9903-x
73. Brouwer WB, van Exel NJ, van Gorp B, Redekop WK. The CarerQol instrument: a new
instrument to measure care-related quality of life of informal caregivers for use in economic
evaluations. Qual Life Res 2006;15:1005–21. https://doi.org/10.1007/s11136-005-5994-6
74. Hoefman R, Payakachat N, van Exel J, Kuhlthau K, Kovacs E, Pyne J, Tilford JM. Caring for a
child with autism spectrum disorder and parents’ quality of life: application of the CarerQol.
J Autism Dev Disord 2014;44:1933–45. https://doi.org/10.1007/s10803-014-2066-1
75. Beecham J, Knapp M. Costing psychiatric interventions. In Thornicroft G, Brewin CR, Wing J,
editors. Measuring Mental Health Needs. London: Gaskell/Royal College of Psychiatrists; 1992.
pp. 163–83.
76. Borm GF, Fransen J, Lemmens WA. A simple sample size formula for analysis of covariance
in randomized clinical trials. J Clin Epidemiol 2007;60:1234–8. https://doi.org/10.1016/
j.jclinepi.2007.02.006
77. Willner P, Rose J, Jahoda A, Stenfert Kroese B, Felce D, MacMahon P, et al. A cluster randomised
controlled trial of a manualised cognitive behavioural anger management intervention delivered by
supervised lay therapists to people with intellectual disabilities. Health Technol Assess 2013;17(21).
https://doi.org/10.3310/hta17210
78. Great Britain. General Data Protection Regulations 2016. London: The Stationery Office; 2016.
79. CASP UK. Critical Appraisal Skills Programme (CASP) Checklist: 10 Questions to Help You Make
Sense of a Qualitative Research. Oxford: CASP UK; 2018.
80. Schaaf RC, Benevides TW, Kelly D, Mailloux-Maggio Z. Occupational therapy and sensory
integration for children with autism: a feasibility, safety, acceptability and fidelity study. Autism
2012;16:321–7. https://doi.org/10.1177/1362361311435157
81. National Institute for Health and Care Excellence (NICE). Guide to the Methods of Technology
Appraisal 2013. London: NICE; 2013.
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
137
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
REFERENCES
82. Curtis L, Burns A. Unit Costs of Health and Social Care 2020. Canterbury: PSSRU, University of
Kent; 2020.
83. Netten A, Knight J, Dennett J, Cooley R, Slight A. A Ready Reckoner for Staff Costs in the NHS.
Canterbury: PSSRU, University of Kent; 1998.
84. Department of Health and Social Care. NHS Reference Costs 2019. 2019. URL: www.england.
nhs.uk/national-cost-collection/#ncc1819 (accessed 14 June 2021).
85. Rodgers M, Marshall D, Simmonds M, Le Couteur A, Biswas M, Wright K, et al. Interventions
based on early intensive applied behaviour analysis for autistic children: a systematic review and
cost-effectiveness analysis. Health Technol Assess 2020;24(35). https://doi.org/10.3310/hta24350
86. Blooming Tree. Social Skills After School Club. URL: https://bloomingtree.co.uk/social-skills-after-
school-club (accessed 20 April 2022).
87. Byford S, Cary M, Barrett B, Aldred CR, Charman T, Howlin P, et al. Cost-effectiveness
analysis of a communication-focused therapy for pre-school children with autism: results
from a randomised controlled trial. BMC Psychiatry 2015;15:316. https://doi.org/10.1186/
s12888-015-0700-x
88. Child Autism UK. Training Courses. URL: www.childautism.org.uk/for-families/training-courses/
(accessed 20 April 2022).
89. Ace Centre. URL: https://acecentre.org.uk/event/aacunit1-2/ (accessed 20 April 2022).
90. Connect to Autism. Fees for Diagnostic Assessment, Clinical Consultancy, Training.
URL: https://connecttoautism.org/fees/ (accessed 20 April 2022).
91. Dulwich Prep London. Dulwich Prep London Parent’s Nurturing Programme. URL: www.
dulwichpreplondon.org/wp-content/uploads/2020/06/Parenting-Programme.pdf (accessed
20 April 2022).
92. Stuttard L, Beresford B, Clarke S, Beecham J, Morris A. An evaluation of the Cygnet parenting
support programme for parents of children with autism spectrum conditions. Res Autism Spectr
Disord 2016;23:166–78. https://doi.org/10.1016/j.rasd.2015.12.004
93. Tutorful. URL: https://tutorful.co.uk/search/autism (accessed 20 April 2022).
94. Payscale. Average Teaching Assistant (TA) Salary in United Kingdom. URL: www.payscale.com/
research/UK/Job=Teaching_Assistant_(TA)/Salary (accessed 20 April 2022).
95. Education Endowment Foundation. Small Group Tuition. URL: https://educationendowment
foundation.org.uk/evidence-summaries/teaching-learning-toolkit/small-group-tuition/
(accessed 20 April 2022).
96. Prospects. URL: https://prospects.ac.uk (accessed 20 April 2022).
97. Curtis LA. Unit Costs of Health and Social Care 2014. Canterbury: PSSRU, University of Kent; 2014.
98. Netten A, Curtis LA. Editorial: adapting and adjusting unit cost information. In Curtis LA,
Netten A, editors. Unit Costs of Health & Social Care 2005. Canterbury: PSSRU, University of
Kent; 2005. pp. 1–8.
99. Curtis L, Burns A. Unit Costs of Health and Social Care 2015. Canterbury: PSSRU, University of
Kent; 2015.
100. The National Archives. SET for Success. The Supply of People with Science, Technology, Engineering
and Mathematics Skills. URL: https://webarchive.nationalarchives.gov.uk/ukgwa/+/http:/www.
hm-treasury.gov.uk/d/robertsreview_introch1.pdf (accessed 26 April 2022).
138
101. Curtis L, Burns A. Unit Costs of Health and Social Care 2016. Canterbury: PSSRU, University of
Kent; 2016.
102. Slade I, Hanson H, George A, Kohut K, Strydom A, Wordsworth S, et al. A cost analysis of a
cancer genetic service model in the UK. J Community Genet 2016;7:185–194. https://doi.org/
10.1007/s12687-016-0266-4
103. NHS. Carers’ Breaks and Respite Care. URL: www.nhs.uk/conditions/social-care-and-support-guide/
support-and-benefits-for-carers/carer-breaks-and-respite-care/ (accessed 20 April 2022).
104. Curtis L, Burns A. Unit Costs of Health and Social Care 2018. Canterbury: PSSRU, University of
Kent; 2018.
105. The Canine Fitness Centre. Treatment and Session Pricing. URL: www.thecaninefitnesscentre.co.uk/
pricing/ (accessed 20 April 2022).
106. NHS. Chiropractic. URL: www.nhs.uk/conditions/chiropractic/#:~:text=Most%20people%20who
%20have%20chiropractic,to%20them%20for%20advice%20first (accessed 20 April 2022).
107. Uttley L, Stevenson M, Scope A, Rawdin A, Sutton A. The clinical and cost effectiveness
of group art therapy for people with non-psychotic mental health disorders: a systematic
review and cost-effectiveness analysis. BMC Psychiatry 2015;15:151. https://doi.org/10.1186/
s12888-015-0528-4
108. Knapp M, King D, Romeo R, Schehl B, Barber J, Griffin M, et al. Cost effectiveness of a
manual based coping strategy programme in promoting the mental health of family carers of
people with dementia (the START (STrAtegies for RelaTives) study): a pragmatic randomised
controlled trial. BMJ 2013;347:f6342. https://doi.org/10.1136/bmj.f6342
109. van Buuren S, Brand JPL, Groothuis-Oudshoorn CGM, Rubin DB. Fully conditional specification
in multivariate imputation. J Stat Comput Simul 2006;76:1049–64. https://doi.org/10.1080/
10629360600810434
110. Moore GF, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, et al. Process evaluation of
complex interventions: Medical Research Council guidance. BMJ 2015;350:h1258. https://doi.org/
10.1136/bmj.h1258
111. Ratto AB, Kenworthy L, Yerys BE, Bascom J, Wieckowski AT, White SW, et al. What about
the girls? Sex-based differences in autistic traits and adaptive skills. J Autism Dev Disord
2018;48:1698–711. https://doi.org/10.1007/s10803-017-3413-9
112. Slade G. Diverse Perspectives: The Challenges for Families Affected by Autism from Black, Asian and
Minority Ethnic Communities. London: National Autistic Society; 2014.
Copyright © 2022 Randell et al. This work was produced by Randell et al. under the terms of a commissioning contract issued by the Secretary of State for Health and
Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use,
139
distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/.
For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
EME
HSDR
HTA
PGfAR
PHR
Part of the NIHR Journals Library
www.journalslibrary.nihr.ac.uk
This report presents independent research funded by the National Institute for Health and Care Research (NIHR).
The views expressed are those of the author(s) and not necessarily those of the NHS, the NIHR or the
Department of Health and Social Care