Validity of Autism Behavior Checklist (ABC)
Validity of Autism Behavior Checklist (ABC)
Validity of Autism Behavior Checklist (ABC)
ORIGINAL
ARTICLE
Abstract
Objective: To examine the concurrent and criterion validity of the Autism Behavior Checklist (ABC). Methods: Three groups,
comprising 38 mothers of children previously diagnosed with autism (DSM IV-TR, 2002), 43 mothers of children with language
disorders other than autism, and 52 mothers of children who had no linguistic or behavioral complaints, were interviewed. In
order to minimize the effect of maternal level of education, the questionnaire was completed by the researcher. To determine the
concurrent validation, ANOVA and discriminant analysis were used. The ROC curve was used to establish the cutoff score of the
sample and to examine the criterion validity. Results: The mean total score was significantly higher in the group of mothers of
autistic children than in the other groups. The ABC correctly identified 81.6% of the autistic children. The ROC curve cutoff score
was 49, and the sensitivity was 92.1%, higher than the 57.89% found when a cutoff score of 68 was used. The specificity was
92.6%, similar to the 94.73% obtained with a cutoff score of 68. Conclusions: The ABC shows promise as an instrument for
identifying children with autistic disorders, both in clinical and educational contexts, especially when a cutoff score of 49 is used.
Keywords: Autistic disorder; Diagnostic and statistical manual of mental disorders; Diagnosis, differential; Validation studies
[Publication type]; Questionnaires
Resumo
Objetivo: Examinar a Validade Concorrente e a Validade de Critrio do Inventrio de Comportamentos Autsticos (ICA). Mtodos:
Foram entrevistadas, com a escala, mes de crianas com diagnstico de transtorno autista, previamente estabelecido por
especialistas na rea. Para comparao, foram tambm entrevistadas mes de crianas com transtorno de linguagem e mes de
escolares sem queixas de problemas de linguagem e comportamento social. Os trs grupos foram assim constitudos: GTA: 38
mes de crianas com transtorno autista (DSM IV-TR, 2002), GTL: 43 mes de crianas com transtorno de linguagem (DSM IV-TR, 2002)
e GET: 52 mes de crianas escolares tpicas. O questionrio foi preenchido sob forma de entrevista para minimizar os efeitos da
escolaridade materna. ANOVA e anlise discriminante foram usadas para examinar a Validade Concorrente. A curva ROC foi usada
para estabelecer o ponto de corte da amostra e para examinar a Validade de Critrio. Resultados: O Inventrio de Comportamentos Autsticos identificou corretamente 81,6% das crianas com autismo, sendo o escore mdio total do GTA significantemente
(p < 0,001) maior que os outros dois grupos de crianas. O Inventrio de Comportamentos Autsticos mostrou baixa sensibilidade
(57,89%) e alta especificidade (94,73%) quando se usou a nota de corte 68 pontos; diminuda a nota de corte para 49 pontos
obtida pela curva ROC, a sensibilidade da escala aumentou (92,1%) e a especificidade se manteve alta (92,6%). Concluses:
O Inventrio de Comportamentos Autsticos um instrumento promissor para identificar crianas com autismo, especialmente
com ponto de corte 49, tanto na clnica como em contextos educacionais.
Descritores: Transtorno autstico; Manual diagnstico e estatstico de transtornos mentais; Diagnstico diferencial; Validade;
Questionrios
Academic thesis conducted with financial support provided by the Conselho Nacional de Pesquisa e Desenvolvimento/Coordenao de
Aperfeioamento de Pessoal de Nvel Superior (CNPq/CAPES) and entitled: Validity and Reliability of the Autism Behavior Checklist
(ABC): Preliminary study, March 2003, presented to the Pediatric Department of the Universidade Federal de So Paulo.
1
Department of Speech Therapy, Federal University of So Paulo (UNIFESP), So Paulo (SP), Brazil (Psychologists)
Correspondence
Mrcia Regina Fumagalli Marteleto
Disciplina de Distrbios da Comunicao Humana,
Departamento de Fonoaudiologia
Rua Botucatu, 802 - Vila Clementino
04023-900 So Paulo, SP, Brazil
Phone/Fax: (11) 5549-7500.
E-mail: marcia.marteleto@terra.com.br
Rev Bras Psiquiatr. 2005;27(4):295-301
Introduction
Autism is a severe, chronic development disorder, involving
marked retardation of aptitudes for social interaction,
communication and play.1
The detection of autism and other general developmental
disorders in very young children is quite difficult since delayed
development may not be identified until the child is given the
opportunity to interact in social environments other than the
family setting. In addition, at the most severe levels, the
differential diagnosis between autism and mental retardation
is more difficult, especially among children of preschool age.2
Early diagnosis is very important since the sooner the
recommended orientation of procedures is carried out, the
more likely it is that such children will develop social and
communicative skills, and the less stereotyped their
behavior will be.
Regarding psychometric scales and psychological tests, there
are few instruments that have been validated for the evaluation
of Brazilian children under 6 years of age, and still fewer that
have been validated for the evaluation of Brazilian children
with autism or similar disorders. Therefore, to further research
and clinical treatment, it is necessary that protocols for the
evaluation of these groups of children be systematized.
In 2003, the validity of the Child Behavior Checklist (CBCL)3
for identifying children with autism was examined.4 The authors
used the CBCL to interview 38 mothers of children with autism
(mean age, 7.4 years), 31 mothers of children with other
psychiatric disorders (mean age, 7.8 years) and 34 mothers
of typical students (mean age, 7.0 years). Using logistic
regression models, those authors identified combinations of
CBCL scales that distinguished the groups. The results
suggested that the CBCL is a promising instrument for identifying
children with autism. In 2004,5 another study involving use of
the CBCL identified the most frequent behavior problems in
autistic children, discussing differences between speaking and
nonspeaking children. In general, speaking and nonspeaking
autistic children both presented behavior problems and more
complaints of thinking problems.
The second edition of the Autism Screening Instrument for
Educational Planning study (ASIEP-2 study)6-7 was initiated in
2001 and presented in 2002.8
The ASIEP-2 is a screening instrument used to evaluate the
autistic profile of children suspected of having this pathology
and to create educational plans for such children. It consists
of five subscales: the Autism Behavior Checklist (ABC), the
Sample of Vocal Behavior, Interaction Assessment, Educational
Assessment and Learning Rate Prognosis. It was designed in
the 1980s and revised in 1993 in most of the United States
and Canada. The material was administered by a
multiprofessional team (psychologists, speech therapists,
teachers and pediatricians) in special education schools whose
students presented autism, hearing impairment, mental
retardation, visual impairment or other disorders.
The ABC consists of a list of atypical behaviors characteristic of
the pathology and is designed for the triage of children suspected
of having this disorder, contributing to the differential diagnosis
and the referral of such children to educational intervention.
Due to its easy application and low cost, it has been used by
health professionals in various countries, in research and in
clinical practice. Some studies have used the questionnaire in
interviews with the parents of such children.9-10
The psychometric properties of the ABC have been investigated
and evaluated for some years. Although the scale presents
Rev Bras Psiquiatr. 2005;27(4):295-301
(66% boys and 34% girls), and 335 speaking individuals (70%
boys and 30% girls). The authors found a total mean score of
59.90 for nonspeaking individuals and 54.86 for speaking
individuals. There was no significant difference between the
two groups in mean score. The mean scores obtained in the
two groups were both lower than the 68-point cutoff proposed
by Krug et al. 6-7 In their study, Miranda-Linn and Melin 20
confirmed the proposals of other authors to decrease the 68point cutoff score, considering it too high to correctly identify
children with autism, and suggested a cutoff score of 54.
In one study, children with autism and children with mental retardation were compared using the ABC together with
two other ASIEP-2 subscales (Interaction Assessment and
Educational Evaluation). 13 The authors correctly classified
100% of the children with autistic disorder and 95% of the
children with mental retardation.
In general, only approximately 50% of children with autism
are identified when the cutoff point proposed by the authors of
the ABC is used, whereas the discriminative capacity of the
questionnaire increases significantly when the cutoff point is
lowered. 14,16-19
Based on the questions arising from these studies, the
present article proposes to examine the concurrent and
criterion validity of the ABC.
Methods
1. Par ticipants
This study involved mothers of children previously diagnosed
with autism, from two institutions of the city of So Paulo that
work exclusively with programs of behavioral and educational
intervention for autism: the Friends of Autism Association and
the Speech Disorders Outpatient Clinic of the Universidade
Federal de So Paulo (UNIFESP). The children were diagnosed
by a multiprofessional team specialized in interviewing parents,
were submitted to clinical evaluation and were diagnosed with
autism.1 Since language problems constitute one of the criteria
for the diagnosis of autism, mothers of children diagnosed
with speech disorders 1 but without autism, all undergoing
speech therapy at the UNIFESP Speech Disorders Outpatient
Clinic, were also invited to participate in the study. With the
objective of having a comparison group without speech
problems or autism complaints, mothers of school children
from an educational program in a school associated with
UNIFESP were also invited to participate. This study involved
38 mothers of children with autistic disorder, designated the
autistic disorder group (ADG), 43 mothers of children with
language disorder, designated the language disorder group
(LDG), and 52 mothers of children without autism or language
problems, designated the typical schoolchild group (TSG).
2. Adaptation of the instrument
For the prevalidation of the ABC, the questionnaire was
initially translated from English into Por tuguese. A backtranslation was then carried out by a professional proficient in
the English language. Subsequently, the questionnaire was
administered to 6 mothers, 1 of mother of a child diagnosed
with autism and 5 mothers of typical students. This test was
administered with the objective of determining whether the
translation needed to be adapted; these protocols were not
included in the validation study.
During the administration of the test, items 13, 16, 19, 20,
21, 22, 23, 25, 29, 37, 38, 48, 49, 51 and 52 required
further explanation for the mothers to understand their
Acknowledgments
We thank the Associao Amigos do Autista (AMA-SP), the Ambulatrio dos Distrbios da Comunicao Humana da UNIFESP, the Escola Paulistinha de Educao, the Centro de Recreao da UNIFESP
and Capes/CNPq. We also thank Prof. Dr. Jacy Perissinoto and Prof.
Me. Ana Carina Tamanaha, partners in studies on autism, and Prof.
Me. Ellen Osborn for the back-translation.
5.
6.
7.
8.
References
1.
American Psychiatric Association. Diagnostic and statistical manual of mental disorders DSM-IV. 4a ed. rev. Washington, DC:
APA; 2002.
2.
de Bildt A, Sytema S, Ketelaars C, Kraijer D, Mulder E, Volkmar F,
et al. Interrelationship between Autism Diagnostic Observation
Schedule-Generic (ADOS-G), Autism Diagnostic InterviewRevised (ADI-R), and the Diagnostic and Statistical Manual of
Mental Disorders (DSM-IV-TR) classification in children and
adolescents with mental retardation. J Autism Dev Disord.
2004;34(2):129-37.
3.
Achenbach TM. Manual for the child behavior checklist/4-18 and
1991 profile. Burlington, VT; Departament of Psychiatric, University
of Vermont; 1991.
4.
Duarte CS, Bordin IAS, Oliveira A, Bird H. The CBCL and the
identification of children with autism and related conditions in
Brazil: pilot findings. J Autism Dev Disord. 2003;33(6):703-7.
Rev Bras Psiquiatr. 2005;27(4):295-301
9.
10 .
11 .
12 .
13 .
14 .
15 .
16 .
17 .
18 .
19 .
20 .
21 .
22 .
23 .
24 .