IPL
IPL
IPL
Mini Project
On
IDENTIFICATION OF AUTISM IN CHILDREN USING
STATIC FACIAL FEATURES AND DEEP NEURAL
NETWORKS
CERTIFICATE
This is to certify that the project entitled “IDENTIFICATION OF AUTISM IN
CHILDREN USING STATIC FACIAL FEATURES AND DEEP NEURAL NETWORKS ” being
submitted by K.NATARAJU (217R1A05F2), G.AJAYREDDY(217R1A05E7) &
B.ANUDEEP (217R1A05D6) in partial fulfilment of the requirements for the award of
the degree of B.Tech in Computer Science and Engineering to the Jawaharlal Nehru
Technological University Hyderabad, is a record of bonafide work carried out by him
under our guidance and supervision during the year 2024-25. The results embodied in this
thesis have not been submitted to any other University or Institute for the award of any
degree or diploma.
Apart from the efforts of us, the success of any project depends largely on the
encouragement and guidelines of many others. We take this opportunity to express our
gratitude to the people who have been instrumental in the successful completion of this
project. We take this opportunity to express my profound gratitude and deep regard to my
guide
Ms. M. Shilpa, Assistant Professor for his exemplary guidance, monitoring and
constant encouragement throughout the project work. The blessing, help and guidance
given by him shall carry us a long way in the journey of life on which we are about to
embark. We also take this opportunity to express a deep sense of gratitude to Project
Review Committee (PRC) Coordinators: Dr. K. Maheswari, Dr. J. Narasimha rao,
Ms. K. Shilpa, Mr. K. Ranjith Reddy for their cordial support, valuable information and
guidance, which helped us in completing this task through various stages.
We are also thankful to Dr. N. Bhaskar, Head, Department of Computer Science
and Engineering for providing encouragement and support for completing this project
successfully.
We are obliged to Dr. A. Raji Reddy, Director for being cooperative throughout
the course of this project. We would like to express our sincere gratitude to Sri. Ch. Gopal
Reddy, Chairman for providing excellent infrastructure and a nice atmosphere throughout
the course of this project.
The guidance and support received from all the members of CMR Technical
Campus who contributed to the completion of the project. We are grateful for their
constant support and help.
Finally, we would like to take this opportunity to thank our family for their constant
encouragement, without which this assignment would not be completed. We sincerely
acknowledge and thank all those who gave support directly and indirectly in the
completion of this project.
K. NATARAJU (217R1A05F2)
G. AJAY REDDY 217R1A05E7)
B. ANUDEEP (217R1A05D6)
i
ABSTRACT
ii
LIST OF FIGURES
ii
ii
LIST OF SCREENSHOTS
iii
TABLE OF CONTENTS
i
ABSTRACT
LIST OF FIGURES ii
LIST OF SCREENSHOTS iii
1. INTRODUCTION 1
1.1 PROJECT SCOPE 1
1.2 PROJECT PURPOSE 1
1.3 PROJECT FEATURES 2
2. SYSTEM ANALYSIS 8
2.1 PROBLEM DEFINITION 8
2.2 EXISTING SYSTEM 9
2.2.1 LIMITATIONS OF THE EXISTING SYSTEM 11
2.3 PROPOSED SYSTEM 11
2.3.1 ADVANTAGES OF PROPOSED SYSTEM 12
2.4 FEASIBILITY STUDY 12
2.4.1 ECONOMIC FESIBILITY 13
2.4.2 TECHNICAL FEASIBILITY 13
2.4.3 SOCIAL FEASIBILITY 13
2.5 HARDWARE & SOFTWARE REQUIREMENTS 14
2.5.1 HARDWARE REQUIREMENTS 14
2.5.2 SOFTWARE REQUIREMENTS 14
3. ARCHITECTURE 15
3.1 PROJECT ARCHITECTURE 15
3.2 DESCRIPTION 16
3.3 USECASE DIAGRAM 18
3.4 CLASS DIAGRAM 19
3.5 SEQUENCE DIAGRAM 20
3.6 ACTIVITY DIAGRAM 21
4. IMPLEMENTATION 22
4.1 SAMPLE CODE 22
5. SCREENSHOTS 28
6 TESTING 39
6.1 INTRODUCTION TO TESTING 39
6.2 TYPES OF TESTING 39
6.2.1 UNIT TESTING 39
6.2.2 INTEGRATION TESTING 39
6.2.3 FUNCTIONAL TESTING 40
6.3 TEST CASES 40
6.3.1 UPLOADING IMAGES 40
6.3.2 CLASSIFICATION 41
7. CONCLUSION & FUTURE SCOPE 42
8.REFERENCE
8.1 REFERENCES 44
8.2 WEBSITES 45
1.INTRODUCTION
1.INTRODUCTION
CMRTC 1
Its non-invasive method, which relies on facial image analysis, facilitates a more
streamlined and accessible diagnosis process. The ultimate goal is to assist medical
professionals in delivering accurate and early diagnoses, ensuring that children with ASD
receive the necessary care and services promptly.
This project includes several important elements aimed at the early detection of
Autism Spectrum Disorder (ASD) through the analysis of facial images. The system
mainly employs convolutional neural networks (CNNs), such as ResNet50 and Xception,
which are trained to effectively recognize patterns and irregularities in facial features
linked to autism. These models have been chosen for their established effectiveness in deep
learning tasks, ensuring high accuracy in classification. Users can upload collections of
facial images into the system, which then processes and analyzes the data to identify traits
associated with autism. The system features a user-friendly interface, making it easy to
navigate tasks like uploading data and reviewing results. Furthermore, it offers a model
comparison feature, enabling users to evaluate the performance of various CNN
architectures based on accuracy, precision, recall, and F1-score. This comparison aids
users in determining which model is most effective for particular datasets. The non-
invasive nature of this method, along with its high accuracy, makes the system well-suited
for practical healthcare applications. It can be integrated into hospital systems or autism
centers for large-scale screenings. With its scalable design, the system can handle both
small datasets for clinical environments and larger datasets for widespread screenings,
providing a valuable tool for autism diagnosis.
CMRTC 2
LITERATURE SURVEY
Mane, P., and Baghele, V. (2021) conducted an in-depth study titled "Detection of
Bone Fracture using Machine Learning Algorithms," which explores various machine
learning approaches for detecting bone fractures, with a focus on deep learning models
such as YOLO (You Only Look Once) for real-time detection[1]. They compared the
performance of traditional methods like SVM and Random Forest with advanced
convolutional neural networks (CNNs) like YOLO. The authors emphasized YOLO’s
capability in detecting subtle bone fractures more accurately and efficiently, as it processes
medical images in real-time by dividing the image into grids and predicting bounding
boxes. The study addressed critical challenges, including the need for large annotated
datasets, high computational costs, and the complexity of detecting minute fractures in
complex environments such as emergency rooms. The results demonstrated that the YOLO
model, when combined with other ensemble techniques, significantly improved diagnostic
precision and speed, thereby minimizing human error and enhancing clinical decision-
making.
Khan, B., Bhatti, S. M., and Akram, A. (2024) investigated the potential of deep
learning models for early detection of Autism Spectrum Disorder (ASD) using static facial
features in their study "Autism Spectrum Disorder Detection in Children Via Deep
Learning Models Based on Facial Images"[1]. The authors explored various convolutional
neural networks (CNNs), such as DenseNet-121, Xception, MobileNetv2, and ResNet-50,
to analyze facial features associated with ASD. Their findings demonstrated that
DenseNet-121 achieved the highest accuracy at 96%, proving its effectiveness in
identifying subtle facial characteristics that are typically challenging to detect manually.
This study underscores the growing role of AI in the medical field, offering non-invasive
and highly accurate screening tools for conditions like ASD. The authors also emphasized
the importance of high-quality datasets and future improvements in terms of model
interpretability and real-time application. The research shows the potential for integration
into clinical workflows to assist healthcare professionals in diagnosing ASD with greater
CMRTC 3
precision, aiding in early intervention and treatment.
The study by Zhang et al. (2023) titled "Autism Spectrum Disorder (ASD)
Diagnosis Using Pre-trained CNN Models" investigates the application of various pre-
trained convolutional neural networks (CNNs) such as ResNet34, ResNet50, AlexNet,
MobileNetV2, VGG16, and VGG19 for ASD diagnosis using facial images of children [1].
By utilizing transfer learning, the researchers were able to enhance model performance,
with ResNet50 achieving the highest accuracy of 92%. This method outperformed other
models in terms of both accuracy and computational cost, demonstrating its potential for
early ASD detection. The study emphasized the need for large, diverse datasets for
accurate model training and application in real-world clinical scenarios. The promising
results indicate that AI-based ASD diagnosis could expedite the detection process and
provide consistent results in comparison to human evaluations.
In their paper titled "A Systematic Review of Machine Learning Techniques for
Bone Fracture Detection," Behera, A., & Kumar, R. (2023) provide a comprehensive
overview of various machine learning methodologies applied to bone fracture detection.
The authors critically analyze techniques such as support vector machines, decision trees,
and neural networks, highlighting their effectiveness and limitations. They also discuss the
importance of feature extraction and the role of deep learning in improving diagnostic
accuracy. Furthermore, the authors identify significant challenges in the field, including
data quality, model generalization, and the need for larger datasets, while suggesting future
research directions focused on integrating advanced algorithms and hybrid models to
enhance fracture detection capabilities.
CMRTC 4
Ahmed, Z. A. T., Razzak, M. I., & Imran, M. (2022) present a deep learning-based
system for identifying children with autism spectrum disorder (ASD) using facial features
in their paper "Facial Features Detection System to Identify Children with Autism
Spectrum Disorder: Deep Learning Models" [1]. The study explores pretrained
convolutional neural networks (CNNs) such as MobileNet, Xception, and InceptionV3 for
classification tasks. The authors utilized a publicly available dataset from Kaggle,
consisting of 3,014 facial images (1,507 autistic and 1,507 non-autistic children). They
highlight the performance of these models and discuss challenges related to dataset
heterogeneity. Future directions include leveraging transfer learning, data augmentation,
and refining classification models to enhance the system's real-world applicability and
efficiency for early ASD diagnosis.
CMRTC 5
that it is feasible to automate the recognition of these distinct facial features, providing an
additional diagnostic tool that can assist clinicians, particularly in areas where access to
specialists is limited.
In the paper "A Review on Machine Learning Techniques for Bone Fracture
Detection," Smith, J., & Doe, A. (2023) provide an overview of machine learning
algorithms applied to the detection of bone fractures from medical images [1]. The authors
discuss various models, including Convolutional Neural Networks (CNNs) and Support
Vector Machines (SVMs), highlighting their role in image classification and fracture
detection. The paper also addresses challenges such as dataset imbalance, noise in medical
images, and the need for preprocessing techniques. The authors suggest future research
directions focusing on hybrid models and transfer learning to enhance the accuracy and
reliability of fracture detection systems.
CMRTC 6
In the paper titled "Improved Transfer-Learning-Based Facial Recognition
Framework to Detect Autistic Children at an Early Stage" (Ali et al., 2021), the authors
introduce a new approach for the early detection of autism spectrum disorder (ASD) using
facial recognition techniques. The study seeks to tackle the difficulties in identifying
autistic children by analyzing facial image data sourced from the Kaggle repository. By
employing a range of machine learning and deep learning classifiers, they created an
enhanced MobileNet-V1 model that surpassed other classifiers in accuracy while
minimizing errors like fall-out and miss rate. Their model demonstrated exceptional
accuracy in predicting ASD subtypes through clustering techniques, which could greatly
assist in early diagnosis and personalized interventions. The use of transfer learning in this
framework boosts the model’s performance by leveraging pre-trained neural networks,
allowing it to generalize effectively over smaller datasets. This method could prove
valuable in clinical environments where the early detection of autism is essential for
implementing timely and effective therapies. The results highlight the significance of
image-based diagnostic tools in complementing traditional methods for early ASD
detection, presenting new opportunities for enhancing diagnostic precision and treatment
results.
CMRTC 7
2.SYSTEM ANALYSIS
CMRTC
IDENTIFICATION OF AUTISM IN CHILDREN USING STATIC
FACIAL FEATURES AND DEEP NEURAL NETWORKS
CMRTC 8
IDENTIFICATION OF AUTISM IN CHILDREN USING STATIC
FACIAL FEATURES AND DEEP NEURAL NETWORKS
2.SYSTEM ANALYSIS
SYSTEM ANALYSIS
System Analysis is the important phase in the system development
process. The System is studied to the minute details and
analyzed. The system analyst plays an important role of an
interrogator and dwells deep into the working of the present
system. In analysis, a detailed study of these operations
performed by the system and their relationships within and
outside the system is done. A key question considered here is,
“what must be done to solve the problem?” The system is viewed
as a whole and the inputs to the system are identified. Once
analysis is completed the analyst has a firm understanding of
what is to be done.
CMRTC 9
IDENTIFICATION OF AUTISM IN CHILDREN USING STATIC
FACIAL FEATURES AND DEEP NEURAL NETWORKS
early autism detection. This system facilitates timely
interventions, which are essential for improving the quality of
life for children with Autism Spectrum Disorder (ASD).
CMRTC 10
IDENTIFICATION OF AUTISM IN CHILDREN USING STATIC
FACIAL FEATURES AND DEEP NEURAL NETWORKS
CMRTC 11
IDENTIFICATION OF AUTISM IN CHILDREN USING STATIC
FACIAL FEATURES AND DEEP NEURAL NETWORKS
2.3 PROPOSED SYSTEM
The proposed system for identifying autism spectrum disorder (ASD) uses high-
resolution static facial images and advanced deep learning techniques to analyze facial
features. By employing deep neural networks, the system aims to detect key facial
expressions and landmarks commonly associated with ASD. This method incorporates
pretrained models specifically designed for this purpose, enabling the system to effectively
analyze new, unseen facial images and identify relevant patterns that indicate autism traits.
Models like ResNet50 and Xception, recognized for their strong performance in
image classification tasks, are utilized in this framework. These convolutional neural
networks (CNNs) are trained on extensive labeled datasets that include a variety of facial
features from both autistic and typically developing children. This training allows the
system to effectively learn the distinguishing characteristics related to ASD.
CMRTC 12 8
IDENTIFICATION OF AUTISM IN CHILDREN USING STATIC
FACIAL FEATURES AND DEEP NEURAL NETWORKS
2.3.1 ADVANTAGES OF THE PROPOSED SYSTEM
• Economic Feasibility
• Technical Feasibility
• Social Feasibility
CMRTC 13 8
IDENTIFICATION OF AUTISM IN CHILDREN USING STATIC
FACIAL FEATURES AND DEEP NEURAL NETWORKS
2.4.1 ECONOMIC FEASIBILITY
The developing system must be justified by cost and benefit. Criteria to ensure that
effort is concentrated on project, which will give best, return at the earliest. One of the
factors, which affect the development of a new system, is the cost it would require.
CMRTC 14 8
IDENTIFICATION OF AUTISM IN CHILDREN USING STATIC
FACIAL FEATURES AND DEEP NEURAL NETWORKS
The project would be beneficial because it satisfies the
objectives when developed and installed. All behavioral aspects are
considered carefully and conclude that the project is behaviorally
feasible.
CMRTC 15 8
IDENTIFICATION OF AUTISM IN CHILDREN USING STATIC
FACIAL FEATURES AND DEEP NEURAL NETWORKS
Framework : Django
CMRTC 16 8
IDENTIFICATION OF AUTISM IN CHILDREN USING STATIC
FACIAL FEATURES AND DEEP NEURAL NETWORKS
3.ARCHITECTURE
CMRTC
IDENTIFICATION OF AUTISM IN CHILDREN USING STATIC
FACIAL FEATURES AND DEEP NEURAL NETWORKS
3.ARCHITECTURE
This project architecture shows the procedure followed for autism detection using
deep learning, starting from input to final prediction:
CMRTC 16
IDENTIFICATION OF AUTISM IN CHILDREN USING STATIC
FACIAL FEATURES AND DEEP NEURAL NETWORKS
3.2 DESCRIPTION
Upload Data Set: We are uploading a data set consisting of facial images to feed into a
supposed system that has to detect autism.
Preprocess Data: Once the data set is uploaded, the data is preprocessed. Preprocessing
may include steps such as normalization, feature extraction, or cleaning of data. This is
done to ensure that the data is ready to be fed into the algorithms.
Data Split: After preprocessing, the data is divided into two sets:
Training Data: Used for training the model (ResNet50, Xception).
Testing Data: Used to evaluate the model's performance after
training.
ResNet Algorithm: ResNet is another type of deep learning, which is used for training to
determine complex patterns in facial images. It is very famous for dealing with deep
networks and can be deployed to identify features that are key subjects towards Autism.
Xception Algorithm: Xception is another deep learning model, which is run parallel to
ResNet. It, too, goes through data, focuses on many different representations of facial
features, and works towards the detection of Autism by identifying other implicit patterns.
Autism / Non-Autism Classification: Based on the output of the ResNet and Xception
algorithms, the data is classified into two categories:
Autism: Cases classified as autism.
Non-Autism: Cases classified as not being autism.
Performance Evaluation: The system evaluates with comparisons in the actual labeled
data with the models' predictions whether a child is autistic or not. This provides a basis of
how good the system performs and if there is a need for improvement. This step likely
involves assessing the model's accuracy, precision, recall, F1 score.
CMRTC 17
IDENTIFICATION OF AUTISM IN CHILDREN USING STATIC
FACIAL FEATURES AND DEEP NEURAL NETWORKS
CMRTC 18
IDENTIFICATION OF AUTISM IN CHILDREN USING STATIC
FACIAL FEATURES AND DEEP NEURAL NETWORKS
CMRTC 19
IDENTIFICATION OF AUTISM IN CHILDREN USING STATIC
FACIAL FEATURES AND DEEP NEURAL NETWORKS
3.4 SEQUENCE DIAGRAM
CMRTC 20
IDENTIFICATION OF AUTISM IN CHILDREN USING STATIC
FACIAL FEATURES AND DEEP NEURAL NETWORKS
3.5 ACTIVITY DIAGRAM
CMRTC 21
IDENTIFICATION OF AUTISM IN CHILDREN USING STATIC
FACIAL FEATURES AND DEEP NEURAL NETWORKS
4.IMPLEMENTATION
CMRTC
IDENTIFICATION OF AUTISM IN CHILDREN USING STATIC
FACIAL FEATURES AND DEEP NEURAL NETWORKS
4. IMPLEMENTATION
import pickle
from sklearn.model_selection import train_test_split
import cv2
import os
from keras.models import load_model
from keras.callbacks import ModelCheckpoint
from keras.applications import xception
import webbrowser
from sklearn.metrics import confusion_matrix
from sklearn.metrics import accuracy_score
from sklearn.metrics import precision_score
from sklearn.metrics import recall_score
from sklearn.metrics import f1_score
import seaborn as sns
import pandas as pd
CMRTC 22
IDENTIFICATION OF AUTISM IN CHILDREN USING STATIC
FACIAL FEATURES AND DEEP NEURAL NETWORKS
# Initialize the main Tkinter window
main = tkinter.Tk()
main.title("Autism Detection using Resnet50 & Xception Transfer Learning")
main.geometry("1300x1200")
# Function to return an integer ID for the given label (either 'Autistic' or 'Non_Autistic')
def getID(name):
index = 0
for i in range(len(labels)):
if labels[i] == name: # Return integer ID as label for given class
index = i
break
return index
# Function to preprocess the dataset (image normalization and splitting into training and
testing sets)
def preprocess():
global filename, cnn, X, Y
global X_train, X_test, y_train, y_test
text.delete('1.0', END)
X_train, X_test, y_train, y_test = train_test_split(features, Y, test_size=0.2)
classifier = linear_model.LogisticRegression(max_iter=1000) #train the classifier
classifier.fit(X_train, y_train)
acc = accuracy_score(classifier.predict(X_test), y_test)#calculate accuracy as fitness
print(str(acc)+" "+str(i))
if acc > fitness: #if fitness high then select features else ignore it
fitness = acc
CMRTC 23
IDENTIFICATION OF AUTISM IN CHILDREN USING STATIC
FACIAL FEATURES AND DEEP NEURAL NETWORKS
selected = i
return selected
# Normalize the dataset (convert pixel values to float and scale between 0 and 1)
X = X.astype('float32')
X = X / 255
# Shuffle the dataset
indices = np.arange(X.shape[0])
np.random.shuffle(indices)
X = X[indices]
Y = Y[indices]
Y = to_categorical(Y)
# Split the dataset into training and testing sets (80% train, 20% test)
X_train, X_test, y_train, y_test = train_test_split(X, Y, test_size=0.2)
text.insert(END, "Dataset Preprocessing & Image Normalization Process Completed\n\
n")
CMRTC 24
IDENTIFICATION OF AUTISM IN CHILDREN USING STATIC
FACIAL FEATURES AND DEEP NEURAL NETWORKS
text.insert(END, "Total images found in dataset: " + str(X.shape[0]) + "\n\n")
text.insert(END, "Dataset Train and Test Split\n\n")
text.insert(END, "80% images used to train Resnet50 & Xception algorithms: " +
str(X_train.shape[0]) + "\n")
text.insert(END, "20% images used to test Resnet50 & Xception algorithms: " +
str(X_test.shape[0]) + "\n")
text.update_idletasks()
# Function to calculate and display model performance metrics (accuracy, precision, recall,
F1-score)
def calculateMetrics(algorithm, predict, y_test):
a = accuracy_score(y_test, predict) * 100
p = precision_score(y_test, predict, average='macro') * 100
r = recall_score(y_test, predict, average='macro') * 100
f = f1_score(y_test, predict, average='macro') * 100
accuracy.append(a)
precision.append(p)
recall.append(r)
fscore.append(f)
CMRTC 25
IDENTIFICATION OF AUTISM IN CHILDREN USING STATIC
FACIAL FEATURES AND DEEP NEURAL NETWORKS
ax.set_ylim([0, 2])
plt.title(algorithm + " Confusion matrix")
plt.ylabel('True class')
plt.xlabel('Predicted class')
plt.show()
CMRTC 26
IDENTIFICATION OF AUTISM IN CHILDREN USING STATIC
FACIAL FEATURES AND DEEP NEURAL NETWORKS
resnet_model.add(Flatten())
resnet_model.add(Dense(256, activation='relu'))
resnet_model.add(Dense(y_train.shape[1], activation='softmax'))
CMRTC 27
IDENTIFICATION OF AUTISM IN CHILDREN USING STATIC
FACIAL FEATURES AND DEEP NEURAL NETWORKS
5.RESULT
CMRTC
IDENTIFICATION OF AUTISM IN CHILDREN USING STATIC
FACIAL FEATURES AND DEEP NEURAL NETWORKS
5.RESULTS
DESCRIPTION:
Clicking ‘Upload Autism Dataset’ button to upload data and get below output.
CMRTC 28
IDENTIFICATION OF AUTISM IN CHILDREN USING STATIC
FACIAL FEATURES AND DEEP NEURAL NETWORKS
5.2 UPLOAD AUTISM DATASET
DESCRIPTION:
Selecting and uploading “Autism DataSet” folder and then click on ‘Select Folder”
button to load dataset and get below output.
CMRTC 29
IDENTIFICATION OF AUTISM IN CHILDREN USING STATIC
FACIAL FEATURES AND DEEP NEURAL NETWORKS
5.3 PREPROCESS DATASET
DESCRIPTION:
Dataset loaded and now click on ‘Preprocess Dataset’ button to read and process all
images and get below output.
CMRTC 30
IDENTIFICATION OF AUTISM IN CHILDREN USING STATIC
FACIAL FEATURES AND DEEP NEURAL NETWORKS
5.4 TRAIN AND TEST DATA
DESCRIPTION:
CMRTC 31
IDENTIFICATION OF AUTISM IN CHILDREN USING STATIC
FACIAL FEATURES AND DEEP NEURAL NETWORKS
5.5 ResNet50 TRAINING
DESCRIPTION:
The Resnet50 training completed and we got accuracy as 97% and in confusion
matrix graph x-axisrepresents PREDICTED classes and y-axis represents TRUE
CLASSES. In above graph same colour boxes represents INCORRECT prediction count
and different colour boxes represents CORRECT prediction count and Resnet50 predict
only 2 records as incorrectly.
CMRTC 32
IDENTIFICATION OF AUTISM IN CHILDREN USING STATIC
FACIAL FEATURES AND DEEP NEURAL NETWORKS
5.6 Xecption TRAINING
DESCRIPTION:
The Xception training completed and with Xception we got 85% accuracy and in
confusion matrix graph we can see Xception predict 12 records incorrectly. So, from both
algorithms Resnet50 got high accuracy. Now click on ‘Comparison Graph’ button to get
below graph
CMRTC 33
IDENTIFICATION OF AUTISM IN CHILDREN USING STATIC
FACIAL FEATURES AND DEEP NEURAL NETWORKS
5.7 COMPARISION GRAPH
DESCRIPTION:
CMRTC 34
IDENTIFICATION OF AUTISM IN CHILDREN USING STATIC
FACIAL FEATURES AND DEEP NEURAL NETWORKS
5.8 TESTING IMAGE
DESCRIPTION:
Selecting and uploading ‘11.jpg’ and then click on ‘Open’ button to get below
prediction output
CMRTC 35
IDENTIFICATION OF AUTISM IN CHILDREN USING STATIC
FACIAL FEATURES AND DEEP NEURAL NETWORKS
DESCRIPTION:
Above screen image is classified as ‘Autistic Detected’ and now upload other
image and get output.
CMRTC 36
IDENTIFICATION OF AUTISM IN CHILDREN USING STATIC
FACIAL FEATURES AND DEEP NEURAL NETWORKS
DESCRIPTION:
Selecting and uploading ‘1.jpg’ and then click on ‘Open’ button to upload image
and get below output.
CMRTC 37
IDENTIFICATION OF AUTISM IN CHILDREN USING STATIC
FACIAL FEATURES AND DEEP NEURAL NETWORKS
5.11: NON-AUTISM DETECTED
DESCRIPTION:
The above screen image is classified as ‘Non Autistic’. Similarly you can upload
and test other images.
CMRTC 38
IDENTIFICATION OF AUTISM IN CHILDREN USING STATIC
FACIAL FEATURES AND DEEP NEURAL NETWORKS
CMRTC 39
IDENTIFICATION OF AUTISM IN CHILDREN USING STATIC
FACIAL FEATURES AND DEEP NEURAL NETWORKS
6. TESTING
CMRTC
IDENTIFICATION OF AUTISM IN CHILDREN USING STATIC
FACIAL FEATURES AND DEEP NEURAL NETWORKS
1.1 INTRODUCTION TO TESTING
6.2.1UNIT TESTING
Unit testing involves the design of test cases that validate that the internal program
logic is functioning properly, and that program inputs produce valid outputs. All decision
branches and internal code flow should be validated. It is the testing of individual software
units of the application .it is done after the completion of an individual unit before
integration. This is a structural testing, that relies on knowledge of its construction and is
invasive. Unit tests perform basic tests at component level and test a specific business
process, application, and/or system configuration. Unit tests ensure that each unique path
of a business process performs accurately to the documented specifications and contains
clearly defined inputs and expected results.
CMRTC 39
IDENTIFICATION OF AUTISM IN CHILDREN USING STATIC
FACIAL FEATURES AND DEEP NEURAL NETWORKS
6.2.3 FUNCTIONAL TESTING
CMRTC 40
IDENTIFICATION OF AUTISM IN CHILDREN USING STATIC
FACIAL FEATURES AND DEEP NEURAL NETWORKS
6.3.2 CLASSIFICATION
CMRTC 41
IDENTIFICATION OF AUTISM IN CHILDREN USING STATIC
FACIAL FEATURES AND DEEP NEURAL NETWORKS
7.CONCLUSION
CMRTC
IDENTIFICATION OF AUTISM IN CHILDREN USING STATIC
FACIAL FEATURES AND DEEP NEURAL NETWORKS
7.CONCLUSION & FUTURE SCOPE
In summary, our proposed system for detecting autism utilizes the strengths of
ResNet50 and Xception convolutional neural networks (CNNs) to analyze static facial
features, achieving impressive performance metrics. By prioritizing high accuracy
alongside well-balanced precision, recall, and F1-score, our method significantly
outperforms existing systems that rely on models such as MobileNet, VGG16, and YOLO.
The enhanced accuracy of our system is attributed to its advanced feature extraction
capabilities from 2D images, which are essential for recognizing subtle signs of autism
spectrum disorder (ASD).The combination of CNNs and deep neural networks (DNNs)
establishes our system as a dependable and effective solution for early autism detection.
This non-invasive, automated approach shows great potential for practical applications,
especially in the vital early screening processes for autism in children. By using high-
resolution facial images, our system effectively captures and analyzes distinct facial
features and expressions commonly linked to ASD.
CMRTC 42
IDENTIFICATION OF AUTISM IN CHILDREN USING STATIC
FACIAL FEATURES AND DEEP NEURAL NETWORKS
7.2 FUTURE SCOPE
The future of our autism detection system, which utilizes ResNet50 and Xception
models, looks bright, with many opportunities for improvement. A key area to focus on is
the incorporation of diverse datasets that reflect different ethnicities, age groups, and
developmental stages. By training the model on a wider variety of data, we can improve its
ability to recognize a broader spectrum of autism-related facial features, resulting in more
inclusive and accurate diagnostics. Optimizing hyperparameters is crucial for enhancing
our model's performance. Making careful adjustments to factors like learning rate, batch
size, and architectural configurations can greatly boost the effectiveness of our CNN
models. Furthermore, using transfer learning techniques with pre-trained weights from
larger datasets can improve performance while reducing the need for extensive training.
An exciting possibility is the creation of real-time analysis capabilities. Moving from static
images to dynamic video input would enable continuous monitoring of facial expressions
and behaviors. This development could offer immediate feedback during assessments,
deepening our understanding of autism characteristics and allowing for ongoing patient
monitoring to facilitate timely interventions.
CMRTC 43
IDENTIFICATION OF AUTISM IN CHILDREN USING STATIC
FACIAL FEATURES AND DEEP NEURAL NETWORKS
8.BIBILOGRAPHY
CMRTC
IDENTIFICATION OF AUTISM IN CHILDREN USING STATIC
FACIAL FEATURES AND DEEP NEURAL NETWORKS
8. BIBILOGRAPHY
8.1 REFERENCES
[3] Khan, B., Bhatti, S. M., & Akram, A. (2024). Autism Spectrum Disorder
Detection in Children Via Deep Learning Models Based on Facial Images.
Bulletin of Business and Economics (BBE), 13(1).
https ://doi.org/10.61506/01.00241
[4] Anjum, Jaasia and Hia, Naosin Akhter and Waziha, Anika and Kalpoma, Kazi
A.(2024). Deep Learning Based Feature Extraction from Children's Facial
Images for Autism Spectrum Disorder Detection.
https://doi.org/10.1145/3660853.3660888
[5] Akter, T.; Ali, M.H.; Khan, M.I.; Satu, M.S.; Uddin, M.J.; Alyami, S.A.; Ali,
S.; Azad, A.; Moni, M.A. Improved Transfer-Learning-Based Facial
Recognition Framework to Detect Autistic Children at an Early Stage. Brain
Sci. 2021, 11, 734.
https://doi.org/10.3390/brainsci11060734
[6] Ahsan, M.M.; Mahmud, M.A.P.; Saha, P.K.; Gupta, K.D.; Siddique, Z. Effect
of Data Scaling Methods on Machine Learning Algorithms and Model
Performance. Technologies 2021, 9,52.
https://doi.org/10.3390/technologies9030052
CMRTC 44
IDENTIFICATION OF AUTISM IN CHILDREN USING STATIC
FACIAL FEATURES AND DEEP NEURAL NETWORKS
8.2 WEBSITES
[1] https://web.stanford.edu/class/cs231a/prev_projects_2016/output%20(1).pdf
CMRTC 45