AI and Software Testing: Vikram Raghuwanshi Senior Consultant
AI and Software Testing: Vikram Raghuwanshi Senior Consultant
AI and Software Testing: Vikram Raghuwanshi Senior Consultant
Vikram Raghuwanshi
Senior Consultant
Capgemini Technology Services
1
ABSTRACT
SAS STANFORD
ML is a current application of
AI based on the idea that ARTIFICIAL
machines be given access to INTELLIGENCE (AI)
data and allowed to learn for
themselves
Data Source 1
DATA ENRICHMENT:
TRAINING DATA
DASHBOARDS
MODEL
Data Source 2
NOTIFICATIONS STATISTICAL MODEL:
TRENDS / GRAPHS
Data Source 3
DATA VISUALIZATION:
What you need to build
AI systems (Languages)
Python
• Choice of Python for AI projects also stems from the fact that there are
• Python is a popular and widely used language and a rising plenty of useful libraries that can be used in AI for example, Numpy
star for machine learning offers scientific computation capability, Scypy for advanced computing
and Pybrain for machine learning in Python
• It can seamlessly be used with the data structures and other
frequently used AI algorithms • Easy to learn, program and debug
• Tons of reading materials and helpful resources available online.
R
• Encompasses enormous number of machine learning algorithms,
• R is a workhorse for statistical analysis and by extension
and advanced implementations too written by the developers of the
machine learning
algorithm
• Hugely popular among data scientists, statisticians, data
• Complex statistical algorithms can be written in a few lines of code
analysts and enthusiasts
• Plenty of extremely useful R packages such as dplyr, plyr to
• It is the default language to understand and explore data
manipulate data; ggvis, lattice and ggplot2 to visualize data; caret for
using statistical methods and graphs
machine learning
What you need to build AI
systems (Platforms &
Skillsets)
RapidMiner KNIME
• Licensed but offers a free version with
restriction on input data rows • Opensource data analysis platform
RTM analysis
An futuristic AI Exhaustive Reporting
application that
Identification of right
Test Cases
will address Preserving Of test
Artifacts
various aspects
Continuous Integration Machine Learning
of testing
Prerequisites for using AI
based system in Testing
• Data Acquisition & Cleansing • Relevant access to data source
• Defects
• Access to Data Science Platform
AI solution gets various data feeds; it then gives critical predictive analysis to the
testing teams across project’s lifecycle assisting them to keep adjusting to various
moving parameters influencing outcomes of the project.
• Analyses asset’s usage trend, execution • Predicts which resource is best suited for what
duration, attached criticality through tasks (& auto assigns such tasks to identified
requirements, defects mapping etc. resources based on bandwidth)
Insights from AI solution
• Provides real time test data consumption and business • Predicting vulnerable (prone to defects) modules in the
requirement coverage Application Under Test
• Predicting the right Test Case pack for a new requirement
Benefits of Using AI in QA
• Shift left testing for faster time-to-market &
improved quality
• AI application will effectively help in
generating and optimizing test cases,
prioritizing testing and automation, enhancing IMPROVED QUALITY
UI testing and reducing tedious analysis & FASTER TIME-TO-
tasks. MARKET
Resource Prediction
• Dashboard aggregates data of defects that have been
logged by the developers
• The aggregated historical defect data will be analyzed
based on severity and type of defect and prediction can
happen for future developer defects during releases
• The dashboard offers analysis, retrospection and
prescription of defects that have been logged Risk Based Test Case Selection
TEST CASE RECOMMENDATION AUTO / SELF ROOT CAUSE ANALYSIS PREDICT THE TEST CASE FAILURE
List of Available Selected Test Case TC3 Actual TC status Predicted TC status
Test Cases for execution