Introduction To AI
Introduction To AI
Introduction To AI
• Definition of AI
• Example Systems
• Approaches to AI
• Brief History
• Current Position
• AI Foundation
• AI Techniques
AI
Sofia – First Humanoid Robot to get Siri - Virtual/intelligent assistant
UAE citizenship
• "Within ten years a digital computer will be the world's chess champion unless
the rules bar it from competition.” Allen Newell (1957)
• Combinatorial explosion:
o One used randomly modified static evaluation function, the other didn’t
change.
o If randomly modified version did better, then that version was adopted for next
round
Intelligence
What is the result of this operation
If someone manage to find the answer within 2 second, can we say the person is
intelligent???
In case of Computer??
• What if same question asked to computer; can the computer be called intelligent?
AI
Intelligence …
if asked to computer?
AI
Intelligence …
AI
Difference between Human and Machine Intelligence
• Humans can figure out the complete object even if some part of it is missing
or distorted; whereas the machines cannot do it correctly (in general).
AI
Difference between Human and Machine Intelligence
AI
Difference between Human and Machine Intelligence
AI
Artificial Intelligence
Artificial intelligence as the study and construction of agent programs that perform
well in a given environment, for a given agent architecture.
Agent as an entity that takes action in response to percept from an environment.
Rationality is the property of a system which does “right thing” given what it knows.
AI
Artificial Intelligence
Logical reasoning is the process of deriving new sentences from old, such that new
sentences are necessarily true if the old ones are true.
Example:
All MIU students are intelligent.
Roshan is MIU student
====================
Roshan is intelligent
AI
AI
• AI is actually concerned with design of intelligence in an artificial device.
AI
AI . . .
What is intelligence?
Like Humans ..
• Behave as intelligently as a human
• Thinking
• Acting
Goals of AI
To Create Expert Systems − systems which exhibit intelligent behavior, learn, demonstrate,
explain, and advice its users.
To Implement Human Intelligence in Machines − Creating systems that understand,
think, learn, and behave like humans.
AI
AI Definitions
• AI is technology.
• Branch of computer science that studies and develops intelligent machines and software.
• The exciting new effort to make computers think … machines with minds, in the full
literal sense. (Haugeland, 1985)
• Study of mental faculties through the use of computational models. (Charniak &
McDermott, 1985)
• A field of study that seeks to explain and emulate intelligent behavior in terms of
computational processes. (Schalkoff, 1990)
• The study of how to make computers do things at which, at the moment, people are better.
(Rich & Knight, 1991)
• The art of creating machines that perform functions that require intelligence when
performed by people'' (Kurzweil, 1990)
AI
AI Definitions ...
• AI seeks to understand the working of the mind in mechanistic terms.
• Study of computations that make it possible to perceive, reason, & act (Winston, 1992)
• The automation of activities that we associate with human thinking, activities such as
decision-making, problem solving, learning ...'' (Bellman, 1978)
• The branch of computer science that is concerned with the automation of intelligent
behavior'' (Luger and Stubblefield, 1993)
• The goal of work in artificial intelligence is to build machines that perform tasks
normally requiring human intelligence. (Nilsson, Nils J. - 1971)
• Research scientists in AI try to get machines to exhibit behavior that we call intelligent
behavior when we observe it in human beings. (Slagle, James R. - 1971)
AI
Levels of needs
• Individual – machine as an amplifier of human capacity and intelligence
• Organizational
• Society
• Access & intelligent navigation in the world knowledge bases (scientific, music, sport,)
• Effective management of intellectual capital, “who knows what, who needs to know what,
and how to learn what is needed”
• Automated tools for pattern discovery and knowledge acquisition (individual & collective)
• Decision support for all professionals: diagnostic, configuration, problem solving, process
control
• Entertainment closer to the life (intelligent games, travel guides and tips, VR visit
of monuments with interaction (touch, smell…)
• Health services
Holistic Perspective
Multi-Lateral Agencies,
Society International Societal
5
Organizations
Countries, Consortia,
Nations/Regions 4 Regional Entities
Companies, Universities,
3 Government Agencies
Enterprise
Employees, Suppliers,
Individual 1 Customers, Stakeholders,
Alliance, Partners
Why AI ?
• Better understanding of our brain capacity
• Intuitive software
• Automated reasoning.
• Machine vision,
• Speech recognition,
AI
Dimensions in AI Definitions
• Term intelligent is important to ensure that the actions and thinking that are being
imitated and incorporated in machine should be RATIONAL.
AI
AI …
Thinking humanly
Thinking rationally
Acting humanly
Acting rationally
AI
Thinking Humanly: The Cognitive modelling approach
AI
Thinking Rationally: The “laws of thought” approach
Design a machine or a system that can think logically through applying some
laws (rules) which govern the operation of mind. Hence, it can solve problem
described in logical notation.
Example:
All students are good.
Roshan is student
====================
Roshan is good
AI
Acting humanly: The Turing Test approach
Computer has to pass the Turing Test, proposed by Alan Turing (1950).
provide a satisfactory operational definition of intelligence.
Turing defined intelligent behavior as the ability to achieve human-level performance
in all cognitive tasks, sufficient to fool an interrogator.
A computer passes the test if a human interrogator, after posing some written
questions, cannot tell whether the written responses come from a person or from a
computer.
The rational-agent approach has two advantages over the other approaches.
1. More general than “laws of thought” approach, because correct inference is just one of several
possible mechanisms for achieving rationality.
2. More amenable to scientific development than are approaches based on human behaviour or
human thought.
AI
AI definitions & categories
Thinking Humanly Thinking Rationally
“The art of creating machines that perform “Computational Intelligence is the study of the
functions that require intelligence when performed design of intelligent agents.” (Poole et al., 1998)
by people.” (Kurzweil, 1990)
AI
Intelligence
• The ability of a system to calculate, reason, perceive relationships and analogies, learn
from experience, store and retrieve information from memory, solve problems,
comprehend complex ideas, use natural language fluently, classify, generalize, and
adapt new situations.
• Intelligence Components:
• Reasoning
• Learning
• Problem Solving
• Perception
• Linguistic Intelligence
AI
Intelligence Components__ Reasoning
• Reasoning − It is the set of processes that enables us to provide basis for judgement,
making decisions, and prediction. (broadly two types)
AI
Intelligence Components__ Learning
• Learning − Activity of gaining knowledge or skill by studying, practising, being taught, or
experiencing something. Learning enhances the awareness of the subjects of the study.
• The ability of learning is possessed by humans, some animals, and AI-enabled systems.
• Auditory Learning − learn by listening & hearing. (students listening to recorded audio lectures)
• Motor Learning − learn by precise movement of muscles. (picking objects, Writing, etc.)
• Observational Learning − learn by watching and imitating others. (child tries to learn by
mimicking)
• Perceptual Learning − learn to recognize stimuli (seen before). (identifying & classifying
objects/situations)
AI
Intelligence Components
• E.g., Adding ‘little less’ salt at the time of cooking potatoes that came up salty last
time, when cooked with adding say a tablespoon of salt.
• Spatial Learning − learn through visual stimuli such as images, colors, maps, etc.
• E.g., A person can create roadmap in mind before actually following the road.
AI
Intelligence Components
Problem Solving − Process in which one perceives & tries to arrive at desired solution
from present situation by taking some path, that is blocked by known/unknown hurdles.
• Also includes decision making, which is the process of selecting the best suitable
alternative out of multiple alternatives to reach the desired goal are available.
Linguistic Intelligence − It is one’s ability to use, comprehend, speak, and write the verbal
and written language. It is important in interpersonal communication.
AI
Types of Intelligence
AI
Types of Intelligence . . .
AI
Foundation of Artificial Intelligence
• Computer engineering
• Mathematics
• Control theory
• Philosophy
• Economics
• Neuroscience
• Psychology
• Linguistics
AI
Foundation of Artificial Intelligence
1. Philosophy
Philosophers made AI conceivable by considering the ideas that the mind, in
some ways like a machine, operates on knowledge encoded in some internal
language, and that thought can be used to choose what actions to take.
2. Mathematics
Mathematicians provided the tools to manipulate statements of logical
certainty as well as uncertain, probabilistic statements. They also set the
groundwork for understanding computation and reasoning about algorithms.
4. Neuroscience
Neuroscientists discovered some facts about how brain works, and the ways in
which it is similar to and different from computers.
5. Psychology
Psychologists adopted the idea that humans and animals can be considered
information processing machines.
7. Control theory
Control theory deals with designing devices that act optimally on the basis of
feedback from the environment. Initially, the mathematical tools of control
theory were quite different from AI, but the fields are coming closer together.
8. Linguistics
How does language relate to thought, and action?
AI
AI Techniques
• Case-Based Reasoning, &
• Rule-Based Reasoning
Case-Based Reasoning
Case-Based Reasoning
AI
AI Techniques
Rule-Based Reasoning
Rule-based systems (RBS) solve problems by rules derived from expert knowledge.
The rules
Have condition and action parts, If and Then.
And are fed to an inference engine, which has :
a working memory of information about the problem,
a pattern matcher and,
a rule applier.
Pattern matcher refers to working memory to decide which rules are relevant, then the
rule applier chooses what rule to apply.
New information created by the action (-THEN-) part of the rule applied is added to
working memory and the MATCH-SELECT-ACT cycle between working memory and
knowledge base repeats until no more relevant rules are found.
AI Techniques
Rule-Based Reasoning
The facts and rules Uncertainty can be incorporated in RBS by approaches such as
subjective probability theory, Dempster-Shafer theory, possibility theory, certainty factors
and Prospector’s subjective Bayesian method, or qualitative approaches such as Cohen’s
theory of endorsements.
They assign to the facts and rules uncertainty values (probabilities, belief functions,
membership values) given by human experts.
There are two rule based systems: forward and backward chaining.
Forward chaining is data-driven: from initial facts it draws conclusions using rules.
Backward chaining is goal-driven: beginning with a hypothesis, it looks for rules
allowing it to be sustained.
Forward chaining discovers what can be derived from the data, & backward chaining
seeks justification for decisions.
AI
AI Techniques
AI Techniques
Fuzzy logic
A type of reasoning based on the recognition that logical statements (truth values of
variables) are not only true or false (white or black areas of probability) but can also
range from 'almost certain' to 'very unlikely' (gray areas of probability).
Truth values of variables may be any real number between 0 and 1, considered to
be "fuzzy".
Neural Network
• These models are used to estimate or approximate functions that can depend on a large
number of inputs and are generally unknown.
• A neural network uses rules it “learns” from patterns in data to construct a hidden layer of
logic.
• The hidden layer then processes inputs, classifying them based on the experience of the model.
• Neural network can be trained to distinguish between valid and fraudulent credit card
purchases.
AI Techniques
Neural Network__Example
Suppose you wanted to predict what someone's profession is based on how much they
like Star Trek and how good they are at math.
You gather several people into a room and you measure how much they like Star Trek
and give them a math test to see how good they are at math.
You then ask what they do for a living.
After that you create a plot placing each person on in based upon their Star Trek and
Math scores.
if few lines are drawn, creates borders between the groups of people.
Judging A random/new person can be much easier.
As a side note, single layer perceptron (algorithm for supervised learning) can be
analytically derived in one step.
We will train the neural network by adjusting the weights in the middle until it starts
to produce the correct output.
AI
AI Techniques
Genetic Algorithm
AI
AI Techniques
Genetic Algorithm
Genetic algorithm does not examine every single timing plan candidate, but is a
random guided search, capable of intelligently tracking global optimum solution.
As with human race, weakest candidates are eliminated from the gene pool, and each
successive generation of individuals contains stronger and stronger characteristics.
It’s survival of the fittest, and the unique processes of crossover and mutation
conspire to keep the species as strong as possible.
AI
AI Techniques
Robotics
• Began as a field within mechanical and electrical engineering
• Today encompasses a much wider range of activities
o Robot cup competition
o Evolutionary robotics
56
Some Applications of AI
Both are common in robotics, expert systems and natural language processing.
AI
Time Machine for AI Developments
1943 McCulloch & Pitts: Boolean circuit model of brain
Deep Blue defeated the reigning world chess champion Garry Kasparov in 1997
No hands across America (driving autonomously 98% of the time from Pittsburgh to
San Diego)
During the 1991 Gulf War, US forces deployed an AI logistics planning and scheduling
program that involved up to 50,000 vehicles, cargo, and people
AI
AI
Applications of AI
1. Pattern Recognition
2. Speech and Voice Recognition
3. Robotics
4. Data Mining
5. Finance
6. Medical
7. Industries
8. Telephone maintenance
9. Telecom
10. Transport
11. Entertainment
AI
Agents & Environment
• An agent is commonly a person who can do our job usually on some obligation.
• An agent is anything that can be viewed as perceiving its environment through sensors
and acting upon that environment through effectors.
AI
Agent Terminology
• Performance Measure of Agent − criteria, which determines how successful an agent is.
• Behavior of Agent − action, that agent performs after any given sequence of percepts.
• Percept Sequence − history of all that an agent has perceived till date.
Rationality
• Expected actions and results depending upon what the agent has perceived.
Human agent has eyes, ears, other organs for sensors; & hands, legs, vocal tract for effectors.
Robotic agent have cameras, infrared range finders for sensors; & various motors for
actuators.
Software agent receives keystrokes, file contents, & network packets as sensory inputs &
acts on environment by displaying on screen, writing files, and sending network packets.
AI
Ideal Rational Agent
• Capable of doing expected actions to maximize its performance measure, on the basis of:
• A rational agent always performs right action, where right action means the action that
causes agent to be most successful in given percept sequence.
Task environments, are essentially the “problems” to which rational agents have the
“solutions.”
• Performance,
• Environment,
• Actuators,
• Sensors.
In designing an agent, first step must always be to specify task environment as fully as
possible.
AI
Intelligent Agents
• Performance Evaluation of an agent: How correctly or efficiently an agent serves to our
expectation. It could be relative depending on individuals expectations.
• Intelligent Agents: Agents which can transform percepts into actions rationally.
AI
Intelligent Agents
• Intelligent agent may not be show perfection like a hard core agent.
• Percepts are components which agent requires as inputs like cameras, speedometer
to control speed.
Agent
Type Percepts Actions Goals Environnent
Safe, fast,
Steer, legal,
Cameras, Roads, other
accelerate, comfortable
Taxi driver speedometer, GPS, traffic, pedestrians,
brake, talk to trip,
sonar, microphone customers
passenger maximize
profits
AI
Intelligent Agents
Types of agent programs
Simple Reflex Agent: When actions of nearest object are clearly visible then what response
has to be taken, e.g.
• If car going ahead applies brake (as appears from brake lights of front car), then car
following it should also initiate brake (take counter action against an action reaction
vs action)
Agents that keep track of the world
- To know about if some other car is over taking our car then what to do!
AI
Intelligent Agents
AI
Intelligent Agents
Goal based agents
• More flexible than reflex agent, since the knowledge supporting a decision is explicitly
modelled, thereby allowing for modifications.
• Goal should be known to agent by means of sequence of actions to follow during operation.
E.g. destination should be known to a taxi driver accordingly paths can be derived.
AI
Intelligent Agents
AI
Environment Properties
Accessible
• Whether the sensors of the agent can access complete environment or partially.
Deterministic
• Whether the next state can be determined by the current state specifically.
Episodic
• Whether environment’s states are available in episodes (parts) or all at one time
Static
Discrete
• Whether the percepts and actions are distinct, & limited like moves in a chess game,
or continuous like a running ship/train/non-digital clock (seconds arm)/ceiling fan.
AI
Environment Properties
AI
Problem-Solving Steps Performed by Agent
1. Goal formulation
First step in problem solving.
3. Searches for a sequence of actions that would solve the problem, and then,
Formal name for this is the transition model, specified by a function RESULT(s, a)
that returns the state that results from doing action a in state s.
Use the term successor to refer to any state reachable from a given state by a
single action.
• Together, the initial state, actions, and transition model implicitly define the state
space of the problem—the set of all states reachable from initial state by any
sequence of actions.
• State space forms a directed network or graph in which the nodes are states and
links between nodes are actions.
• The preceding elements define a problem, and can be gathered into a single
data structure that is given as input to a problem-solving algorithm.
AI
Expert systems
• Software package to assist humans in situations where expert knowledge is
required; e.g. medical diagnosis
• Basic idea – experts have knowledge, and this knowledge can be given to
computer program.
1. Requires knowledge base – interview and observe experts, and convert
words and actions into knowledge base
2. Reasoning mechanisms to apply knowledge to problems: inference engine
3. Mechanisms for explaining their decisions
Expert systems
oForward chaining (start with facts and use rules to draw new
conclusions)
oBackward chaining (start with hypothesis, or goal, to prove and look
for rules to prove that hypothesis).
Expert systems
Disadvantages
• Lack of creativity, not adaptive, lacks sensory experience, narrow focus, no
common sense knowledge; E.g won’t notice if medical history says patient
weighs 14 pounds and is 130 years old.
• More like idiot savants (retarded person who can perform well in one
domain), or automated reference manuals.
AI Issues
87
Summary
• Introduction to AI
AI