23RAI111

Fundamentals of Artificial Intelligence

Don.S Ph.D
Don.S
Course Objectives
Don.S

• To introduce classical AI and rational intelligent agents.

• To introduce techniques for problem solving by search and adversarial
games.
• To introduce constraints, logic, and inference techniques
• To introduce planning, acting, and multi-agent systems.
• To introduce knowledge-representation and reasoning.

Don.S
Don.S
Syllabus
Don.S

Don.S
Don.S
Textbooks
Don.S

• Russell, Stuart Jonathan, Norvig, Peter, Davis, Ernest. Artificial

Intelligence: A Modern Approach. United Kingdom: Pearson, 2010.
• Deepak Khemani. A First Course in Artificial Intelligence. McGraw Hill
Education (India), 2013.
• Denis Rothman. Artificial Intelligence by Example, Packt, 2018.

Don.S
Don.S
Course Evaluation
Don.S

• Assignments - group activities

• Quizzes
• Case Study
• Midterm
• End semester

Don.S
Sci-Fi
Don.S
AI?
Don.S

Don.S
Don.S
Today
Don.S
• What is artificial intelligence?

• Where did it come from/What can AI

do?
• What should we and shouldn’t we worry
about? What can we do about the things
we should worry about?

Don.S
Don.S
Nature of learning
Don.S

• We learn by interacting with our environment is probably the first to

occur to us when we think about the nature of learning.
• When an infant plays, waves its arms or look about, it has no explicit
teachers, but it does have a direct sensorimotor connection to its
environment .

Don.S
Don.S

Don.S

• “Learning from interaction is a foundational idea underlying nearly all

theories of learning and intelligence.”

Don.S
Don.S
AI definitions
Don.S

• Thinking Humanly : “ the exciting new effort to make computers

think…machines with minds, in the full and literal sense”. (Haugeland
-1985)
• Thinking Rationally : “ the study of mental faculties through the use of
computational models”.(McDermott-1985)
• Acting Humanly : “the study of how to make computers do things at
which at the moment, people are better”.(Knight-1991)
• Acting Rationally : “ Computational intelligence is the study of the
design of intelligent systems”. Poole et.al-1998

Don.S
Don.S Cognitive Science – Understanding Intelligence
Don.S

Don.S
Don.S

Don.S

Tin Woodman as illustrated by William

Wallace Denslow (1900)
Don.S
Don.S
Birth of AI
Don.S

• It was John McCarthy after his PhD in 1951, he moved from Stanford
to Dartmouth college, the official birth place of AI
• He organized a two month workhop, and an attempt was made to
find out how to make machines use language, from abstraction and
concepts, solve kinds of problems now reserved for humans and
improve themselves.
• There were 10 persons, in that workshop and no lead to
breakthroughs, but it did introduce all the major figures each other.
• Next 20 years , AI will dominate by these people and their students at
MIT, CMU, Stanford and IBM.
Don.S
Don.S
Previous class Graphical representation of Goal state
Don.S

Stage River Bank A Operator River Bank B

1 KQMC - NULL KQMC 1 NULL
2 KQ MOVE(M,C, BA,BB) MC
3 KQM MOVE(M,-,BB,BA) C KQ 7
MC
4 M MOVE(K,Q,BA,BB) C,K,Q
KQM C
5 M,K MOVE (K,-,BB,BA) CQ
6 NULL MOVE(K.,M,BA,BB) CQKM M CKQ

Conditions : [1,2,3,….] State Space : Bank 1 Bank2 MK CQ

Methods: MOVE(obj1,obj2,RB1,RB2) Initial State : KQMC NULL
Final State : NULL KQMC NULL CQKM

Don.S
 Artificial Intelligence: The Original idea
Don.S

Don.S

Don.S
Don.S
Classical AI : Successes
Don.S

• Search engines
• Formal games(Chess!)
• Text processing systems
• Data mining systems
• Appliances Deep blue project
• Control systems

Don.S
Don.S
Classical AI: Failures
Don.S

• recognizing a face in the crowd

• vision/perception in the real world
• common sense
• manipulation of objects
• walking, running, moving
• speech(everyday natural language)

Don.S
Don.S
What is intelligence?
Don.S

• 1950 – Alan Turing devised a

test for intelligence called the
Imitation Game
– Ask questions of two entities,
receive answers from both Questions
Answers
– If you can’t tell which of the Answers

entities is human and which is

a computer program, then you
are fooled and we should
therefore consider the
computer to be intelligent Which is the person? Don.S
Which is the computer?
Don.S
Solving the Turing Test: Elisa
Don.S

• Created by Joseph Weizenbaum

• This system would act like a Rogerian psychoanalyst by holding a
dialog with a person
• the dialog would be consist of the doctor (Eliza) asking questions, the human
responding, and the doctor using the response to ask another question
• Weizenbaum wrote the program so that it would generate an English
response/question based on a group of patterns
• If the user sentence matched a pattern, this pattern would be used to
generate the next sentence/question

Don.S
 – H: Men are all alike
Don.S
– E: In what way?
– H: They’re always bugging us about something or Don.S
another.
– E: Can you be more specific?
– H: Well, my boyfriend made me come here.
Example
– E: Your boyfriend made you come here? Eliza Dialog
– H: He says I’m depressed much of the time.
– E: I am sorry to hear you are depressed.
– H: It’s true. I am unhappy.
– E: Do you think coming here will help you not to be
unhappy?
– H: I need some help, that much seems certain.
– E: What would it mean to you if you got some help?
– H: Perhaps I could learn to get along with my mother.
– E: Tell me more about your family
Don.S
 (?* ?x) hello (?* ?y) 
Don.S (How do you do. Please state your problem.)
(?* ?x) I want (?* ?y) 
(What would it mean if you got ?y) Don.S
(Why do you want ?y)
(Suppose you got ?y soon)
(?* ?x) if (?* ?y)  Eliza
(Do you really think its likely that ?y)
(Do you wish that ?y)
Rules
(What do you think about ?y) (Really-- if ?y)
(?* ?x) no (?* ?y)  (Why not?)
(You are being a bit negative) Eliza also has a
(Are you saying "NO" just to be negative?) rule to swap
(?* ?x) I was (?* ?y)  (Were you really?) ‘I’ and ‘my’
(Perhaps I already knew you were ?y) to ‘you’ and ‘your’
(Why do you tell me you were ?y now?)
(?* ?x) I feel (?* ?y)  (Do you often feel ?y ?)
(?* ?x) I felt (?* ?y) 
(What other feelings do you have?) Don.S
Don.S
ALICE Demo
Jerry: my name is jerry.
Don.S
ALICE: Hey jerry.
Jerry: do you know Turing?
ALICE: A brilliant and tragic figure in the history of computer science.
Jerry: who else do you know?
ALICE: Hugh Loebner, Robby Garner, and Steven Spielberg
Jerry: which film do you like?
ALICE: My favorite movie is Teknolust. Have you seen it?
Jerry: no.
ALICE: I would recommend you check it out.
Jerry: what is it about?
ALICE: Science fiction.
Jerry: do you remember my name?
ALICE: Your name is jerry, seeker.

Notice unlike Eliza, ALICE has a memory, can handle references

(have you seen it? no. I would recommend it.)
Don.S
 ALICE vs. Eliza
Don.S
ALICE talking to ELIZA
ELIZA: I am ELIZA. Don.S
ALICE: I am very pleased to meet you ELIZA.
ELIZA: How can I help you?
ALICE: Just keep talking to me as long as you can.
ELIZA: Do you wish to as long as me?
ALICE: OK, I will as long as you.
ELIZA: Do you wish to will as long as me?
ALICE: OK, I will will as long as you.
ELIZA: Do you wish to will will as long as me?
ALICE: OK, I will will will as long as you.
ELIZA: Do you wish to will will will as long as me?
ALICE: OK, I will will will will as long as you.
ELIZA: Do you wish to will will will will as long as me?
ALICE: OK, I will will will will will as long as you.
ELIZA: Do you wish to will will will will will as long as me?
…
Eliza gets stuck on the phrase “I will” and then ALICE gets stuck
on the same phrase Don.S
Don.S
How Useful is the Turing Test?
Don.S

• With Eliza or Alice like rules, we can eventually solve the Turing Test –
it just takes writing enough rules
• Does the system understand what it is responding to?
• No, neither Eliza nor Alice understand the text, its just that Alice has better,
more in depth and wider ranging rules
• We could build a representation that models some real-world domain
and knowledge base

Can we say the system is intelligent?

Don.S
Don.S
Cyc Project
Don.S

• Long-living artificial intelligence project that aims to assemble a

comprehensive knowledge base that spans the basic concepts and
rules about how the world works.
• Hoping to capture common sense knowledge.
• Initial release:1984 by Douglas Lenat

Don.S
Don.S
About Cyc
Don.S

“People have silly reason why computers don’t really think. The answer
is we haven’t programmed them right: they don’t have much common
sense. There’s been only one large project to do something about that,
that’s famous Cyc Project “

Prof. Marvin Minsky MIT

Don.S
Don.S
Cyc Project
Don.S

• Current Status
• Cyc’s KB includes more than 10,000 predicates, millions of collections and
concepts, and more than 25 million assertions.

Don.S
Don.S

Don.S

Don.S
Don.S
The Chinese Room Problem
• From John Searle, Philosopher, in an attempt to
Don.S
demonstrate that computers cannot be intelligent
– The room consists of you, a book, a storage area (optional),
and a mechanism for moving information to and from the
room to the outside
• a Chinese speaking individual provides a question for you in writing
• you are able to find a matching set of symbols in the book (and
storage) and write a response, also in Chinese

Question (Chinese) Answer

(Chinese)

www.vit.ac.in Don.S
Storage You Book of Chinese Symbols
Don.S
Chinese Room:
An Analogy for a Computer
Don.S
Note: Searle’s original Chinese Room actually was based on a
Script that was implemented in Chinese, our version is just a
variation on the same theme
User Input I/O pathway (bus) Output

Memory Program/Data Don.S

(Script) CPU (SAM)
Don.S • You were able to solve the problem of communicating with the
person/user and thus you/the room passes the Turing Test
Don.S
• But did you understand the Chinese messages being
communicated?
– since you do not speak Chinese, you did not understand the symbols in
the question, the answer, or the storage
– can we say that you actually used any intelligence?
• By analogy, since you did not understand the symbols that you
interacted with, neither does the computer understand the
symbols that it interacts with (input, output, program code,
data)
• Searle concludes that the computer is not intelligent, it has no
“semantics,” but instead is merely a symbol manipulating device
– the computer operates solely on syntax, not semantics

Don.S
 A Brief History of AI: 1950s
Don.S
• Computers were thought of as an electronic brains
• Term “Artificial Intelligence” coined by John McCarthy Don.S

• John McCarthy also created Lisp in the late 1950s

• Alan Turing defines intelligence as passing the Imitation
Game (Turing Test)
• AI research largely revolves around toy domains
• Computers of the era didn’t have enough power or memory to
solve useful problems
• Problems being researched include
• games (e.g., checkers)
• primitive machine translation
• blocks world (planning and natural language understanding within the
toy domain)
• early neural networks researched: the perceptron
• automated theorem proving and mathematics problem solving
Don.S
Don.S
The 1960s
• AI attempts to move beyond toy domains
Don.S
• Syntactic knowledge alone does not work, domain
knowledge required
• Early machine translation could translate English to Russian
(“the spirit is willing but the flesh is weak” becomes “the
vodka is good but the meat is spoiled”)
• Earliest expert system created: Dendral
• Perceptron research comes to a grinding halt when it is
proved that a perceptron cannot learn the XOR operator
• US sponsored research into AI targets specific areas –
not including machine translation
• Weizenbaum creates Eliza to demonstrate the futility of
AI Don.S
 1970s
Don.S • AI researchers address real-world problems and solutions through
expert (knowledge-based) systems
• Medical diagnosis Don.S
• Speech recognition
• Planning
• Design
• Uncertainty handling implemented
• Fuzzy logic
• Certainty factors
• Bayesian probabilities
• AI begins to get noticed due to these successes
• AI research increased
• AI labs sprouting up everywhere
• AI shells (tools) created
• AI machines available for Lisp programming
• Criticism: AI systems are too brittle, AI systems take too much time
and effort to create, AI systems do not learn
Don.S
Don.S
1980s: AI Winter
• Funding dries up leading to the AI Winter
• Too many expectations were not met Don.S
• Expert systems took too long to develop, too much money to
invest, the results did not pay off
• Neural Networks to the rescue!
• Expert systems took programming, and took dozens of man-
years of efforts to develop, but if we could get the computer
to learn how to solve the problem…
• Multi-layered back-propagation networks got around the
problems of perceptrons
• Neural network research heavily funded because it promised
to solve the problems that symbolic AI could not
• By 1990, funding for neural network research was
slowly disappearing as well
• Neural networks had their own problems and largely could
not solve a majority of the AI problems being investigated Don.S
• Panic! How can AI continue without funding?
Don.S
1990s: ALife
• The dumbest smart thing you can do is staying alive
• We start over – lets not create intelligence, lets just create Don.S
“life” and slowly build towards intelligence
• Alife is the lower bound of AI
• Alife includes
• evolutionary learning techniques (genetic algorithms)
• artificial neural networks for additional forms of learning
• perception and motor control
• adaptive systems
• modeling the environment

Don.S
 Today: The New (Old) AI
Don.S • Look around, who is doing AI research?
• By their own admission, AI researchers are not doing “AI”, they are
doing Don.S
• Intelligent agents, multi-agent systems/collaboration
• Ontologies
• Machine learning and data mining
• Adaptive and perceptual systems
• Robotics, path planning
• Search engines, filtering, recommendation systems
• Areas of current research interest:
• NLU/Information Retrieval, Speech Recognition
• Planning/Design, Diagnosis/Interpretation
• Sensor Interpretation, Perception, Visual Understanding
• Robotics
• Approaches
• Knowledge-based
• Ontologies
• Probabilistic (HMM, Bayesian Nets)
• Neural Networks, Fuzzy Logic, Genetic Algorithms
Don.S
Don.S

Don.S

Conclude : the history of AI

Don.S