ARTIFICIAL

INTELLIGENCE- CS411
 Noor Hafsa
• Background: Computing Science/ Machine Learning/ Bioinformatics
• Research Interest: Pattern Recognition/Machine Learning/Data mining/
Computational Biology

Assistant Professor, PhD

Department of Computer Science
CCSIT, KFU

nhafsa@kfu.edu.sa
S
Artificial Intelligence Instructor data Dr. Noor Hafsa
Artificial Intelligence “CS 411”
• Textbook:
S. Russell and P. Norvig
Artificial Intelligence: A Modern Approach
Prentice Hall, 2010, Third Edition

• Grading:
Class Activity (5%),
Assignments/HW (5%),
Projects (10%)
Quizzes (5%),
Lab (15 %),
Mid-term exam (20%),
Final exam (40%)
Artificial Intelligence Ch1: Introduction Dr. Noor Hafsa
 Artificial Intelligence Ch1: Introduction
Dr. Noor Hafsa

Artificial Intelligence “Topics to be

covered”

Topic* Week*
1- Introduction to AI 1
2- Intelligent Agents 2-3
3- Solving Problems by Searching 3-4
4- Informed Search and Exploration 4-5
5- Adversarial Search and Logical Agents 5-6
6- Logical Agents 7-9
Mid Semester Examination 9
7- Uncertainty and Reasoning 10-11
8- Learning by Induction 11-12
9-ANN and SVM 13-14
End Semester Examination 15
* Subject to change

Artificial Intelligence Course data & outline Dr. Noor Hafsa

 Artificial Intelligence Ch1: Introduction
Dr. Noor Hafsa

Artificial Intelligence “Code of Collaboration”

 We would like the course to run smoothly and to be
fruitful for you
 Help each other to understand the course
 Be supportive and collaborative with me!
 Feel free to ask about any ambiguous concepts
 Think of AI as a Science NOT as a Subject!
 Feedback, by email or in person, always welcome
 Feel free to let us know what you find good or even bad.

 Keep in mind, I am at your side and doing my best to

help you
 Do not misuse the democratic and warm way of interaction with
me
 I can
Artificial handle criticism or difference
Intelligence Course data of opinions.
& outline Dr. Noor Hafsa
 Chapter 1

Introduction

S
Main Areas of AI
• Knowledge representation (including
Agent Perception
formal logic)
Robotics
• Search, especially heuristic search
(puzzles, games) Reasoning
• Planning Search Learning

• Reasoning under uncertainty,

including probabilistic reasoning Knowledge Constraint
rep. satisfaction
• Learning Planning
• Agent architectures
• Robotics and perception
Natural Expert
• Natural language processing language ... Systems

Artificial Intelligence Ch1: Introduction Dr. Noor Hafsa

Main Areas of AI
• Knowledge representation (including
Agent Perception
formal logic)
Robotics
• Search, especially heuristic search
(puzzles, games) Reasoning
• Planning Search Learning

• Reasoning under uncertainty,

including probabilistic reasoning Knowledge Constraint
rep. satisfaction
• Learning Planning
• Agent architectures
• Robotics and perception
Natural Expert
• Natural language processing language ... Systems

Artificial Intelligence Ch1: Introduction Dr. Noor Hafsa

Course Overview
o 1-Introduction,
o 2-Intelligent Agents,
o 3 & 4-Problem-Solving using Search,
o 5-Game Theory,
o 6-Inference using Logic,
o 7-Knowledge and Reasoning,
o 8-Learning from Observation,
o 9-Learning Algorithms,

Artificial Intelligence Ch1: Introduction Dr. Noor Hafsa

 Why is AI?
Why do we study AI?

Artificial Intelligence Ch1: Introduction Dr. Noor Hafsa

 Applications of AI
Industry
”Fixed Robot“

Artificial Intelligence Ch1: Introduction Dr. Noor Hafsa

 Applications of AI
Science and Space
“Mobile Robot”

Artificial Intelligence Ch1: Introduction Dr. Noor Hafsa

 Applications of AI
Hazardous Environments
“Mobile Robot”

TROV in Antarctica operating HAZBOT operating in atmospheres

under water containing firing gases
Artificial Intelligence Ch1: Introduction Dr. Noor Hafsa
 Applications of AI
In Military
“Mobile Robot”

Artificial Intelligence Ch1: Introduction Dr. Noor Hafsa

 Applications of AI
Medical Welfare
“Mobile Robot”

Artificial Intelligence Ch1: Introduction Dr. Noor Hafsa

 Applications of AI
Search Engines

Artificial Intelligence Ch1: Introduction Dr. Noor Hafsa

 Applications of AI
Humanoid Robots

Honda debuts a
new humanoid The robot dog AIBO (mean
companion) produced by
robot called Asimo
SONY Japan 1995
in 2002

Artificial Intelligence Ch1: Introduction Dr. Noor Hafsa

 Applications of AI
Houses

Artificial Intelligence Ch1: Introduction Dr. Noor Hafsa

 What is AI? (Could we answer?- Brain storming)
1) What is intelligence? Can we say, he is intelligent means:
 He knows a lot
 He thinks fast
 He talks much
 He learns quickly
 He memorizes well

2) Is it learned?

3) Are you born with it?

Intelligence = Knowledge + ability to perceive, feel, understand,

process, communicate, judge, and learn.
Artificial Intelligence Ch1: Introduction Dr. Noor Hafsa
 What is AI? (Could we answer?- Brain storming)
- There is no official or agreed definition for Artificial Intelligence!

- Why?????

1) In practice, it is an “umbrella term”

2) It is multidisciplinary subject

3) Technologies enter and exit the AI “umbrella” regularly.

Artificial Intelligence Ch1: Introduction Dr. Noor Hafsa

 AI is a Multi Disciplinary
Many disciplines contribute to the goal of creating/modeling intelligent entities:
 Philosophy (Logic, methods of reasoning, mind as physical system, foundations o
learning, etc)
 Mathematics (Formal representation and proof, algorithms, etc.)
 Economics (Make decisions so as to maximize payoff)
 Human Biology/Neuroscience (How brain works)
 Psychology (Perceive, process information, represent knowledge.)
 Computer Engineering (Building fast computers)
 Control theory (Design systems that maximize an objective function over time)
 Linguistics (Structure and meaning of language/ How does language relate to
thought)
Artificial Intelligence Ch1: Introduction Dr. Noor Hafsa
 Different Types of AI
• Modeling exactly how humans actually think
 cognitive models of human reasoning

• Modeling exactly how humans actually act

 models of human behavior (what they do, not how they think)

• Modeling how ideal agents “should think”

 models of “rational” thought (formal logic)
 note: humans are often not rational!

• Modeling how ideal agents “should act”

 rational actions but not necessarily formal rational reasoning
 i.e., more of a black-box/engineering approach

Artificial Intelligence Ch1: Introduction Dr. Noor Hafsa

What is AI?
The science of making machines that:

Thinking Thinking
humanly rationally

Acting Acting
humanly Acting rationally rationally

The textbook advocates "acting rationally”

Artificial Intelligence Ch1: Introduction Dr. Noor Hafsa
 Acting Humanly Turing test
o Turing (1950) "Computing machinery and intelligence":
o "Can machines think?"  "Can machines behave
intelligently?”

o The computer passes the test if a human interrogator cannot tell

whether the written responses come from a person or not,
o The computer would need to possess the following FOUR capabilities:
 Natural language processing to communicate successfully;
 Knowledge representation to store what it knows or hears;
 Automated reasoning to answer questions and to draw new conclusions;
 Machine learning to adapt to new circumstances.

Artificial Intelligence Ch1: Introduction Dr. Noor Hafsa

 Acting Humanly Total Turing test *

o Via a physical interaction, the Total Turing Test includes a video signal so
that the interrogator can test the subject's perceptual abilities,
o The computer would need to possess the following SIX capabilities:
 Natural language processing
 Knowledge representation
 Automated reasoning
 Machine learning
 Computer vision to perceive objects, and
 Robotics to manipulate objects and move about

Artificial Intelligence Ch1: Introduction Dr. Noor Hafsa

 Artificial Intelligence Ch1: Introduction
Dr. Noor Hafsa

Thinking humanly cognitive modeling

To think like human…How does human think?
“To get inside: introspection or psychological experiments
(observing person in action) or brain imaging (observing brain in
action) ”

Cognitive Science

* cognitive science: the study of thought, learning, and mental organization, which draws on
aspects of psychology, linguistics and philosophy.
 Thinking Rationally Laws of thought
o Aristotle attempts to codify the "right thinking," that is,
irrefutable reasoning processes
"Socrates is a man; all men are mortal; therefore, Socrates is mortal"

Logic Science

Artificial Intelligence Ch1: Introduction Dr. Noor Hafsa

 Rational Decisions
 Here, we’ll use the term rational in a very specific, technical way:
 Rational: maximally achieving pre-defined goals
 Rationality only concerns what decisions are made
(not the thought process behind them)
 Goals are expressed in terms of the utility of outcomes
 Being rational means maximizing your expected utility

Artificial Intelligence Ch1: Introduction Dr. Noor Hafsa

 Rational Decisions

Maximize Your
Expected Utility

Artificial Intelligence Ch1: Introduction Dr. Noor Hafsa

Acting Rationally Rational agents
 An Agent is something that acts!
(Computer Agents are operating under autonomous control, perceiving their environment,
persisting over a long time period, adapting to change, and being capable of taking on another's
goals),

 Rational Behavior: doing the right thing (The right thing: that which is
expected to maximize goal achievement, given the available information)

 A Rational Agent is one that acts so as to achieve the best

outcome or, when there is uncertainty, the best expected outcome.
- Making correct inferences is sometimes part of being a rational agent,
- Doesn't necessarily involve thinking, but thinking should be in the service of
rational action,
(recoiling from a hot stove is a reflex action that is usually more
successful than a slower action taken after careful deliberation)

Artificial Intelligence Ch1: Introduction Dr. Noor Hafsa

 Rational Agents
 An AGENT is an entity that perceives and acts!
 (This course is about designing rational agents)

 Abstractly, an agent is a function from percept histories to actions:

[f: P*  A]
 For any given class of environments and tasks, we seek the agent
(or class of agents) with the best performance
 Note: Computational limitations make perfect rationality
unachievable

Thus  design best PROGRAM for given machine

resources
Artificial Intelligence Ch1: Introduction Dr. Noor Hafsa
Abridged history of AI
• 1943 McCulloch & Pitts: Boolean circuit model of brain
• 1950 Turing's "Computing Machinery and Intelligence"
• 1956 Dartmouth meeting: "Artificial Intelligence“
adopted
• 1952-69Look, Ma, no hands!
• 1950 Early AI programs, including Samuel's checkers
program, Newell & Simon's Logic Theorist,
Gelernter's Geometry Engine
• 1965 Robinson's complete algorithm for logical
reasoning
• 1966-73AI discovers computational complexity
Neural network research almost disappears
• 1969-79Early development of knowledge-based systems
• 1980 AI becomes an industry
• 1986 Neural networks return to popularity
• 1987 AI becomes a science
• 1995 The emergence of intelligent agents
• 2001- Present The availability of very large data sets
Artificial Intelligence Ch1: Introduction Dr. Noor Hafsa
 What About the Brain?
 Brains (human minds) are very good at making rational decisions,
but not perfect

 “Brains are to intelligence as wings are to

flight”
 Lessons learned from the brain: memory
and simulation are key to decision making

Artificial Intelligence Ch1: Introduction Dr. Noor Hafsa

Can we build hardware as complex as the brain?
 How complicated is our brain?
 a neuron, or nerve cell, is the basic information processing unit
 estimated to be on the order of 10 neurons in a human brain
11

 many more synapses (10 14) connecting these neurons

 cycle time: 10 -3 seconds (1 millisecond)
 Operations/sec: 1017, Memory update/sec: 1014
 How complex can we make computers?
 1012 or more transistors per CPU, 104 CPUs
 supercomputer: hundreds of CPUs, 10 14
bits of RAM
 cycle times: order of 10 seconds
-9

 Operations/sec: 1015, Memory update/sec: 1014

 Conclusion
 YES: in the near future we can have computers with as many basic processing
elements as our brain, but with
o far fewer interconnections (wires or synapses) than the brain
o much faster updates than the brain
 but building hardware is very different from making a computer behave like a
Artificial Intelligence
brain! Ch1: Introduction Dr. Noor Hafsa
Can Computers play Humans at Chess?
 Chess Playing is a classic AI problem
 well-defined problem
 very complex: difficult for humans to play well
3000
Garry Kasparov (current World Champion) Deep Blue
2800
2600
Deep Thought
Points Ratings

2400
2200
Ratings
2000
1800
1600
1400
1200
1966 1971 1976 1981 1986 1991 1997
 Conclusion: YES: today’s computers can beat even the best human

Artificial Intelligence Ch1: Introduction Dr. Noor Hafsa

 Can Computers Recognize Speech?
 Speech Recognition
 mapping sounds from a microphone into a list of words.
 Hard problem: noise, more than one person talking,
 occlusion, speech variability,..
 Even if we recognize each word, we may not understand its
meaning.

 Recognizing single words from a small vocabulary

• systems can do this with high accuracy (order of 99%)
• e.g., directory inquiries
• limited vocabulary (area codes, city names)
• computer tries to recognize you first, if unsuccessful hands you over to a human
operator
• saves millions of dollars a year for the phone companies

Artificial Intelligence Ch1: Introduction Dr. Noor Hafsa

Can Computers Understand speech?
• Recently, Computers can talk and recognize speech

• Understanding is different to recognition:

• “Time flies like an arrow”
• assume the computer can recognize all the words
• but how could it understand it?
• 1. time passes quickly like an arrow?
• 2. command: time the flies the way an arrow times the flies
• 3. command: only time those flies which are like an arrow
• 4. “time-flies” are fond of arrows
• only 1. makes any sense, but how could a computer figure this out?
• clearly humans use a lot of implicit commonsense knowledge in communication

• Conclusion: NO, much of what we say is beyond the capabilities

of a computer to understand at present
Artificial Intelligence Ch1: Introduction Dr. Noor Hafsa
Can Computers Learn and Adapt ?
• Learning and Adaptation
• consider a computer learning to drive on the freeway
• we could code lots of rules about what to do
• and/or we could have it learn from experience

Darpa’s Grand Challenge. Stanford’s “Stanley” drove

150 without supervision in the Majove dessert

• machine learning allows computers to learn to do things

without explicit programming

• Conclusion: YES, computers can learn and adapt,

when presented with information in the appropriate way

Artificial Intelligence Ch1: Introduction Dr. Noor Hafsa

Can Computers “see”?
• Recognition v. Understanding (like Speech)
• Recognition and Understanding of Objects in a scene
• look around this room
• you can effortlessly recognize objects
• human brain can map 2d visual image to 3d “map”

• Why is visual recognition a hard problem?

Conclusion: mostly NO: computers can only “see” certain types

of objects under limited circumstances: but YES for certain
constrained problems (e.g., face recognition)

Artificial Intelligence Ch1: Introduction Dr. Noor Hafsa

 Artificial Intelligence Ch1: Introduction
Dr. Noor Hafsa
Intelligent Systems in Your Everyday Life

• Post Office
• automatic address recognition and sorting of mail
• Banks
• automatic check readers, signature verification systems
• automated loan application classification
• Telephone Companies
• automatic voice recognition for directory inquiries
• Credit Card Companies
• automated fraud detection
• Computer Companies
• automated diagnosis for help-desk applications
• Netflix:
• movie recommendation
• Google:
• Search Technology
 AI Applications: Identification Technologies

• Biometric Identification
• walk up to a locked door
• camera
• fingerprint device
• microphone
• iris scan
• computer uses your biometric signature for identification
• face, eyes, fingerprints, voice pattern, iris pattern

Artificial Intelligence Ch1: Introduction Dr. Noor Hafsa

 AI Applications: Predicting the Stock Market

• The Prediction Problem

o Given the past, predict the future
o Very difficult problem!
o We can use learning algorithms to learn a predictive model from historical data
- prob(increase at day t+1 | values at day t, t-1,t-2....,t-k)
o Such models are routinely used by banks and financial traders to manage
portfolios worth millions of dollars
Artificial Intelligence Ch1: Introduction Dr. Noor Hafsa
 Summary
• Artificial Intelligence involves the study of:
• automated recognition and understanding of speech, images, etc
• learning and adaptation
• reasoning, planning, and decision-making

• AI has made substantial progress in

• recognition and learning
• some planning and reasoning problems

• AI Applications
• improvements in hardware and algorithms => AI applications in
industry, finance, medicine, and science.
• AI Research
• many problems still unsolved: AI is a fun research area!

Artificial Intelligence Ch1: Introduction Dr. Noor Hafsa

 Artificial Intelligence Ch1: Introduction
Dr. Noor Hafsa

Homework
• Define the following terms based on Chapter-1 (AIML):
• Intelligence
• Artificial Intelligence
• Automated Reasoning
• Knowledge Representation
• Total Turing Test
• Syllogisms
• Logic
• Limited Rationality
• Tractability
• Staisficing
• Cognitive Psychology
• Physical Symbol System
• Homeostatic device
Artificial Intelligence Ch1: Introduction
Dr. Noor Hafsa