00 Artificial Intelligence

Artificial
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Artificial intelligence
Foundations (CK0031/CK0248)
Philosophy
Mathematics
Economics
Neuroscience Francesco Corona
Psychology
Computer eng
Control, cybernetics Department of Computer Science
Linguistics Federal University of Ceará, Fortaleza
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Neural nets are back
Scientific methods
Intelligent agents
Large datasets
Today
Artificial Artificial intelligence
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Intelligence
Acting rationally
• For thousands (2) of years, understand how (we think) we think
Foundations
Philosophy
Mathematics • Understand but also to build intelligent entities
Economics
Neuroscience
Psychology
Computer eng AI is one of the newest fields in science and engineering
Control, cybernetics
• Work started after World War II, the name was coined in 1956
Linguistics
History • Along with molecular biology, AI is regularly cited as ‘the field I

Gestation and birth would most like to be in’ by scientists in other disciplines
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial Artificial intelligence (cont.)
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations AI: A huge variety of sub-fields

Philosophy
Mathematics
• From the general (learning and perception) to the specific (playing
Economics chess, proving mathematical theorems, writing poetry, driving a car
Neuroscience on a crowded street, diagnosing diseases, ...)
Psychology
Computer eng
Control, cybernetics AI is relevant to any intellectual task: It is truly a universal field
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations
Philosophy
Mathematics What’s AI?
Economics
Neuroscience
Psychology
Computer eng
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial What’s AI?
intelligence
UFC/DC
CK0031/CK0248
2017.2
We can attempt a quadruple definition, along 2-by-2 dimensions
What’s AI? • reasoning v behaviour, vertically
Acting humanly
• humanity v ideality, horizontally
Thinking humanly
Thinking rationally
Acting rationally A system that ‘does the right thing’ given what it knows has an ideal
Foundations performance measure, which we can also call rationality
Philosophy
Mathematics
Economics
Neuroscience
Psychology
Computer eng
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial What’s AI? (cont.)
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI? Thinking Humanly Thinking Rationally

Acting humanly
“The exciting new effort to make comput- “The study of mental faculties through the
Thinking humanly
Thinking rationally
ers think . . . machines with minds, in the use of computational models.”
Acting rationally full and literal sense.” (Haugeland, 1985) (Charniak and McDermott, 1985)
Foundations “[The automation of] activities that we “The study of the computations that make
Philosophy
associate with human thinking, activities it possible to perceive, reason, and act.”
Mathematics
Economics such as decision-making, problem solv- (Winston, 1992)
Neuroscience ing, learning . . .” (Bellman, 1978)
Psychology
Computer eng Acting Humanly Acting Rationally
Linguistics
“The art of creating machines that per- “Computational Intelligence is the study
form functions that require intelligence of the design of intelligent agents.” (Poole
History
Gestation and birth
when performed by people.” (Kurzweil, et al., 1998)
Early enthusiasm, 1990)
great expectations
A dose of reality “The study of how to make computers do “AI . . . is concerned with intelligent be-
Knowledge-based AI things at which, at the moment, people are havior in artifacts.” (Nilsson, 1998)
AI as an industry
better.” (Rich and Knight, 1991)
Scientific methods
Intelligent agents
Large datasets
Today
Artificial What’s AI? (cont.)
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI? Historically, all of the four approaches to AI have been followed
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Vertically • Thinking humanly and acting humanly;
Foundations
• Thinking rationally and acting rationally
Philosophy
Mathematics
Economics
Neuroscience • A human approach must be in part an empirical science, involving
Psychology
observations and hypotheses about human behaviour
Computer eng
Control, cybernetics • A rational approach must be in part a formal science, involving
Linguistics
some combination of mathematics and engineering
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality Horizontally? • Thinking humanly and rationally;
Knowledge-based AI
• Acting humanly and rationally
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations
Philosophy
Mathematics
Economics
Acting humanly
Neuroscience
What’s AI
Psychology
Computer eng
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial Acting humanly
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly The Turing test was proposed by,
Thinking rationally
ehm ... Alan Turing (1950)
Acting rationally
• It was designed to provide a
Foundations
Philosophy satisfactory operational
Mathematics definition of intelligence
Economics
Neuroscience
• The details of the test can be
Psychology used to discuss whether a
Computer eng
computer would really be
Linguistics
intelligent if it passed
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
• A computer passes the test if a human interrogator, after posing some
AI as an industry
Neural nets are back written questions, cannot tell whether the written responses come
Scientific methods from a person or from a computer
Intelligent agents
Large datasets
Today
Artificial Acting humanly (cont.)
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally Programming a computer to pass a rigorous test is not easy stuff
Acting rationally
Foundations
Philosophy The computer would need to possess the following capabilities:
Mathematics
• Natural language processing, to communicate in English
Economics
Neuroscience • Knowledge representation, to store what it knows
Psychology
Computer eng • Automated reasoning, to use stored information to answer
Control, cybernetics questions and draw new conclusions
Linguistics
• Machine learning, to adapt to new circumstances
History
Gestation and birth
and to detect and extrapolate patterns
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
The test deliberately avoids physical interaction between interrogator and
Acting rationally computer, as physical simulation of a person is unnecessary for intelligence
Foundations
Philosophy
Mathematics • The total Turing test includes a video signal so that the interrogator
Economics
can test the subject’s perceptual abilities, as well as the opportunity
Neuroscience
Psychology
for the interrogator to pass physical objects ‘through the hatch’
Computer eng
Linguistics
To pass the total Turing test, the computer additionally will need
History • Computer vision, to perceive objects
Gestation and birth
• Robotics, to manipulate objects and move about
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations
Philosophy
Mathematics Turing deserves credit for designing a test that stays relevant 60 years later
Economics
Neuroscience These six disciplines compose most of modern AI
Psychology
Computer eng
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations
Philosophy
Mathematics
Economics
Neuroscience
Psychology
Computer eng
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Hit Turing right in the test-ees
Today
Artificial
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations
Philosophy
Mathematics
Economics
Thinking humanly
Neuroscience
What’s AI
Psychology
Computer eng
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial Thinking humanly
intelligence
UFC/DC
CK0031/CK0248
2017.2
If we are going to say that a given program thinks like a human

What’s AI?
Acting humanly • We must have some way of determining how humans think (doh!)
Thinking humanly
Thinking rationally
• We need to get inside the actual workings of human minds
Acting rationally
Foundations There are three ways to do this, through:

Philosophy
• Introspection, trying to catch own thoughts as they go by;
Mathematics
Economics • Psychological experiments, observing a person in action;
Neuroscience
Psychology • Brain imaging, observing the brain in action
Computer eng
Linguistics
First we need a sufficiently precise theory of the mind
History
Gestation and birth
Then, it may be possible to express the theory as a computer program
Early enthusiasm,
great expectations
A dose of reality
If the program’s IO behaviour and corresponding human behaviour match
Knowledge-based AI
Then, there is evidence that some of the program’s mechanisms could
AI as an industry
also be operating in humans
Scientific methods
Intelligent agents
Large datasets
Today
Artificial Thinking humanly (cont.)
intelligence
UFC/DC
CK0031/CK0248
2017.2
Newell, Shaw and Simon, who developed GPS, the General Problem
What’s AI?
Solver (1959), were not content to have their program solve problems
Acting humanly • More concerned with studying the trace of its reasoning steps
Thinking humanly
Thinking rationally • Compare them to traces of humans solving the same quiz
Acting rationally
Foundations
Philosophy
Mathematics
Economics
Neuroscience
Psychology
Computer eng
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
The interdisciplinary field of cognitive science brings together i)
computer models from AI and ii) experimental techniques from psychology
Foundations
Philosophy • To construct precise and testable theories of our mind
Mathematics
Economics
Neuroscience
• We comment on similarities between AI and human cognition
Psychology
Computer eng • Cognitive science is necessarily based on experimental investigation
Linguistics
• (actual humans or animals)
History Basically, we assume you have only a computer for experimentation
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally In early days there was often confusion between the approaches
Acting rationally
• An algorithm that performs well on a task
Foundations
Philosophy
is also good model of human performance
Mathematics • (or vice versa)
Economics
Neuroscience Modern authors separate the two kinds of claims
Psychology
Computer eng
Control, cybernetics This distinction has allowed both AI and cognitive science to grow
Linguistics
• The two fields continue to fertilize each other (in computer vision, they
History
Gestation and birth
incorporate neurophysiological evidence into computational models)
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations
Philosophy
Mathematics
Economics
Thinking rationally
Neuroscience
What’s AI
Psychology
Computer eng
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial Thinking rationally
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
This is also called the law of thought approach and it is one of the first
Thinking humanly attempts to codify ‘right thinking’ as irrefutable reasoning processes it
Thinking rationally
• Due to the greek philosopher Aristotle
Acting rationally
Foundations
Philosophy
Mathematics
The syllogism provided patterns for argument structures
Economics • Always yielded correct conclusions, when given the right premises
Neuroscience
Psychology
Computer eng
• Premises: a) Socrates is a man and b) all men are mortal
Linguistics • Conclusion: Socrates is mortal
History
Gestation and birth
Early enthusiasm,
great expectations These laws of thought were supposed to govern mind operation
A dose of reality
Knowledge-based AI
• Their study initiated the field called logic
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial Thinking rationally (cont.)
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly Logicians developed a notation for statements about all kinds of objects
Thinking humanly
• and relations among them
Thinking rationally
Acting rationally
Foundations
Contrast this with ordinary arithmetic notation
Philosophy • (only for statements about numbers)
Mathematics
Economics
Neuroscience
Psychology By 1965, programs existed that could solve any solvable problem
Computer eng
• The problem must be described in logical notation
Linguistics • And, if no solution exists, the program might loop forever
History
Gestation and birth
Early enthusiasm,
great expectations
The logicist tradition within AI aims at building on such programs
A dose of reality
• This is how they create intelligent systems
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly There are two main obstacles to this approach:
Thinking rationally
Acting rationally
• First, it is hard to take informal knowledge and state it in the formal
Foundations
terms required by logical notation1
Philosophy • Second, there is a difference between solving a problem ‘in principle’
and solving it in practice2
Mathematics
Economics
Neuroscience
Psychology
Computer eng Such issue apply to any attempt to build computational reasoning systems
Linguistics
• though they appeared first in the logicist tradition
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets 1
Particularly true when knowledge is less than 100% certain.
2
Today Problems with a moderate number of facts can exhaust the resources of any
computer, unless it has guidance as to which reasoning steps to try first.
intelligence
UFC/DC
CK0031/CK0248
2017.2 Honk IFF you love formal logic
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations
Philosophy
Mathematics
Economics
Neuroscience
Psychology
Computer eng
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents Note that this implies you should NOT honk
Large datasets solely because I stopped for a pedestrian and you’re behind me
Today
Artificial
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations
Philosophy
Mathematics
Economics
Acting rationally
Neuroscience
What’s AI
Psychology
Computer eng
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial Acting rationally
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly An agent is just something that acts (from Latin agere, to do)
Thinking humanly
Thinking rationally
Computer programs do something, computer agents must do more:
Acting rationally
Foundations • They are expected to operate autonomously

Philosophy
Mathematics
• To perceive their environment
Economics • To persist over a prolonged time period
Neuroscience
Psychology • To adapt to change
Computer eng
• To create and pursue goals
Linguistics
History
Gestation and birth A rational agent is one that acts so as to achieve best outcomes
Early enthusiasm,
great expectations
• When there is uncertainty, the best expected outcome
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial Acting rationally (cont.)
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
In the ‘thinking rationally’ way, emphasis is on correct inferences
Acting rationally • Making correct inferences is part of being a rational agent: One way
Foundations to act rationally is to reason logically to the conclusion that a given
Philosophy
action will achieve one’s goals and then to act on that conclusion
Mathematics
Economics • Making correct inference is not all of rationality: In some cases, there
Neuroscience
is no provably correct thing to do, but something must still be done
Psychology
Computer eng
Linguistics There are ways of acting rationally that do not involve inference
History • Recoiling from a hot stove is a reflex action: It is usually more
Gestation and birth
Early enthusiasm,
successful than a slower action taken after careful deliberation
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
All skills needed for the Turing test allow agents to act rationally
Foundations
Philosophy
• Knowledge representation and reasoning enable agents
Mathematics to reach good decisions
Economics
Neuroscience
• Natural language processing enables agents to generate
Psychology comprehensible sentences
Computer eng
• Learning is needed not only for erudition, but also to
Linguistics improve ability to generate effective behaviour
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly The rational-agent approach has two advantages over the others
Thinking humanly
Thinking rationally 1 More general than ‘thinking rationally’: Correct inference is just
Acting rationally one possible mechanism for achieving rationality
Foundations
2 More amenable to scientific development than are the other ways
Philosophy
Mathematics
based on human behaviour or human thought
Economics
Neuroscience
Psychology The standard of rationality is well defined (mathematically)
Computer eng
Control, cybernetics • It is completely general
Linguistics
• It generates agents that provably achieve it
History
Gestation and birth
Early enthusiasm, Human behaviour is well adapted for one specific environment
great expectations
A dose of reality
• It is defined by the sum of all the things that humans do
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly Focus on general principles of rational agents and their parts
Thinking rationally
Acting rationally • Despite the apparent simplicity with which a problem can be stated,
Foundations a variety of issues come up when we try to solve it
Philosophy
• Achieving perfect rationality, always the right thing, is not feasible
Mathematics
Economics
in complex environments (computational demand)
Neuroscience
Psychology
Computer eng
Still, perfect rationality is a good starting point for analysis
Linguistics • It simplifies the problem and provides an appropriate setting
History • Limited rationality deals with acting appropriately
Gestation and birth
Early enthusiasm, • When there is not enough time to do all the computations
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations
Philosophy
Mathematics Foundations
Economics
Neuroscience
Psychology
Computer eng
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial Foundations
intelligence
UFC/DC
CK0031/CK0248
2017.2
The disciplines that contributed ideas, viewpoints, and techniques

What’s AI?
Acting humanly • We concentrate on a small number of people, events, and ideas
Thinking humanly
Thinking rationally
• Around a series of questions, from such disciplines
Acting rationally
• We ignore others that also were important
Foundations
Philosophy
Mathematics
Economics • Philosophy
Neuroscience
Psychology • Mathematics
Computer eng
• Economics
Linguistics • Neuroscience
History
• Psychology
Gestation and birth
Early enthusiasm, • Computer engineering
great expectations
A dose of reality • Control and cybernetics
Knowledge-based AI
AI as an industry
• Linguistics
Scientific methods
Intelligent agents
Large datasets
Today
Artificial
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations
Philosophy
Mathematics
Economics
Philosophy
Neuroscience
Foundations
Psychology
Computer eng
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial Philosophy
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations
Philosophy • Can formal rules be used to draw valid conclusions?
Mathematics
• How does the mind arise from physical brain?
Economics
Neuroscience • Where does knowledge come from?
Psychology
Computer eng • How does knowledge lead to action?
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial Philosophy (cont.)
intelligence
UFC/DC
CK0031/CK0248
2017.2
Aristotle (-350): Set of laws driving the rational part of the mind
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations
Philosophy
Mathematics
Economics
• The system of syllogisms for
Neuroscience proper reasoning
Psychology
• Generation of conclusions,
Computer eng
Control, cybernetics given initial premises
Linguistics
• Could be done mechanically,
History
in principle
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
The idea that useful reasoning could actually be carried out by a
Foundations
Philosophy
mechanical artefact arrived much later, with Ramon Lull (1315)
Mathematics
Economics Thomas Hobbes (1588-1679): Reasoning is like numerical computation
Neuroscience
• ‘We add and subtract in our silent thoughts’
Psychology
Computer eng
Linguistics The automation of computation itself was already well under way
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally Leonardo da Vinci (1452-1519) designed a mechanical calculator
Foundations
• Recent reconstructions show the design to be functional
Philosophy
Mathematics
Economics
Neuroscience The first known calculating machine is by Wilhelm Schickard (1592-1635)
Psychology
in 1623, the Pascaline (1642) by Blaise Pascal (1623-1662), is more famous
Computer eng
Control, cybernetics • Pascal wrote that ‘the arithmetical machine produces effects which
Linguistics
appear nearer to thought than the actions of animals’
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally Gottfried Wilhelm Leibniz (1646-1716) built a mechanical device
Acting rationally
• To carry out operations on concepts rather than numbers
Foundations
Philosophy
Mathematics
• Leibniz did surpass Pascal by building a calculator
Economics
Neuroscience that could add, subtract, multiply, and take roots
Psychology
• The Pascaline could only add and subtract
Computer eng
Linguistics
History In those times some speculated that machines might not just do
Gestation and birth calculations but actually be able to think and act, on their own!
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly • It’s one thing to say mind operates, at least partly, according to logical
Thinking rationally rules, and to build physical systems that emulate some of those rules
Acting rationally
Foundations It’s another to say that the mind itself is such a physical system
Philosophy
Mathematics
Economics
Neuroscience Descartes (1596-1650) discussed the distinction between mind and matter
Psychology
Computer eng
And, the problems that arise
Linguistics One main problem with a purely physical conception of the mind:
History
• It is that it seems to leave little room for free will
Gestation and birth
Early enthusiasm, • If the mind is governed entirely by physical laws, then it has no more
great expectations
A dose of reality
free will than a rock ‘deciding’ to fall toward the centre of the earth
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally Descartes was a fan of the power of reasoning in understanding the world
Foundations • Rationalism, together with Aristotle and Leibniz
Philosophy
Mathematics
• ..., and he was also a proponent of dualism
Economics
Neuroscience
He held that there is a part of the human mind (soul or spirit) that
Psychology
Computer eng
is outside of nature, a part that is exempt from physical laws
Control, cybernetics • Animals, on the other hand, did not possess this dual quality
Linguistics
• As such they could be treated as machines
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations
Philosophy An alternative to dualism is materialism, which holds that brain’s
Mathematics operation according to the laws of physics constitutes the mind
Economics
Neuroscience • Free will is simply the way that the perception of
Psychology available choices appears to the choosing entity
Computer eng
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally Given a physical mind that manipulates knowledge, the next problem
Acting rationally
Foundations
Establish the source of knowledge
Philosophy
Mathematics
Economics
• The empiricism movement, with Francis Bacon’s (1561-1626) Novum
Neuroscience Organum, is characterised by a dictum of John Locke (1632-1704):
Psychology
’Nothing is in the understanding, which was not first in the senses’
Computer eng
Control, cybernetics • David Hume’s (1711-1776) A Treatise of Human Nature proposed
Linguistics
what is now known as the principle of induction: General rules are
History acquired by exposure to repeated associations between their elements
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Building on the work of Ludwig Wittgenstein (1889-1951) and Bertrand
Acting rationally
Russell (1872-1970), the Vienna Circle, led by Rudolf Carnap (1891-1970)
Foundations
Philosophy
• They developed a novel doctrine
Mathematics
Economics
Logical positivism
Neuroscience
Psychology • All knowledge can be characterised by logical theories connected
Computer eng
• Ultimately, to observation sentences
Linguistics
• (that correspond to sensory inputs)
History
Gestation and birth
Logical positivism: A combo of rationalism and empiricism, like
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations The confirmation theory of Carnap and Carl Hempel (1905-1997)

Philosophy
• An attempt to analyse the acquisition of knowledge from experience
Mathematics
Economics
Neuroscience Carnap’s The Logical Structure of the World (1928) defined a computational
Psychology
procedure for extracting knowledge from elementary experiences
Computer eng
Control, cybernetics • Probably the first theory of mind as a computational process
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally The final element in the philosophical picture of the mind
Acting rationally
The connection between knowledge and action
Foundations
Philosophy • Vital to AI, as intelligence requires action as well as reasoning
Mathematics
Economics
Neuroscience
Only by understanding how actions are justified can we understand
Psychology how to build an agent whose actions are justifiable (or rational)
Computer eng
• Aristotle argued that actions are justified by a logical connection
Linguistics • Goals and knowledge of action’s outcome are connected
History
• (in De Motu Animalium)
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Goal-based analysis does not say what to do when several actions will
Foundations
achieve the goal or when no action will achieve it completely
Philosophy
Mathematics
Economics • Antoine Arnauld (1612-1694) described a quantitative formula
Neuroscience
Psychology
for deciding what action to take in cases like this
Computer eng • Stuart Mill’s (1806-1873) Utilitarianism (1863) promoted the
Linguistics
idea of rational decision criteria in all spheres of our activity
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations
Mathematics
Philosophy
Mathematics
Economics
Neuroscience
Foundations
Psychology
Computer eng
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial Mathematics
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally • What are the formal rules to draw valid conclusions?
Foundations • What can be computed?
Philosophy
Mathematics • How do we reason with uncertain information?
Economics
Neuroscience
Psychology
Computer eng Philosophers staked out some of the fundamental ideas of AI
• The leap to formal science required formalisation
Linguistics
History
• Three areas: Logic, computation and probability
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial Mathematics (cont.)
intelligence
The idea of formal logic can be tracked back to ancient Greece
UFC/DC
CK0031/CK0248 • Mathematical development began with George Boole (1815-1864)
2017.2
• He worked out propositional or Boolean logic
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations
Philosophy
Mathematics
Economics
Neuroscience
Psychology
Computer eng
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
• In 1879, Gottlob Frege (1840-1925) extended Boole’s logic
Large datasets
• Inclusion of objects and relations
Today
• The creation of first-order logic
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally Find the limits of what could be done with logic and computation
Foundations • The first nontrivial algorithm is thought to be Euclid’s algorithm
Philosophy
Mathematics • For computing greatest common divisors
Economics
Neuroscience
Psychology
The word algorithm (and the idea of studying them) comes from a Persian
Computer eng
Control, cybernetics • His writings introduced Arabic numerals and algebra to Europe
Linguistics
• A mathematician of the 9th century, al-Khowarazmi
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
• Boole and others discussed algorithms for logical deduction
Foundations
Philosophy • By the late 19th century, efforts were under way to formalise
Mathematics
general mathematical reasoning as logical deduction
Economics
Neuroscience • In 1930, Kurt Gödel (1906-1978) showed that there exists a
Psychology
procedure to prove any true statement in first-order logic
Computer eng
Control, cybernetics • But first-order logic cannot capture the principle of mathematical
Linguistics
induction needed to characterise the natural numbers
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations Gödel: Limits on deduction do exist

Philosophy
Mathematics The incompleteness theorem, 1931:
Economics
Neuroscience
In any formal theory as strong as Peano
Psychology arithmetic (elementary theory of natural
Computer eng numbers), there are true undecidable
statements
Linguistics
History
• No proof within the theory
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations
Philosophy
Mathematics
Economics
Neuroscience
Psychology
Computer eng
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Motivated Turing (1912-1954), characterise which funcs are computable
Acting rationally
• The notion is problematic because the notion of an effective
Foundations
procedure or computation cannot be given a formal definition
Philosophy
Mathematics
Economics
The Church-Turing thesis is accepted as providing a sufficient definition
Neuroscience
Psychology • The Turing machine is capable of computing any computable function
Computer eng
Linguistics
There are some functions that no Turing machine can compute
History • For example, no machine can tell in general whether a given
Gestation and birth program will return an answer on a given input or run forever
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Decidability and computability are vital to understand computation
Thinking rationally • The notion of tractability has a greater impact
Acting rationally
• Roughly, a problem is called intractable if the time required
Foundations
Philosophy to solve it grows exponentially with the size of the instances
Mathematics
Economics
Neuroscience
Psychology
This is truly serious stuff
Computer eng
Linguistics
Exponential growth means that mildly large instances cannot be solved
History • At least, in any reasonable time
Gestation and birth
• Strive to divide the overall problem of generating intelligent behaviour
Early enthusiasm,
great expectations into tractable subproblems
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
How can one recognize an intractable problem? Need a method ...
Acting rationally
Foundations NP-completeness theory by S. Cook (1971) and R. Karp (1972)

Philosophy
Mathematics
A class of combinatorial search and reasoning problems are NP-complete
Economics
Neuroscience • (NP + NP-hard)
Psychology
Computer eng
Linguistics
Any problem class to which the class of NP-complete problems can be
reduced is ‘likely’ to be intractable (yet no proof that NP-complete
History
Gestation and birth
problems are necessarily intractable, but still ...)
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations
Philosophy These results contrast with the optimism with which the popular
Mathematics press greeted the first computers and yesterday’s and today’s AI
Economics
Neuroscience • Despite the increasing speed of computers, careful
Psychology use of resources will characterise intelligent systems
Computer eng
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
The third contribution of mathematics to AI is probability theory
Thinking humanly • Gerolamo Cardano (1501-1576) framed the idea of probability,
Thinking rationally
describing it in terms of the possible outcomes (gambling)
Acting rationally
Foundations
• Blaise Pascal (1623-1662), in a letter to Pierre Fermat (1601-1665),
Philosophy showed how to predict the future of an unfinished gambling game
Mathematics and assign average payoffs
Economics
Neuroscience
Psychology
Computer eng Probability became invaluable to quantitative sciences
Linguistics Deal with uncertain measurements and incomplete theories
History • James Bernoulli (1654-1705), Pierre Laplace (1749-1827) and others:
Gestation and birth
Early enthusiasm,
Advance in the theory and statistical methods
great expectations
• Thomas Bayes (1702-1761):
A dose of reality
Knowledge-based AI Update of probabilities in the light of new evidence
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations
Philosophy
Mathematics
Economics
Neuroscience
Psychology
Computer eng
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations
Philosophy
Mathematics
Economics
Neuroscience
Psychology
Computer eng
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets Bayes’ rule: In most modern approaches to uncertain reasoning
Today
Artificial
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations
Economics
Philosophy
Mathematics
Economics
Neuroscience
Foundations
Psychology
Computer eng
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial Economics
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
• How should we make decisions, so as to maximise payoff?
Thinking humanly
• How should we do this, when others may not go along?
Thinking rationally
Acting rationally • How we do this, when the payoff may be far in the future?
Foundations
Philosophy
Mathematics
Economics
The science of economics got its start in 1776
Neuroscience
Psychology
Scottish philosopher Adam Smith (1723-1790) wrote his famous book
Computer eng
• ‘An inquiry into the nature and causes of the wealth of nations’
Linguistics
History
The ancient Greeks and others made contributions to economic thought
Gestation and birth • Smith was first to treat it as a science
Early enthusiasm,
great expectations • Economies can be thought of as consisting of individual agents
A dose of reality
Knowledge-based AI • Agents maximise their own economic well-being
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial Economics (cont.)
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
We think of economics as being about money, economists say that
Acting rationally they study how people make choices that lead to desired outcomes
Foundations • When McDonald’s offers a hamburger for 1$, they are asserting that
Philosophy
they would prefer 1$ and hoping that you will prefer the hamburger
Mathematics
Economics
Neuroscience
Psychology The math treatment of ‘preferred outcomes’ or utility was formalised
Computer eng
• L. Walras (1834-1910) and then improved by F. Ramsey (1931)
Linguistics
History Later, von Neumann and Morgenstern and their book

Gestation and birth
• ‘The theory of games and economic behavior ’ (1944)
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Decision theory combines probability theory with utility theory
Thinking rationally • A formal and complete framework for decisions under uncertainty
Acting rationally
• Situations in which probabilistic descriptions capture
Foundations
Philosophy appropriately the environment of the decision maker
Mathematics
Economics
Neuroscience
This is suitable for ‘large’ economies in which each agent need
Psychology
Computer eng
pay no attention to the actions of other agents as individuals
Linguistics
• For ‘small’ economies, the situation is much more like a game
History
Gestation and birth The actions of one player can significantly affect the utility of another
Early enthusiasm,
great expectations • (either positively or negatively)
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations
Von Neumann and Morgenstern’s game theory showed that, for some
Philosophy
Mathematics
games, a rational agent should adopt policies that appear to be randomised
Economics
Neuroscience
Psychology
• Unlike decision theory, game theory does not offer
Computer eng an unambiguous prescription for selecting actions
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
For the most part, economists did not address the third question
Acting rationally
Foundations
• How to make rational decisions when payoffs from actions are
Philosophy not immediate but result from several sequential actions?
Mathematics
Economics
Neuroscience
Psychology
This topic was pursued in the field of operations research
Computer eng • Formalisation of a class of sequential decision problems
Linguistics • Markov decision processes
History • Richard Bellman (1957)
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations
Philosophy
Mathematics
Economics
Neuroscience
Psychology
Computer eng
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Economics/operations research contributed to the notion of rational agents
Thinking rationally
Acting rationally
• Yet, AI developed along separate paths
Foundations
Philosophy
Mathematics One reason was the complexity of making rational decisions
Economics
Neuroscience
• The pioneering AI researcher Herbert Simon (1916-2001)
Psychology won the Nobel Prize in economics in 1978 for his work
Computer eng
• Models based on satisficing (making decisions that are ‘good
Linguistics enough,’ rather than laboriously calculating an optimal decision)
History gave a better description of actual human behaviour
Gestation and birth
• Since the 1990s, there has been a resurgence of interest
Early enthusiasm,
great expectations in decision-theoretic techniques for agent systems
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations
Neuroscience
Philosophy
Mathematics
Economics
Neuroscience
Foundations
Psychology
Computer eng
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial Neuroscience
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
• How do brains process information?
Foundations
Philosophy
Neuroscience studies the nervous system, particularly the brain
Mathematics
Economics
Neuroscience
Psychology
How the brain enables thought is one of the mysteries of science
Computer eng • The fact that it does enable thought had been appreciated
Linguistics • Evidence that head blows can lead to mental incapacitation
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial Neuroscience (cont.)
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
It has also long been known that human brains are ‘different’
Foundations • In ∼ -335 Aristotle wrote, ‘Of all the animals, man has
Philosophy the largest brain in proportion to his size’
Mathematics
Economics
• The largest brain, ...!
Neuroscience
Psychology
Computer eng
It was not until the middle of the 18th century that the
Linguistics
brain was widely recognised as the seat of consciousness
History • Before, candidate locations included heart and the spleen
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
Studies in brain-damaged patients (1861) showed the existence of localised
What’s AI? brain areas responsible for specific cognitive functions
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Axonal arborization
Foundations
Philosophy
Axon from another cell
Mathematics
Economics Synapse
Neuroscience
Dendrite Axon
Psychology
Computer eng
Linguistics Nucleus
History
Synapses
Gestation and birth
Early enthusiasm,
great expectations Cell body or Soma
A dose of reality
Knowledge-based AI
AI as an industry By that time, we knew that the brain consisted of nerve cells, neurons
Scientific methods
• In 1873 Golgi developed a technique to observe single neurons
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Nicolas Rashevsky (1936 and 1938): First to apply math models
Thinking rationally
Acting rationally • The study of the nervous system
Foundations
Philosophy
Mathematics We have some data on the mapping between brain areas and the
Economics
Neuroscience
body parts that they control or from which receive sensory input
Psychology • Such mappings are able to change radically over the course of
Computer eng
a few weeks, and some animals seem to have multiple maps
Linguistics • Moreover, we do not fully understand how other areas
History can take over functions when one area is damaged
Gestation and birth
Early enthusiasm,
• Almost no theory on how an individual memory is stored
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Measurement of intact brain activity: The electroencephalograph (EEG)
Acting rationally • Hans Berger, in 1929
Foundations
Philosophy
The development of functional magnetic resonance imaging (fMRI, 2001)
Mathematics
Economics • Unprecedentedly detailed images of brain activity
Neuroscience
Psychology
• Measurements that correspond to ongoing cognitive processes
Computer eng
There are the advances in single-cell recording of neuron activity
Linguistics
History
• Neurons are stimulated electrically, chemically and optically
Gestation and birth
• Allows neuronal input-output relationships to be mapped
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
A long way from understanding how cognitive processes work
Acting rationally
Foundations
Philosophy
These are our (rather amazing) conclusions today
Mathematics
Economics • A collection of simple cells can lead to thought
Neuroscience
Psychology
Brains causes minds
Computer eng
The only real alternative theory is mysticism
Linguistics
History
• Minds operate in some mystical realm
Gestation and birth • Beyond physical science
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Brains and digital computers have somewhat different properties
Thinking humanly
Thinking rationally Supercomputer Personal Computer Human Brain
Acting rationally
Computational units104 CPUs, 1012 transistors 4 CPUs, 109 transistors 1011 neurons
Foundations
Philosophy
Storage units 1014 bits RAM 1011 bits RAM 1011 neurons
15
10 bits disk 1013 bits disk 1014 synapses
Mathematics
Economics Cycle time 10−9 sec 10−9 sec 10−3 sec
Neuroscience
Operations/sec 1015 1010 1017
Psychology
Computer eng
Memory updates/sec 1014 1010 1014
Linguistics
Computers have a cycle time that is a million times faster than a brain
History
Gestation and birth
The brain makes up for that with far more storage and interconnection
Early enthusiasm,
great expectations
• Some supercomputers have a similar capacity to the brain’s
A dose of reality
Knowledge-based AI The brain does not seem to use all of its neurons simultaneously
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations Futurists make much of such numbers, pointing to incoming singularity

Philosophy
Mathematics
• Computers will soon reach a super-human level of performance
Economics
• Even with a computer of virtually unlimited capacity, we still
Neuroscience
Psychology
would not know how to achieve the brain’s level of intelligence
Computer eng
• Comparisons are not terribly informative
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations
Philosophy
Mathematics
Economics
Psychology
Neuroscience
Foundations
Psychology
Computer eng
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial Psychology
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations • How do humans and animals think and act?

Philosophy
Mathematics Scientific psychology: By physicists von Helmholtz (1821-94) and Wundt
Economics (1832-1920)
Neuroscience
Psychology
• Helmholtz applied the scientific method to the study of human vision
Computer eng
• His Handbook of Physiological Optics is described as ‘the single most
Linguistics
important treatise on the physics and physiology of human vision’
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial Psychology (cont.)
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations
Wundt opened the first lab of experimental psychology (1879)
Philosophy • Wundt insisted on controlled experiments in which his workers would
Mathematics
Economics
perform a perceptual or associative task while introspecting
Neuroscience • The careful controls went toward making psychology a science
Psychology
Computer eng • The subjective nature of the data made it unlikely that an
Control, cybernetics experimenter would ever disconfirm his/her own theories
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Biologists studying animal behaviou lacked introspective data
Thinking humanly
• They developed an objective methodology
Thinking rationally
Acting rationally • Described by H. S. Jennings (1906) in his
Foundations work Behavior of the Lower Organisms
Philosophy
Mathematics
Economics
Applying this viewpoint to humans, the behaviourism movement, led by
Neuroscience John Watson (1878-1958), rejected any theory involving mental processes
Psychology
• Introspection cannot provide reliable evidence
Computer eng
Linguistics
History
Behaviourists kept on studying objective measures of the percepts
Gestation and birth (stimulus) given to animals and resulting actions (response)
Early enthusiasm,
great expectations • Behaviourism discovered a lot about rats and pigeons
A dose of reality
• They had less success at understanding humans
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally Cognitive psychology: Brains are information-processing devices
Foundations • Traced back at least to the works of William James (1842-1910)
Philosophy
Mathematics • Perception involves a form of unconscious logical inference
Economics
Neuroscience
Psychology
Computer eng The cognitive viewpoint was eclipsed by behaviourism in the U.S.
• Cognitive modelling was able to flourish at the Cambridge’s
Linguistics
Applied Psychology Unit, directed by F. Bartlett (1886-969)
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
The Nature of Explanation, by Bartlett’s student Kenneth Craik (1943),
Thinking rationally reestablished the legitimacy of such ‘mental’ terms as beliefs and goals
Acting rationally
• They are as scientific as, say, using pressure and temperature to talk
Foundations
Philosophy
about gases, despite their being made of molecules that have neither
Mathematics
Economics
Neuroscience Craik specified the three key steps of a knowledge-based agent:
Psychology
Computer eng 1 The stimulus must be translated into internal representation;
Linguistics
2 The representation is manipulated by cognitive processes;
History 3 The goal is to derive new internal representations;
Gestation and birth
4 These are in turn retranslated back into action
Early enthusiasm,
great expectations
He clearly explained why this was a good design for an agent
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally Meanwhile, in the United States, the development of computer modelling
Acting rationally
The creation of the field of cognitive science
Foundations
Philosophy
Mathematics The field have started at a workshop in September 1956 at MIT
Economics
• G. Miller presented The Magic Number Seven
Neuroscience
Psychology • N. Chomsky presented Three Models of Language
Computer eng
Control, cybernetics • A. Newell and H. Simon presented The Logic Theory Machine
Linguistics
History The papers showed how computer models can be used to address the
Gestation and birth psychology of memory, language, and logical thinking respectively
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations
• ‘A cognitive theory should be like a computer program’
Philosophy
Mathematics
Among psychologists, it is now a common (though not universal) view
Economics
Neuroscience
• ‘a cognitive theory should be like a computer program’
Psychology
Computer eng • It should describe a detailed information-processing mechanism
Linguistics • Some cognitive function might be implemented whereby
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations
Philosophy
Mathematics
Economics
Computer engineering
Neuroscience
Foundations
Psychology
Computer eng
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial Computer engineering
intelligence
UFC/DC
CK0031/CK0248
2017.2 For AI to succeed, two things:
• How do we build an • Intelligence + artefact
What’s AI?
efficient computer?
Acting humanly Artefact of choice: Computer
Thinking humanly
Thinking rationally
Acting rationally
Foundations
The modern digital electronic computer invented almost simultaneously
Philosophy
Mathematics • By scientists in 3 countries embattled in WWII
Economics
Neuroscience
Psychology The first operational computer: The electromechanical Heath Robinson
Computer eng
• (built in 1940 by Alan Turing’s team)
Linguistics • In 1943, the same group developed the Colossus
History
• (a general-purpose machine based on vacuum tubes)
Gestation and birth
Early enthusiasm,
great expectations
The first working programmable computer was the Z-3
A dose of reality
Knowledge-based AI • (by Konrad Zuse in Germany, 1941)
AI as an industry
Zuse also invented the first high-level programming language
Scientific methods
• And floating-point numbers
Intelligent agents
Large datasets
Today
Artificial Computer engineering (cont.)
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
The first electronic computer, ABC (1942):
Foundations
• Assembled by John Atanasoff and his student Clifford Berry
Philosophy
Mathematics • (at Iowa State)
Economics
Neuroscience
Psychology The ENIAC, developed in a secret military project at UPenn
Computer eng
• A team including John Mauchly and John Eckert
Linguistics • It proved to be the most influential forerunner of modern computers
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Since then, each generation of computer hardware has brought an
Acting rationally
increase in speed and capacity and (somewhere) a price decrease
Foundations
Philosophy • Performance doubled approx. every 18 months until around 2005
Mathematics
Economics
• Power dissipation problems led manufacturers to start multiplying
Neuroscience CPU cores rather than clock speed
Psychology
Computer eng
Linguistics
Current expectations are that future increases in power
History
Gestation and birth
will come from massive parallelism (as in the brain?)
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations There were calculating devices before the electronic computer

Philosophy
• The earliest automated machines, from the 17th century
Mathematics
Economics • The first programmable machine was a loom
Neuroscience
Psychology • Devised in 1805 by Joseph Marie Jacquard (1752-1834)
Computer eng
• It used punched cards to store instructions for the pattern to be woven
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Charles Babbage (1792-1871) designed two machines, unfinished
Acting rationally
Foundations • The Difference engine was intended to compute math tables

Philosophy
Mathematics
• (for engineering and scientific projects)
Economics
• It was finally built in 1991 at the Science Museum in London
Neuroscience
Psychology
Computer eng
Control, cybernetics • The Analytical engine was more ambitious
Linguistics
• With addressable memory, stored programs, and conditional jumps
History
Gestation and birth • The first artefact capable of universal computation
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations
Babbage’s colleague Ada Lovelace: Perhaps, the world’s first programmer
Philosophy
Mathematics • She wrote programs for the unfinished Analytical engine
Economics
Neuroscience
• She speculated that it could play chess or compose music
Psychology
Computer eng
The programming language Ada is named after her
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly AI owes a debt to the software side of computer science, which has
Thinking rationally supplied the operating systems, programming languages, and tools
Acting rationally
• This is one area where the debt has been repaid
Foundations
Philosophy
Mathematics
Economics
Neuroscience Work in AI pioneered many ideas in mainstream computer science
Psychology
• Time sharing, interactive interpreters, personal computers with
Computer eng
Control, cybernetics windows and pointer, development environments
Linguistics
• Linked list data types, automatic storage management
History
Gestation and birth
• Key concepts of symbolic, functional, declarative
Early enthusiasm,
great expectations
• Object-oriented programming
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations
Philosophy
Mathematics
Economics
Control theory and cybernetics
Neuroscience
Foundations
Psychology
Computer eng
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial Control theory and cybernetics
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
• How can artefacts operate under their own control?
Acting humanly
Thinking humanly
Thinking rationally
Ktesibios of Alexandria (∼ -250) built a self-controlling machine
Acting rationally
• A water clock with a regulator to keep a constant flow rate
Foundations
Philosophy This invention changed the definition of what an artefact could do
Mathematics
Economics • Previously, only living things could modify their behaviour
Neuroscience
Psychology
• (in response to changes in the environment)
Computer eng
Control, cybernetics Other examples of self-regulating feedback control systems
Linguistics
• The steam engine governor, created by James Watt (1736-1819)
History
Gestation and birth • The thermostat, invented by Cornelis Drebbel (1572-1633)
Early enthusiasm,
great expectations
A dose of reality The math theory of stable feedback systems was developed later
Knowledge-based AI
AI as an industry
• In the 19th century
Scientific methods
Intelligent agents
Large datasets
Today
Artificial Control theory and cybernetics (cont.)
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly A central figure in control theory is Norbert Wiener (1894-1964)
Thinking rationally
Acting rationally
• A brilliant mathematician who worked also with Bertrand Russell
Foundations • Developed interest in biological and mechanical control systems
Philosophy
Mathematics
• He studied their connection to cognition
Economics
Neuroscience
Psychology Wiener and colleagues used control systems as psychological models
Computer eng
Control, cybernetics • Purposive behaviour as arising from a regulatory mechanism
Linguistics
• An effort to try to minimise some ‘error’
History
Gestation and birth • (difference between current state and goal/target state)
Early enthusiasm,
great expectations They challenged the behaviourists
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations
Philosophy
Mathematics
Economics
Neuroscience
Psychology
Computer eng
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
In the late 1940s, Wiener, along with McCulloch, Pitts and von Neumann,
Foundations
Philosophy • A series of influential conferences
Mathematics
Economics
They explored mathematical and computational models of cognition
Neuroscience
Psychology
• Wiener’s book Cybernetics (1948) became a bestseller
Computer eng
Control, cybernetics • It awoke the public to the possibility of AI machines
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally Meanwhile, in Britain ..., W. Ross Ashby pioneered similar ideas
Foundations
Philosophy
The Ratio Club (1940): Together with Turing, Walter, and others
Mathematics • ‘For those who had Wiener’s ideas, ... before Wiener’s book appeared’
Economics
Neuroscience
Psychology
Computer eng Ashby’s Design for a brain (1952): Intelligence can be created by the
Control, cybernetics use of homeostatic devices containing appropriate feedback loops
Linguistics
• Achieve stable adaptive behaviour
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations
Philosophy
Modern control theory, especially stochastic optimal control, has as
Mathematics its goal systems that maximise an objective function over time
Economics
Neuroscience
• This roughly matches our view of AI
Psychology
• Design systems that behave optimally
Computer eng
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Why are AI and control theory two different fields then?
Thinking rationally
Acting rationally • Because of the coupling between math techniques familiar
Foundations to the participants and sets of problems in each world view
Philosophy
Mathematics
Economics
Neuroscience
Calculus and matrix algebra, tools of control, lend themselves to
Psychology systems that are describable by fixed sets of continuous variables
Computer eng
• AI arises partly as a way to escape from such perceived limitations
Linguistics • The tools of logical inference and computation allowed AI to
History consider problems such as language, vision, and planning
Gestation and birth
Early enthusiasm,
• Stuff that fell outside the control theorist’s purview
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations
Philosophy
Mathematics
Economics
Linguistics
Neuroscience
Foundations
Psychology
Computer eng
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial Linguistics
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
• How does language relate to thought?
Acting rationally
B. F. Skinner published Verbal behavior (1957) a comprehensive,
Foundations
Philosophy
detailed account of the behaviourist approach to language learning
Mathematics
Economics
• A review of the book became as well known as the book itself
Neuroscience
Psychology • It served to almost kill off interest in behaviourism
Computer eng
Linguistics The author of the review was the linguist Noam Chomsky
History • He had just published a book on his own theory
Gestation and birth
Early enthusiasm, • (Syntactic structures)
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial Linguistics (cont.)
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations
Philosophy
Mathematics
Economics
Neuroscience
Psychology
Computer eng
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Behaviourist theories do not address the notion of creativity in language
Foundations
Philosophy • They do not explain how a child could understand and make up
Mathematics sentences that he or she had never heard before
Economics
Neuroscience
Psychology Chomsky’s theory, based on syntactic models could explain this
Computer eng
• Formal enough that it could in principle be programmed
Linguistics Inspired by the Indian linguist Panini (∼ -350)
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly Modern linguistics and AI, then, were ‘born’ at about the same time
Thinking humanly
Thinking rationally
• The fields grew up together, intersecting in a hybrid field called
Acting rationally
• Computational linguistics or natural language processing
Foundations
Philosophy
Understanding language turned out to be more complex than it seemed
Mathematics
Economics
Neuroscience
Psychology Understanding language needs understanding of subject matter/contex
Computer eng
• Not just the structure of sentences
Linguistics • This might seem obvious, but it was not until the ’60s
History • Much of the early work in knowledge representation
Gestation and birth
Early enthusiasm, • (how to put knowledge into a form for a computer to reason with)
great expectations
A dose of reality • Too tied to language and informed by research in linguistics
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations
Philosophy
Mathematics History
Economics
Neuroscience
Psychology
Computer eng
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial History
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
• The gestation of AI (1943-1955)
Acting rationally
Foundations
• The birth of AI (1956)
Philosophy • Early enthusiasm, great expectations (1952-1969
Mathematics
Economics • Back to reality (1966-1973)
Neuroscience
Psychology
• Knowledge-based systems (1969-1979)
Computer eng • AI becomes an industry (1980-today)
Linguistics • The return(s) of neural networks (1986-today)
History • AI goes scientific (1987-today)
Gestation and birth
Early enthusiasm, • The emergence of intelligent systems (1995-today)
great expectations
A dose of reality • Big data, very big data (2001-today)
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations
Philosophy
Mathematics Gestation and birth
Economics
Neuroscience
History
Psychology
Computer eng
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial Gestation (1943-1955)
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI? The first work now generally recognised as AI

Acting humanly
• By Warren McCulloch and Walter Pitts (1943)
Thinking humanly
Thinking rationally
Acting rationally
• Knowledge of the basic physiology and
Foundations
Philosophy function of neurons in the brain;
Mathematics
They drew on
three sources: • A formal analysis of propositional logic
Economics
Neuroscience due to Russell and Whitehead;
Psychology
• Turing’s theory of computation
Computer eng
Linguistics
History They proposed a model of artificial neurons where each neuron is

Gestation and birth characterised as ‘on’ or ‘off’, with a switch to ‘on’ in response to
Early enthusiasm,
great expectations stimulation by a sufficient number of neighbouring neurons
A dose of reality
• The neuron state is conceived of as ‘factually equivalent
Knowledge-based AI
AI as an industry to a proposition which proposed its adequate stimulus’
Scientific methods
Intelligent agents
Large datasets
Today
Artificial Gestation - 1943-1955 (cont.)
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally They showed that any computable function could be computed by some
Acting rationally
network of connected neurons, and that all logical connectives (‘and’, ‘or’,
Foundations ‘not’, etc.) could be implemented by network structures
Philosophy
Mathematics
Economics • McCulloch and Pitts also suggested that suitably
Neuroscience
defined artificial neural networks could learn
Psychology
Computer eng
Control, cybernetics Donald Hebb (1949) demonstrated a simple updating rule
Linguistics
for modifying the connection strengths between neurons
History
Gestation and birth
• Hebbian learning remains an influential model to this day
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248 Two undergrad students at Harvard, Marvin Minsky and Dean Edmonds
2017.2
• The first neural network computer in 1950
What’s AI?
• The SNARC: 3K vacuum tubes and a surplus automatic pilot
Acting humanly
Thinking humanly
mechanism from a B-24 bomber to simulate a 40-neuron net
Thinking rationally
• Stochastic Neural Analog Reinforcement Calculator
Acting rationally
Foundations
Philosophy
Mathematics
Economics
Neuroscience
Psychology
Computer eng
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
At Princeton, Minsky studied universal computation in neural nets
Foundations
Philosophy
• His Ph.D. committee was skeptical about whether this kind of work
Mathematics should be considered mathematics
Economics
Neuroscience
• von Neumann reportedly said, ‘If it isn’t now, it will be someday’
Psychology
Computer eng
Minsky was later to prove influential theorems
Linguistics • limitations of neural network research
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly Other early examples of work that can also be characterised as AI
Thinking humanly
Thinking rationally
• Alan Turing’s vision was perhaps the most influential
Acting rationally
Foundations He lectured on the topic in 1947 at the London Mathematical Society

Philosophy
Mathematics
Economics
• He articulated a persuasive agenda in his 1950 article
Neuroscience
• Computing machinery and intelligence
Psychology
Computer eng • Therein, he introduced the Turing test, machine learning,
genetic algorithms, and reinforcement learning
Linguistics
History
Gestation and birth He proposed the Child Programme idea
Early enthusiasm,
great expectations • ‘Instead of trying to produce a programme to simulate the adult mind,
A dose of reality why not rather try to produce one which simulated the child’s?’
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial Birth (1956)
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Princeton was home to another figure in AI, John McCarthy
Foundations
Philosophy • After receiving his PhD in 1951 and working for two years
Mathematics as an instructor, McCarthy moved to Stanford and then to
Economics
Dartmouth College, later the official birthplace of the field
Neuroscience
Psychology • McCarthy convinced Minsky, Claude Shannon, and Nathaniel
Computer eng
Rochester to help him bring together US researchers in theory
Linguistics
of automata, neural nets, and the study of intelligence
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial Birth - 1956 (cont.)
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
They organised a 2-month workshop at Dartmouth, summer 1956
Thinking humanly
Thinking rationally ‘We propose that a 2 month, 10 man study of artificial intelligence be
Acting rationally carried out during the summer of 1956 at Dartmouth College in Hanover,
Foundations New Hampshire.
Philosophy
Mathematics The study is to proceed on the basis of the conjecture that every aspect of
Economics
Neuroscience
learning or any other feature of intelligence can in principle be so
Psychology precisely described that a machine can be made to simulate it.
Computer eng
Control, cybernetics An attempt will be made to find how to make machines use language,
Linguistics
form abstractions and concepts, solve kinds of problems now reserved for
History humans, and improve themselves.
Gestation and birth
Early enthusiasm,
great expectations
We think that a significant advance can be made in one or more of these
A dose of reality problems if a carefully selected group of scientists work on it together for a
Knowledge-based AI summer ’
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
There were 10 attendees in all, including More from Princeton,
Thinking rationally
Acting rationally
Samueln from IBM, and Solomonoff and Selfridge from MIT
Foundations • Two researchers from Carnegie Tech rather stole the show
Philosophy
• Allen Newell and Herbert Simon,
Mathematics
Economics
Neuroscience
Psychology Although the others had ideas and in some cases programs for particular
Computer eng
applications such as checkers, Newell and Simon had a reasoning program
Linguistics • The Logic Theorist (LT)
History • ‘We have invented a computer program capable of thinking
Gestation and birth
Early enthusiasm,
non-numerically, and thereby solved the venerable mind-body problem’
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Soon after, the program was able to prove most of the theorems in
Thinking rationally
Acting rationally
Chapter 2 of Russell and Whitehead’s Principia Mathematica
Foundations • Russell was reportedly delighted when Simon showed him that the
Philosophy program had come up with a proof for one theorem that was shorter
Mathematics
than the one in Principia
Economics
Neuroscience
Psychology
Computer eng
Control, cybernetics Remark
Linguistics
The editors of the Journal of Symbolic Logic were less impressed
History
Gestation and birth • They rejected a paper by Newell, Simon, and Logic Theorist
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations
Philosophy
The Dartmouth workshop did not lead to any new breakthroughs
Mathematics • It did introduce all the major figures to each other
Economics
Neuroscience • For the next 20 years, the field would be dominated by these people
Psychology
Computer eng
• And their students at MIT, CMU, Stanford, and IBM
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Why was it necessary for AI to become a separate fiel?
Thinking humanly
Thinking rationally
• Why couldn’t all the work done in AI have taken place under the
Acting rationally name of control theory or operations research or decision theory?
Foundations • All have objectives similar to those of AI
Philosophy
Mathematics
• Why isn’t AI a branch of mathematics?
Economics
Neuroscience
Psychology
AI from the start embraced the idea of duplicating human faculties
Computer eng
• (such as creativity, self-improvement, and language use)
Linguistics • None of the other fields were addressing these issues
History
Gestation and birth AI is the only one of such fields that is a clear branch of computer science
Early enthusiasm,
great expectations • Methodologically, AI is the only field to attempt to build machines
A dose of reality
Knowledge-based AI
that will function autonomously in complex, changing environments
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations
Philosophy Early enthusiasm and great
Mathematics
Economics
Neuroscience expectations
Psychology
History
Computer eng
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial Early enthusiasm and great expectations
intelligence
(1952-1969)
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
The early years of AI were full of successes, in a limited way
Acting rationally
Given the primitive computers and programming tools of the time
Foundations
Philosophy • Only a few years earlier computers were seen as things that could only
Mathematics
do arithmetic
Economics
Neuroscience Whenever a computer did anything remotely clever, it was a wow!
Psychology
Computer eng
Linguistics
Remark
History
The intellectual establishment believed that ‘a machine can never do X’
Gestation and birth • AI researchers responded by demonstrating one X after another
Early enthusiasm,
great expectations • John McCarthy referred to this as the ‘Look, Ma, no hands!’ era
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial Early enthusiasm and great expectations -
intelligence
1952-1969 (cont.)
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations Newell and Simon’s early success was followed up with the GPS
Philosophy
• Unlike Logic Theorist, this program was designed from
Mathematics
Economics the start to imitate human problem-solving protocols
Neuroscience
• In the limited class of puzzles it could handle, it turned out that the
Psychology
Computer eng
order in which the program considered subgoals and possible actions
Control, cybernetics was similar to that in which humans approached the same problems
Linguistics
History GPS was the first program to embody the ‘thinking humanly’ approach
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
1952-1969 (cont.)
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations
The success of GPS and others as models of cognition led Newell and Simon
Philosophy to formulate the physical symbol system hypothesis
Mathematics
Economics
• ‘A physical symbol system has the necessary and sufficient means for
Neuroscience general intelligent action’
Psychology
Computer eng
Any system (human or machine) exhibiting intelligence must operate by
Linguistics manipulating data structures composed of symbols
History • This hypothesis has been challenged from many directions
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
1952-1969 (cont.)
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally At IBM, Rochester and colleagues produced the first AI programs
Foundations
• Gelernter (1959) constructed the Geometry Theorem Prover
Philosophy
Mathematics • Able to prove theorems that many math students would find tricky
Economics
Neuroscience • Starting in 1952, Samuel wrote a series of programs for checkers
Psychology (draughts/dama) that eventually learned to play at amateur level
Computer eng
Linguistics He disproved the idea that computers can do only what told to
History • His program learned to play a better game than its creator
Gestation and birth
Early enthusiasm,
The program was demonstrated on television in February 1956
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial Early enthusiasm and great expectation -
intelligence
1952-1969 (cont.)
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations
Philosophy
Mathematics Remark
Economics
Neuroscience
Like Turing, Samuel had trouble finding computer time
Psychology • Working at night, he used machines that were still
Computer eng
on the testing floor at IBM’s manufacturing plant
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
1952-1969 (cont.)
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
John McCarthy moved from Dartmouth to MIT
Acting rationally
• There he made three crucial contributions
Foundations
Philosophy • One historic year: 1958
Mathematics
Economics
Neuroscience In MIT AI LabMemo No. 1, McCarthy defined the high-level language
Psychology Lisp, it became the AI programming language for the next 30 years
Computer eng
Control, cybernetics • With Lisp, McCarthy had the tool he needed
Linguistics
History
Gestation and birth Access to scarce/expensive computing resources was a serious problem
Early enthusiasm,
great expectations • In response, he and others at MIT invented time sharing
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
1952-1969 (cont.)
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
In 1958, McCarthy published the paper Programs with Common Sense
Foundations
Philosophy
• He described the Advice Taker (AT), a hypothetical program
Mathematics
• (perhaps, the first complete AI system)
Economics
Neuroscience
Psychology Designed to use knowledge to search for solutions to problems
Computer eng
• But unlike the others, it was to embody knowledge of the world
Linguistics
History For example, he showed how simple axioms would enable the program to
Gestation and birth generate a plan to drive to the airport
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
1952-1969 (cont.)
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally The program was also designed to accept new axioms in the course
Foundations of operation (allowing it to achieve competence in new areas)
Philosophy
Mathematics
• Without being reprogrammed
Economics
Neuroscience
Psychology The AT embodied principles of knowledge representation and reasoning
Computer eng
Control, cybernetics • It is useful to have a formal, explicit representation of the world
Linguistics
• To be able to manipulate that representation with deductive processes
History
Gestation and birth
Early enthusiasm, It is remarkable how much of the 1958 paper stays relevant today
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
1952-1969 (cont.)
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
1958 also marked the year that Marvin Minsky moved to MIT
Acting rationally
Foundations • His initial collaboration with McCarthy did not last, tho
Philosophy
Mathematics
Economics McCarthy stressed representation and reasoning in formal logic
Neuroscience
Psychology
• Minsky was more into getting programs to work
Computer eng
• In 1963, McCarthy started the AI lab at Stanford
Linguistics
History
Gestation and birth
His plan to use logic to build the ultimate Advice Taker was advanced
Early enthusiasm, by J. A. Robinson’s discovery in 1965 of the resolution method
great expectations
A dose of reality • (a theorem-proving algorithm for first-order logic)
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
1952-1969 (cont.)
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations Stanford emphasised general-purpose methods for logical reasoning

Philosophy
Mathematics
• Applications of logic included Cordell Green’s question answering and
Economics planning systems (1969) and the Shakey robotics project
Neuroscience
Psychology
• (at the Stanford Research Institute, SRI)
Computer eng
Control, cybernetics Shakey’s project was the first one to demonstrate the complete integration
Linguistics
• Logical reasoning and physical activity
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
1952-1969 (cont.)
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Minsky supervised a series of students who chose limited problems
Thinking rationally • Intelligence was required to solve them
Acting rationally
Foundations
These limited domains became known as micro-worlds
Philosophy
Mathematics
Economics
• James Slagle’s Saint program (1963) was able to solve closed-form
Neuroscience
Psychology
calculus integration problems typical of first-year college courses
Computer eng • Tom Evans’s Analogy program (1968) solved geometric analogy
Linguistics
problems that appear in IQ tests
History
Gestation and birth Daniel Bobrow’s Student program (1967) solved algebra stories
Early enthusiasm,
great expectations • ‘If the number of customers Tom gets is twice the square of 20% of the
A dose of reality
number of advertisements he runs, and the number of advertisements
Knowledge-based AI
AI as an industry
he runs is 45, what is the number of customers Tom gets? ’
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
1952-1969 (cont.)
UFC/DC
CK0031/CK0248
2017.2
Typical task in the world of blocks: Rearrange blocks in a certain way
What’s AI?
• Use a robot hand that can pick up one block at a time
Acting humanly
Thinking humanly
Thinking rationally
Example
Acting rationally
Foundations
Philosophy
Mathematics
Economics
Neuroscience Blue
Psychology
Computer eng
Linguistics
Red
History Red Green
Gestation and birth Blue
Green
Early enthusiasm,
great expectations
Green
A dose of reality
Knowledge-based AI Red
AI as an industry
Neural nets are back ’Find a block that is taller than the one you’re holding,
Scientific methods
and put it in the box
Intelligent agents
Large datasets
Today
intelligence
1952-1969 (cont.)
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations The blocks world was home to

Philosophy
Mathematics • The vision project of Huffman (1971)
Economics
• The vision and constraint propagation work of Waltz (1975)
Neuroscience
Psychology • The learning theory of Winston (1970)
Computer eng
Control, cybernetics • The natural language understanding program of Winograd (1972),
Linguistics
• The planner of Fahlman (1974)
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
1952-1969 (cont.)
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally Work building on the neural nets of McCulloch and Pitts
Foundations
• Winograd and Cowan (1963) showed how a large number of elements
Philosophy
Mathematics
could represent an individual concept
Economics
• With a corresponding increase in robustness and parallelism
Neuroscience
Psychology • Hebb’s learning methods were enhanced by Widrow (1962), with
Computer eng
his adalines, and by Rosenblatt (1962) with his perceptrons
Linguistics
History
Gestation and birth
The perceptron convergence theorem (1962) says that the learning algo
Early enthusiasm, can adjust the connection strengths of a perceptron to match any input
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations
Philosophy
Mathematics A dose of reality
Economics
Neuroscience
History
Psychology
Computer eng
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial A dose of reality (1966-1973)
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
AI researchers were not shy about making predictions
Foundations
The following statement by Herbert Simon in 1957 is often quoted
Philosophy
Mathematics
Economics
It is not my aim to surprise or shock you,
Neuroscience but the simplest way I can summarise is to say that there are now in the
Psychology world machines that think, that learn and that create.
Computer eng
Moreover, their ability to do these things is going to increase rapidly until,
Linguistics
in a visible future, the range of problems they can handle will be
coextensive with the range to which the human mind has been applied
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial A dose of reality - 1966-1973 (cont.)
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly ‘Visible future’ can be interpreted in various ways
Thinking rationally
Acting rationally • Simon also made more concrete predictions
Foundations
Philosophy
... within 10 years a computer would be chess champion, and a significant
Mathematics mathematical theorem would be proved by machine
Economics
Neuroscience
Psychology
Computer eng
These predictions came true (approximately) within 40 years rather than 10
Linguistics
Overconfidence was due to the promising performance on simple examples
History
Gestation and birth
• In almost all cases early systems failed miserably when tried out on
Early enthusiasm, wider selections of problems and on more difficult problems
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI? The first kind of difficulty arose because most early programs knew nothing
Acting humanly
of their subject matter
Thinking humanly
Thinking rationally • They succeeded by means of simple syntactic manipulations
Acting rationally
Foundations
Philosophy A typical story occurred in early machine translation efforts
Mathematics
Economics • An attempt to speed up the translation of Russian papers
Neuroscience
• (At the time of the Sputnik launch in 1957)
Psychology
Computer eng • Generously funded by the US National Research Council
Linguistics
History
It was thought that syntactic transformations based on grammars and word
Gestation and birth
Early enthusiasm,
replacement from dictionary, would preserve sentence meaning
great expectations
A dose of reality
• Thing is that translation requires background knowledge
Knowledge-based AI
• Needed to resolve ambiguity and establish the content of sentences
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations
Philosophy Example
Mathematics
Economics
Neuroscience ‘the spirit is willing but the flesh is weak? ’
Psychology ‘the vodka is good but the meat is rotten’
Computer eng
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally In 1966, a report by an advisory committee: ‘There has been no machine
Acting rationally translation of general scientific text, and none is in immediate prospect’
Foundations • All U.S. government funding for academic translation was canceled
Philosophy
Mathematics
Economics
Neuroscience
Psychology Remark
Computer eng
Today, machine translation is an imperfect but widely used tool
Linguistics
• Technical, commercial, government documents
History
• Internet documents
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly The second kind of difficulty was intractability of the problems
Thinking humanly
• Most of the early AI programs solved problems by trying out
Thinking rationally
Acting rationally different combinations of steps until the solution was found
Foundations
Philosophy It worked initially because micro-worlds contained very few objects
Mathematics
Economics
• and very few possible actions
Neuroscience • and very short solution sequences
Psychology
Computer eng
Linguistics Before the theory of computational complexity, it was believed that ‘scaling
History up’ to larger problems was just a matter of faster hardware/larger memories
Gestation and birth
Early enthusiasm,
great expectations • Optimism from proving the resolution theorem was dampened when
A dose of reality
researchers failed to prove theorems involving more than a few facts
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations
Philosophy
Mathematics The fact that a program can find a solution, in principle,
Economics does not mean that the program contains any of the mechanisms
Neuroscience
Psychology
needed to find it in practice
Computer eng
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly The illusion of unlimited power, not confined to problem-solving
Thinking humanly
Thinking rationally • Early experiments in machine evolution (now, genetic algorithms)
Acting rationally
• Based on a correct belief
Foundations
Philosophy
• By making a series of small mutations to a machine-code program, one
Mathematics can generate a program with good performance for any particular task
Economics
Neuroscience
Psychology
Computer eng
The idea was to try random mutations with a selection process
Linguistics • To preserve mutations that seemed useful
History
• Thousands of hours of CPU time
Gestation and birth
Early enthusiasm, • Almost no progress was proved
great expectations
A dose of reality Modern GA use better representations and shown more success
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations
Philosophy
Mathematics Failure to come to grips with the ‘combinatorial explosion’
Economics
Neuroscience
• One of the main criticisms of AI contained in the Lighthill report
Psychology
Computer eng
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
A third difficulty arose because of some fundamental limitations on the basic
structures being used to generate intelligent behaviour
Foundations
Philosophy
Mathematics
Economics
Minsky and Papert’s book Perceptrons (1969) proved that, though percep-
Neuroscience trons (a simple neural net) could be shown to learn anything they were
Psychology capable of representing, they could represent very little
Computer eng
• In particular, a two-input perceptron (restricted to be simpler than
Linguistics the form Rosenblatt originally studied) could not be trained to
History recognize when its two inputs were different
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations Although their results did not apply to more complex, multilayer networks,
Philosophy research funding for neural-net research soon diminished
Mathematics
Economics • Ironically, the new back-propagation learning algorithms for
Neuroscience multilayer networks that were to cause a resurgence in neural net
Psychology
research in the late 1980s (and today, and perhaps again in twenty
Computer eng
years), were actually discovered first in 1969
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations
Philosophy
Mathematics Knowledge-based systems
Economics
Neuroscience
History
Psychology
Computer eng
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial Knowledge based systems (1969-1979)
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Problem solving in the first decade of AI: A general-purpose search tool
Acting rationally • String together elementary reasoning steps, find complete solutions
Foundations
Philosophy
Such approaches have been called weak methods because, though general,
Mathematics
Economics
they do not scale up to large or difficult problem instances
Neuroscience
Psychology
Computer eng
Control, cybernetics The alternative to weak methods is to use more powerful, domain specific
Linguistics knowledge that allows larger reasoning steps and can more easily handle
History typically occurring cases in narrow areas of expertise
Gestation and birth
• To solve a hard problem, you have to almost know the answer
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
The Dendral program (1969) was an example of this approach
Acting rationally
Foundations
Developed at Stanford, Feigenbaum (Simon’s student), Lederberg (Nobel
Philosophy
laureate geneticist) and Buchanan (philosopher turned computer scientist)
Mathematics
• Infer molecular structures from data by a mass spectrometer
Economics
Neuroscience
Psychology
Computer eng The input to the program was the elementary formula of a molecule (say,
Control, cybernetics C6 H13 NO2 ) and the mass spectrum giving the masses of its fragments
Linguistics
• The mass spectrum might contain a peak at m = 15
History
Gestation and birth • Corresponding to the mass of a methyl (CH3 ) fragment
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations Naive versions generated all possible structures consistent with the formula
Philosophy
Mathematics
Economics • Predicted what mass spectrum would be observed for each
Neuroscience
• By comparing this with the actual spectrum
Psychology
Computer eng
Control, cybernetics As expected, this is intractable for even moderate-sized molecules
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
The Dendral researchers consulted analytical chemists
Thinking humanly • Chemists work by looking for patterns of peaks in the spectrum
Thinking rationally
Acting rationally • That was used to label common substructures
Foundations
Philosophy Example
Mathematics
Economics This rule is used to recognise a ketone (C = O) subgroup (weight 28):
Neuroscience
Psychology If there are two peaks at x1 and x2 , such that
Computer eng
Control, cybernetics • x1 + x2 = M + 28, with M the mass of the whole molecule
Linguistics
• x1 − 28 is a high peak
History
Gestation and birth
• x2 − 28 is a high peak
Early enthusiasm,
great expectations
• At least one of x1 and x2 is high,
A dose of reality
then there is a ketone subgroup
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Recognising that the molecule contains a particular substructure
Foundations
reduces the number of possible candidates enormously
Philosophy
Mathematics • The Dendral was powerful
Economics
Neuroscience
Psychology
‘All the relevant theoretical knowledge to solve these problems has been
Computer eng mapped over from its general form in the [spectrum prediction component]
Control, cybernetics (‘first principles’) to efficient special forms (‘cookbook recipes’)
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations The Dendral was the first successful knowledge-intensive system

Philosophy
Mathematics • Expertise derived from large numbers of special-purpose rules
Economics
Neuroscience
Psychology
Later systems incorporated the main theme of McCarthy’s Advice Taker
Computer eng • A separation of knowledge (rules) and reasoning components
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
With this in mind, Feigenbaum and others at Stanford began the (HPP)
Thinking rationally • Heuristic Programming Project
Acting rationally
• Study the extent to which expert systems could be applied to other
Foundations
Philosophy
areas of human expertise
Mathematics • The next major effort was in the area of medical diagnosis
Economics
Neuroscience
Psychology
Computer eng Feigenbaum, Buchanan, and Dr. Shortliffe developed MYCIN
Linguistics
• Blood infection diagnosis
History • MYCIN was able to perform as well as some experts
Gestation and birth
• Considerably better than junior doctors
Early enthusiasm,
great expectations
• About 450 rules
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
MYCIN also contained two major differences from Dendral
Thinking humanly
Thinking rationally
Acting rationally
Foundations • First, unlike the Dendral rules, no general theoretical model

Philosophy existed from which the MYCIN rules could be deduced
Mathematics
Economics They had to be acquired from extensive interviewing of experts
Neuroscience
Psychology
• Who in turn acquired them from textbooks, other experts, etc
Computer eng
Linguistics
• Second, the rules had to reflect the uncertainty in medical knowledge
History
Gestation and birth
Early enthusiasm,
MYCIN incorporated a calculus of uncertainty called certainty factors
great expectations
• It seemed to fit well with how doctors assessed the impact of evidence
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Importance of domain knowledge: Understanding natural language
Thinking humanly
Thinking rationally Winograd’s SHRDLU for understanding natural language was exciting
Acting rationally
• Yet, dependence on syntactic analysis caused some of the same
Foundations
problems that occurred in the early machine translation work
Philosophy
Mathematics
Economics
• Ability to overcome ambiguity and understand pronoun references
Neuroscience
• Mainly because it was designed specifically for one area
Psychology
Computer eng • (the blocks world)
Linguistics
History
Gestation and birth
Several researchers (including Charniak, a Winograd’s student at MIT)
Early enthusiasm,
great expectations suggested that language understanding requires general knowledge
A dose of reality
Knowledge-based AI
• And, a general method for using that knowledge
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally At Yale, linguist-turned-AI-researcher Roger Schank emphasised this point
Foundations • ‘There is no such thing as syntax ’
Philosophy
Mathematics • This served to start a discussion
Economics
• It upset a lot of linguists
Neuroscience
Psychology
Computer eng
Control, cybernetics Schank and his students built a series of programs (early 1980s)
Linguistics
• All had the task of understanding natural language
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations
Philosophy The emphasis was less on language per se and more on representing and
Mathematics reasoning with the knowledge required for language understanding
Economics
Neuroscience
Problems included representing stereotypical situations, human memory
Psychology
Computer eng
organisation, and understanding plans and goals
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Apps to real-world problems demanded for knowledge representation
Thinking rationally
• Different representation and reasoning languages appeared
Acting rationally
Foundations
Philosophy
Some were based on logic
Mathematics • the Prolog was popular in Europe
Economics
Neuroscience • the Planner family in the US
Psychology
Computer eng
Linguistics
Others followed Minsky’s idea of frames (1975)
History • Assembling facts about particular object and event types
Gestation and birth
• Then arranging the types into taxonomic hierarchies
Early enthusiasm,
great expectations
A more structured approach
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations
Philosophy
Mathematics AI as an industry
Economics
Neuroscience
History
Psychology
Computer eng
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial AI as an industry (1980-today)
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
The first successful commercial expert system R1 began operations, 1982
Thinking humanly
Thinking rationally • At Digital Equipment Corporation (DEC)
Acting rationally
Foundations The program helped configure orders for new computer systems
Philosophy
Mathematics • By 1986, it was saving the company an estimated $40M/yr
Economics
• By 1988, DEC’s AI group had +40 expert systems deployed
Neuroscience
Psychology DuPont had 100 in use and 500 in development, saving ∼$10M/yr
Computer eng
Linguistics
History Nearly every major U.S. corporation had its own AI group
Gestation and birth
• Either using or investigating expert systems
Early enthusiasm,
great expectations
A dose of reality
• ... just like today!
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial AI as an industry - 1980-today (cont.)
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly In 1981, Japan announced the ‘Fifth Generation’ project
Thinking rationally
• a 10-year plan to build intelligent computers running Prolog
Acting rationally
Foundations
Philosophy
The US formed Microelectronics and Computer Technology Corporation
Mathematics • A research consortium designed to assure national competitiveness
Economics
Neuroscience
Psychology In both cases, AI was part of a broad effort
Computer eng
• Both chip design and human-interface research
Linguistics
History In GB, the Alvey report reinstated funding (cut by Lighthill report)
Gestation and birth
Early enthusiasm,
great expectations
In all three countries, the projects never met their ambitious goals
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial AI as an industry - 1980-today (cont.)
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally AI industry boomed from a few million dollars in 1980 to billions in 1988
Foundations • ... building expert systems, vision systems, robots, and
Philosophy
Mathematics
software and hardware specialised for these purposes
Economics
Neuroscience
Psychology Soon after that came a period called the ‘AI Winter’
Computer eng
• Many companies failed to deliver
Linguistics
• Too extravagant promises
History
Gestation and birth
• Hundreds of companies
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations
Philosophy
Mathematics The return of neural networks
Economics
Neuroscience
History
Psychology
Computer eng
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial The return of neural networks (1986-today)
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly In the mid-80s at least four different groups reinvented back-propagation
Thinking rationally
• It is a learning algorithm found in 1969 by Bryson and Ho
Acting rationally
Foundations • The algorithm was applied to many learning problems

Philosophy
• In computer science, psychology, ...
Mathematics
Economics
Neuroscience The results were reported in the collection Parallel Distributed Processing
Psychology
Computer eng
• (Rumelhart and McClelland, 1986)
• The caused great excitement
Linguistics
History
Gestation and birth
Early enthusiasm,
These connectionist models of intelligent systems were seen by some as
great expectations competitors both to symbolic models and to the logicist approach
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial The return of neural networks - 1986-today (cont.)
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally It seems obvious that, at some level, humans manipulate symbols3
Foundations
Philosophy
• Connectionists questioned whether symbol manipulation had any real
Mathematics
Economics
explanatory role in detailed models of cognition
Neuroscience
• The question remains unanswered, current view is that connectionist
Psychology
Computer eng
and symbolic approaches are complementary, not competing
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
3
Today Terrence Deacon’s book The Symbolic Species in 1997 suggests that this is the
defining characteristic of humans
Artificial The return of neural networks - 1986-today (cont.)
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Modern neural network research has bifurcated into two fields
Foundations
Philosophy • One concerned with creating network architectures and algorithms
Mathematics
and understanding their mathematical properties
Economics
Neuroscience • The other concerned with modelling of the empirical properties of
Psychology actual neurons and ensembles of neurons
Computer eng
Linguistics The same occurred with the separation of AI and cognitive science
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations
Philosophy
Mathematics The scientific method
Economics
Neuroscience
History
Psychology
Computer eng
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial The scientific method (1987-today)
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Recent revolution in both content and methodology of work in AI
Thinking rationally
• More common to build on existing theories, than to propose
Acting rationally
brand-new ones
Foundations
Philosophy • More common to base claims on rigorous theorems or hard
Mathematics experimental evidence rather than on intuition
Economics
Neuroscience • More common to show relevance to real-world applications
Psychology rather than toy examples
Computer eng
Linguistics
AI was founded also as a rebellion against the limitations of existing fields
History
Gestation and birth • Stuff like control theory and statistics
Early enthusiasm,
great expectations • Now, it is embracing those fields
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial The scientific method - 1987-today (cont.)
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
As David McAllester (1998) put it:
Foundations
Philosophy
• In the early period of AI it seemed plausible that new forms of
Mathematics symbolic computation, e.g., frames and semantic networks,
Economics
made much of classical theory obsolete
Neuroscience
Psychology • This led to a form of isolationism in which AI became
Computer eng largely separated from the rest of computer science
Linguistics • This isolationism is currently being abandoned
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations There is a recognition that

Philosophy
• Machine learning should not be isolated from information theory
Mathematics
Economics • Uncertain reasoning, from stochastic modelling
Neuroscience
Psychology • Search, from classical optimisation and control
Computer eng
• Automated reasoning, from formal methods and static analysis
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly In terms of methodology, AI has come under the scientific method
Thinking rationally
Acting rationally
Foundations
• To be accepted, hypotheses must be subjected to rigorous experiments
Philosophy • The results must be analysed statistically for importance (1995)
Mathematics
Economics
Neuroscience
Psychology
Computer eng
Remark
Linguistics
• It is now possible to replicate experiments
History
Gestation and birth • Shared repositories of test data and code
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations The field of speech recognition illustrates the pattern

Philosophy
• In the 1970s, different architectures and approaches were tried
Mathematics
Economics • Many were ad hoc and fragile
Neuroscience
Psychology
• Tested on a few selected examples
Computer eng
Recently, approaches based on hidden Markov models (HMMs)
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Two aspects of HMMs are relevant
Foundations
Philosophy
Mathematics
• First, they are based on a rigorous mathematical theory
Economics
Neuroscience
Speech builds on decades of mathematical results in other fields
Psychology
Computer eng
• Second, they are trained on a large corpus of data
Linguistics
The performance is robust and it has been improving steadily
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Speech technology and related field of handwritten character recognition
Foundations
Philosophy • Transition to industrial/consumer apps
Mathematics
Economics
Neuroscience
There is no claim that humans use HMMs to recognise speech
Psychology
Computer eng HMMs provide a math framework for understanding the problem
• A support to the engineering claim that they work well
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Machine translation follows the same course as speech recognition
Foundations
Philosophy • In the 1950s there was initial enthusiasm for an approach based
Mathematics
on sequences of words, with models based on information theory
Economics
Neuroscience • That approach fell out of favor in the 1960s
Psychology
Computer eng
• It only returned in the late 90’s
• Today, it dominates the field
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Neural networks also fit this trend
Foundations
Philosophy • Much of the work on neural nets in the 1980s was done in an attempt
Mathematics to scope out what could be done and to learn how neural nets differ
Economics
from ‘traditional’ techniques
Neuroscience
Psychology • Using improved methodology and theoretical frameworks, the field
Computer eng
arrived at an understanding in which neural nets can be compared
Linguistics
with related techniques from statistics and pattern recognition
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations
Philosophy
Mathematics
Economics As a result, data science technology has spawned a vigorous new industry
Neuroscience
Psychology
Computer eng
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Judea Pearl’s (1988) Probabilistic Reasoning in Intelligent Systems
Thinking humanly
• A new acceptance of probability and decision theory in AI4
Thinking rationally
Acting rationally
Foundations
Philosophy • The Bayesian network formalism was invented to allow efficient
Mathematics
Economics
representation of, and rigorous reasoning with, uncertain knowledge
Neuroscience • The approach overcomes issues of probabilistic systems from 60/70’s
Psychology
Computer eng
Linguistics On top of AI research on uncertain reasoning and expert systems
History
Gestation and birth The approach allows for learning from experience, and
Early enthusiasm, it combines the best of classical AI and neural nets
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
4
Today A resurgence of interest epitomised by Peter Cheeseman’s (1985) article In
Defense of Probability.
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations
Philosophy Work by Pearl, Horvitz and Heckerman promoted a new idea
Mathematics
Economics • Normative expert systems that act rationally, decision theory
Neuroscience
Psychology
• Do not try to imitate the thought steps of human experts
Computer eng
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly Robotics, computer vision, and knowledge representation, ... the same
Thinking rationally
• A better understanding of problems and their complexity
Acting rationally
Foundations • Increased math sophistication

Philosophy
Towards a workable research agenda and robust methods
Mathematics
Economics
Neuroscience
Psychology Increased formalisation and specialisation led fields such as vision
Computer eng
and robotics to become isolated from ‘mainstream’ AI in the ’90s
Linguistics • This trend has reversed in recent years
History • Machine learning tools have proved effective for many problems
Gestation and birth
Early enthusiasm,
great expectations The process of reintegration is already yielding significant benefits
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations
Philosophy
Mathematics Intelligent agents
Economics
Neuroscience
History
Psychology
Computer eng
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial Intelligent agents (1995-today)
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations Perhaps encouraged by the progress in solving subproblems of AI,

Philosophy
researchers started to look at the ‘whole agent’ problem again
Mathematics
Economics
Neuroscience • Newell, Laird, and Rosenbloom Soar’s (∼ 1990)
Psychology
Computer eng • The best-known example of a complete agent architecture
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial Intelligent agents - 1995-today (cont.)
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
One important environment for intelligent agents is the Internet
Foundations
Philosophy • AI systems have become so common in apps
Mathematics
• The ‘-bot’ suffix entered everyday language
Economics
Neuroscience
Psychology
Computer eng Moreover, AI technologies underlie many Internet tools
Linguistics
• Search engines, recommender systems, web site aggregators ...
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
One effect of trying to build complete agents is the realisation that
Foundations
Philosophy
the previously isolated subfields of AI might need to be reorganised
Mathematics • Their results are to be tied together
Economics
Neuroscience • It is now widely appreciated that sensory systems (vision, sonar,
Psychology speech recognition, etc.) cannot deliver perfectly reliable info
Computer eng
Linguistics Reasoning and planning systems must also handle uncertainty
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
A second major consequence of the agent perspective
Foundations • AI has been drawn into closer contact with other fields
Philosophy
• Control theory, economics, ...
Mathematics
Economics
Neuroscience
Psychology
Computer eng Progress in robotic cars has derived from a mixture of approaches
Linguistics
• Better sensors, control-theoretic integration of sensing
History • Localisation and mapping, a degree of hi-level planning
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Despite successes, influential founders of AI (Nilsson and Winston,
Foundations
McCarthy, Minsky) have expressed discontent with the AI progress
Philosophy • AI should put less emphasis on creating ever-improved apps that are
Mathematics
Economics
good at a specific task (such as driving a car, playing chess, ...)
Neuroscience • AI should return to its roots
Psychology
Computer eng • ‘ ... machines that think, that learn and that create’ (Simon’s words)
Linguistics
History They call the effort human-level AI (HLAI): They first met 2004
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally A related idea is Artificial General Intelligence or AGI (2007)
Foundations • AGI looks for a universal algorithm for learning and acting in any
Philosophy
Mathematics
environment, and has its roots in the work of Solomonoff (1964)
Economics • (An attendee of the 1956 Dartmouth conference)
Neuroscience
Psychology
Computer eng First conference, the Journal of Artificial General Intelligence: From 2008
Linguistics
History
Guarantee that what we create is friendly AI is a concern (2008)
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations
Philosophy
Mathematics Large datasets
Economics
Neuroscience
History
Psychology
Computer eng
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial Large datasets (2001-today)
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally Throughout the 60 years of computer science, emphasis on the algorithm
Acting rationally
Foundations
Recent work in AI seem to suggest that for many problems, it makes more
Philosophy sense to worry about data and be less picky about the algorithms (does it?)
Mathematics
Economics
Neuroscience True, because of the availability of very large data sources
Psychology
Computer eng
• Trillions of words of English
• Billions of images from the Web (2006)
Linguistics
History
• Billions of base pairs of genomic sequences (2003)
Gestation and birth • ...
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial Large datasets - 2001-today (cont.)
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally An influential paper: Yarowsky (’95) on word-sense disambiguation
Foundations • Given the word ‘plant’ in a sentence, does it refer to flora or factory?
Philosophy
Mathematics
Economics Previous approaches to the problem had relied on human-labeled examples
Neuroscience
• Combined with machine learning algorithms
Psychology
Computer eng
Control, cybernetics Yarowsky show that the task can be done with no labeled examples at all
Linguistics
• Accuracy +96%,
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Banko and Brill (2001) show that techniques like this perform increasingly
Foundations
better as the amount of available text goes up
Philosophy
Mathematics
Economics • The increase in performance from using more data exceeds any
Neuroscience
Psychology
difference in algorithm choice
Computer eng • A mediocre algorithm with 100M words of un-labeled training
Linguistics
data outperforms the best known algorithm with 1M words
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Hays and Efros (2007) and the task of filling in holes in photos
Thinking humanly
Thinking rationally
Acting rationally Example
Foundations
Suppose you use Photoshop to mask out an ex-friend from a group photo
Philosophy
Mathematics • Now you need to fill in the masked area
Economics
Neuroscience
• Something that matches the background
Psychology
Computer eng
Control, cybernetics • Hays and Efros defined an algorithm that searches through
Linguistics
a collection of photos to find something that will match
History
• Performance was poor when they used only 10K photos
Gestation and birth
Early enthusiasm, • They crossed a threshold into excellent performance
great expectations
A dose of reality when they grew the collection to two million photos
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Works like these suggest how to solve the ‘knowledge bottleneck’ in AI
Thinking humanly
• How to express all the knowledge that a system needs
Thinking rationally
Acting rationally
Foundations
Learning methods, not hand- and hard-coded a priori knowledge
Philosophy • Algorithms need enough (good) data to go on (2009)
Mathematics
Economics
Neuroscience
Psychology
Computer eng Remark
Linguistics
Reporters noticed the surge of new applications
History
‘AI winter’ may be yielding to a new spring (2005)
Gestation and birth
Early enthusiasm, • Kurzweil (2005): ‘today, many thousands of AI applications
great expectations
A dose of reality are deeply embedded in the infrastructure of every industry’
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations
Philosophy
Mathematics Today
Economics
Neuroscience
Psychology
Computer eng
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations
Philosophy
Mathematics What can AI do today?
Economics A concise answer is not difficult.
Neuroscience
Psychology
Lots!
Computer eng
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
Artificial Today (cont.)
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Robotic vehicles
Thinking rationally • VOLKSWAGEN’s STANLEY: First driverless robotic car
Acting rationally
in the DARPA Grand Challenge (2005), 132-mile course
Foundations
Philosophy
• Rough terrain of the Mojave dessert at 22 mph
Mathematics
Economics
Neuroscience
Remark
Psychology STANLEY is a Touareg with cameras, radar, and laser rangefinders to
Computer eng
sense the environment and on-board software to command steering,
Linguistics
braking, and acceleration
History
Gestation and birth
• CMU’s BOSS won the Urban Challenge (2007): Driving in traffic,
Early enthusiasm,
great expectations obeying traffic rules and avoiding pedestrians and other vehicles
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations
Philosophy
Mathematics
Economics
Neuroscience
Psychology
Computer eng
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations
Philosophy
Mathematics
Economics
Neuroscience
Psychology
Computer eng
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC Speech recognition

CK0031/CK0248
2017.2 • Travellers calling airline companies to book a flight can have
the entire conversation guided by dialog management systems
What’s AI?
Acting humanly • Automated speech recognition systems
Thinking humanly
• ...
Thinking rationally
Acting rationally
Foundations
Philosophy
Mathematics
Economics
Neuroscience
Psychology
Computer eng
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Autonomous planning and scheduling
Acting rationally • NASA’s REMOTE AGENT: First on-board autonomous planning
Foundations program to control scheduling of operations of a spacecraft
Philosophy
Mathematics
• (2000, 100M miles from Earth)
Economics
Neuroscience
Planning from hi-level goals from ground, monitoring execution on-board
Psychology
Computer eng • Detection, diagnosis, and recover from problems
Linguistics
Successor program MAPGEN plans daily operations (NASA’s Mars Ex-
History
Gestation and birth
ploration Rovers, 2004) and MEXAR2 did mission planning, logistics and
Early enthusiasm, science planning (European Space Agency’s Mars Express mission, 2007-8)
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Game playing
Thinking humanly • IBM’s DEEP BLUE: First to beat the chess world champion
Thinking rationally
Acting rationally • It bested Garry Kasparov (3.5 to 2.5 in an exhibition, 1997)
Foundations
Philosophy Kasparov said he felt a ‘new kind of intelligence’ across the board
Mathematics
Economics
Newsweek described the match as ‘The brain’s last stand’
Neuroscience
Psychology
Computer eng
The value of IBM’s stock increased by $18B
Linguistics
History
Gestation and birth
Remark
Early enthusiasm, Humans studied Kasparov’s loss and drew a few matches in next years
great expectations
A dose of reality • Recent human-computer matches have been won by the computer
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations
Philosophy
Mathematics
Economics
Neuroscience
Psychology
Computer eng
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI? Spam fighting

Acting humanly
Thinking humanly
• Each day, learning algorithms classify over 1B messages as spam
Thinking rationally
• Savings from wasting time deleting 80%-90% of all messages
Acting rationally
Foundations
Philosophy
Spammers update their tactics: Hard for a static approach to keep up
Mathematics • Learning algorithms work best (SpamAssassin, 2001)
Economics
Neuroscience
Psychology
Computer eng Robotics
Linguistics
• The iRobot Corporation: +2M ROOMBA robotic vacuum cleaners
History
Gestation and birth Remark
Early enthusiasm,
great expectations They also deploy the PackBot to Iraq/Afghanistan
A dose of reality
Knowledge-based AI
• To handle hazardous materials, clear explosives, ...
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations
Philosophy
Mathematics
Economics
Neuroscience
Psychology
Computer eng
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI? Logistics planning

Acting humanly
• During the Persian Gulf crisis of 1991, U.S. forces deployed a
Thinking humanly
Thinking rationally Dynamic Analysis and Replanning Tool, DART (1994)
Acting rationally
• Automated logistics planning and scheduling for transportation
Foundations
Philosophy
Mathematics
Involved up to 50K vehicles, cargo, and people at a time
Economics
• Accounts for starting points, destinations, routes, conflicts, ..
Neuroscience
Psychology
Computer eng
• The AI planning techniques generated in hours a plan
Control, cybernetics that would have taken weeks with older methods
Linguistics
History
Gestation and birth
Early enthusiasm,
Remark
great expectations
The Defense Advanced Research Project Agency statement
A dose of reality
Knowledge-based AI • This single application more than paid back 30-year investment in AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly Machine translation
Thinking humanly
Thinking rationally
• In 2007, a program translated from Arabic to English
Acting rationally • ‘Ardogan Confirms That Turkey Would Not Accept Any Pressure,
Foundations Urging Them to Recognize Cyprus’
Philosophy
Mathematics
Economics A statistical model built from Arabic-to-English translations
Neuroscience
• Examples of English text totalling two trillion words
Psychology
Computer eng
Linguistics
History Remark
Gestation and birth
None of the computer scientists on the team speak Arabic
Early enthusiasm,
great expectations
• They did understand statistics and machine learning
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations
Philosophy
Mathematics
Economics
Neuroscience
Psychology
Computer eng
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Scientific methods
Intelligent agents
Large datasets
Today
intelligence
UFC/DC
CK0031/CK0248
2017.2
What’s AI?
Acting humanly
Thinking humanly
Thinking rationally
Acting rationally
Foundations
Philosophy
Mathematics
Economics
Neuroscience
Psychology
Computer eng
Linguistics
History
Gestation and birth
Early enthusiasm,
great expectations
A dose of reality
Knowledge-based AI
AI as an industry
Ken Jennings: Watson, Jeopardy and me, the obsolete know-it-all
Scientific methods
Intelligent agents
Large datasets
Today

00 Artificial Intelligence

Uploaded by

Copyright:

Available Formats

You might also like

00 Artificial Intelligence

Uploaded by

Document Information

Original Description:

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

00 Artificial Intelligence

Uploaded by

Copyright:

Available Formats

Artificial

History • Along with molecular biology, AI is regularly cited as ‘the field I

Foundations AI: A huge variety of sub-fields

What’s AI? Thinking Humanly Thinking Rationally

If we are going to say that a given program thinks like a human

Foundations There are three ways to do this, through:

Foundations • They are expected to operate autonomously

The disciplines that contributed ideas, viewpoints, and techniques

Foundations The confirmation theory of Carnap and Carl Hempel (1905-1997)

Foundations Gödel: Limits on deduction do exist

Foundations NP-completeness theory by S. Cook (1971) and R. Karp (1972)

History Later, von Neumann and Morgenstern and their book

Foundations Futurists make much of such numbers, pointing to incoming singularity

Foundations • How do humans and animals think and act?

Foundations There were calculating devices before the electronic computer

Foundations • The Difference engine was intended to compute math tables

What’s AI? The first work now generally recognised as AI

History They proposed a model of artificial neurons where each neuron is

Foundations He lectured on the topic in 1947 at the London Mathematical Society

Foundations Stanford emphasised general-purpose methods for logical reasoning

Foundations The blocks world was home to

Foundations The Dendral was the first successful knowledge-intensive system

Foundations • First, unlike the Dendral rules, no general theoretical model

Foundations • The algorithm was applied to many learning problems

Foundations There is a recognition that

Foundations The field of speech recognition illustrates the pattern

Foundations • Increased math sophistication

Foundations Perhaps encouraged by the progress in solving subproblems of AI,

UFC/DC Speech recognition

What’s AI? Spam fighting

What’s AI? Logistics planning

You might also like