Professional Documents
Culture Documents
Chap-1 AI 2019
Chap-1 AI 2019
Chap-1 AI 2019
A-U: 2019-2020
1
Biography
Boudour Ammar Maried Cherif
PhD, Eng., Assistant Professor
Director of 4C-ENIS
Department of Computer Engineering and Applied Mathematics
National Engineering School of Sfax (ENIS), University of Sfax, Tunisia
Certified on Huawi Machine Learning HCIA & HCAI (2019)
Chair of IEEE Computational Intelligence Society Tunisia 2019-2020
(CIS-TN)
Researcher on Research Group on Intelligent Machines (REGIM-Lab)
2
Content
1. The Past of AI
2. What Is AI?
6
History of Artificial Intelligence
7
Dartmouth Workshop: Birth of AI
In August 1956, some scientists
and mathematicians gathered at
Dartmouth College, discussing
about how to make machines
simulate human learning and any
other feature of intelligence.
They were John McCarthy,
Marvin Minsky (AI and cognitive
scientist), Claude Shannon (father
of information theory), Allen
Newell (computer scientist), and
Herbert A. Simon (winner of the
Nobel Prize in Economic
Sciences).
The workshop ran for two
months. No consensus was
reached, but they picked the
name artificial intelligence for the
field they discussed about. Then,
the year 1956 marked the birth
of AI.
8
The Dartmouth College Artificial Intelligence
Conference: The Next Fifty Years
Participants of Dartmouth Workshop reunited in 2006,
after 50 years of the Dartmouth Workshop.
1997-2010 2010-
1956-1976 1976-1982 1982-1987
Recovering period Explosive growth
Flourishing period Flourishing 1987-1997
Declining The computing period
The Dartmouth Workshop period Declining period
period performance was Cutting-edge
coined the concept and Artificial Expert systems The technical
improved and the information
goals of Artificial capable of field encountered
Intelligence was Internet technologies technologies lead to
Intelligence. logical its bottleneck
criticized due to were widely used. the transformation of
again, abstract
its insufficient deduction and information
solving reasoning lost its
computing environment and
problems in popularity, and
capability, data. The emergence
specific models based on
computational of multiple-model
domains symbolic
complexity, and data such as massive
difficulties in prevailed and processing lost
images, voices, and
their advantages.
common sense fifth generation texts improves the
based computers
computing capability.
reasoning. showed up.
1
13
3
Contents
1. The Past of AI
2. What Is AI?
16
Symbolicism (2)
Symbolicism
Representatives
17
Connectionism (1)
Connectionism
Principle: neural network, connection mechanism and
learning algorithm between neural networks
Origin: bionics, especially the study of the human brain
model
18
Connectionism (2)
Concept:
Neuron, instead of the symbol operation process, is the basic
thinking unit.
Human brain differs from computers, and the human brain pattern
can be used to replace the computer pattern.
Representatives: Warren McCulloch, Walter Pitts, John
Hopfield, Rumelhart, D.E., etc.
𝑥2 𝑦
𝑥3
𝑦𝑗 = 𝜎(𝑏𝑗 + 𝑤𝑖𝑗 𝑥𝑖 )
𝑖
Representatives
20
Actionism
Actionism (evolutionism and cyberneticsism)
Principle: cybernetics and perception-action control
system
Origin: cybernetics
21
Actionism
Concept:
Intelligence depends on perception and actions. The "perception-
action" mode of intelligent behavior is proposed.
Intelligence requires knowledge, representation, and inference.
Artificial intelligence can evolve like human intelligence. Intelligent
behavior can only interact with the surrounding environment in
the real world.
Feature Learning
Requiring Large
Representation
Interpretability
Computational
Mainstream AI
Combinatorial
Environment
Complexity
Knowledge
Interaction
Overfitting
Black Box
Explosion
Theories
Samples
With
Symbolicism
Strong No No Strong No High Many No No
(logicism)
Connectionism
Weak Yes Yes Weak Yes High Few No Yes
(bionicsism)
Actionism
(decision-
Strong No No Strong No Ordinary Ordinary Yes No
making
control)
Computers
More and more powerful, but they do not always solve all the
problems.
The material may not be in question.
24
AI evolution
Software
Software construction relies on several approaches :
basics Knowledge
Injected Learned
step-by-step Knowledge self-learning
procedure database
Algorithms
Expert
Neuronal
26
Types of reasoning in AI
• The reasoning is a series of statements or symbolic
representations conducted according to a goal
(demonstrate, convince, interpret, decide, justify,
explain) in general non-linear (backward) as the
human approach:
• Formal reasoning
• Procedural reasoning
• Reasoning by analogy
• Reasoning by generalization and abstraction
• Geometric reasoning
Acquisition of
knowledge
Explicitness Modelization
Logical reasoning,
Approximate Reasoning,
Temporal reasoning
1. The Past of AI
2. What Is AI?
Brain
science Cognitive
Computer science
Science
AI Psychology
Philosophy
Linguistics
Logic
Relationship Between AI, Machine
Learning, and Deep Learning
Four elements: data, algorithm,
computing power, and scenario
Relationship Between AI, Machine
Learning, and Deep Learning
AI is a technical science that studies and develops theories, methods, and
applications for simulating and extending human intelligence.
Machine learning specializes in how computers simulate or implement human
learning behavior to acquire new knowledge or skills, and reorganize existing
knowledge structures to improve their performance continuously. It is a subset
of artificial intelligence. Any system without learning ability can hardly be
considered a real intelligent system.
Relationship Between AI, Machine
Learning, and Deep Learning
Deep learning is developed based on the study of artificial neural networks
(ANNs). The multilayer perceptron (MLP) with multiple hidden layers has a deep
learning structure
Deep learning is a new field of machine learning. It aims to establish a neural
network that simulates the human brain to analyze and interpret data, such as
images, sounds, and texts.
Key Technologies of Machine
Learning
Lightweight
machine learning Learning policy
Statistic
decision Lightweight model (low computing complexity)
Online learning (not saving the training data) Ensemble learning
Bayesian expected loss Approximate computing (seeking the satisfactory solution, -Automatic focusing
Minimax principle which is easier) -Gradient boosting
Bayes risk principle Rules and methods based on knowledge in specific fields Incremental learning
Bayesian inference Transfer learning)
Non-lightweight
machine learning
Unsupervised Supervised
learning Parametric learning
Nonparametric Bayesian
Aggregation method
method probability
-K-means clustering Maximum likelihood Instance-based methods
-Hierarchical clustering estimation -k-nearest neighbors
Random
Expectation maximization Prior distribution probability simulation
Self-organizing map Algorithm
algorithm Posterior distribution method
-Kernel density estimation
-Hidden Markov Model Decision tree approximation algorithm
Regression model Bayesian Neural Networks Random number
-ID3/4/5
-Logistic regression -CART Bayes regression model generators obeying
Reinforcement
learning
common distribution
Probabilistic
Markov chain
No model graphical model
-Policy iteration Kernel
Probabilistic
Monte Carlo
-Policy search method Geometrical Back propagation Gibbs sampling
method graphical model
With models Gaussian process Deep learning
-Deep reinforcement learning Supports vector Bayesian network -CNN
Relevance vector Machine Markov random field
machine -RNN
Manifold learning
Kernel PCA
Computing
Basics
1. The Past of AI
2. What Is AI?
Unsupervised learning:
Supervised learning:
no human interference
model answer
Reasoning
Known
Industry-leading:
CER: 3-5%, WER: 9-11%, reaching or environments
The accuracy and naturalness cannot
above human beings average ability Exceeded human intelligence in some
compete with human beings. Clear objectives
Understanding Issues being solved (incomplete
fields
Predictable
information) actions
Recognition
Natural User profile Behavior Search and Image Personal
dialogue modeling recommendation semantics health
1. The Past of AI
2. What Is AI?
Algorithm Basic
service
AI execution
AI algorithm Basic AI service framework
Operating
Basic AI service system
AI might lead to a change in chip architectures, which will further reshape the
industry landscape. NVIDIA, Google, and Intel are competing for the dominant
place in the future.
AI is the next major operating system. AI technology platforms will be a hot spot
competed by big players. AI applications or services of vertical industries might be
provided based on the technology platforms.
Striving to be a leader of digital brains in the future becomes a strategic vision
of information giants. Cloud services in the future might integrate cloud
computing, big data, and AI.
Contents
1. The Past of AI
2. What Is AI?
Four Alphabus smart buses made the Baidu CEO Robin Li took a
inaugural trial run in Shenzhen, 2 driverless car developed by
December, 2017. Baidu.
Wu Shichun, founder of Plum Ventures, said, "Self-driving is an inevitable trend, but it must be constrained by
standards. The deadly crash with self-driving Uber was shocking and heartbreaking. According to statistics, more
than 1 million people died from traffic accidents each year. Therefore, each new technology must be tested and
optimized continuously to ensure its security before it is put into wide use. An aircraft cannot be put into
commercial use without an airworthiness certificate. Similarly, self-driving systems should be tested by an official
authority or authoritative third party, and then drive cars on the road after obtaining a certificate. Companies cannot
decide whether to put self-driving systems into the market. This applies to all emerging technologies such as robots
and AI."
Efforts in Self-driving Legislation
In 2013, the U.S. National Highway Traffic Safety Administration (NHTSA) issued the
Federal AutomatedVehicles Policy, which stipulated the responsibilities in case of self-driving
test accidents.
In August 2016, the United Nations Education, Scientific and Cultural Organization
(UNESCO) and World Commission on the Ethics of Scientific Knowledge and Technology
(COMEST) explored the possibility of robots in the Preliminary Draft Report of COMEST on
Robotics Ethics. It suggested that people participating in the robots' invention, authorization,
and distribution share the responsibility.
On May 12, 2017, Germany passed a revised action proposed by the transport
department. The system cannot completely replace the driver for driving. The driver
should stay there and be able to take over the vehicle at any time. Although self-driving is
controlled by the computer, the ultimate responsibility should primarily fall on the driver .
Under the current legal framework, the robot is not liable for any damage to the third
party due to its behavior or negligence.
How to Protect Privacy?
Two researchers from the University of Texas at Austin
successfully identified two people out of the nearly half million
anonymized users whose movie ratings were released by
online rental company Netflix, which forced the company to
cancel the movie-recommendation engine competition.
Legislation Protection and
Technology Application
Legislation protection:
Since the Swedish Data Protection Act, the first personal data
protection act, was issued in 1973, more than 110 countries and
regions have enacted dedicated laws to protect personal
information till December 2016.
In 2012, Decision of the Standing Committee of the National
People's Congress on Strengthening Information Protection on
Networks was passed. In 2016, the People's Republic of China
Network Security Law was adopted.
Technical application:
Data anonymization: It is the process of removing personally
identifiable information from personal data, so that the people
whom the data describes remain anonymous.
Is the Algorithm Fair by Default?
2. What Is AI?
1. The Past of AI
2. What Is AI?
ASIMO Waiter
Soul Mate
I love you.
Tap to edit
Intelligence
Digital brain
Data Control
Physical world
A. Automatic Intelligence
B. Artificial Intelligence
C. Automatic Information
D. Artificial Information
2. Which of the following theories does neural network research belong to? ( )
A. Symbolicism
B. Connectionism
C. Actionism