Professional Documents
Culture Documents
Intelligent Systems 1
Intelligent Systems 1
A Altahhan
Welcome…!
• Module Guide
• Have a look please
• Assignment + Test
• Lecture
• Interactive
• Recorded
• Register
• Labs + lecture attendance
• Essential to provide practice to pass the test and assignment
• Strongly encourage a persistent and consistence attendance
What is intelligence?
• Intelligence is difficult to define
• Dictionary: ability to acquire and apply knowledge and skills
• Wikipedia: problem solving using knowledge?
• Machine Intelligence?
Knowledge Engineering
• Data
• Information
• Knowledge
Computability and Computational Limitation
• Problems Types
• Tractable
• Intractable: most of real-life, AI and business problems
• Due to high dimensionality
• Huge space search
• Tractable problems: ---> exact solution, exhaustive search
• Intractable problems: ---> inexact of approximate algorithms
• Greedy Algorithms
• Hill Climbing
• A*
Artificial Intelligence
• AI concentrate on problems that are:
• Interactable
• cannot be normally be solved in limited computational time
• Complex problems
• Early was Influenced by games such as chess
• Historically depended on search method in order to find a solution
• Depth first search
• Width first search
• A* is prevalent
• Min-max
Intelligent Systems
Intelligent systems on the other hand
• Borrows techniques from AI, Machine Learning and others
• Deals with wide variety of practical problems
• Problem we are interested in building a system or a model of a system
for them
• So commonality of the problem that justifies the effort and
• Practicality of the solution are strongly present
Early Intelligent System
• Expert System
• Systems that are able to capture an expert expertise (knowledge)
• Often in a rule based structure (Knowledge base)
• Operate a mechanism that tries to infer a solution or a conclusion to a query
• The mechanism is called inference engine
• Those systems highly depends on
• logical programming and
• predicate logic
• Hence fuzzy logic played an important role in those system
Fuzzy Systems
• Fuzzy logic allows us to deal with uncertainty in the information and
data provide by the user
• Fuzzy Systems
• Type 1
• Type 2
• Useful for control as well
Machine Learning
• Most prominent of all areas
• Machine Learning
• Supervised
• Unsupervised
• Reinforcement
Artificial Neural Networks
• Shallow Neural Networks
• Deep Neural Networks
• AutoEncoder
• Convolutional Neural Networks
• LSTM
Evolutionary Computing
• Evolutionary Computing
• Genetic Algorithms
• Greedy Algorithms
• Optimisation
Areas of Computational Intelligence
Will dedicate this module to explore intelligent systems in the context
of
• Machine Learning and
• Data Mining
How they can be utilised to build a
• Strong resilient models that can be used to solve
• Practical problems needed for the industry
Data Mining
• Draws on the strength of
• Machine Learning and Statistics
• To extract knowledge out of the Data
• Data
• Structured such as a Database
• Unstructured such as values in a text file
• A lot of the big data exists as unstructured
Overview
• Now let us have an overview of the field and what we will cover
mostly
• We will be using various resources but mostly the first book in our
guide Intro. Data Mining by Tan et al.
The following slides are due to Tan, Steinbach, Karpatne, and Kumar Intro. Data Mining Book
Great Opportunities to Solve Society’s Major Problems
Improving health care and reducing costs Predicting the impact of climate change
• Description Methods
• Find human-interpretable patterns that describe the data.
From [Fayyad, et.al.] Advances in Knowledge Discovery and Data Mining, 1996
Data
Tid Refund Marital Taxable
Status Income Cheat
Milk
Class Employed
# years at
Level of Credit Yes
Tid Employed present No
Education Worthy
address
1 Yes Graduate 5 Yes
2 Yes High School 2 No No Education
3 No Undergrad 1 No
{ High school,
4 Yes High School 10 Yes Graduate
Undergrad }
… … … … …
10
Number of Number of
years years
Yes No Yes No
Set
Training
Learn
Model
Set Classifier
From [Fayyad, et.al.] Advances in Knowledge Discovery and Data Mining, 1996
Late
Data Size:
• 72 million stars, 20 million galaxies
• Object Catalog: 9 GB
• Image Database: 150 GB
Use of K-means to
60
Land Cluster 2
partition Sea Surface
30 Temperature (SST) and
Land Cluster 1 Net Primary Production
latitude
0
(NPP) into clusters that
Ice or No NPP
-30
reflect the Northern and
Sea Cluster 2 Southern Hemispheres.
-60
Sea Cluster 1
01/17/2018 -90
-180 -150 -120 -90 -60 -30 0 30 60 90 120 150 180
Cluster
Introduction to Data Mining, 2nd Edition 31
longitude
Clustering: Application 1
• Market Segmentation:
• Goal: subdivide a market into distinct subsets of
customers where any subset may conceivably be selected
as a market target to be reached with a distinct marketing
mix.
• Approach:
• Collect different attributes of customers based on their
geographical and lifestyle related information.
• Find clusters of similar customers.
• Measure the clustering quality by observing buying patterns of
customers in same cluster vs. those from different clusters.
• Goal: To find groups of documents that are similar to each other based on
the important terms appearing in them.
• Approach: To identify frequently occurring terms in each document. Form a
similarity measure based on the frequencies of different terms. Use it to
cluster.
TID Items
1 Bread, Coke, Milk
Rules Discovered:
2 Beer, Bread {Milk} --> {Coke}
3 Beer, Coke, Diaper, Milk {Diaper, Milk} --> {Beer}
4 Beer, Bread, Diaper, Milk
5 Coke, Diaper, Milk
• Medical Informatics
• Rules are used to find combination of patient symptoms and test results
associated with certain diseases