Course: Intelligent Systems

Examples of Intelligent Systems

Martin Molina
2021
Outline
• Example 1: Intelligent advisor for bus fleet management
• Example 2: Aerial robot for autonomous inspection
• A taxonomy of intelligent systems

1
Example 1:
Intelligent advisor for bus fleet management
The fleet management system of the Bus Control Center of Vitoria (Spain) included in
2002 a system to detect incidents and recommend actuations.

• Incident
detection
• Actuation
suggestion

Bus operator

Intelligent advisor system

Speech
commands
to vehicles
Vehicle fleet
(sensor network with GPS data)

Molina, M. (2005) An intelligent assistant for public transport management. In International

Conference on Intelligent Computing (pp. 199-208). Springer, Berlin, Heidelberg.
How does the system perceive the environment?

• The system collects data from buses

Bus operator
using GPS localization
• The system localizes the position of each
System bus in a map of transportation lines
Interaction

Deliberation

Action
Perception
control

Environment

3
How does the system deliberate?

Bus operator • The system detects the presence of

incidents
– E.g., detection of delays based on current
System position and planned position
Interaction
• The system predicts future behavior
– E.g., a model is used about historic demand for
Deliberation transportation
• The system determines actions to be done
Action
Perception
control to solve incidents
– The system uses an automated planner (HTN
planning) to generate action plans
Environment

4
How does the system interact with the operator?

Bus operator • The system presents detected incidents

– E.g., bus delays
• The operator can notify other events to
System
the system
Interaction
– E. g., a broken bus, a blocked street, etc.

Deliberation
• The system recommends actions
– E.g., using additional buses, sending repairing
Action truck, etc.
Perception
control
• The system justifies actions
– E.g., some lines are prioritized based on demand
Environment

5
The system for bus fleet management is an example of
an intelligent advisor system using a sensor network
There are multiple examples of intelligent assistants using
sensor networks:

User • Emergency decision support (floods) using a geographic

sensor network
Molina, M., Blasco, G. (2003). A multi-agent system for emergency decision
Intelligent support. Proc. International Conference on Intelligent Data Engineering and
advisor Automated Learning.
system Interaction

Deliberation

Action
Perception
control

• Electric power operation using a local sensor network

Sensor network Da Silva Filho, J. I., Onuki, A. S., Ferrara, L. F. P., Mário, M. C., de Melo Camargo, J.,
Garcia, D. V., ... & Rocco, A. (2012). Electric Power System Operation Decision
Support by Expert System Built with Paraconsistent Annotated Logic. In Advances in
Expert Systems. IntechOpen.

6
Example 2:
Autonomous inspection of airplanes with aerial robots
• The Universidad Politécnica de Madrid developed in 2019 a prototype of an
autonomous aerial system for airplane inspection for the company Airbus

https://vimeo.com/393907228
Bavle, Hriday (2019). Positioning and Mapping for Aerial Robots using on-board Perception for Autonomous Missions. PhD Dissertation.
Universidad Politécnica de Madrid.
The aerial robot is equipped with multiple sensors

On-board computer 3D lidar sensor

(DJI Manifold) (Ouster OS1)

Inertial measurement unit (IMU)

and barometer

Bottom camera
Sonar altimeter

Front RGB stereo camera High resolution camera

(DJI Zenmuse X7)

Matrice-210 aerial robotic platform (https://www.dji.com/bg/matrice-200-series) 8

How does the aerial robot perceive the environment?
• Environment map:
Operator – 3D point cloud scanned from lidar sensor
• Self localization:
– IMU for speeds and accelerations , etc.
– Data fusion from multiple sensors for precise localization
• Anomalies in the surface of the airplane:
Interaction
Robot – Cameras for visual recognition of anomalies
using computer vision

Deliberation

Action
Perception control

Airplane

9
How does the aerial robot
interact with the operator?

Operator
• The operator provides the geometry of the airplane
and relevant search points

Interaction
Robot

Deliberation

Action
Perception
control

Airplane

• The operator can stop the mission execution if an

emergency happens

10
How does the aerial robot deliberate?

Operator
• Generation of an inspection plan to cover
the surface of the airplane

Interaction
Robot

Deliberation

Action
Perception
control

• Storage of images in memory with symbolic

description

Airplane

11
How does the aerial robot control actions?

Operator • Plan execution and motion control to complete

the navigation plan
• Reaction in the presence of unexpected
obstacles to avoid collisions
Interaction
Robot

Deliberation

Action
Perception
control

Airplane

12
A taxonomy of intelligent systems (simplified)
Intelligent system

Intelligent Intelligent
autonomous system advisor system

Autonomous Autonomous in a virtual

in a real environment environment

Autonomous Autonomous Autonomous with Advisor with open Advisor

Robotic
automation with restricted open natural natural with restricted
system
system Interaction language language interaction

Autonomous Home Software

automation Question
robot robot Personal Expert system
answering
assistant
E.g
E.g., home
E.g., robot process
system E.g., fleet bus
energy management
Curiosity space automation RPA E.g., SIRI, Alexa
control E.g., Watson
robot

Intelligent Recommender
Collaborative Virtual
industrial Transactional system
robot automation character
chatbot
E.g., diagnosis/ E.g., recommend
E.g., robot E.g., characters for
repair control E.g., ecommerce books, news
Baxter training or
pocesses chatbots recommendation
enteirtaining

Self-driving Intelligent
vehicle tutoring
System
E.g.,
autonomous car E.g., Practical
Algebra Tutor PAT Molina, Martin (2020). What is an intelligent system?. ArXiv preprint arXiv:2009.09083
https://arxiv.org/pdf/2009.09083.pdf

13
Lecture slides of master course “Intelligent Systems”.
© 2021 Martin Molina

This work is licensed under Creative Commons license CC BY-SA 4.0:

https://creativecommons.org/licenses/by-sa/4.0/legalcode

Suggested work citation:

Molina, M. (2021): “Intelligent Systems”. Master course (lecture slides). Department of
Artificial Intelligence. Universidad Politécnica de Madrid.

14