1111

You might also like

Download as pdf or txt
Download as pdf or txt
You are on page 1of 20

Republic of the Philippines

Laguna State Polytechnic University


ISO 9001:2015 Certified
Province of Laguna
Level I Institutionally Accredited

LSPU Self-Paced Learning Module (SLM)


Course PERCEPTION AND COMPUTER VISION
Sem/AY First Semester/2021-2022
Module No. 1
Lesson Title INTRODUCTION TO PERCEPTION AND COMPUTER VISION
Week
2-5
Duration
Date October 11-November 5, 2021
Description This lesson will discuss the introduction of perception and computer vision. This will
of the give the glimpse of how the computer and human see. Also, this will discuss the
Lesson computer vision in various fields and the steps in the image processing.

Learning Outcomes
Intended Understand the process of image processing.
Learning
Outcomes
Targets/ At the end of the lesson, students should be able to:
Objectives • Define what computer vision is.
• Know the different applications and examples of computer vision.
• Understand the computer vision methods.
• Know the different components of an image processing system.

Student Learning Strategies

Online Activities A. Online Discussion via Google Meet


(Synchronous/ You will be directed to attend in a One and a half-Hour class discussion
about the Introduction to Perception and Computer Vision. To have
Asynchronous) access to the Online Discussion, refer to the link provided on our Google
Classroom.

The online discussion will happen on October 11-November 5, 2021,


between 7:00AM-5:00PM based from your class schedule.

(For further instructions, refer to your Google Classroom and see the
schedule of activities for this module)

B. Learning Guide Questions:


1. What is Computer Vision?
2. Where can I apply Computer Vision?
3. How does a human eye perceive an image?

LSPU SELF-PACED LEARNING MODULE: PERCEPTION AND COMPUTER VISION


Republic of the Philippines
Laguna State Polytechnic University
ISO 9001:2015 Certified
Province of Laguna
Level I Institutionally Accredited

Note: The insight that you will post on online discussion forum using Learning Management System
(LMS) will receive additional scores in class participation.
Lecture Guide
Computer vision is a field of study focused on the problem of helping computers
to see. It is a multidisciplinary field that could broadly be called a subfield of artificial
intelligence and machine learning, which may involve the use of specialized methods
and make use of general learning algorithms.
A field that includes methods for acquiring, processing, analyzing, and
understanding images. It is also known as Image analysis, Scene analysis, Image
understanding. Computer vision duplicates the abilities of human vision by
electronically perceiving and understanding an image. It is also a theory for building
artificial systems that obtain information from images. These image data can take many
forms, such as a video sequence, depth images, views from multiple cameras, medical
scanner, satellite sensors, etc.

Computer Vision vs. Human Vision


The left side of the Figure 1 is what the human vision sees. And on the right side
is the computer vision. As you can see it is represented by numbers or value of the color
of the picture.

Offline Activities
(e-Learning/Self-
Paced)

Figure 1. Comparison of Vision between Computers and Human.

Vision is an amazing feat of natural intelligence. More human brain devoted to


vision than anything else. There are about 30,000 visual categories. Learn 4.5 categories
per day -> 18 years. At age 6, child can learn roughly all 30,000 (13.5day). As of the
moment that this reference was made, machines can’t replicate Human Image
Recognition, yet. They do not possess our ability to recognize distorted images.

Why is Computer Vision Difficult?


• It is a many-to-one mapping
• It is computationally intensive
• We do not understand the recognition problem

LSPU SELF-PACED LEARNING MODULE: PERCEPTION AND COMPUTER VISION


Republic of the Philippines
Laguna State Polytechnic University
ISO 9001:2015 Certified
Province of Laguna
Level I Institutionally Accredited

Relationship between Computer Vision and Various Fields


The relationship between computer vision, machine vision, and image
processing is depicted on Figure 2. This also shows various fields that corelates with the
computer vision.

Figure 2. Different fields and Computer Vision

Computer Vision System Methods

Figure 3. Computer Vision System Methods

LSPU SELF-PACED LEARNING MODULE: PERCEPTION AND COMPUTER VISION


Republic of the Philippines
Laguna State Polytechnic University
ISO 9001:2015 Certified
Province of Laguna
Level I Institutionally Accredited

The following are the methods in computer vision system which we will be
having other discussion focusing on these methods:
• Image Acquisition
• Pre-processing
• Feature extraction
• Detection/segmentation
• Recognition and interpretation
Low-level processing
• Standard procedures are applied to improve image quality
• Procedures are required to have no intelligent capabilities.
• Input and output are images
• Tasks: Primitive operations, such as, image processing to reduce noise, contrast
enhancement and image sharpening
Intermediate-level processing
• Extract and characterize components in the image
• Some intelligent capabilities are required.
• Inputs, generally, are images. Outputs are attributes extracted from those
images (edges, contours, identity of individual objects)
• Tasks:
o Segmentation (partitioning an image into regions or objects)
o Description of those objects to reduce them to a form suitable for
computer processing
o Classifications (recognition) of objects
High-level processing
• Recognition and interpretation.
• Procedures require high intelligent capabilities.
• Image analysis and computer vision

Recognition Cues
Scene interpretation, even of complex, cluttered scenes is a straightforward task
for humans. The following has its role:

• Color
• Texture
• Pattern
• Shape
• Association

Mathematics in Computer Vision


• In the early days of computer vision, vision systems employed simple heuristic
methods.
• Today, the domain is heavily inclined towards theoretically, well-founded
methods involving non-trivial mathematics.
– Calculus
– Linear Algebra

LSPU SELF-PACED LEARNING MODULE: PERCEPTION AND COMPUTER VISION


Republic of the Philippines
Laguna State Polytechnic University
ISO 9001:2015 Certified
Province of Laguna
Level I Institutionally Accredited

– Probabilities and Statistics


– Signal Processing
– Projective Geometry
– Computational Geometry
– Optimization Theory
– Control Theory
Computer Vision Applications
• Industrial inspection/quality control
• Surveillance and security
• Face recognition
• Gesture recognition
• Space applications
• Medical image analysis
• Autonomous vehicles
• Virtual reality and much more …...

Computer Vision Examples


Optical Character Recognition (OCR)

Figure 4. Computer Vision Example – OCR

Login without a password

Figure 5. Computer Vision Example –Login without a Password

LSPU SELF-PACED LEARNING MODULE: PERCEPTION AND COMPUTER VISION


Republic of the Philippines
Laguna State Polytechnic University
ISO 9001:2015 Certified
Province of Laguna
Level I Institutionally Accredited

Target Recognition

Figure 6. Computer Vision Example – Target Recognition

Interpretation of High Resolution Satellite Images

Figure 7. Computer Vision Example – Interpreting Satellite Images

Traffic Monitoring

Figure 8. Computer Vision Example – Traffic Monitoring

LSPU SELF-PACED LEARNING MODULE: PERCEPTION AND COMPUTER VISION


Republic of the Philippines
Laguna State Polytechnic University
ISO 9001:2015 Certified
Province of Laguna
Level I Institutionally Accredited

Face Detection

Figure 9. Computer Vision Example – Facial Recognition

3D Shape Reconstruction

Figure 10. Computer Vision Example – 3D Shape Reconstruction

Object Recognition (in Mobile Phones)

Figure 11. Computer Vision Example – Object Recognition

LSPU SELF-PACED LEARNING MODULE: PERCEPTION AND COMPUTER VISION


Republic of the Philippines
Laguna State Polytechnic University
ISO 9001:2015 Certified
Province of Laguna
Level I Institutionally Accredited

Sports

Figure 12. Computer Vision Example - Sports

Smart Cars (by Google)

Figure 13. Computer Vision Example – Smart Cars by Google


Interactive Games

Figure 14. Computer Vision Example – Interactive Games (XBOX)

Industrial Robots

Figure 15. Computer Vision Example – Industrial Robots

LSPU SELF-PACED LEARNING MODULE: PERCEPTION AND COMPUTER VISION


Republic of the Philippines
Laguna State Polytechnic University
ISO 9001:2015 Certified
Province of Laguna
Level I Institutionally Accredited

Mobile Robots

Figure 16. Computer Vision Example – Mobile Robots

Medical Imaging

Figure 17. Computer Vision Example - Medicine

LSPU SELF-PACED LEARNING MODULE: PERCEPTION AND COMPUTER VISION


Republic of the Philippines
Laguna State Polytechnic University
ISO 9001:2015 Certified
Province of Laguna
Level I Institutionally Accredited

Topic 2: Image Acquisition, Representation, Processing and


Properties
Digital Image
• An image can be defined as a two-dimensional function f(x,y)
• x,y: Spatial coordinate
• F: the amplitude of any pair of coordinate x,y, which is called the intensity or
gray level of the image at that point.
• X,y and f, are all finite and discrete quantities.

Fundamental Steps in Digital Image Processing

Figure 18. Fundamentals Steps in DIP

Step 1: Image Acquisition


The image is captured by a sensor (eg. Camera), and digitized if the output of the
camera or sensor is not already in digital form, using analogue-to-digital convertor.
Step 2: Image Enhancement
The process of manipulating an image so that the result is more suitable than
the original for specific applications.
The idea behind enhancement techniques is to bring out details that are hidden,
or simple to highlight certain features of interest in an image.
Step 3: Image Restoration
Improving the appearance of an image
Tend to be mathematical or probabilistic models. Enhancement, on the other
hand, is based on human subjective preferences regarding what constitutes a “good”
enhancement result.
Step 4: Colour Image Processing
Use the colour of the image to extract features of interest in an image

LSPU SELF-PACED LEARNING MODULE: PERCEPTION AND COMPUTER VISION


Republic of the Philippines
Laguna State Polytechnic University
ISO 9001:2015 Certified
Province of Laguna
Level I Institutionally Accredited

Step 5: Wavelets
Are the foundation of representing images in various degrees of resolution. It is
used for image data compression.
Step 6: Compression
Techniques for reducing the storage required to save an image or the bandwidth
required to transmit it.
Step 7: Morphological Processing
Tools for extracting image components that are useful in the representation and
description of shape.
In this step, there would be a transition from processes that output images, to
processes that output image attributes.
Step 8: Image Segmentation
Segmentation procedures partition an image into its constituent parts or
objects.
Important Tip: The more accurate the segmentation, the more likely recognition
is to succeed.
Step 9: Representation and Description
Representation: Make a decision whether the data should be represented as a
boundary or as a complete region. It is almost always follows the output of a
segmentation stage:
• Boundary Representation: Focus on external shape characteristics, such as
corners and inflections
• Region Representation: Focus on internal properties, such as texture or
skeleton shape
Choosing a representation is only part of the solution for transforming raw data
into a form suitable for subsequent computer processing (mainly recognition)
Description: also called, feature selection, deals with extracting attributes that
result in some information of interest.
Recognition: the process that assigns label to an object based on the
information provided by its description.
Step 10: Knowledge Base
Knowledge about a problem domain is coded into an image processing system
in the form of a knowledge database.

LSPU SELF-PACED LEARNING MODULE: PERCEPTION AND COMPUTER VISION


Republic of the Philippines
Laguna State Polytechnic University
ISO 9001:2015 Certified
Province of Laguna
Level I Institutionally Accredited

Components of an Image Processing System

Figure 19. Components of an Image Processing System

1. Image Sensors
Two elements are required to acquire digital images. The first is the physical
device that is sensitive to the energy radiated by the object we wish to image (Sensor).
The second, called a digitizer, is a device for converting the output of the physical
sensing device into digital form.
2. Specialized Image Processing Hardware
Usually consists of the digitizer, mentioned before, plus hardware that performs
other primitive operations, such as an arithmetic logic unit (ALU), which performs
arithmetic and logical operations in parallel on entire images.
This type of hardware sometimes is called a frontend subsystem, and its most
distinguishing characteristic is speed. In other words, this unit performs functions that
require fast data throughputs that the typical main computer cannot handle.
3. Computer
The computer in an image processing system is a general-purpose computer
and can range from a PC to a supercomputer. In dedicated applications, sometimes
specially designed computers are used to achieve a required level of performance.
4. Image Processing Software
Software for image processing consists of specialized modules that perform
specific tasks. A well-designed package also includes the capability for the user to write
code that, as a minimum, utilizes the specialized modules.

LSPU SELF-PACED LEARNING MODULE: PERCEPTION AND COMPUTER VISION


Republic of the Philippines
Laguna State Polytechnic University
ISO 9001:2015 Certified
Province of Laguna
Level I Institutionally Accredited

5. Mass Storage Capability


Mass storage capability is a must in a image processing applications. And image
of sized 1024 * 1024 pixels requires one megabyte of storage space if the image is not
compressed.
Digital storage for image processing applications falls into three principal
categories:
1. Short-term storage for use during processing.
2. on line storage for relatively fast recall
3. Archival storage, characterized by infrequent access
One method of providing short-term storage is computer memory. Another is
by specialized boards, called frame buffers, that store one or more images and can be
accessed rapidly.
The on-line storage method, allows virtually instantaneous image zoom, as well
as scroll (vertical shifts) and pan (horizontal shifts). On-line storage generally takes the
form of magnetic disks and optical-media storage. The key factor characterizing on-line
storage is frequent access to the stored data.
6. Image Displays
The displays in use today are mainly color (preferably flat screen) TV monitors.
Monitors are driven by the outputs of the image and graphics display cards that are an
integral part of a computer system.
7. Hardcopy devices
Used for recording images, include laser printers, film cameras, heat-sensitive
devices, inkjet units and digital units, such as optical and CD-Rom disks.
8. Networking
Is almost a default function in any computer system, in use today. Because of the
large amount of data inherent in image processing applications the key consideration in
image transmission is bandwidth.
In dedicated networks, this typically is not a problem, but communications with
remote sites via the internet are not always as efficient.

Engaging Activity

Think of where you can apply Perception and Computer Vision. Explain your
discussion by stating why and how you can apply it on your chosen area.

LSPU SELF-PACED LEARNING MODULE: PERCEPTION AND COMPUTER VISION


Republic of the Philippines
Laguna State Polytechnic University
Province of Laguna
ISO 9001:2015 Certified
Level I Institutionally Accredited

Performance Tasks
Performance Task 1

Research at least one related article to computer vision, analyze and discuss how they discussed the
image acquisition, representation, processing and properties. Please put the reference.

LSPU SELF-PACED LEARNING MODULE: PERCEPTION AND COMPUTER VISION


Republic of the Philippines
Laguna State Polytechnic University
Province of Laguna
ISO 9001:2015 Certified
Level I Institutionally Accredited

Understanding Directed Assessment


Rubric for Essay
Criteria 1 2 3 4
Quality of Writing • Piece had no • Piece had little • Piece was • Piece was
style or voice style or voice written in an written in an
• Gives no new • Gives some new interesting style extraordinary
information and information but and voice style and voice
very poorly poorly organized • Somewhat • Very informative
organized informative and and well
organized organized
Grammar, Usage & • So many • A number of • Few spelling and • Virtually no
Mechanics spelling, spelling, punctuations spelling,
punctuation and punctuation or errors, minor punctuation or
grammatical grammatical grammatical grammatical
errors that it errors errors errors
interferes with
the meaning
Adopted from: https://www.thoughtco.com/essay-rubric-2081367

Rubric for Research Paper


Criteria 4 3 2 1

Integration The paper The paper The paper The paper does not
of demonstrates that demonstrates that demonstrates that demonstrate that
Knowledge the author fully the author, for the the author, to a the author has fully
understands and has most part, certain extent, understood and
applied concepts understands and has understands and has applied concepts
learned in the course. applied concepts applied concepts learned in the
Concepts are learned in the learned in the course.
integrated into the course. Some of the course.
writer’s own insights. conclusions,
The writer provides however, are not
concluding remarks supported in the
that show analysis body of the paper.
and synthesis of
ideas.

Topic focus The topic is focused The topic is focused The topic is too The topic is not
narrowly enough for but lacks direction. broad for the scope clearly defined.
the scope of this The paper is about a of this assignment.
assignment. A thesis specific topic but the
statement provides writer has not
direction for the established a
paper, either by position.
statement of a
position or
hypothesis.

Depth of In-depth discussion & In-depth discussion The writer has Cursory discussion
discussion elaboration in all & elaboration in omitted pertinent in all the sections of
sections of the paper. most sections of the content or content the paper or brief
paper. runs-on excessively. discussion in only a
Quotations from few sections.

LSPU SELF-PACED LEARNING MODULE: PERCEPTION AND COMPUTER VISION


Republic of the Philippines
Laguna State Polytechnic University
Province of Laguna
ISO 9001:2015 Certified
Level I Institutionally Accredited

others outweigh the


writer’s own ideas
excessively.

Cohesiveness Ties together For the most part, Sometimes ties Does not tie together
information from all ties together together information information. Paper
sources. Paper flows information from all from all sources. does not flow and
from one issue to the sources. Paper flows Paper does not flow - appears to be
next without the need with only some disjointedness is created from
for headings. disjointedness. apparent. Author's disparate issues.
Author's writing Author's writing writing does not Headings are
demonstrates an demonstrates an demonstrate an necessary to link
understanding of the understanding of the understanding of the concepts. Writing
relationship among relationship among relationship among does not
material obtained material obtained material obtained demonstrate
from all sources. from all sources. from all sources. understanding any
relationships

Citations Cites all data obtained Cites most data Cites some data Does not cite
from other sources. obtained from other obtained from other sources.
APA citation style is sources. APA citation sources. Citation
used in both text and style is used in both style is either
bibliography. text and inconsistent or
bibliography. incorrect.
Adapted from: Whalen, S. “Rubric from Contemporary Health Issues Research Paper”

LSPU SELF-PACED LEARNING MODULE: PERCEPTION AND COMPUTER VISION


Republic of the Philippines
Laguna State Polytechnic University
Province of Laguna
ISO 9001:2015 Certified
Level I Institutionally Accredited

Learning Resources
• Students’ Handbook
• Forsyth, D., & Ponce, J. (2011). Computer vision: A modern approach (p. 792). Prentice hall.
• Sonka, M., Hlavac, V., & Boyle, R. (2007). Image processing, analysis and computer
vision. Thomson, 3ed.
• Szeliski, R. (2010). Computer vision: algorithms and applications. Springer Science & Business
Media.
• https://machinelearningmastery.com/what-is-computer-vision/
• https://www.bharathuniv.ac.in/colleges1/downloads/courseware_ece/notes/BEC007%20%
20-Digital%20image%20processing.pdf

LSPU SELF-PACED LEARNING MODULE: PERCEPTION AND COMPUTER VISION

You might also like