VISION SOLUTIONS IN INDUSTRIES

SMART CAMERA – MITSUBISHI ELECTRIC

Mitsubishi Electric Vietnam

Presenter: Tran Ngoc Tung
 Mitsubishi Electric – Vision system

Content:
1. Basic knowledge of a smart industrial camera system:
• Vision sensor
• Lens
• Lighting
• Software
2. Applications of Smart cameras in Industries (GIGI:
Guidance – Inspection – Gauging – Identification)

3. Integrating vision system to an control system.

4. Simulation on PC and practice on the demo kit.

 1. Basic knowledge

Vision Sensor

A hardware that contains

applications that conduct
conversion, recognition, and
measurement for image
information.
 Terminologies of Image
■ Pixel: The minimum element that composes an image.
■ Brightness: a value that each pixel can express in a gray image

Image

Image height
Brightness
value
(gray value)
0 to 255

Each square
is a pixel.
Image width
Lens
 Terminologies
Field of View (FOV)
 The maximum range a sensor can
inspect. Ex: heigh 60mm / Wide 90mm
 Terminologies

Working Distance (WD)

 A distance from the front surface of the
lens to the target object
 Terminologies

Focal distance (mm)

 A distance from the center of the lens to
the image element
 Lens

Working distance – Field of View - Lens

Lighting
 Lighting

Reference:
https://vst.co.jp/en/category/lighting-en/
Lighting Technique

Same part
Different lighting position
 Lighting

Lighting angle
 Constant Lighting and Stroboscope

Stroboscope No stroboscope
• Used only when capturing images • Always turned ON
• Stops the movement • Constant brightness
• Quick response lighting is required • Easy settings
• Control is required • Rise of temperature
 Lighting

Shadow

Front light Back light

Tips:
Tips:
• Minimize the shadows by using two or
• Always keep the lights clean
more spot light
• Use a light control film to improve the
• Use shadows to enhance the contrast
accuracy
 Back Light Application

Ring light Back light

 Back Light Application

Ring light Back light

Direct Front Lighting Application

Front lighting Shadows enhanced

 Structured Lighting
Advantages
 Measure height and depth at relatively
low cost.
 Express the surface shape with low
contrast

Disadvantages
 Laser is expensive and need cautions
when handling.
 The accuracy of Z axis direction is not
high.

• Application
• Measurement of continued
characteristics
• For objects with extremely low
contrast (linear deformation)
Tips:
If possible, use fiber
light instead of laser
Structured Light Application

Line lighting Changes by depth

 Uniform Diffused Lighting Application

Direct front lighting Uniform diffused lighting

(Ring lighting) (Dome lighting)
 Polarizing Filter Application

Ring lighting without polarizing plate Ring lighting with polarizing plate
 Colors

Use color lighting to produce

contrast.

Use the same or similar color

to increase brightness.
 Yellow lighting brightens
the yellow characteristic.

Use an opposite color to

increase darkness.
 Green lighting darkens the
red characteristic.
 Color Application

Actual color White lighting

Red lighting Green lighting Blue lighting

 Color Lighting Application

Use blue lighting to enhance the date.

 Blue printed parts are cleared.
 The printed parts in red (opposite color) look dark.

Peripheral light Blue lighting

 Software

In-sight Explorer for Melsensor

2. Applications of Smart cameras in Industries
(GIGI: Guidance – Inspection – Gauging – Identification)
Mitsubishi Electric - Vision Sensor VS 20

Mitsubishi Electric
Corporation

28
 Mitsubishi Electric - Vision Sensor VS 20

Above all, it is a vision sensor that can construct an inspection

system easily.

OK?
NG?
 Mitsubishi Electric - Vision Sensor VS 20

Easy to use

The software is designed for ‘easy to use’ and allows you to

set up quickly.
Example of inspection : inspection for presence of label

OK NG

VS 20 can be set up only 11 steps in about 30 seconds.

 Mitsubishi Electric - Vision Sensor VS 20

Simultaneous measurement of multiple workpieces is

possible
 Mitsubishi Electric - Vision Sensor VS 20
代理店様外秘

VS 20 Option Lens

 Standard S-mount 8 mm focal length

 The camera has a focusing mechanism.
 Can be replaced with other focal length lenses
3.6 mm/6 mm/12 mm/16 mm/25 mm

VS 20 has a "2x zoom mode" that can capture image 2 times.

This may make lens replacement unnecessary.
 Mitsubishi Electric - Vision Sensor VS 20
代理店様外秘

VS20 Optional 2 lighting, 3 cables

Lighting
 Standard white LED ring lighting
 Replaceable in red, blue and infrared

Cables
*Use a dedicated Ethernet cable and two power I/O cables.
 both are robotic cables
 Typical length is 5 m/10 m/15 m
 Mitsubishi Electric
代理店様外秘
Vision Sensor VS 70 – VS80

Mitsubishi Electric Vision Sensor:

VS 70 – VS80 Melsensor
New Product Features

Integrated lighting and

excellent flexibility (VS 70)

Standalone Ultra Small +

Ultra High Speed (VS 80)
Excellent compatibility with
Mitsubishi Electric FA products

Intuitive setup (VS 70, VS

80)
 Mitsubishi Electric
代理店様外秘
Vision Sensor VS 70 – VS80

Integrated Lighting and Excellent Flexibility

Modular lighting and

IP 67
15.2 GB memory optics
(7.2 GB: Internal Flash Memory
+ 8GB: SD card)
Lighting to meet your requirements and
The lens configuration can be changed freely.

flexible optics
interface Power and I/O
24 VDC, trigger: (1)
IN: (2) OUT: (2)

Gigabit Ethernet
ODVA-compliant, X-Coded M 12
connector
connector for external
lighting
(brightness control)
 Mitsubishi Electric
代理店様外秘
Vision Sensor VS 70 – VS80

Integrated Lighting and Excellent Flexibility

Lens type, lens focal length selected
Select the type of lens

S-Mount autofocus C-Mount

Requires C-mount to S-mount Standard: 8mm
conversion kit 6, 12, 16 and 25 mm are optional
(6 mm, 8 mm, 12 mm,
16 mm, 25 mm)
 Mitsubishi Electric
Vision Sensor VS 70 – VS80
VS 70 Lineup
VS 70 M -600 - VS 70 M -600 - VS 70 M -800 - VS 70 M -800 - VS 70 M -802 - VS 70 M -802 -
Model E ER *2 E ER E ER

Image 800 x 600 /

1600 x 1200
Resolution 640 x 480
165/217 53
Image Capture
frames per second frames per second
Communication Ethernet (CC-Link IE Field Network Basic, SLMP Scanner, SLMP, Modbus TCP, TCP/IP, UDP,
s FTP, Telnet), RS -232
1 shooting trigger, 1 input, 4 high-speed outputs (2 out of 4 points can be changed to
input)
I/O
(CIO - 8 inputs using MICRO, 2 fast outputs, 8 outputs, 7 inputs using CIO -1400, 2 fast
outputs, 6 outputs)
image processing tool The following image processing tools are available for all models:.
positioning Positioning Tools

Existence tool, dimension measurement tool, counting tool, identification tool, geometry
and measurement tool
Inspection
arithmetic and logic tools, plotting tools, image filtering tools, defect detection tools,
Calibration

*2) Models with an R in the model name (-ER) can be used with the PatMax RedLine tool.

37
 Mitsubishi Electric
Vision Sensor VS 70 – VS80

VS 80 Lineup

VS 80 M - VS 80 M -200 - VS 80 M -200 - VS 80 M -400 - VS 80 M -400 - VS 80 M -202 - VS 80 M -202 - VS 80 M -402 - VS 80 M -402 -

Model
100 - E E ER E ER E ER E ER
*3
Image Resolution 640 x 480 1600 x 1200
Image Capture 217 frames/second 53 frames/second
Communications Ethernet (CC-Link IE Field Network Basic, SLMP Scanner, SLMP, Modbus TCP, TCP/IP, UDP, FTP, Telnet), RS -232
1 shooting trigger point, 0 input point, 2 high-speed output points (CIO - Using MICRO, Input: 8, Fast Output: 2,
I/O
Output: 8)
image processing tool The following image processing tools are available for all models:.
positioning Positioning Tools

Existence tool, dimension measurement tool, counting tool, identification tool, geometry and measurement
tool
Inspection
arithmetic and logic tools, plotting tools, image filtering tools, defect detection tools,
Calibration

*3) The PatMaxRedLine tool is available for models with an R in the model name (-ER).

38
 Main Roles of Image Processing GIGI

Guidance (Positioning)
 Where is the target object?  Transmitted to
robots, etc.

Inspection (Examination)
 Defect detection  Elimination of defective parts

Gauging (Size measuring)

 Contactless size measurement  Elimination of
defective parts

Identification (OCR, 2D, and barcode)

 Which part, and serial No.  To next process
 Mitsubishi Electric
代理店様外秘
Vision Sensor VS 70 – VS80

Positioning
In many machine vision applications, the most important first step is to find a part from an image.
In most cases, that capability is a factor in application success.
PatMax RedLine technology (patented) quickly and reliably finds components without being affected by object size, position, orientation,
surface reflections, shadows, etc.
In addition, it is now possible to output position information that could not be output with the VS 20 series.
 Mitsubishi Electric
代理店様外秘
Vision Sensor VS 70 – VS80
Positioning
Detects the edges of the
object and calculates the
position.
Calculates the intersection
of two detected edges.
Find the circular shape and
find the center position of
the circle.
The barycentric position is
calculated by detecting an object
(Example: black spots on a white
background, shapes that change
beyond the tolerance of the
pattern tool, etc.) without a fixed
shape.
The model pattern is
registered, and the pattern
which matches the model
pattern is detected in the
designated area when the
inspection is carried out, and
the position is obtained.
Uses specific points, lines,
and angle data generated
by the positioning and
inspection tools to
calculate position.
 Guidance

Eyes of a robot: Guides to the position of a part

2D Vision

conveyer

System Example
（ conveyer tracking）
 Mitsubishi Electric
代理店様外秘
Vision Sensor VS 70 – VS80

Inspection
The presence or absence of parts and features in the
inspection area is determined.

Determines the presence or The presence or absence of

absence of a feature based
on the average grayscale
value (= Luminance) of the
pixel
a feature is determined
based on a contrast value
indicating a difference
between a light pixel and a
dark pixel.

Based on the registered

Determines the presence or
pattern (called a model.),
absence of features based
use PatMax RedLine,
on the number of white or
PatMax, or a pattern
black pixels
algorithm to determine
presence.
 Mitsubishi Electric
代理店様外秘
Vision Sensor VS 70 – VS80

Inspection
The presence or absence of parts and features in the
inspection area is determined.

Determine if there is a Determines if there are

black or white mass. edge (Borders of light and
dark pixels) features that
match the specified
parameters

Determine the presence of Defines whether the

circular features image is in focus correctly
based on the image
sharpness score in the
area
 Mitsubishi Electric
代理店様外秘
Vision Sensor VS 70 – VS80

Gauge - Measure

It extracts features from the image based on the tool you choose.

Just point and click with your mouse on the feature you want.
(You can also select locations, lines, and circles detected by other tools.)
 Mitsubishi Electric
代理店様外秘
Vision Sensor VS 70 – VS80

Measure Tools
Dimensioning tools determine the distance, diameter, angle, and area of
features in an image.
Measures the distance between Measures the angle between two
any two selected input features. edges.

Measures the area of a shape. Measures the diameter of circular

edge features.
 Gauging
Size measurement: Contactless measurement is
possible even on irregular shapes

Spark plug Surgical staple

 Mitsubishi Electric
代理店様外秘
Vision Sensor VS 70 – VS80

Identification Tools
Use to identify bar codes, 2D codes, symbols, alphanumeric characters, and pattern
characteristics in an image.

Reads a one-dimensional Read the 2D barcode.

barcode.

Reads the postal code. Recognizes characters from

within an image.

Based on the registered

patterns (called a model.),
PatMax RedLine, PatMax,
or a pattern algorithm is
used to identify the specific
patterns extracted in the
image.
 Mitsubishi Electric
代理店様外秘
Vision Sensor VS 70 – VS80

Add – on: Counting functions

The Count tool counts features in an image.

*Blob Returns the number of black or white clumps.

*Edge Returns the number of edge (Borders of light and dark pixels)
features.
*Edge Pair Specifies the distance between edges and returns the number
of pairs of edges that exist at the specified distance.
*PatMax RedLine/PatMax
Based on the registered patterns (called a model.), the PatMax RedLine or
PatMax algorithm is converted to the
to return the number of patterns.
*Pattern Returns the number of patterns based on registered patterns
(called a model.).

Min Distance = 10
Max Distance = 50
Number of detected edge
pairs: 2
 Mitsubishi Electric
代理店様外秘
Vision Sensor VS 70 – VS80
Add – on: Counting functions
The Count tool counts features in an image.
Returns the number of
black or white clumps.
Specifies the distance
between edges and
returns the number of
pairs of edges that exist
at the specified distance.
Returns the number of
edge (Borders of light
and dark pixels)
features.
Returns the number of
occurrences of a
registered pattern
(called a model.) using
the PatMax RedLine,
PatMax, or pattern
algorithm.
3. Integrating vision system to
an automation control system.

51
 System Configuration 代理店様外秘

Ethernet Connection
This connection method controls the vision sensor and obtains the measurement results via
Ethernet.
Ethernet connections make wiring easier. In addition to controlling and setting, you can also
specify image transfer.
CC-Link IEF Basic and SLMP communication enable programless results acquisition
and vision sensor control
Configuration Tool
In-Sight Explorer for MELSENSOR
Vision
Ethernet cable Ethernet cable

Ethernet cable for

vision sensor
switching hub Ethernet cable for
POE Switching Hub vision sensor
24 VDC

Breakout cable for

VS 70
 System Configuration 代理店様外秘

I/O connectivity
This is a connection method for controlling the vision sensor and obtaining the measurement results at
the input/output terminals of the PLC.
The trigger command can be directly input to the vision sensor by I/O connection. It can also be
combined with PLC that does not support Ethernet communication.
Trigger timing deviation is minimum because trigger command is directly input.

Configuration Tool
In-Sight Explorer for MELSENSOR
Vision
Ethernet cable Ethernet cable

Ethernet cable for Breakout cable for

vision sensor VS 80
switching hub Ethernet cable for
POE Switching Hub vision sensor
24 VDC

Breakout cable for

VS 70
 System Configuration 代理店様外秘

I/O module connections

I/O modules are used to increase the number of IO points.
VS 70 (In: 1 point, Out: 2 points, In or Out: 2 points) → In: 8 points, Out: 10 points
VS 80 (In: 0 points, Out: 2 points) ->In: 8 points, Out: 8 points

Configuration Tool
In-Sight Explorer for MELSENSOR
Vision
Ethernet cable Ethernet cable

Ethernet cable for

vision sensor
CIO - MICRO
CIO - MICRO
switching hub Dedicated Ethernet
Cave for Vision Sensor

dedicated VS 70 breakout
dedicated VS 80 breakout cable (Connector Type)
cable (Connector Type) 24 VDC 24 VDC
 System Configuration 代理店様外秘

Ethernet Connection + I/O

Connection
This is a connection method for controlling the vision sensor via IO and obtaining measurement
results via Ethernet.
Data other than OK/NG can be acquired by PLC by using Ethernet connection.

Trigger timing deviation is minimum because trigger command is directly input.

Configuration Tool
In-Sight Explorer for MELSENSOR
Vision
Ethernet cable Ethernet cable

Ethernet cable for Breakout cable for

vision sensor VS 80
switching hub Ethernet cable for
POE Switching Hub vision sensor
24 VDC

Breakout cable for

VS 70
 代理店様外秘

4. Simulation on PC and practice on the

demo kit.
代理店様外秘
代理店様外秘
代理店様外秘
代理店様外秘
代理店様外秘
代理店様外秘
代理店様外秘
代理店様外秘
代理店様外秘
代理店様外秘
代理店様外秘
代理店様外秘