Robotic Vision System

“Robotic vision” is among the latest innovations in robotic and automation technology.
Essentially, robot vision is a sophisticated technology that helps a robot, usually an automated
robot, better identify things, navigate, find objects, inspect, and handle parts or bits before an
application is performed. Robot vision usually uses a series of carefully-calibrated algorithms,
calibration, and even temperature detection sensors that all have a varying range of complexity
and application. Just as technology rapidly accelerates in sophistication, robotic vision is
constantly improving and moving in smoother directions. This innovative, yet simple technology
can cut operation costs and create a straightforward solution for all types of automation or
robotic needs. Robots working side by side, when fitted with robotic vision technology, won’t
collide with each other. There is also enhanced safety for human workers, as the robots will be
able to “see” any workers who are in the way. Robots fitted with robotic vision technology can
perform a series of different tasks:
 Measuring;
 Reading barcodes and scanners;
 Engine part inspection;
 Packaging inspection;
 Wood quality inspection;
 Surface inspection;
 Guidance and checking orientation of components and pieces;
 Inspecting for defects.
The process of robotic vison works in two simple steps:

1. Imaging: The robot uses its vision technology to do its scanning or “seeing.” It can scan
two-dimensional things like line scanning and barcode scanning, as well as 3D imaging
and X-ray imaging for inspection purposes.
2. Image Processing: After detecting the object or image, the robot processes it, or “thinks
about it.” For instance, it finds and detects edges, the presence of an obstruction, counts
pixels, discovers and manipulates objects according to its programming, recognizes
patterns, and processes the imagery according to its programming.
Depending on this process and the algorithm used to govern the actions of the robot, a certain
part will be assembled, a default in a product may be detected, a product may be scanned and
recognized, etc. Robotic vision technology can be applied practically as far as you can imagine,
and is already being used in a series of industries, including automotive, industrial,
manufacturing, food and product packaging, and parts assembly. Concept Systems has the
capabilities to integrate robotic vision technology, retrofit old robots with newer control systems,
provide innovative solutions to your automation and robotic technology, and manage all aspects
of the conception and integration.
Machines with Ability to see things
Strictly speaking, a robotic vision system is a technology that enables a robot to “see.” These
systems enable the machine to be able to identify, navigate, inspect or handle parts or tasks.
A robotic vision system consists of one or more cameras connected to a computer. The computer
contains a processing software program that helps the robot interpret what it sees. Then, the
robot follows the program’s instructions—specified by the manufacturing facility’s staff—to
complete the specified task. Additional elements, such as lighting, image sensors,
communications devices or other components, can be incorporated to add to the machine’s

overall capabilities.
Fig: 1-Vision system installed on industrial robot

The capabilities for robotic vision systems are seemingly endless. Robots can be used to handle a
wide variety of tasks, such as:
 Product sorting;
 Product assembly;
 Measuring;
 Depalletizing.
Another capability for robotic vision systems is switching between parts and products on the
same line. A robotic vision system could determine the difference between two products being
built and select the appropriate part to be installed at that step in the process. This allows for
greater flexibility to construct different units on the same line without the need to reprogram a
“blind” robot that is expecting the same thing every time.
A robot’s vision system consists of a number of essential components, which include the camera
that captures a picture, to the processing mechanism that provides and communicates the result.
For any machine vision system to work dependably and produce results that can be repeated, it is
important how these essential components interact.
 Fig: 2-Machine Vision System
Types of Robotic Vision Systems
The development of robotic vision systems has significantly advanced the scope of robot
applications. Industrial robots guided by machine vision are capable of handling more complex
processes. For instance, a FANUC M-20ia integrated with a vision system can automate
inspection processes for quality control of finished products before they are packaged for
shipment. Its vision system allows it to detect microscopic defects too small for a human to see.
Robotic vision systems can be one or multi-dimensional. Having an understanding of each vision
system type will help you determine which one will be best suited for your application.
 1D Robotic Vision
1D vision systems involve the use of one-dimensional cameras to analyze the digital signal of a
single group of lines at a time and compare variations between previous and current line groups.
Robots with 1D cameras are typically used to inspect the surface of parts manufactured in a
continuous process. 1D vision systems are the least common type in robotics since many
manufacturers are looking to automate more complex processes.
 2D Robotic Vision
2D vision systems are the most common type of robotic vision. 2D systems can provide views of
objects on both X and Y planes. There are two types of 2D vision systems, area scans and line
scans. Area scans provide a 2D snapshot of an object but are limited when it comes to capturing
rounded parts. Line scan vision builds a 2D image by capturing each line of a part and piecing
them together to form it as a whole, similar to how a document scanner works. Line scans are
often used in tight spaces, for cylindrical parts, and to capture continuously moving objects in
high resolution. Both types are best for simpler applications involving a high level of
repeatability. Processes involving the picking of the same part type over and over from the same
location would be a good fit for 2D robotic vision. The FANUC LR Mate 200id is an ideal
choice for deploying 2D vision for simple pick and place applications.
 3D Robotic Vision
3D vision systems have been gaining popularity in the robot world in recent years. 3D systems
provide imagery feedback to robots on all six degrees of freedom of an object, similar to viewing
an object in real life. Robotic 3D vision has advanced the depth of robot applications. With 3D
vision systems robots have the autonomy to recognize and determine how to adjust to variations
in part types, locations, orientation, environment, and applications while operating. These vision
systems can be used for assembly, pick and place, part transfer, palletizing, and even welding
applications. Integrating 3D vision with the ABB IRB 2600 gives it the ability to automate
complex assemblies due to enhanced visual guidance.
 4D Robotic Vision
The future of robotic vision systems will most likely be moving towards 4D. In 2017 engineers
at Stanford University developed a 4D camera that can be integrated with robots. While the
camera is still being tested and going through prototyping researchers are excited about its
potential. The 4D system captures 140 degrees of information to identify features including
depth, finish, shape, and transparency. Images can even be refocused to allow robots to see
through obstructions.
Benefits of a Robotic Vision System
While using robotic systems helps with general efficiency and productivity of an assembly plant,
there are additional benefits that accompany the incorporation of a vision system with that robot.
Robots can be more precise and productive. Rather than requiring a stack of parts to be perfectly
placed in alignment and orientation, a vision system can enable a robot to pick the correct part
out of a bin of assorted products. This
requires far less time to prepare the parts
for installation in the assembly process.
Additionally, vision systems allow robots
to have greater flexibility. A robot can
identify where on the product it needs to
complete its operation based on sight,
rather than requiring a specific placement.
Vision systems also offer greater quality
control. When used for analyzing an
object, a camera can magnify an image,
allowing the robot to determine
imperfections that would otherwise go
unnoticed by a manual, human scan.
These are some of the top benefits of
using vision systems to guide robots.
Fig: 3- Robotic VS for application of inspection.
  Automates manual steps and processes;
 One camera can replace multiple sensors;
 Speeds production and increases throughput;
 Greatly reduces programming effort to guide robot;
 Increases flexibility of the robot and Eliminates expensive fixtures;
 Recipe-driven production reduces changeover times;
 Allows for less precise positioning of parts;
 Less expensive and more precise robots can be used;
 Allows a robot to perform multiple tasks;
Robotic Vision System Applications
Conveyor tracking is often useful in packaging applications. The product moves into the robot
cell on a conveyor without stopping. A FANUC vision system determines accurate belt position
and the robot controller adds speed information from the belt encoder — letting the vision
system robot track and pick while the product is in motion. This eliminates any need to stop the
belt or use expensive fixturing. Rather than presenting every piece in precisely the same location
and orientation for the robot to pick up, a vision system simplifies cell design and can lower
costs, making robotic automation even easier to justify. Applications include;

 Inspection: Inspection tasks can be carried out by integrating machine vision and robots.
Machine vision is used to make checks for visual factors such as surface finish, dimensions,
potential errors in labeling, and the presence of holes and other elements. Machine vision can
carry out these tasks faster and with fewer errors than humans can, meaning that production
becomes faster and more profitable as a result.
 Identification: Machine vision can be incorporated in robotics, giving them the skills of
object detection to allow for identification and the classification of numerous objects
simultaneously. Machine vision looks for the “variable” part of the object, the bit that is
different and sets it apart, in order to successfully identify it. This can help robots in
warehouses to find the right item quickly, this speeds up production, and can also make retail
processes more efficient.
 Navigation: Machine vision is used to enhance and correct data coming in through other
sources in order to move robots safely and autonomously in a dynamic environment. Other
measures of incoming data, such as accelerometers and encoders, can relay small errors that
add up over time.
 Quality Control: Through the capabilities of inspection and identification, machine vision
can be reliably used in quality control applications. The machine vision techniques of
inspection and identification are combined in order to assess whether products meet various
quality control checks. This has the impact of making production more efficient and cost-
effective.

 Assembling: Research has shown that machine vision can be integrated with robotic systems
to create pick and place capabilities. Together, the system can accurately pick the correct
assembly parts from the storage station and put them in the right assembly spaces and on the
appropriate parts where they need to be fixed. This gives the possibility of automated
assembly lines with the use of robots with machine vision.
 Locating Parts: Using inspection and identification, a robot with machine vision can select
required parts by classifying them through their unique visual features. This allows
production equipment to be able to automatically locate and identify items, speeding up
production processes and reducing the required manpower.
 Transporting Parts: A data processing framework is currently being developed that seeks to
have the capabilities of interpreting the floor within a scene. Machine vision is being used to
process the information of the surroundings and analyze it in order to feedback movement
instructions to the robot.
These applications are just the beginning of how machine vision will be used in robotics. Many
applications are still in the laboratory, and as the development of machine vision increases, so
will its applications in robotics. The industries that will benefit from these applications of
machine vision in robotics are numerous.