Professional Documents
Culture Documents
OT Eyes UserGuidev2.1.1.0
OT Eyes UserGuidev2.1.1.0
OT Eyes UserGuidev2.1.1.0
User Guide
2/63
OT_Eyes diagram....................................................................................................................................... 6
TCPIP ....................................................................................................................................................... 10
Configuration ............................................................................................................................................ 21
3/63
Summary .................................................................................................................................................. 42
Automatic mode........................................................................................................................................ 44
Troubleshooting ......................................................................................................................................... 47
Drivers ......................................................................................................................................................... 49
Sherlock ...................................................................................................................................................... 50
OT_Eyes ...................................................................................................................................................... 56
4/63
....................................................................... 56
5/63
Sherlock is software provided by Teledyne Dalsa, a company specialized in vision systems. Each inspection
program (ivs files) will be developed with Sherlock and will be loaded by the OT_Eyes plug-in which can be
assimilated to a user interface for production.
The number of plugin is not limited.
OT_Eyes diagram
OT_Eyes
…
Plug-in Plug-in Plug-in Plug-in Pluggin
Dual Wirepad Embedding Support XXXX
Sherlock
kernel + ivs
Sherlock
kernel + ivs
Sherlock
kernel + ivs
Sherlock
kernel + ivs … Sherlock
kernel + ivs
Dual User
interface
Dual User
interface
Dual User
interface
Dual User
interface … XXXX User
interface
6/63
Communication
Plugin
OT_Eyes
Wirepad
Plugin
Camera
7/63
Language folder
8/63
To start the OT vision software, run c:\OT_Eyes\OT_Eyes.exe or use the desktop shortcut:
If you are trying to start OT_Eyes on a non-administrator account, please refer to Annex 1 on OT_Eyes
installation procedure.
The following page is opened:
This window allows you to start the plug-in installed on your machine. To run, click on the button corresponding
to the plug-in you want to start:
- Dual : milling inspection of standard dual cards
- Wirepad : milling inspection for wirepad dual cards
- Contact : milling through inspection
- Calibration : allow to calibrate system (mechanical and lens adjustments)
- Photometrie : check the color calibration
- Reference : check the calibration drift during production
- Configuration: machine communication configuration
- Help: Support plug-in to get image and to test communication protocols.
- Exit : Close OT_Eyes
9/63
After starting OT_Eyes.exe, click on the configuration button to start the plug-in . The following
window is shown:
This page give you the possibility to configure the communication mode between machine and OT_Eyes.
This communication allow machine to request the inspection of the current card and allow OT_Eyes to
provide results to the machine.
Communication interface can be Ethernet, serial or IO cards.
TCPIP
10/63
Serial (RS232)
Test communication
Once configuration done and saved, you can test it with the lower panel of the page
11/63
After starting OT_Eyes.exe, click on the copper pad button to start the plug-in . The following window is
shown:
To start the production you must choose the Card reference (M3, M4 or M5) and the type of card (PVC, PETG
or Metal), fill in the Workorder and module number, and then click on the “Start” button.
The Stop button will be shown once camera and communication initialization will be done.
A new option is available to change the shutter for PETG, there is 2 radio button 1 for new tool for the milling
and one for used tool when the milling starts to shift and the vision needs a little adjustment
During the production you can choose a different view in the Sherlock camera visualization. To change this
view, click on the combo box in the bottom of the image:
12/63
PVC Configuration
Inspection criteria
Four qualities criteria are inspected with the vision inspection software:
1. Pads position checking for the good position of copper pads into the milling (regarding to
the top inner cavity edge)
2. Pads presence left and right checking if the copper pads are at least 70% of the surface for
both pads (no lack)
13/63
4. Milling Through checking, detects if the inner cavity isn’t pierced. Check if some pixels in
the inner cavity are not in a good range of the average luminosity of the cavity.
14/63
Inspection criteria
Five qualities criteria are inspected with the vision inspection software:
1. Pads position checking for the good position of copper pads into the milling (regarding to
the top inner cavity edge)
2. Pads presence left and right checking if the copper pads are at least 70% of the surface for
both pads (no lack)
3. Pads aspect on the left and right checking for the good milling quality of the copper pads
with at least 70% of the surface on both sides (shiny aspect)
15/63
5. Milling Through checking, detects if the inner cavity isn’t pierced. Check if some pixels in
the inner cavity are not in a good range of the average luminosity of the cavity.
16/63
The “Apply” button validates the tolerances modified in the current program without saving in the main program.
The “Save” button load the values in the main program of Sherlock.
17/63
18/63
Start inspection
Yes
No
Position OK ?
Yes
No
Presence OK ?
Yes
No
Aspect OK ?
Yes
No
Tearing OK ?
Yes
19/63
After starting OT_Eyes.exe, click on the embedded button to start the plug-in . The following window is
shown:
To start the production you have to choose your chip type (M3, M4, M5) and the card type (Standard, Monzo,
Amex or MotionCode), then click on the start button.
The Stop button will be shown when camera and communication initialization will be finished.
During the production the user has some live data:
- Calculation results (more details on configuration part)
- Results of the currents inspection
- Counter of good and bad cards since the plug-in has been started
During the production you can choose a different view in the Sherlock camera visualization. To change this
view, click on the combo box at the bottom of the image:
20/63
Configuration
Each parameter, that defines whether a card is good or bad, has a tolerance which can be changed. To access
these parameters, you must be logged on as an administrator. To log in, go to the General Menu and click on
A new feature is available to enable the Milling Through for admins, this option should be unavailable while
you are not logged in as “Admin” or “Super Admin”. To do so, go to the General Menu and click on and
fill in the password box with “op3” then validate. This option is designed to team leaders, if they can verify that
the batch in progress is good and the Milling Through is not working for Core Color or something else, they
can disable it temporarely.
21/63
22/63
In this sample:
- 12449 pixels are found for the right wire -> OK
- 8379 pixels are found for the left wire -> OK
- 113 pixels are found in the P2 milling area -> Snatching
Software diagram
Start inspection
No
P1/P2 detect OK ?
Yes
No
Position OK ?
Yes
No
Missing wire OK ?
Yes
No
Aspect OK ?
Yes
No
Tearing OK ?
Yes
23/63
After starting OT_Eyes.exe, click on the contact card button to start the plug-in . This window should be
displayed:
To start the production, you need to select the chip type (M3, M4, M5) and your card type (Standard or Tacho),
and then press the Start button.
The STOP button should appears when the camera and communication will be ready. Now it should give you
some data on the production.
Firstly, you have 3 check boxes to select if you want to analyze some data during the investigation. Either the
milling through to check if the back of the card is pierced, the cavity shift, to check if the cavity is on the right
position and if the milling is sufficient.
And at last, the Pad detection, to check if a pad is present, this option should be unavailable while you are not
logged in as “Admin” or “Super Admin”. To do so, go to the General Menu and click on and fill in the
password box with “op3” then validate.
24/63
Pad Detection
The Pad detection is used to make sure the batch ran through the machine is correct and doesn’t contain
copper pads. The detection is almost the same as the one in Dual Pad but instead of rejecting if the pad isn’t
present, it rejects if it detects a pad.
Milling Through
The Milling Through detection makes sure the back of the card is not milled, it can also be detected when the
background is really thin and almost pierced, because sometimes the milling can be visible on the back of the
card. The Milling Through checks if some pixels in the inner cavity are not in a good range of the average
luminosity of the cavity.
25/63
Start inspection
Yes
No
Position OK ?
Yes
Yes
Presence OK ?
No
Yes
Milling Through?
No
26/63
After starting OT_Eyes.exe, click on the FCode button to start the plug-in.
27/63
The Stop button will be shown when camera and communication initialization will be finished.
During the production the user has some live data:
- Calculation results (more details on configuration part)
- Results of the currents inspection
During the production you can choose a different view in the Sherlock camera visualization. To change this
view, click on the combo box at the bottom of the image:
28/63
Those tolerances can be configured in the Parameters tab on the left part of OT_Eyes:
29/63
1
X and Y coordinates of each copper pad.
For example:
For Pad 1:
Ref
X=510 Y=170
Detected
X=450 Y=170
30/63
This control will check if the milling has been correctly done. This is done by detecting pad color and
generating a image corresponding to:
- Black pixel = good milled copper
- White pixel = all other part of the card
Then, for each pad, a count of black pixel is done and compare to a theorical value. In parameter part you can
configure:
Check the box to control pad aspect. Uncheck to
disable it
Number of pixel for a full copper pad
31/63
Software diagram
Start inspection
No
Detect copper ok?
Yes
No
Aspect OK ?
Yes
No
wire not present?
Yes
32/63
This plug-in is a help for support and installation test. To start it, start OT_Eyes and click on the button
It allows a live view of the camera and testing of the communication between the machine and OT_Eyes.
33/63
Once the plug-in is started you have the option to save the images from the camera by clicking on the lens
configuration files. For that, click on the zip button and send the generated package to the Vision
software support team.
Communication test
Input Output card
This part allows you to communicate with the input/ output card. This card is used in some machines to do the
interface between machine automaton and OT_Eyes.
This card is composed of 8 relays, 4 named “port high” and 4 named “port low”. The configurations in all
machine are as follow:
- Port High = input (read information from machine)
- Port Low = output (send information to the machine)
To be able to change the output relay state or to read the input relay state, you must first click on the start
button . Then you can read on the 8 LEDs the states of each relay:
- Red = relay off
- Green = relay on
In case of output relay you can manually change the state of it by clicking on the led button.
34/63
This part will allow the user to log all communication sent by the machine via RS232. For that, choose the
communication port which is use to dialogite with the machine into the list. And press on the connect button
. Once done, all communication received by the computer will be show in the list box.
Those logs can be saved into a file by clicking on the export button .
Once completed, the communication can be ended by clicking on the disconnect button
35/63
First of all, insert the “Grey calibration card” under the camera and center it.
Check the aperture of the lenses which must be set to 8 (cf picture below) => this not the final set up.
Execute file: uEyeCockpit software situated on the desktop and choose “No profil” button
36/63
For that, click on menu: File->Load parameters->From file… and choose the file located in
c:\OT_Eyes\CameraParameters\uEyesParam.ini
Check AES/AGC, Image, Format, Taille tab and disable all auto mode mainly gamma check box. In Image
tab, set shutter value to 4 ms.
Then, we must execute the white balance. Go to camera parameters . Then in AWB tab, select Auto(Grey
world) and click on “Execution unique”
37/63
38/63
This serial number can be found in the title bar of uEye Cockpit (see image above).
Then you can close the uEyeCockpit software.
39/63
Set the aperture of the lense to 0 and increase it until you get 116 value for the current luminosity (top right in
OT_Eyes calibration)
Once done, the software shutter will be calculated automatically by pressing “Start measurement” button. The
software will test several shutter value and will choose the best one:
The correction coefficient must be close to 1 and luminosity must be close to value 105 (green value for both
parameters). If not refer to the Help tab.
Correction coeff. : the optimal value for this coefficient is between 0,9 and 1,1.
If the message “Warning! Light Flatness is incorrect please check your configuration” is written in the image
window, you need to adjust the light position to make it almost the same everywhere.
To guide you, you can select the imgAvgLumSquares image window, if the square is red, the light is too low,
if the square is blue, the light is too high.
If your flatness is not correct, you can run the program without any issue, this is just to prevent some problems
with lightness analysis in some investigation.
40/63
Once shutter calculated and ok, we must setup the camera positioning. For that, place the checkerboard card
under the camera:
41/63
®+ +®
Detection of the
specific points
on the + +
® ®
reference card
Current dot Ref point
Once all value are in green in the right of OT_Eyes, the calibration part will be enable.
If all values are ok you are done for the calibration. If not, refer to the help and restart the full calibration
process.
Summary
42/63
43/63
Automatic mode
An automatic mode is available and allows to directly communicate with the machine. Place your card in the
input magazine, click on start button in ot_Eyes and start your transfer batch on the machine. Only vision
station must be activated on the machine.
Once the card will be on the vision station, the card will be checked and sorted in the OK or NOK output
magazine.
44/63
This plugin allow to check if vision system is still well setup and if vision system is still available to check dual
cards. It will check camera position, color and measurement.
This test must be done every XXXXXX cards to be sure that the system has not derivate.
Place the reference card under the camera:
45/63
Automatic mode
An automatic mode is available and allows to directly communicate with the machine. Place your card in the
input magazine, click on start button in ot_Eyes and start your transfer batch on the machine. Only vision
station must be activated on the machine.
Once the card will be on the vision station, the card will be checked and sorted in the OK or NOK output
magazine.
46/63
When clicking the icon of a plug-in, a new window appears but there is a
47/63
Hardware installation
110
mm
Optical adjustement :
Apperture = 8
110 mm
48/63
Then a list of drivers is shown and driver has to be selected according to your hardware (usually Intel driver).
Download and install the file.
49/63
Sherlock installation
For installing Teledyne DALSA Sherlock, execute the setup package Sherlock7_x86_Setup.exe which you
can find on the Sherlock DVD in the folder _Sherlock7.3.1.1
Then configure the line “Angles’ unit of measure” to Degrees and the line “Use more accurate but slower…” to
“False”
50/63
51/63
Select your camera and click on button “Configuration automatique ETH” to configure camera communication.
52/63
Double click on first camera and put something under camera to know which one we are speaking about.
Camera 1 or camera 2. Camera 1 is the camera nearest the milling station. Camera 2 is the camera nearest
output magazine.
Once we know if camera is 1 or 2 then open again IDS camera manager and click on Camera information and
change the number accordingly.
53/63
If error message is displayed about intel i5 then change settings like below. In IDS manager, click on button.
Additional functions and set settings like picture below.
54/63
To install OT_Eyes, you need to copy the folder OT_Eyes and the folder opencv to the root of your C disk at
“C:\”.
Then, on the OT_Eyes folder there is a SherlockDrivers folder. Launch the executable
OT.Eyes.SherlockDriverInstaller.exe as Administrator. Enter the serial number of your camera(s). Click Install.
Now your camera drivers are configured. Please refer to the “Plug-in Calibration” if you will have administration
rights during production, if not, keep reading the next section.
Next step, in the Package, go in the “Dependencies” folder, and copy the UsrImgProcLib.dll. In the URL
section, at the top of your File Explorer write %SP7HOME64% as seen below. Go in the Plugins folder and
paste the UsrImgProcLib.dll.
Go to the Environment variables, click on the Windows icon on your task bar, start writing “environment
variables” and select “Modify your environment variables”, click on Path on the second table and the button
“Modify” and Add “C:\opencv\build\x64\vc15\bin”, as seen below.
For the latest version of Sherlock (version 7.3.1.1), the engine needs administration rights to start. If your user
account to start OT_Eyes is not administrator, you will need to install “RunAsTool”.
Step 1:
In the OT_Eyes package in the Drivers folder, you will find the RunAsTool folder. Copy it in “C:\Program
Files(x86)” then open it and create a shortcut of “RunAsToolx64.Exe and put it on the desktop.
56/63
Step 3 :
OT_Eyes should be added to the list of software that will run as administrator. If you double-click the
OT_Eyes.exe icon, it should run perfectly. To make it easier for everyone, we are gonna create the shortcut
for OT_Eyes, just right-click the icon and select “Create a shortcut”, and then click “Save” as the Desktop
should be the standard location.
If the program start and you can launch any Plug-in, please refer to the “Plug-in Calibration” now.
57/63
58/63
Snatching
Raised pad
59/63
60/63
Snatching
61/63
62/63
Franck LE CHARPENTIER
Manufacturing Equipment Support Engineer | Oberthur Technologies
Avenue d'Helmstedt - La Haye Robert - BP90308 - 35503 VITRE Cedex - FRANCE
T: +33 (0)2 90 70 90 37 | F: +33 (0)2 99 74 18 35 | M: +33 (0)7 86 66 13 00
E-mail : f.lecharpentier@oberthur.com - Web : www.oberthur.com
Damien LANGLOIS
Corporate & regional management project engineer / Oberthur Technologies
Avenue d'Helmstedt - La Haye Robert - BP90308 - 35503 VITRE Cedex - FRANCE
T: +33 (0)2 90 70 90 23 | M: +33 (0)63 39 07 78
E-mail:d.langlois2@oberthur.com - Web: www.oberthur.com
63/63