Trainingdep Visionsensors En30
Trainingdep Visionsensors En30
vision sensors
industrial imaging
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 1 / 74
copyrights
No part of this publication may be used (in particular reproduced, distributed and placed
in the public domain) nor modified or rearranged without prior written permission of ifm.
Despite utmost care we cannot assume any guarantee for the correctness and
completeness of the contents. Since errors cannot be avoided despite all efforts we
appreciate any comments.
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 2 / 74
introduction
◄
system setup
2D vision sensors
O2D*contour
O2V* object inspection
3D vision sensors
O3D* pmd 3D
q&a
summary
introduction
add-on:
tcp/ip communication
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 3 / 74
Introduction and overview
► Vision sensors allow the monitoring, detection and/or evaluation of complex object
properties and are important tools in many production processes.
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 4 / 74
Applications for vision sensors
Manufacture of cocoa,
chocolate and sugar
confectionery
Control of the mould
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 5 / 74
Applications for vision sensors
Production of
mineral water and
soft drinks
Detection of
missing bottles in
the crate
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 6 / 74
Applications for vision sensors
In combination with feeder bowls
► Feeder bowls supply an assembly line
with parts.
► Here quality control of the parts often
plays a vital role in the production
process
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 7 / 74
Applications for vision sensors
In combination with robots
► Correct rotation and position (coordinates) of parts is imperative for e.g. robotic arms or
P&P machines.
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 8 / 74
introduction
system setup
◄
2D vision sensors
O2D*contour
O2V* object inspection
3D vision sensors
O3D* pmd 3D
q&a
summary
system setup
add-on:
tcp/ip communication
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 9 / 74
Vision system setup
Sensor ↔ PLC (optional)
Sensor ↔ PLC
(optional) Pin 4, Pin 5, Pin 6, Pin 7, Pin 8
Pin 1: TD + TCP/IP Functionality different from O3D to O2D/O2V
Pin 2: RDEthernet
+ IP
Pin 3: TD -
Pin 4: RD -
TCP/IP object
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 10 / 74
Firmware and software
General rules:
► Use the newest firmware and software possible
► Before installing a new firmware, backup sensor programs (applications) and
parameters using the export function.
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 11 / 74
General accessories and crosselling products
► Power supplies
► Mounting set
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 12 / 74
Vision systems: interfaces
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 13 / 74
Sensors ↔ PC
Sensor IP (factory)
O2D* 192.168.0.49
O2V* 192.168.0.59
O3D* 192.168.0.69
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 14 / 74
introduction
system setup
2D vision sensors
O2D*contour
◄
O2V* object inspection
3D vision sensors
O3D* pmd 3D
q&a
summary
2d vision sensors
add-on:
tcp/ip communication
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 15 / 74
2D vision sensors
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 16 / 74
O2D*, O2V* - field of view
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 17 / 74
Contours and areas
► O2D* contour sensor mainly detects ► O2V* object inspection sensor mainly
contours and orientation. monitors areas and colours.
► Taught target needs to be stable ► Taught target may vary in shape
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 18 / 74
O2D* vs O2V*
► Different shape, same area (pixel)
O2D* O2V*
looking for
Object correct? No Yes
the shape
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 19 / 74
O2D* vs O2V*
► Same shape, different orientation
O2D* O2V*
looking for
orientation Object correct? Yes No
desired result
unwanted result
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 20 / 74
O2D* vs O2V*
► Different colour
O2D* O2V*
looking for
contrast Object correct? Yes No
desired result
unwanted result
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 21 / 74
Technical features: O2D* vs O2V*
Main differences between O2D* and O2V*
► Algorithm used for image processing.
► Available light types - luminous colour (white) and infrared illumination
► Corresponding software
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 22 / 74
O2D*, O2V* - construction
Die-cast metal housing rated IP 67
Lens
Microprocessor
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 23 / 74
O2D*, O2V* - common features
► All-in-one design: image sensor, evaluation electronics and
integrated lighting
► Stand-alone usage possible
► Small, industrial-compatible housing
► 640 x 480 resolution
► Powerful internal algorithm that performs in low-light conditions.
► Simultaneous recognition of up to 32 contours
► Simple setup software (including an easy-to-follow 5-step Wizard)
► Very small and robust housing for flexible use
► Easy focus tool quickly defines images
► Allen-Bradley EtherNet /IP and standard Ethernet TCP/IP
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 24 / 74
O2D*, O2V* - price/complexity ratio
Vision systems
High complexity
- troubleshooting
- wiring
- mounting brackets - specialists often required
- installation and maintenance time - additional processing power
- increased integration costs
Sensor clusters
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 26 / 74
Environmental conditions: extraneous light
Try avoiding, reducing or eliminating...
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 27 / 74
Lighting accessories
► Spot and bar lights allow illumination of the scene from
different angles (changing or reducing reflections on shiny objects)
► Ring light increase the front light factor of the sensor.
► Back lights are used to enhance and emphasize contours
► Diffusors can be used to diffuse the emitted light
(reducing reflections on shiny objects)
► Daylight filters help reducing interfering sunlight
Please note:
Custom-made lighting systems are also possible.
(just make sure their frequency e.g. for fluorescent
tubes is higher than 50 Hz.)
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 28 / 74
O2D*, O2V* - tasks
Task O2D* O2V* Task O2D* O2V*
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 29 / 74
introduction
system setup
2D vision sensors
O2D*contour
O2V* object inspection ◄
3D vision sensors
O3D* pmd 3D
q&a
summary
contour sensor
add-on:
tcp/ip communication
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 30 / 74
Rule of thumb: use the contour sensor when...
► ...you are looking for a shape
► ...colour is irrelevant
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 31 / 74
O2D* - working principle
► The sensor finds contours based
Level of detail
on the defined level of contrast
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 32 / 74
O2D* - pattern matching O2D* O2V*
► Identify the orientation by pattern Yes
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 33 / 74
O2D* - shape detection O2D* O2V*
► Presence verification Yes
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 34 / 74
O2D* - orientation detection O2D* O2V*
► Orientation verification Yes
► allowed angle definable
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 35 / 74
O2D - position detection O2D* O2V*
► Object position determination Yes *
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 37 / 74
Camera workshop
► By solving some application examples you‘ll learn something
about...
► ...the hardware and the setup
► ...the software and its parameters
► Different operating modes
► Lighting functions
► ROI and good/bad parameters
► Input/output types, triggering options
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 38 / 74
introduction
system setup
2D vision sensors
O2D*contour
O2V* object inspection
◄
3D vision sensors
O3D* pmd 3D
q&a
summary
object inspection
add-on:
tcp/ip communication
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 39 / 74
Rule of thumb: use the object inspection sensor when...
► ...you are looking for the size of an area,
► and you want to find out if there are any changes to it.
(even changes within it such as holes, scratches etc.)
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 40 / 74
O2V* - working principle
► The sensor finds areas based
Level of detail
on the defined level of pixel
brightness.
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 41 / 74
O2V* - position detection O2V* O2D*
► Detemines if an object is present or missing Yes *
► Regardless of shape and size (O2V* only)
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 44 / 74
O2V* - inner / outer radius, object width / O2V* O2D*
height
Yes
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 45 / 74
O2V* - roundness / rectangularity O2V* O2D*
► Verification of the correct shape Yes
Manufacturing of chocolate
The vision sensor checks if the
chocolate mould is filled correctly.
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 46 / 74
O2V* - hole counting O2V* O2D*
► Determination of the number of holes coming in various shapes. Yes
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 47 / 74
O2V* - object contrast O2V* O2D*
► Differentiation of greyscale colours Yes
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 48 / 74
Camera workshop
► By solving some application examples you‘ll learn something
about...
► ...the hardware and the setup
► ...the software and its parameters
► Different operating modes
► Lighting functions
► ROI and good/bad parameters
► Input/output types, triggering options
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 49 / 74
introduction
system setup
2D vision sensors
O2D*contour
O2V* object inspection
3D vision sensors
O3D* pmd 3D ◄
q&a
summary
3d vision sensors
add-on:
tcp/ip communication
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 50 / 74
3 dimensional data
► O3D* collects distance values from more than 3000 measuring points within a scene
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 51 / 74
3D vision sensors
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 52 / 74
O3D* - function principle
► Based on the time from being sent until having reached the chip → 64 x 48 = 3072 distance
information
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 53 / 74
O3D* - field of view
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 54 / 74
O3D* - features
► 3D sensor for assessment of distance, level or volume.
► All-in-one design: image sensor, evaluation electronics and integrated
lighting
► Stand-alone usage possible
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 55 / 74
O3D* sensor or O3D* camera?
► Sensor and camera have the same hardware
► Difference: software interface and firmware
Sensors:
► provide some pre-installed functions and application solutions
► easy setup via software
► possibility of binary or analogue output
Camera:
► is a product for vision integrators.
► It comes with an sdk (software development kit) and…
► …allows the customer to download of all the 3072 distance values…
► …to calculate an own application in an external PC.
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 56 / 74
Tasks: O3D* pmd 3D sensor
Task O3D*
Distance Yes
Existence Yes
Volume Yes
Level Yes
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 57 / 74
O3D* - distance measuring O3D*
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 58 / 74
O3D* - presence O3D*
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 59 / 74
O3D* - presence O3D*
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 60 / 74
O3D* - volume monitoring O3D*
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 61 / 74
O3D* - volume monitoring O3D*
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 62 / 74
O3D* - volume monitoring O3D*
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 63 / 74
O3D* - level measurement O3D*
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 64 / 74
O3D* - level measurement O3D*
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 65 / 74
O3D* - shadowed areas
Every scene when analyzed by a camera system has
shadowed areas.
O3D*
► These areas can lead to variances when
determining the volume of a scene.
Example:
► The volume measured by the O3D* would be:
A+B+C
B
A C
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 66 / 74
Camera workshop
► By solving some application examples you‘ll learn something
about...
► ...the hardware and the setup
► ...the software and its parameters
► Different operating modes
► Lighting functions
► ROI and good/bad parameters
► Input/output types, triggering options
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 67 / 74
introduction
system setup
2D vision sensors
O2D*contour
O2V* object inspection
3D vision sensors
O3D* pmd 3D
q&a
◄
summary
questions &
answers
add-on:
tcp/ip communication
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 68 / 74
Questions and answers
► Which sensor would you recommend for this application and why?
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 69 / 74
Questions and answers
► Which sensor would you recommend for this application and why?
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 70 / 74
Questions and answers
► Which sensor would you recommend for this application and why?
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 71 / 74
introduction
system setup
2D vision sensors
O2D*contour
O2V* object inspection
3D vision sensors
O3D* pmd 3D
q&a
◄
summary
summary
add-on:
tcp/ip communication
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 72 / 74
Summary
Vision sensor @ ifm
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 73 / 74
contact
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 74 / 74π
introduction
system setup
2D vision sensors
O2D*contour
O2V* object inspection
3D vision sensors
O3D* pmd 3D
q&a
summary
add-on
tcp/ip communication
add-on:
tcp/ip communication ◄
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 75 / 74
Process connection via TCP/IP (e.g. O3D*)
► Step 1:
Configure the O3D* for TCP/IP access using the “Process interface configuration
software“ (see download area on ifm homepage)
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 76 / 74
Process connection via TCP/IP
► Step 2: send commands and receive data e.g by using WindowsXP hyperterminal:
Start->Programs->Accessories->Communication->Hyperterminal->New Connection
► Alternatively use another terminal software e.g. “Putty“
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 77 / 74
Setting up the command-syntax
► To select the “simplest“ protocol (and command syntax) type in:
0000v01 (aknowledge by pressing “enter“)
Output (confirmation):
0000*
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 78 / 74
Replies to commands
► Case: Command does not exist…
e.g.: “U“ then “?“ is replied
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 79 / 74
Commands (excerpt)
► D?
Device Information
► E?
Error Detection (if Errorcode unequal 0000, see Appendix of “Process Interface Manual“)
► s?
Showing statistics like “amount of trigger events“, “sensor temperature“ etc.
► R?
Trigger-event and output of the previously defined (in the “Process Interface configuration
software“) data
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 80 / 74
Commands (excerpt)
► a?
Displays the number of applications and the available ones.
► Example:
c002
Use always with O3D* Application 2
©2015 ifm electronic gmbh, training department, vision sensors, defriemr 3.0c 81 / 74