Scribd
Upload
244 views29 pages

TS9566 Extending Machine Vision in LabVIEW To 3D Applications

This document provides an agenda for the NIWeek Vision Summit occurring on August 7-8, 2012 in Austin, Texas. On the first day, sessions will cover topics such as using FPGAs vs. multicore processors for machine vision, extending machine vision in LabVIEW to 3D applications, visual servoing using RIO technology, and vision inspection for wafer defects. The second day will feature sessions on new features in the NI Vision Development Module 2012 including 3D vision, vision at high speeds, optics and lighting best practices, applying industry standards, and USB3 Vision. Keynote speakers will discuss the embedded vision alliance and the evolution of embedded vision.

Uploaded by

Nilesh Vaidya
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
244 views29 pages

TS9566 Extending Machine Vision in LabVIEW To 3D Applications

This document provides an agenda for the NIWeek Vision Summit occurring on August 7-8, 2012 in Austin, Texas. On the first day, sessions will cover topics such as using FPGAs vs. multicore processors for machine vision, extending machine vision in LabVIEW to 3D applications, visual servoing using RIO technology, and vision inspection for wafer defects. The second day will feature sessions on new features in the NI Vision Development Module 2012 including 3D vision, vision at high speeds, optics and lighting best practices, applying industry standards, and USB3 Vision. Keynote speakers will discuss the embedded vision alliance and the evolution of embedded vision.

Uploaded by

Nilesh Vaidya
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 29

NIWeek Vision Summit

August 7-8, 2012 Austin, Texas

www.ni.com/niweek/summit_vision

NIWeek Vision Summit


August 78, 2012

Austin, Texas

Extending Machine Vision in LabVIEW


to 3D Applications
Gianbattista Gualeni
[email protected]
Ignazio Piacentini
[email protected]
Carles Matabosch
[email protected]

NI Week 2012, Austin, TX

Agenda

Introduction to 3D vision
Tools for real applications
3D Using LabVIEW
Pass / Fail using 3D
From CAD to Cloud Of Point (COP)
Robots as 3D device
Examples
Conclusions
NI Week 2012, Austin, TX

Introduction: Moving from 2D to 3D


Machine Vision is moving from 2D to 3D
Stereo vision
Structured light / fringe projections
Laser triangulation/ laser profiling
TOF (Time of flight)

The MV market is offering right now


more 3D hw than 3D software

Example of applications: 3D adds


significant improvements to robot
guidance / bin picking

NI Week 2012, Austin, TX

Laser Triangulation and Industrial 3D

laser line

The object or the camera


need to move
The camera acquire a
sequence of 3D profiles

3D camera
3D camera

scanned object
linear stage
NI Week 2012, Austin, TX

3D Peak Detection from Laser Light Line


Grey level representation of single
vertical transition

Source Image

Determination
of the maximum
value position
up to 1/64th of
a pixel

Reconstructed Laser Projection

A single point is obtained for each line


across the laser stripe.
This point is obtained at sub-pixel
accuracy at a maximum of 1/64 pixel.

NI Week 2012, Austin, TX

Range Map
The range map is a accumulation of
profiles
White pixels are the highest points
Black pixels are the lower points
The intensity of each pixel
represents an height, but not in
metric units

NI Week 2012, Austin, TX

Occlusions and Merging


Two or more cameras overcome occlusions

NI Week 2012, Austin, TX

Metric Calibration
Calibration pattern
Perspective distortion compensation
From pixels to real measures: fraction of
millimeters or inches

NI Week 2012, Austin, TX

10

Cloud of Points (COP)


Set of organized 3D points (x, y, z)
The COP values correspond to real world dimensions

NI Week 2012, Austin, TX

11

COP Cleanings

Plenty of issues need to be addressed to obtain good quality 3D images


(material surfaces, signal/noise level, reflections, and so on)
Outliers are essentially unwanted points of the acquired COP

outliers

NI Week 2012, Austin, TX

12

Z-Map
Planar projection of the COP on to the plane with
equation z = 0
Useful to measure features using 2D tools

Orthogonal projection
onto the Z plane

NI Week 2012, Austin, TX

13

COP Rotation
Not all the feature are normal to Z
This create a distortion in the Z Map
We can rotate the COP before the projection

This is not
circular

This is
circular
With Rotation

Without Rotation
NI Week 2012, Austin, TX

14

Vision Development Module 2012


The new VDM2012 Stereo palette complete 3D-MVL

NI Week 2012, Austin, TX

15

Stereovision to COP

NI Week 2012, Austin, TX

16

3D-Machine Vision Library (3D-MVL)

3D-MVL library is currently undergoing certifications as part of the LabVIEW Tools


Network Program
The library is a porting in LabVIEW of the AQSENSE SAL3D dll based library

NI Week 2012, Austin, TX

17

3D-MVL Palette
Full range of tools:
Peak finder
COP
Manipulation
Merger
Metric
calibration
Z Map
Match 3D
NI Week 2012, Austin, TX

19

Standard 2D Tools on 3D Features


Circle diameter measurement

NI Week 2012, Austin, TX

20

Match 3D
Using the Match 3D we can compare an object to a
reference and see if it is valid or not checking the
number of disparity points.

NI Week 2012, Austin, TX

22

From CAD to COP


Using a CAD Import tool
could, we can generate
the Golden Model from
CAD
Then using Match 3D
we can compare the
model and the result

NI Week 2012, Austin, TX

23

Robots are 3D devices

The core business of


ImagingLab is the tight
integration of Vision and
Robotics
2D Vision has been used
extensively for robotics
guidance and integration
Robots are intrinsically 3D as
they move in a 3D space
3D vision is gaining market
space for many Vision-Robot
applications

J6

J4
J5
J3
J2

NI Week 2012, Austin, TX

J1

6 axis robot

24

Angular scanning

One Joint at time


No Vibration or ripple
High accuracy
Flexibility
After a metric calibration, the result
is a calibrated Cloud of Points

Watch the video


NI Week 2012, Austin, TX

Disk

25

4 Robots and 360 scanner at


Automatica in 2010
Four different brand,
controlled from LabVIEW
insert objects in a 360
3D scanner.
Now we have library for:
Denso
Mitsubishi
Toshiba
Kuka
Kawasaky
Yaskawa Motoman
Watch the video

Disk
NI Week 2012, Austin, TX

26

360 3D Scanner
A dedicated scanner for
constant-weight portioning for
the food industry

Watch the video Disk


NI Week 2012, Austin, TX

27

Conclusions
Using 3D-MVL we expand 3D functionalities already in the
Vision Development Module 2012
Using LabVIEW, Robotics Libraries and 3D-MVL we can
have an unlimited range of applications.
We can have example in industrial robotics, bin-picking, inline quality inspection, food processing, testing, etc
The 3D-MVL Library is available via the NI LabVIEW Tools
Network
For further information: www.imaginglab.it
[email protected]

NI Week 2012, Austin, TX

28

Q&A

Thanks for your attention


NI Week 2012, Austin, TX

NIWeek Vision Summit


August 78, 2012

Austin, Texas

Keynote
Embedded Vision Alliance

Tuesday, August 7
1:00-2:00

Inside the Thunderdome FPGAs vs. Multicore Processors

National Instruments

10:30-11:30

Extending Machine Vision in LabVIEW to 3D Applications

ImagingLab

2:15-2:45

Visual Servoing Using RIO Technology

National Instruments

2:45-3:15

Vision Inspection for Defects in Wafer Fabrication Process

Graftek Imaging

3:30-4:00

Automated Seed Germination Monitoring System With Multispectral and Color Image
Analysis

Coleman Technologies

4:00-4:30

Best Practices: Image Calibration

National Instruments

4:45-5:15

Aligning and Calibrating Multiple Line Scan Cameras for Web Inspection

PVI Systems

5:15-5:45

Getting Started With LabVIEW FPGA for Vision Applications

National Instruments

10:30-11:30

Whats New in the NI Vision Development Modules 2012 3D Vision and More

National Instruments

1:00-2:00

Vision at Mach 1

GE Global Research Center

2:15-3:15

Optics and Lighting Best Practices

Edmund Optics

3:30-4:30

Applying Industry Standards in Imaging

Procter and Gamble

4:45-5:15

USB3 Vision in a Nutshell

National Instruments

5:15-5:45

Keynote: The Evolution of Embedded Vision


Tuesday, August 7

Wednesday, August 8

You might also like