Skyblue - Operations: Operating Manual
Skyblue - Operations: Operating Manual
0
Metrology LAB LTD
©2018-2021
SkyBlue – Operations
Purpose of the system .................................................................................................................................. 4
Parameters .................................................................................................................................................... 4
System Architecture and cabling .................................................................................................................. 4
Measurement sensor (Head) .................................................................................................................... 5
Controller .................................................................................................................................................. 5
HMI Display ............................................................................................................................................... 7
Cabling....................................................................................................................................................... 7
Head to Controller ................................................................................................................................ 7
HMI to Controller .................................................................................................................................. 7
Robot to Controller ............................................................................................................................... 7
SkyBlue Client................................................................................................................................................ 8
Starting the client...................................................................................................................................... 8
Visualization of results and parameters adjustment ................................................................................ 8
Parts of visualization screen ................................................................................................................. 9
Title bar ............................................................................................................................................. 9
Control buttons ............................................................................................................................... 10
View ............................................................................................................................................................ 10
VIEW – OBJ .......................................................................................................................................... 11
Image................................................................................................................................................... 12
Presets..................................................................................................................................................... 12
Joint types ........................................................................................................................................... 12
Standard parallelogram plates ........................................................................................................ 13
Filet ................................................................................................................................................. 13
Corner ............................................................................................................................................. 13
But ................................................................................................................................................... 14
LAP .................................................................................................................................................. 14
Cut parallelogram plate .................................................................................................................. 14
1
Operating Manual-1.0
Metrology LAB LTD
©2018-2021
V groove .......................................................................................................................................... 15
HV groove........................................................................................................................................ 15
Concave parallelogram plate .......................................................................................................... 16
U grove ............................................................................................................................................ 16
J grove ............................................................................................................................................. 16
Global parameters .............................................................................................................................. 16
Preset specific parameters.................................................................................................................. 17
But ....................................................................................................................................................... 17
Measurements ................................................................................................................................ 17
Fillet..................................................................................................................................................... 17
Measurements ................................................................................................................................ 18
Corner ................................................................................................................................................. 18
Measurements ................................................................................................................................ 18
Lap ....................................................................................................................................................... 18
Measurements ................................................................................................................................ 19
Vgroove ............................................................................................................................................... 19
Measurements ................................................................................................................................ 19
Area ................................................................................................................................................. 20
hvgroove ............................................................................................................................................. 20
Measurements ................................................................................................................................ 20
Area ................................................................................................................................................. 21
U groove .............................................................................................................................................. 21
Measurements ................................................................................................................................ 21
J groove ............................................................................................................................................... 22
Measurements ................................................................................................................................ 22
Presets management .............................................................................................................................. 22
System ..................................................................................................................................................... 24
Presets for robot connectors .............................................................................................................. 26
Beckhoff .......................................................................................................................................... 26
Slave operation ........................................................................................................................... 26
2
Operating Manual-1.0
Metrology LAB LTD
©2018-2021
Master operations....................................................................................................................... 27
Abb-egm .......................................................................................................................................... 27
Kuka-rsi............................................................................................................................................ 27
Robot state diagram ....................................................................................................................... 27
Locking policy use case ................................................................................................................... 28
Updating of the system ....................................................................................................................... 29
Setting the client manually ................................................................................................................. 29
Sample Workflows .................................................................................................................................. 30
Start a new welding piece ................................................................................................................... 30
Update the controller ......................................................................................................................... 30
Update the client ................................................................................................................................ 30
Understanding SkyBlue algorithm .......................................................................................................... 30
3
Operating Manual-1.0
Metrology LAB LTD
©2018-2021
Parameters
SB50-2 SB120
Area of measurement 15-65mm from front side of the
sensor
Precision of measurement 0.05 mm 0.1 mm
Repeatability 0.03 mm 0.1 mm
Number of measurements per 100 100
second
Power supply of the system 24V 24V
Number collected frames Up to 100 per second Up to 100 per second
Laser wave length 660nm 660nm
Exposure tiem 100µs – 18 ms 100µs – 18 ms
Gain 1-12db 1-12db
4
Operating Manual-1.0
Metrology LAB LTD
©2018-2021
To Controller
Controller
The controller gets images from the measurement sensor and does the appropriate conversion and
processing to geometric objects of the specified preset.
5
Operating Manual-1.0
Metrology LAB LTD
©2018-2021
1.
2. HMI display or switch to HMI and external pc.
3. Debug interface intended for servicing, remote access etc. The IP configuration is obtained by
DHCP on the network where the controller is connected.
4. OFF
5. Interface to robot. Preconfigured to 10.0.0.1/255.255.255.0. IP configuration can be changed
from the client.
6. SkyBlue sensor connection. 5m gray cable CAT7 and 10m blue cable CAT6A are provided.
7. Not used.
6
Operating Manual-1.0
Metrology LAB LTD
©2018-2021
Sensor interface is POE enabled and controller is powering the sensor. IP address is factory defined and
is not intended to be changed on the field.
HMI Display
Provide user interface to the controller and parameterization of pattern matching for successful seam
tracking.
Power supply between 8 and 35 V VDC has to be supplied to controller and HMI display (Head is
powered by the controller). Recommended value – 24V. Sample power supplies for controller and HMI
display are provided in the package.
Cabling
Head to Controller
- done by factory qualified cable 5-10m long; CAT 7(5m) and CAT6E(10m) Ethernet cable. Shielding on
both sides is very important (as per the cited standards). The cables are delivered with the system.
White 5m; Blue 10m
HMI to Controller
- sample cable provided by factory with 3m length; CAT5E + Shield minimum
Robot to Controller
- RJ45 connector as defined above (not included in the package).
7
Operating Manual-1.0
Metrology LAB LTD
©2018-2021
SkyBlue Client
Starting the client
To start the client from HMI display a link on HMI screen is provided (2). Before starting the client, it is
advised to start a standard Linux virtual keyboard (1).
On a regular PC, with installed Java, connected with dedicated interface to the controller HMI port you
can start the client by double click of skyblue.jar file.
8
Operating Manual-1.0
Metrology LAB LTD
©2018-2021
Version of client Serial number of sensor Time stamp of current frame Locking state
The title bar contains important information about the current system connected:
Sensor M: - Sensor model – SB50 is the viewing range 001 is the version
SN: - Serial number of the sensor (stored in the sensor). If one connects a sensor to a controller the
specific sensor will be listed here.
9
Operating Manual-1.0
Metrology LAB LTD
©2018-2021
It shows as well essential status information about the operation of the system:
xxxxxx[ms] - Timestamp – timestamp of the visualized frame since start of the sensor in milliseconds
fc: (xxxxx) – frame counter of the number of frames since the sensor has been started
Control buttons
View
Depending on status of the system (measurement on or off) the screen shows parameters of the
selected preset and observed results.
10
Operating Manual-1.0
Metrology LAB LTD
©2018-2021
VIEW – OBJ
Preset selector
Time stamp in ms
11
Operating Manual-1.0
Metrology LAB LTD
©2018-2021
Image
Image screen is used to adjust the exposure time, gain and point sensitivity (when Points button on the
left is pressed).
Presets
Presets are collection of parameters intended to track specific workpiece. Presets have types and
parameters. There are parameters global for all preset types and parameters specific to the geometry of
the type.
Presets in SkyBlue are designed taking into account the basic welding standards. During welding two
plates are joined with arc welding process. Two types of plates are usually available for welding:
Joint types
12
Operating Manual-1.0
Metrology LAB LTD
©2018-2021
This plate can be joined with another plate of the same kind in several different ways:
Filet
Corner
13
Operating Manual-1.0
Metrology LAB LTD
©2018-2021
But
LAP
It is possible to cut one or both of the plates to be joined to increase the quantity of welding material
used.
14
Operating Manual-1.0
Metrology LAB LTD
©2018-2021
V groove
HV groove
If the material needed for strong joint is still not enough special cutting of one or both plates is possible
15
Operating Manual-1.0
Metrology LAB LTD
©2018-2021
U grove
J grove
Taking in mind this subset of joints defined by ISO welding standard we need to define the following
presets – one for each joint type.
Global parameters
In front of all there are some global parameters not related to the specific shape of a joint:
Exposure time[ms] – the sensor can collect light for different time. The supported time range is 0.1ms to
18ms (to keep the rate of produced frames high enough).
Gain[dB] – in addition to exposure the gain allows making the image lighter. Value can change between
1db and 15db.
Point sensitivity – Controls the collection of points by the algorithm. Range is between 1 and 10. 1 allow
more points 10 reduces the number of points. At 1 a noisy image will give a lot of outliers but a dark
image will deliver points. At 10 the chosen points are reduced and filtering of data takes place.
Line sensitivity – Line sensitivity controls the ease the algorithm produces lines. Value can be changed
from 1 to 100. 1- stands for more lines (more noise). 100 heavy filtering of the lines.
Maximum gap – maximum gap between two lines to aggregate them into a single line.
16
Operating Manual-1.0
Metrology LAB LTD
©2018-2021
O - Absolute angle and Absolute angle tolerance – angle of observation of the working pies. Defined
below and on the client as green line.
But
but_track_point A, B, C – supported tracking points: end of right plate-A, center between plates - B, left
plate -C
Measurements
The following measurements are calculated with this preset:
Width of but [mm] in GUI; [mm]*100 in robot
Distortion angle [deg] in GUI; [rad]*100 in ROBOT
Mismatch [mm] in GUI; [mm]*100 in robot
Left plate length [mm] in GUI; [mm]*100 in robot
Right plate length [mm] in GUI; [mm]*100 in robot
Width of gap [mm] in GUI; [mm]*100 in robot
Fillet
A - fillet_angle and fillet_angle_tol – angle between plates and tolerance of the angle [deg]
17
Operating Manual-1.0
Metrology LAB LTD
©2018-2021
Measurements
Filet measured angle [deg] in GUI; [rad]*100 in robot
Filet gap [mm] in GUI; [mm]*100 in robot
Left plate length [mm] in GUI; [mm]*100 in robot
Right plate length [mm] in GUI; [mm]*100 in robot
Corner
A - corner_angle and corner_angle_tol – angle between plates and tolerance of the angle [deg]
Measurements
Measured angle [deg] in GUI; [rad]*100 in robot
Left plate length [mm] in GUI; [mm]*100 in robot
Right plate length [mm] in GUI; [mm]*100 in robot
Lap
lap_track_point A,B,C
Special comments: Lap preset is defined with 3 segments. All 3 segments should be visible for that
version of the preset.
18
Operating Manual-1.0
Metrology LAB LTD
©2018-2021
Measurements
Step height [mm] in GUI; [mm]*100 in robot
Bending angle [deg] in GUI; [rad]*100 in robot
Upper plate length [mm] in GUI; [mm]*100 in robot
Lower plate length [mm] in GUI; [mm]*100 in robot
Vgroove
vgroove_track_point A, B, C, D, E A – left plate cut edge, B – right plate cut edge, C – crossing between
cut parts(bottom of V), D – Middle between A and B, E – centre of A, B, C
Measurements
Bottom gap [mm] in GUI; [mm]*100 in robot
Area [mm2] in GUI; [mm2]*100 in robot
Bending of both plates [deg] in GUI; [rad]*100 in robot
Top width [mm] in GUI; [mm]*100 in robot
Height [mm] in GUI; [mm]*100 in robot
Mismatch [mm] in GUI; [mm]*100 in robot
Left plate [mm] in GUI; [mm]*100 in robot
Right plate [mm] in GUI; [mm]*100 in robot
19
Operating Manual-1.0
Metrology LAB LTD
©2018-2021
Area
hvgroove
A hvgroove_bending – The expected angle between vertical plate and cut plate is 90 0. This parameter
defines the maximum deviation from this angle 00 in the ideal case. [deg]
orientation (left/right)
hvgroove_track_point A, B, C, D, E
Measurements
Bottom gap [mm] in GUI; [mm]*100 in robot
Area [mm2] in GUI; [mm2]*100 in robot
Bending angle [deg] in GUI; [rad]*100 in robot
20
Operating Manual-1.0
Metrology LAB LTD
©2018-2021
Area
U groove
Measurements
Cut-angle [deg] in GUI; [rad]*100 in robot
Bottom length [mm] in GUI; [mm]*100 in robot
Bending angle [deg] in GUI; [rad]*100 in robot
Gap [mm] in GUI; [mm]*100 in robot
Left Plate [mm] in GUI; [mm]*100 in robot
Right Plate [mm] in GUI; [mm]*100 in robot
21
Operating Manual-1.0
Metrology LAB LTD
©2018-2021
J groove
Measurements
Cut-angle [deg] in GUI; [rad]*100 in robot
Bottom length [mm] in GUI; [mm]*100 in robot
Bending angle [deg] in GUI; [rad]*100 in robot
Gap [mm] in GUI; [mm]*100 in robot
Horizontal Plate [mm] in GUI; [mm]*100 in robot
Vertical Plate [mm] in GUI; [mm]*100 in robot
Presets management
Presets management screen allows creation of presets and removal of not needed presets.
NEW button allows creation of new preset. When created the preset gets number (must be unique in
the system) type and label. When created if number of an existing preset is used the existing preset is
overwritten. Type of the preset can be defined only during preset creation. Label is used to allow the
operator easier decision about the purpose of the preset.
22
Operating Manual-1.0
Metrology LAB LTD
©2018-2021
23
Operating Manual-1.0
Metrology LAB LTD
©2018-2021
System
System function contains the options needed for robot operations and management of logs and
updates.
Robot IP address – the address of SkyBlue controller used to communicate with robot systems.
Robot Net Mask – the subnet-mask used for the robot connection
The values above apply to the interface of the controller named TO Robot.
24
Operating Manual-1.0
Metrology LAB LTD
©2018-2021
Robot type
Identify the type of the robot connected to SkyBlue. Currently Beckhoff, ABB, KUKA. Currently SkyBlue
support only ethernet connection to robots. To change the used robot types, one should select the type
from the combo box provided in the client, adjust the parameters and press the SET button. The
selected robot type is stored in the controller and will be used in future until changed to another type.
Simple Robot
Test functions
25
Operating Manual-1.0
Metrology LAB LTD
©2018-2021
Slave operation
Beckhoff connector can operate as master and slave. For that purpose, SkyBlue contains an internal PLC
simulator. By default (the settings above) measurements and timing information are redirected to the
internal PLC. The internal PLC support the full set of Beckhoff TwinCat 3 protocol. This include
subscription for variable changes and this way SkyBlue may operate as a slave device to ADS compliant
system. The PLC simulator is accessible through the TO ROBOT port on the defined IP (10.0.0.1 in the
sample) on port 48898.
sbvars.out_sb_preset INT32 – when set the variable define which preset number to be used.
26
Operating Manual-1.0
Metrology LAB LTD
©2018-2021
[3] – age of the frame in ms. As the processing needs some time after the image has been collected the
age contains that time and can be used on the robot for precise synchronization.
– 0 – no error
– 1 – Not enough segments – the expected object has more segments than SkyBlue can see.
E.g. looking for filet but only one segment is found.
– 2 – No candidate segment – The absolute angles do not allow selection of the needed
number of segments.
– 3 – No candidate pair – The relative angles do not fit to the observed object
– 4 – Validation not successful – The distance constraints do not fit. E.g. minimum lengths,
maximum gap etc.
– +100 (e.g. 100, 101, 102, 103, 104) – an attempt to set non existing preset from the robot
has been done. The preset remains the same as before the attempt.
[5] – Tracking point X coordinate in 10microns units (mm * 100). E.g. 1101 is 11.01mm
[6] – Tracking point Y coordinate in 10microns units (mm * 100). E.g. 2101 is 21.01mm
[7]..[14] – Measurement specific to the preset type. The measurements are multiplied by 100 as for the
TP. The angles are presented in radians*100. The distances in mm*100. The areas in mm 2*100. The
order of the measurements is the same as displayed on SkyBlue measurement panel.
Master operations
From timing point of view, it may be more suitable to use SkyBlue as MASTER. This can be achieved by
simple configuration. Adjusting the parameters in Beckhoff connector to appropriate addresses of
Beckhoff PLC will switch SkyBlue to directly send data to actual PLC.
For more details please consult Beckhoff addressing schemes and models.
Abb-egm
TBD
Kuka-rsi
TBD
27
Operating Manual-1.0
Metrology LAB LTD
©2018-2021
In case the operator still wants to change some of the above parameters it can explicitly unlock the
client and make the required modifications. If the client has been unlocked with the unlock function the
robot state have to be returned to not-measuring before subsequent switch of measurement-on. This
can be done with SYSTEM SYM_ROB_OFF button in case of slave operation of SkyBlue or in the Real PLC
in case of master operations. Only the change from 0 to 1 of sbvars.out_sb_track is considered as
measurement ON activation.
The same behavior applies to multiple GUI clients but they are not prioritized. The first client locks the
system. When the system is locked by a GUI client the robot will lock it if it switches the measurements
ON.
On the user interface the locking state is shown as last section on the title bar
Version of client Serial number of sensor Time stamp of current frame Locking state
Type of
locker –
client or
robot
28
Operating Manual-1.0
Metrology LAB LTD
©2018-2021
- When second client is started the system is still locked by the first client. The
second client can not change parameters and states on the screen but can observe results.
Unlock by pressing
this button
- The client ID is 5 but the robot (ID 6) took over and locked the system. When robot
starts (Including internal robot simulation) it always locks the system. In the client pool the first client
locks. When robot starts it override the client locks and lock the system.
Update of the controller is done by selection of factory distributed xxxxx.deb file. For update of the
client a xxxxxxx.jar file is used (Please use only factory provided update files!)
The controller should be connected to the “green” cable connector with the PC. IP addresses should be
conformant to spec above.
29
Operating Manual-1.0
Metrology LAB LTD
©2018-2021
Sample Workflows
Start a new welding piece
TBD
1- Collection of the frame – the image collection is done with fast controller located in the sensor
which collects 10bits/pixel images with real time speed of the sensor. Parameters affecting
quality of collected image (frame) are available in all presets:
Exposure time[ms] – the sensor can collect light for different time. The supported time
range is 0.1ms to 18ms (to keep the rate of produced frames).
Gain[dB] – in addition to exposure the gain allows making the image lighter. Value can
change between 1db and 15db.
2- Point finding – Includes a procedure for extracting points from the visible object (shown in black
in VIEW-OBJ and in RED in VIEW-IMG). Parameters affecting point finding are available in all
presets:
Point sensitivity – Controls the collection of points by the algorithm. Range is between 1
and 10. 1 allow more points 10 reduces the number of points. At 1 a noisy image will give a
lot of outliers but a dark image will deliver points. At 10 the chosen points are reduced and
filtering of data takes place.
3- Line finding – uses a transformation of the points known as HOUGH transform to convert them
in linear segments. The following exposed parameters affect the line finding algorithm:
Line sensitivity – Line sensitivity controls the ease the algorithm produces lines. Value can
be changed from 1 to 100. 1- stands for more lines (more noise). 100 heavy filtering of the
lines.
Minimum line – minimum length of accepted line.
Maximum gap – maximum gap between two lines to aggregate them into a single line.
4- Geometric combinations for finding the expected shape – the obtained segments are combined
according to defined geometric parameters in the selected preset. If there is a successful match
the object is “recognized” by SkyBlue and calculations can be done.
30
Operating Manual-1.0
Metrology LAB LTD
©2018-2021
31