L6-TSP Sensing and Perception
L6-TSP Sensing and Perception
TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AAAAA
Schedule
Week 1 2 3 4 5 Date 23-Jul 30-Jul 6-Aug 13-Aug 20-Aug Lecture (M: 12-1:30, 43-102) Introduction Representing Position & Orientation & State (Frames, Transformation Matrices & Affine Transformations) Robot Kinematics and Dynamics Robot Dynamics & Control Obstacle Avoidance & Motion Planning
6
7 8 9 10 11 12 13
and
Localization and Navigation (GPS, INS, & SLAM) State-space modelling & Controller Design Vision-based control Study break Public Holiday Robot Machine Learning Guest Lecture Wrap-up & Course Review
Quick Outline
1. Discussion Forum & Sign-up Updates 2. Path Planning Recap 3. Sample-based Path Planning & Sequencing 4. Perception
1. 2. 3. 4. Sensing Sensors (Laser, Vision) Calibration Feature extraction
Proposal:
Each week the tutors will select the best student answer
They will award a gold and silver star. Gold star entitles a free 6 hour extension for the team Silver star entitles a 1 hour extension The tutors can issue multiple (or no) stars
Sign-up Sheet is available (after class) and will be posted outside the Axon Learning Lab
Start
Start
Start
Start
PRMs
RRTs
r(m)
xrand
xgoal
q(m/s)
Goal Goal
distance
Minimize:
Goal Goal
Goal
Sense
Control
Act
ENERGY
Current
Capacitance
Spectrum
Noise
Note: this picture illustrates the concepts but it is not quantitatively precise
10
11
Accelerometer Acceleration
signal
(Accelerometer)
rotation
acceleration gravity
tangential
centripetal
Noise
Velocity Measurement
Tachometer
Sources: ADI
signal
12
Vin
R Vout
Example Applications
Joystick Electric car control
13
Incremental Encoders
Pulses from leds are counted to provide rotary position Two detectors are used to determine direction (quadrature) Index pulse used to denote start point Otherwise pulses are not unique
14
Absolute Encoders
Absolute encoders have a unique code that can be detected for every angular position Often in the form of a grey code; a binary code of minimal change Absolute encoders are much more complex and expensive than incremental encoders
15
-100
Laser HD
Infrastructure
-200
-300
Back wall
-400
-500
-600
200
400
600
800
1000
1200
1400
1600
1800
Position/Velocity
Potentiometer LVDT Encoders Tachogenerator
Force/Pressure
16
Sensor Information
Laser
GPS Vision
17
Cameras
Image Formation
18
Stereopsis
Perception
Making Sense from Sensors
http://www.michaelbach.de/ot/mot_rotsnake/index.html
19
Bayer Patterns
Edge Detection
Canny edge detector:
20
Edge Detection
Canny edge detector:
21