Space Robotics: Preview
Space Robotics: Preview
Space Robotics: Preview
Space Robotics
David Wettergreen
Scientist in the Robotics Institute
Post-doc at NASA Ames
Research Areas
Field-deployable mobile
robots
System synthesis
Software architecture
and engineering
Sensor-based guidance
Adaptive control and
learning
Mobility
Exploration and
autonomy
Research Area
Robotic Exploration
Objective
To develop the methods and practice
needed to engage robots in scientific
discovery and meaningful work
3
Carnegie Mellon
Carnegie Mellon
Carnegie Mellon
Carnegie Mellon
Carnegie Mellon
Carnegie Mellon
Carnegie Mellon
Attributes?
Space Robot
Abilities?
Challenges?
Deep Space
Near Space
Ground
Service
Exploration
Lander
Flyby
9
Assembly &
Maintenance
Orbiter
Rover
Carnegie Mellon
10
Carnegie Mellon
Carnegie Mellon
On Surface Capabilities
Inspection
Surface Mobility
Visual inspection of
exterior spacecraft
surfaces; path planning
and coverage planning;
automated anomaly
detection
Transporting and
mating of components;
making connections;
assembly sequence
planning and execution;
assembling small
structures
Mobility Autonomy
Terrain assessment, path
planning, visual servoing
Mobility Mechanism
Extreme terrain access,
energy efficiency
Maintenance
Change-out of
components;
accessing
obstructed
components; robotic
refueling
13
Carnegie Mellon
Near-Space Assembly
14
Carnegie Mellon
Currently Possible:
Autonomous assembly of carefully
designed mechanism in a static,
known environment
Autonomous mating of robotfriendly connectors
Needs Work :
Recovering from errors/perturbations
Design and control of high DOF
robot systems
Manipulation of fragile components
Significant Challenge:
Autonomous assembly planning
including responding to unforeseen
situations
15
Instrument Placement
and Sample Manipulation
Tele-operation to
human supervision
robot/EVA astronaut
teams
Astronaut monitoring
and understanding
Monitoring and
documenting EVA tasks;
preparing a worksite;
interacting with
astronauts; human-robot
teaming
Component
capture
Teleoperated
capture of fixed
component
Teleoperated capture
of free-flying
component
Flight SOA
Mating
connectors
Teleoperated mating of
robot friendly
connectors
Fielded
SOA
Autonomous mating of
robot friendly connectors
Flight SOA
Grasp of gossamer
component with attach
point
10 year
nominal
Teleoperated mating
of EVA connectors
Fielded SOA
Carnegie Mellon
Autonomous capture
of fixed component
10 year
nominal
Grasp of gossamer
component w/out attach
point
10 year
intense
Autonomous mating
of EVA connectors
Autonomous mating
of arbitrary connectors
10 year
intense
16
Carnegie Mellon
Skyworker
Tested in neutral
buoyancy facility
Transport of objects
Teleoperated robots that can mate parts and make fine connections between parts
Tele-operated
Low-energy climb on
structure
Motion planning
Other Systems
Tele-operated crane
Requires special connectors
Limited mobility
17
Carnegie Mellon
18
Robonaut
Langley Assembly Robot
ETS-VII
ROTEX
ERA
JEM Fine Arm
SPDM
Carnegie Mellon
Currently Possible:
Mobility and coverage of the
exterior of complex structures
Autonomous
refueling/recharging of
inspection robot
Needs Work:
Accessing interior spaces
(perhaps using snake or
other high DOF robots)
Significant Challenge
Autonomous anomaly
detection
19
Carnegie Mellon
Inspector
Failed in space
experiment
Flown on space
shuttle
Designed for
autonomous and
teleoperated operation
Other Systems
Autonomous inspection
Charlotte
PSA (IVA robot)
21
Carnegie Mellon
22
Carnegie Mellon
Currently Possible:
Autonomous change-out of
components that are designed
for replacement
Accessing components behind
covers under teleoperation
Needs Work:
Autonomous change-out of components not designed to
be replaced
Accessing components behind covers, blankets, etc.
under supervised autonomy
Interaction with badly damaged components
Significant Challenge
Advanced troubleshooting
23
Carnegie Mellon
AERCam (JSC)
20
Carnegie Mellon
A priori model of
undamaged
component
Locating a
component
Flight SOA
Teleoperated refueling
of satellite designed for
refueling
10 year
nominal
Fielded SOA
Autonomous refueling of
satellite designed for
refueling
Robotic
refueling
Current
10 year
nominal
Teleoperated
refueling of satellite
not designed for
refueling
A priori model of
damaged component
10 year
intense
Autonomous refueling
of satellite not
designed for refueling
10 year
intense
24
Carnegie Mellon
DEXTER
High DOF
grippers
Compliant grip
Telepresence
interface
ROTEX
Other Systems
Flown on space shuttle
Skyworker
ETS-VII
Ranger
Carnegie Mellon
26
Program objectives
Robotic System Performance:
Characterization of the
performance of the various
components of the robotic
system, along with
demonstration of representative
EVA and EVR servicing tasks.
Human Factors Effects: Effects
of local and remote teleoperation
of the robotic system, and
potential mitigating techniques
that may be applied to the user
interface.
Correlation of Flight Data to
Ground Simulations: Validate
the database from computer
graphic and neutral buoyancy
simulations developed in support
of the flight mission.
Carnegie Mellon
Carnegie Mellon
Currently Possible:
Tracking of EVA astronauts
Physical interaction with astronaut
by holding/handing tools
Recognition of gestures and natural
language commands
Site preparation given specific
requirements
Needs Work:
Site preparation based on task
Significant Challenge
Free-flowing dialog between robot
and human
Recognition of human emotional
and physical condition
29
28
Carnegie Mellon
Robots move humans from one work site to another; human operator in lowbandwidth, high-latency communication with robot.
Robots do site preparation and cleanup for EVA; human operator in highbandwidth, low-latency communication with robot.
Robots do site preparation and cleanup for EVA; human operator in lowbandwidth, high-latency communication
Robots in same proximity as humans working same tasks but no physical
interaction; human operator in high-bandwidth, low-latency communication with
robot
Robots in same proximity as humans working same tasks but no physical
interaction; human operator in low-bandwidth, high-latency communication with
robot
Robots that physically interact with humans; human operator in highbandwidth, low-latency communication with robot
Robots that physically interact with humans; human operator in lowbandwidth, high-latency communication with robot
Robots that are true teammates with humans, working on same tasks,
responding to natural language, gestures and high-level goals and
recognizing human intentions
Synergistic relationship between human and machine with direct, physical
connections and prostheses, i.e., super humans augmented with machines
Carnegie Mellon
30
Carnegie Mellon
Robonaut (JSC)
RMS
High DOF
grippers
Teleoperated crane
Can move EVA
astronauts around
Compliant grip
Telepresence
interface
Other Systems
Ranger
FTS
Teleoperated
Tested in Neutral
Buoyancy Facility
31
Robonaut is a humanoid
robot being designed at
NASA Johnson Space Center
in cooperation with DARPA
Carnegie Mellon
32
Carnegie Mellon
Currently Possible:
Following of human (e.g.,
pack mule)
Site reconnaissance and
mapping
Gesture recognition
Plan recognition
Needs Work:
Site clean-up (e.g., picking up
tools, setting up experiments)
Significant Challenge
Dialog with human crew
Recognition of human mental
and physical state
Robots carry tools, which they hand to the EVA crew member. Robots can
also collect designated samples
Robots physically interact with humans via high-level voice commands and
gestures
Robots that are true teammates with humans, working on same tasks,
responding to natural language, gestures and high-level goals and
recognizing human intentions
33
Carnegie Mellon
34
Currently Possible:
Localization and local mapping
100s of meters between command cycles
Coverage patterns
Visual servoing
Obstacle avoidance
Needs Work:
Most terrain types with specialized machines
Globally consistent mapping
Robust navigation
Significant Challenge:
Single vehicle that can access all terrain
types, cover long distances, survive 1000
days AND carry a payload.
Robust self-recoverable mechanisms
35
Carnegie Mellon
36
Carnegie Mellon
Carnegie Mellon
Dante I and II
volacano explorers
Tethered descent
37
Carnegie Mellon
38
Carnegie Mellon
Currently Possible:
Visual servoing to target
Contact measurements
Needs Work:
Robust visual servoing
combined with SLAM to visit
multiple targets in a single
command cycle.
Precise contact
measurements and
autonomous sample
manipulation
Significant Challenge:
Drilling to 1000m depth (Mars
conditions)
1m
10 m
Flight SOA
100 m
Fielded
SOA
1000+ m
10 year
Forecast
39
Carnegie Mellon
Command
cycles /
operation :
Simple
surface
contact
measurements
Precision
surface
contact
measurement
s
Multiple
targets in
single cycle,
highly robust
Multiple
Multiple
Single
Highly autonomous
41
Carnegie Mellon
Remote
measuremen
ts
40
10 year forecast
Carnegie Mellon
v
x1 , !
1
42
v
x2 , !
2
Carnegie Mellon
Rocky 7 (JPL)
Visual Servoing to Target
Better range estimates
Sense of 3D nature of
world
Slower than 2D methods
(Top view)
[Nesnas et al]
Range data
43
Carnegie Mellon
44
Carnegie Mellon
Direction
to
SDOG Motion Target
Correlator
SDOG Range
Correlator
Pan
Other Systems
Autonomous
approach and
placement.
Update
Template
Simple
environment.
[Bualat et al]
Pan-Tilt
Controller
Robot Motion
Controller
Limited
robustness.
Sojourner (JPL)
Supervised
teleoperation (3-5
command cycles)
Robot
Motion
Simple contact
measurements
Tilt
Compliant mechanism
Rudimentary Find
rock capability (unused)
45
Carnegie Mellon
Command
cycles /
operation :
Example
manipulators:
Precise and
predictable
manipulation
Carnegie Mellon
46
Manipulate
complex
shapes
Operate in complex
environment w/ clutter,
constraints and occlusions
Robonaut (JSC)
Viking
Tele-operated
humanoid robot
Scoop to pick up
soil, and small
loose rocks.
Multiple
Single
Highly autonomous
Scoops,
clamshell
Gripper
Dexterou
s gripper
Human hand
10 year forecast
Significant
Challenge
Flight SOA
Supervised teleoperation
Visual feedback
only
Imprecise and
unpredictable
Other Systems
Supervised teleoperation
Imprecise and
unpredictable
Deliberately
limited to avoid
tipping over
lander
47
Carnegie Mellon
48
Carnegie Mellon
Currently Possible:
Virtual presence for scientific exploration
Ground tools for scientists to plan days events.
Generation and robust execution of plans with
Contingencies
Flexible times
Weakly interacting concurrent activities
Limited, highly specialized, onboard science
perception
Needs Work:
Limited high level science goal commanding for
specialized tasks
Significant Challenge:
Human level cognition and perception of science
opportunities.
Carnegie Mellon
50
Carnegie Mellon
Flexible time,
contingencies
Other Systems
NASA Ames Research Center [Edwards et al, 2001]
Time
stamped
sequence
49
None (teleoperation)
Select targets
Characterize site
Recognize unforeseen
scientific opportunities
10 years
Significant
Challenge
10 years
51
Carnegie Mellon
52
Carnegie Mellon
Rock /
Meteorite
type
Iron
meteorite
Sandstone
Basalt
x1
x2
xN
color camera
P(RockType | Data) =
spectrometer
Meteorite
spectrometer
Selects targets
53
Carnegie Mellon
54
Carnegie Mellon
Assessment Conclusions
Challenge of Robustness
55
Carnegie Mellon
56
Establishing a virtual
presence
Non-visual feedback such
as haptic and proprioreceptive.
Shared control (lowlevel control automated)
Adjustable autonomy
Teleoperation
high-level goal input
Human-robot teaming
Human operator to robot ratio
Interface to non-humanoid
robots
Carnegie Mellon
Carnegie Mellon
58
Technology Challenges
Problem
Scientific perception and discovery
go there and look for anorthosite.
Construction
Assemble that strut
Challenges
Understanding operator intentions (e.g. what strut)
Planning in open world and using common sense
reasoning
Complex plan execution in uncertain environment
Carnegie Mellon
59
Carnegie Mellon
60
Carnegie Mellon
10
Handful of robots
flown
Significant gap
between flight and
terrestrial systems
Massive in place
infrastructure for
human space flight
61
Carnegie Mellon
Are we alone?
Determine how life developed in the solar system, where
it may have existed, whether extant life forms exist.
Where did we come from?
Learn how the Suns retinue of planets originated and
evolved.
Discover how the basic laws of physics and chemistry,
acting over aeons, lead to diverse phenomena
What is our destiny?
Explore the terrestrial space environment to discover
what potential hazards exist.
Understand how physical and chemical processes
determine the main characteristics of the planets
63
Carnegie Mellon
64
Carnegie Mellon
65
Carnegie Mellon
66
Carnegie Mellon
11
67
Carnegie Mellon
SURVEY THEMES
The First Billion
Years of Solar
System History
Volatiles and
Organics: The Stuff
of Life
Processes: How
Planets Work
2) Lunar South
Pole-Aitken
Basin Sample
Return
3) Jupiter Polar
Orbiter with
Probes
4) Venus In-Situ
Explorer
5) Comet
Surface
Sample
Return
69
Carnegie Mellon
70
Carnegie Mellon
Objective
Conduct the first reconnaissance of the Pluto/Charon
system, and attempt to encounter one or more Kuiper
objects.
GOALS:
Investigate the diversity of
the physical and
compositional properties of
Kuiper belt objects
Perform a detailed
reconnaissance of the
properties of the Pluto-Charon
system
Assess the impact history of
large (Pluto) and small KBOs
71
Mission scenario
Launch in 2004 or 2006 on Delta-4, 11-13 year JGA
flight to Pluto
Small RTG-powered spacecraft (Cassini spare RTG)
Remote sensing and radio science instrumentation
Kuiper object flybys as extended mission objective
Mission Options
11
Use of solar electric propulsion instead of
ballistic JGA trajectory
10
- Enables roughly equivalent flight
times with launch any year (current
9
tech.)
- Improved SEP: flight times <10 years
Time of Flight to Pluto
350 kg Pluto S/C
8
- Allows use of smaller launch vehicle
Atlas IIIB Launch Vehicle
No LV Contingency
- Requires Earth flyby
SeEGA Trajectory
95% SEP Duty Cycle
7
Optimum Launch Dates
Use of novel gravity assist trajectories
No S/C Power
20% Neutral Mass Margin
- Allows later launch (2007-8)
6
Mellon
- Requires longer flight time or very lowCarnegie
2006
2008
perihelion
Carnegie Mellon
2010
2012
2014
72
2016
Launch Year
12
Pluto/Kuiper Express
Comments and Issues
Development/launch:
$402 M
Operations and data analysis: $150 M
120
$RY Millions
100
80
60
40
20
0
2001
Carnegie Mellon
73
2002
2003
2004
2005
Fiscal Year
Carnegie Mellon
74
NOTE: Costs from August 31, 2000 from the OPSP office.
C osts assume a December 2004 launch.
75
Return to
Lunar Orbit
Lander
(Descent & Ascent Vehicle)
Powered Descent
Ascent Vehicle
Surface Science
and Sampling
Descent
Vehicle
Carnegie Mellon
76
Carnegie Mellon
Objective
Collect and return samples of lunar mantle material
from the floor of the South Pole - Aitken basin
Mission Options
Launch sample directly to Earth - no rendezvous in Earth orbit
Avoids rendezvous issues and sample transfer, but requires larger launch vehicle
Rendezvous in lunar orbit
Mass penalty due to lunar orbit insertion and escape
Earth return using aero-entry ballute
Reduces entry vehicle mass and orbiter size, but requires technology development
Link to Earth using Ka-band
Carnegie Mellon
GOALS:
Obtain samples to constrain the
early impact history of the inner
solar system
Assess the nature of the moons
mantle and the style of the
differentiation process
Develop robotic sample
acquisition, handling, and return
technologies
77
Carnegie Mellon
78
13
Carnegie Mellon
250
200
150
100
50
0
L-4
L-3
L-2
L-1
79
80
Objective
Carrier/Relay
Spacecraft
Initial Approach
V3
V1 V2
North Probe
Equatorial Probe
South Probe
Mission Options
82
Relay Geometry
CRSC trajectory
North Probe
trajectory
North Probe
link window
Equatorial
Probe
trajectory
Equatorial Probe
link window
Carnegie Mellon
Notes:
- Jupiter rotation
rate limits link
window duration
Carnegie Mellon
South Probe
link window
83
84
14
Development
$350-425M
Mission Operations $25-30M
Launch Vehicle
$95M
85
86
Objective
Conduct Venus surface/atmosphere measurements
Validate techniques for future Venus surface sample
return
GOALS:
Determine the compositional and
isotopic properties of the surface
and atmosphere
Mission Options
87
Extend surface survival time to cover primary data relay instead of raising to altitude
- Reduces risk that balloon failure could compromise primary science goals
Carnegie Mellon
- Significant mass and cost impact to increase
surface survival; not required for VSSR
- Balloon inflation and ascent is a major element of future VSSR mission
Carnegie Mellon
Outer insulation
(CO2)
Titanium Pressure Shell
Payload
Carnegie Mellon
88
Carnegie Mellon
15
91
Carnegie Mellon
92
Objective
Return pristine samples of volatile materials from a comet nucleus for analysis on Earth
Mission
Deep Space 1
Mission Options
Full science with drilling to 1 m at multiple sites, well documented,
vs. surface grab sample
- Major implications for science return and cost
2001 2002
2003
2004
Contour
Carnegie Mellon
2009
2012
2013
2014
2015
2016
DArrest
Rosetta (ESA)
93
2011
SW3
Wirtanen
Phase A
Phase B
Phase C/D
Landing
Launch
CNSR Example:
2011 launch to
Comet Brooks 2 Carnegie Mellon
Return
2019
Brooks2 ?
94
Mission operations:
$75-150 M
2010
Tempel 1
Contour
2008
Wild2
2007
Encke
Stardust
Contour
2005 2006
Borrelly
Deep Impact
Carnegie Mellon
GOALS:
Return near-surface cometary materials to Earth for
detailed compositional, isotopic, and structural
analysis
Assess the detailed organic composition of the
cometary nucleus
Assess the porosity and other physical properties of
nuclear material
Assess the physical relationship among volatiles,
ices, organics and refractories and their relationship
to porosity
Assess the isotopic and mineralogic content at both
microscopic and macroscopic scales assess the
detailed organic composition of the cometary
nucleus
300
250
200
150
100
50
0
L-5
Carnegie Mellon
L-4
L-3
L-2
L-1
96
16
97
Carnegie Mellon
98
Europa Orbiter
Europa Orbiter
Challenges of Europa Environment
Objectives
Conduct intensive orbital study of Europa to conclusively
determine presence or absence of subsurface ocean,
understand formation and evolution of surface, and
identify landing sites for possible future missions
Key Trades
3.3 Mrad
Over 30 day
Science mission
In Europa orbit
3.2 Mrad
Over 1-2 years
in Jupiter orbit
before EOI
Impact
10 year
duration
Contingency
Science (allocation)
Spacecraft (CBE)
Shielding
Adapter
Adapter (CBE)
Propulsion
Subsystem (CBE)
Carnegie Mellon
Planned Missions
Propellant
Propulsion
loaded)
(fully
Contingency (dry)
1221
100kg
273 kg
Europa Orbiter
Europa Orbiter
11.4 ft (3.5 m)
Development
Launch vehicle
Operations
Subtotal
Taxes and fees
Total life cycle
20 kg
354 kg
Rad s hielding (CBE)
33 kg
Adapter (CBE)
90 kg
Propulsion Subsy stem (CBE)150 kg
Propellant
Cassini
22.3 ft (6.7 m)
Command &
Data
Subsystem,
inc. Solid State
Recorder
Science (allocation)
Spacecraft (CBE)
Galileo
Galileo
Europa Orbiter
MASS BREAKDOWN:
Spacecraft
MEO
Telecom
Sats
7 year
duration
Iridium
Science
4 year
duration
Current Missions
Intelsat
99
Science objectives
Achieve quarantine orbit
10-12 year
duration
Other Europa exploration modes (e.g. multi-flybys) have been examined as cost-reduction
measures but would lead to significant reductions in primary science objectives
Europa
O
Orbiter
rbiter
(X2000)
(X2000)
Earth gravity assist trajectory reduces launch vehicle size and increases mass margin, but
increases flight time to Jupiter by 2 years
Carnegie Mellon
Mission scenario
Carnegie Mellon
Power
& Pyro
System
X2000 Chassis
Attitude &
Articulation
Control
Electronics
X2000
Electronics
170 kg
Mass
0.25m3
Volume
43 kg
$760M
170
120
1050
30
$1080M
Notes:
- Includes X2000 completion costs
- Includes reserves and contingency
- Includes RTG ($67M)
0.074m3
Carnegie Mellon
102
17
Objective
Following Europa Orbiter, conduct the first surface
exploration of Europa as the next science and
technology step in a decadal exploration program
Surface composition/geochemistry
Microscale surface imaging
Surface temperature, radiation
Seismicity
70 kg
103
Carnegie Mellon
30 kg
104
220 kg
Mission Options
Carnegie Mellon
Carrier vehicle enters Europa orbit following a 2year gravity assist tour of the Jupiter system
2-week mapping in Europa orbit for site selection
Europa Pathfinder deployed for airbag landing
3-day surface mission, data relay via orbiter
~25Gbits data return
$500-600M
Multimission technology:
(lander only)
$20M
Carnegie Mellon
100
125
100
$825-925M
105
106
107
Carnegie Mellon
Carnegie Mellon
108
Carnegie Mellon
18
GOALS:
Mars Long-lived Lander Network (MLN)
109
Carnegie Mellon
110
Carnegie Mellon
GOALS:
111
Carnegie Mellon
Carnegie Mellon
GOALS:
Return samples to Earth from a site selected on
the basis of remotely sensed and in situ data that
will address key scientific questions
Precisely measure the geochemical,
mineralogical, and volatile content of samples in
Earth laboratories
Assess the biological potential of Mars
Provide the ultimate ground truth for orbital and
in situ data to guide future exploration
113
112
Carnegie Mellon
114
Carnegie Mellon
19
Objective
Conduct in situ exploration of Titans atmosphere and
surface as the next step beyond Cassini/Huygens
GOALS:
Follow up on significant
discoveries during the
nominal mission
Extension of spatial
coverage on Titan through
changing orbital geometry
Mission Options
Range of in situ platforms is possible: Simple lander, mobile lander, simple balloon,
aerobot (controlled balloon)
- Mobility for multiple surface site sampling appears to be a key science driver
- Must plan for variety of surface conditions
- Relative balance of surface and atmospheric observations
Orbital science may be eliminated in favor of in situ science to save cost
Orbiter for telecom relay is probably required
- options
Carnegie
Mellon under study for direct-to-Earth
116
Carnegie Mellon
117
115
Carnegie Mellon
L-5
L-4
L-3
L-2
L-1
118
Objective
Return well-documented samples of surface and sub-surface materials
from one or more asteroids
Mission Options
Return to Eros may minimize mission cost and risk
Multiple landing sites may be feasible...enhances science return but increases cost/risk
Depth of subsurface access required, if any, drives sample system complexity and cost
Multiple targets could be sampled in a single mission using SEP
SEP enables access to greater number of targets, including main-belt asteroids
- Increases flight time (~7 years for Vesta sample return)
Carnegie Mellon
119
Carnegie Mellon
120
20
Panel
Inner Planets
Cost Class
Medium
Medium
Medium
Large
Large
Small
Medium
Medium
Medium
Medium
Large
Small
Small
Medium
Large
Large
Large
Small
Large
Large
Large
Large
Medium
Medium
Small
Large
Medium
Medium
Small
Small
Missions listed in
Priority Order
Missions in bold face
were selected by the
Steering Group for
overall prioritization
Primitive Bodies
Cost
$300-400M
25-40M
Giant Planets
Large Satellites
200
150
100
Mars
50
0
L-4
Carnegie Mellon
L-3
L-2
L-1
121
122
Carnegie Mellon
Space Exploration
Review
125
Carnegie Mellon
126
Carnegie Mellon
21