Exploration of Underwater Life With An Acoustically Controlled Soft Robotic Fish
Exploration of Underwater Life With An Acoustically Controlled Soft Robotic Fish
INTRODUCTION top robotic fish prototypes reported in literature can swim unteth-
Problem addressed ered in three dimensions for prolonged periods of time at a range
Closeup and minimally disruptive observations of marine life are par- of depths.
ticularly useful when studying animals’ behaviors, swim patterns, and This paper describes our Soft Robotic Fish (SoFi), which builds
interactions within their habitats (1, 2). A biomimetic underwater ob- on the basic design philosophy of previous robotic fish prototypes
servatory for long-term studies could facilitate deeper understanding that we have constructed. In contrast to earlier efforts, this robot
of marine life, especially their social behaviors and how environmen- has onboard capabilities for untethered operation in ocean environ-
tal changes affect the delicate balance within the marine world. One ments, including the ability to move along three-dimensional (3D)
possibility to achieve this is using underwater vehicles that can swim trajectories by adjusting its dive planes or by controlling its buoyan-
alongside marine life to allow closeup observations. Remotely oper- cy. Onboard sensors perceive the environment, and a mission con-
ated vehicles (ROVs) or autonomous underwater vehicles (AUVs) in trol system enables a human diver to issue remote commands. SoFi
ocean environments typically use propellers or jet-based propulsion advances our previous work on soft robotic fish in several dimen-
systems (3). However, these propulsion systems generate substantial sions. The first-generation fish (10) was suspended underwater and
turbulence and have the potential to scare marine life and to prevent pneumatically actuated to swim forward at a fixed depth and to exe-
closeup observations (4). Further, the mere appearance of these vehi- cute escape maneuvers. The second-generation fish (11) used hy-
cles, typically large and rigid like a submarine, does not integrate well draulic soft actuation and incorporated dive planes for dynamic
into the marine environment. The complexity of most traditional diving. However, the robot had limited thrust, could not withstand
ROVs also requires costly fabrication and intricate control strategies, compression at depths of more than a meter, was not able to adjust
and their large bulk restricts their tethered deployment to deeper wa- its buoyancy autonomously, and had no mechanism for under-
ter using specially equipped vessels. Smaller ROVs also generally re- water remote control and communication with a human diver. This
quire tethers, which can be cumbersome and restrict operation. paper also builds on our acoustic communication modem docu-
To address this problem, we sought to create biomimetic fish mented in (12), presenting its integration into SoFi and evaluating
robots that can be easily used by a single diver. We also wanted to its ability to enable real-time interactive oceanic exploration. SoFi
generate lifelike undulation of the robotic fish tail for propulsion integrates and extends these previous works, achieving untethered
and to enable untethered remote control of these fish robots by a swimming and remote control at a range of depths in complex
diver. Our solution is a soft underwater robot with fluid-driven ac- environments.
tuation that swims with compliant and continuous strokes that im-
itate the movement of fish. Biomimicry potentially increases the ability Paper’s importance
of robots to approach marine life without disturbing them (5, 6) or SoFi is capable of close observations of marine life and has the poten-
their natural environment. Despite the emergence of previously un- tial to be a new platform for studying and interacting with underwater
known actuation modalities (7) that could also enable undulatory or species. It demonstrates that a soft fluidic actuator can be a successful
oscillatory biomimetic locomotion underwater (8, 9), none of the bench- propulsive mechanism for prolonged untethered underwater explo-
ration at multiple depths.
In particular, this work presents (i) a powerful hydraulic soft ac-
Distributed Robotics Laboratory, Computer Science and Artificial Intelligence Lab-
oratory, Massachusetts Institute of Technology, Cambridge, MA 02139, USA. tuator, (ii) a control mechanism that allows the robot to adjust its
*Corresponding author. Email: [email protected] buoyancy according to depth, (iii) onboard sensors to observe and
record the environment, (iv) a mission control system that a human There have been various design and fabrication techniques pro-
diver can use to provide navigational commands to the robot from posed for fluidic elastomer actuators. Soft lithography (36), shape depo-
a distance using acoustic signals, and (v) extended ocean experiments sition manufacturing (37), thread-reinforced pneumatic chambers (38),
at depths ranging from 0 to 18 m. SoFi has demonstrated untethered and retractable pin casting (39) were some of the initial methods that
swimming and the ability to autonomously execute high-level com- can be used to realize soft fluid actuators. None of these methods
mands in coastal waters and coral reefs at depths of up to 18 m. In allow for the repeatable fabrication of soft fluidic actuators without
short, SoFi has the onboard capabilities of an untethered mobile un- weakening seams and integrated functional structures such as back-
derwater observatory to potentially enable nondisruptive monitoring bones. Three-dimensional printing of soft actuators and the creation
of marine life. of intelligent damping materials (40, 41) have shown that fine-grained
control of various materials allows for the automated fabrication of
Challenges in design and control heterogeneous structures with embedded liquids as functional actu-
We wanted to build and successfully deploy an untethered under- ation or passive damping channels. Although 3D printing opens pre-
water robotic fish, similar in size and behavior to living fish, that viously unknown dimensions in heterogeneous actuator design, the
can autonomously execute high-level commands received remotely materials available are not deformable and robust enough to undergo
from a diver. The challenge is to realize biomimetic swimming of a strong cyclical flexing. In the work presented here, we use monolithic
self-contained system in a compact size, with good portability, lim- casting using a lost-wax fabrication technique (11), a reliable and easily
ited power, and communication capabilities. The robotic fish has to reproducible way to fabricate soft actuators with complex inner cav-
40 min. It propels itself by undulating its soft tail in a cyclic manner by adjusting the baseline deflection angle of the tail around which
and adjusts this undulation to swim forward or turn. The tail motion the tail undulates. The fish performed three levels of deflections in
is created by the cyclic flow of a displacement pump, and adjusting each direction, with a maximum baseline deflection of about ±30°.
the relative amount of liquid pumped into each side of the tail can Similarly, the fish could pitch its dive planes at three levels in each
generate a turning motion. Vertical swimming is achieved via dive direction, with a maximum pitch of ±45°. A sample fish trajectory
planes and a BCU. The fish is equipped with a fisheye camera at its tip along a coral reef is shown in Fig. 2, illustrating the controlled swim-
to observe its environment. An acoustic transducer is also mounted ming motion as it was commanded by a human diver. The fish changed
in front of the rigid dorsal fin, tilted upward, to receive commands direction and depth while exploring the reef, with an average swim-
from the human-operated diver interface module. ming speed of 21.7 cm/s (±3.2 cm/s) at depths of 0 to 18 m.
We performed quantitative tests in the ocean to measure the for-
Swimming along a 3D trajectory ward and turning capabilities of the fish (Fig. 3). The average swim-
The hydraulic system performed undulating tail actuation at low ming speed in a straight path was 23.5 cm/s (±0.4 cm/s), equivalent to
(0.9 Hz), medium (1.15 Hz), and high (1.4 Hz) frequencies to achieve 0.5 body lengths per second. The average turning speed was 18.3 cm/s
a range of swimming speeds. The fish executed left and right turns (±4.1 cm/s) on an average turning radius of 78.2 cm (±28.6 cm). Dy-
namic diving using the dive planes was
possible within a range of ±0.9 m from
its baseline depth at an average speed of
Table 1. Communication experiments. Cumulative results of the acoustic communication during four of the six dives, spanning 2 days and averaging about
40 active minutes per dive. Note that “steady commands” are commanded states that persisted for at least 1 s. Observations were made at an average depth of
8.1 m, a maximum depth of 18 m, a range between transmitter and receiver of 0 to 10 m, and a transmit acoustic power of 137.3 dB SPL re 1 Pa.
Dive 3 Dive 4 Dive 5 Dive 6
Total commands obeyed 67 30 111 93
Total commands missed 55 62 46 57
Steady commands obeyed 55 26 75 78
Steady commands missed 25 31 7 21
Percent of steady 68.8% 45.6% 91.5% 78.8%
commands obeyed
Fish timeouts (reversions to 63 34 81 81
neutral state)
Percent of dive spent 12.3% 8.0% 7.3% 8.1%
timed out
Fig. 7. Soft tail, pump, and BCU. (Top) Two views of the soft fish tail in an actuated
Soft body for undulating locomotion ducing sufficiently large cyclic body deflections and the least acoustic
The fish achieves undulating locomotion via a hydraulically actuated noise. An external gear pump design produced the largest body de-
soft fish tail with two internal cavities. The soft fish tail, shown in flection and therefore the best swimming performance but consumed
Fig. 7, is a fluidic elastomer actuator (39, 86, 87). The design mimics an order of magnitude more power and produced higher noise levels.
the rear portion of a fish, encompassing the posterior peduncle and A detailed study of the various actuation systems is provided in (90). We
the caudal fin. The tail can continuously bend along its vertical center chose an external gear pump (Fig. 7) for the fully integrated robotic
constraint layer by fluidic actuation of two lateral cavity structures. fish because of its better swimming performance, lower part count,
The inextensible and stiffer center constraint layer splits the tail evenly and easier controllability.
along a vertical plane. An actuator consists of evenly spaced ribs The motor controller operates the motor attached to the pump
with hollow sections in between, connected by a center channel and through a trapezoidal voltage profile, alternating from positive to
accessible by a front inlet. The rib structure allows for expansion or negative voltages after each half-cycle. This profile rotates the motor
contraction of the thin exterior skin under positive or negative fluidic shaft back and forth, causing the pump to create a cyclic hydraulic
pressure, respectively. These expanding or contracting motions bend flow. Asymmetrically varying the flow intensity for each half-phase
the inextensible center constraint layer. The rib structure is evenly can enable yaw control by creating a pressure bias in the tail.
spread along the fin, leading to a continuous flexing of the whole
body under fluidic pressure. The inherent elasticity of the body forces Depth control
it back into its neutral state after each pulse of actuation. A fluidic The depth of SoFi is controlled by dive planes or the BCU. The dive
a new low-power, low-cost, software-defined acoustic modem, rep- using a [15,11] Hamming encoding with an additional parity bit.
resented schematically in Fig. 8 on the right and described in detail This vocabulary of commands can then be used to remotely control
in (12). the fish.
The acoustic modem’s transmitter is housed in the diver interface Acoustic modem testing
module, which incorporates an oil-filled rigid outer shell (22 cm by We evaluated the acoustic modem in a pool, a fish tank, and the ocean.
22 cm by 6 cm) with a transparent flexible membrane on one face. The The system was first evaluated in a tank (1.2 m × 0.3 m × 0.45 m)
membrane, a soft cast-molded silicone rubber (SORTA-Clear 40, Smooth- and pool (23 m × 12.5 m × 2.2 to 4.2 m) to test the modem under
On), retains nonconductive mineral oil within the housing and al- controlled conditions. These environments facilitate multipath re-
lows for pressure equalization underwater. The flexibility and molded flections due to the enclosed configuration, hard walls, and shallow
shape of the membrane allow the control buttons within the module to depth, approximating the types of interference observed in open-ocean
be pressed by the diver when selecting a desired fish state. These com- deployments.
mands are read by a Raspberry Pi single-board computer via Uni- As described in more detail in the Supplementary Materials, tests
versal Serial Bus and are encoded as a specific sequence of ultrasonic were performed during development to choose parameters of the
acoustic tones, which are then converted to audio signals by a digital- modulation scheme and decoding algorithm. Then, to evaluate the
to-analog converter (HiFiBerry). The analog signals are amplified communication reliability of the completed modem, we transmitted
via a Class G differential audio amplifier (MAX9788) and are then a series of 200 alternating bits at a rate of 20 bits/s over a sequence of
impedance-matched to the output ceramic transducer (Aquarian Sci- increasing distances and depths. For each transmission, the percent-
In addition, one dive was dedicated to performing quantitative 5. S. Marras, M. Porfiri, Fish and robots swimming together: Attraction towards the robot
demands biomimetic locomotion. J. R. Soc. Interface 9, 1856–1868 (2012).
swimming tests on the ocean floor at a baseline depth of about 7 m.
6. S. Butail, N. Abaid, S. Macrì, M. Porfiri, Fish–robot interactions: Robot fish in animal
We installed several premeasured ropes to define a reference volume behavioral studies, in Robot Fish, R. Du, Z. Li, K. Youcef-Toumi, P. Valdivia y Alvarado, Eds.
(4 m × 4 m × 1 m) for measuring and filming the robot’s ability to (Springer, 2015), Springer Tracts in Mechanical Engineering, pp. 359–377.
swim straight, turn right, turn left, dive up, and dive down. We per- 7. L. Hines, K. Petersen, G. Z. Lum, M. Sitti, Soft actuators for small-scale robotics. Adv. Mater.
formed three trials for each ability. During all trials, the thrust was 29 (2017).
8. W.-S. Chu, K.-T. Lee, S.-H. Song, M.-W. Han, J.-Y. Lee, H.-S. Kim, M.-S. Kim, Y.-J. Park,
set to maximum and the undulation frequency was set to medium K.-J. Cho, S.-H. Ahn, Review of biomimetic underwater robots using smart actuators.
(1.15 Hz). For right and left turns, the yaw was set to ±30° and the dive Int. J. Precis. Eng. Manuf. 13, 1281–1292 (2012).
planes were set to neutral. For up or down swimming, the dive planes 9. A. Raj, A. Thakur, Fish-inspired robots: Design, sensing, actuation, and autonomy—A
were adjusted to ±45° and yaw was set to neutral. Yaw and pitch were review of research. Bioinspir. Biomim. 11, 031001 (2016).
10. A. D. Marchese, C. D. Onal, D. Rus, Autonomous soft robotic fish capable of escape
both neutral for straight swimming. At the beginning of each trial, a
maneuvers using fluidic elastomer actuators. Soft Robot. 1, 75–87 (2014).
diver repositioned the fish to its starting position at the center of one 11. R. K. Katzschmann, A. D. Marchese, D. Rus, Hydraulic autonomous soft robotic fish for 3D
of the bounding planes of the reference volume and then released the swimming, in Experimental Robotics: The 14th International Symposium on Experimental
fish without pushing it. This diver also took notes during trials. A Robotics, M. A. Hsieh, O. Khatib, V. Kumar, Eds. (Springer International Publishing, 2014),
second diver commanded the desired fish state from the starting po- vol. 109, pp. 405–420.
12. J. DelPreto, R. K. Katzschmann, R. MacCurdy, D. Rus, A compact acoustic communication
sition. Two additional divers filmed the trials from the side and top, module for remote control underwater, in WUWNET ’15: Proceedings of the 10th
standing or floating at the boundary of the reference volume. International Conference on Underwater Networks & Systems (ACM, 2015), pp. 1–7.
31. G. Polverino, N. Abaid, V. Kopman, S. Macrì, M. Porfiri, Zebrafish response to robotic fish: 59. L. Freitag, M. Johnson, M. Grund, S. Singh, J. Preisig, Integrated acoustic communication
Preference experiments on isolated individuals and small shoals. Bioinspir. Biomim. 7, and navigation for multiple UUVs, in OCEANS 2001 MTS/IEEE Conference and Exhibition
036019 (2012). (IEEE, 2001), vol. 4, pp. 2065–2070.
32. V. Cianca, T. Bartolini, M. Porfiri, S. Macrì, A robotics-based behavioral paradigm to 60. I. F. Akyildiz, D. Pompili, T. Melodia, Underwater acoustic sensor networks: Research
measure anxiety-related responses in zebrafish. PLOS ONE 8, e69661 (2013). challenges. Ad Hoc Netw. 3, 257–279 (2005).
33. T. Ruberto, V. Mwaffo, S. Singh, D. Neri, M. Porfiri, Zebrafish response to a robotic replica 61. M. S. Martins, N. Pinto, G. Rocha, J. Cabral, S. L. Mendez, Development of a 1 Mbps low
in three dimensions. R. Soc. Open Sci. 3, 160505 (2016). power acoustic modem for underwater communications, in 2014 IEEE International
34. F. Bonnet, Y. Kato, J. Halloy, F. Mondada, Infiltrating the zebrafish swarm: Design, Ultrasonics Symposium (IUS) (IEEE, 2014), pp. 2482–2485.
implementation and experimental tests of a miniature robotic fish lure for fish–robot 62. A. Sánchez, S. Blanc, P. Yuste, A. Perles, J. J. Serrano, An ultra-low power and flexible
interaction studies. Artif. Life Robot. 21, 239–246 (2016). acoustic modem design to develop energy-efficient underwater sensor networks.
35. D. Romano, G. Benelli, E. Donati, D. Remorini, A. Canale, C. Stefanini, Multiple cues Sensors 12, 6837–6856 (2012).
produced by a robotic fish modulate aggressive behaviour in Siamese fighting fishes. 63. P. Fischer, A. Weber, G. Heine, H. Weber, Habitat structure and fish: Assessing the role of
Sci. Rep. 7, 4667 (2017). habitat complexity for fish using a small, semiportable, 3-D underwater observatory.
36. Y. Xia, G. M. Whitesides, Soft lithography. Annu. Rev. Mater. Sci. 28, 153–184 (1998). Limnol. Oceanogr. Methods 5, 250–262 (2007).
37. J. G. Cham, S. A. Bailey, J. E. Clark, R. J. Full, M. R. Cutkosky, Fast and robust: Hexapedal 64. X. Tan, D. Kim, N. Usher, D. Laboy, J. Jackson, A. Kapetanovic, J. Rapai, B. Sabadus,
robots via shape deposition manufacturing. Int. J. Rob. Res. 21, 869–882 (2002). X. Zhou, An autonomous robotic fish for mobile sensing, in 2006 IEEE/RSJ International
38. R. Deimel, O. Brock, A compliant hand based on a novel pneumatic actuator, in 2013 IEEE Conference on Intelligent Robots and Systems (IEEE 2006), pp. 5424–5429.
International Conference on Robotics and Automation (ICRA) (IEEE, 2013), pp. 2047–2053. 65. C. Georgiades, A. German, A. Hogue, H. Liu, C. Prahacs, A. Ripsman, R. Sim, L.-A. Torres,
39. A. D. Marchese, R. K. Katzschmann, D. Rus, A recipe for soft fluidic elastomer robots. P. Zhang, M. Buehler, G. Dudek, M. Jenkin, E. Milios, AQUA: An aquatic walking robot,
Soft Robot. 2, 7–25 (2015). in 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE,
40. R. MacCurdy, R. Katzschmann, Y. Kim, D. Rus, Printable hydraulics: A method for 2004), vol. 4, pp. 3525–3531.
84. M. Read, C. Möslinger, T. Dipper, D. Kengyel, J. Hilder, R. Thenius, A. Tyrrell, J. Timmis, 95. L. Amundsen, M. Landrø, Marine seismic sources part VIII: Fish hear a great deal. GEO ExPro
T. Schmickl, Profiling underwater swarm robotic shoaling performance using simulation, 8, 42–46 (2011).
in Towards Autonomous Robotic Systems (Springer, 2013), Lecture Notes in Computer 96. A. N. Popper, D. T. T. Plachta, D. A. Mann, D. Higgs, Response of clupeid fish to ultrasound:
Science, pp. 404–416. A review. ICES J. Mar. Sci. 61, 1057–1061 (2004).
85. J. S. Jaffe, P. J. S. Franks, P. L. D. Roberts, D. Mirza, C. Schurgers, R. Kastner, A. Boch, 97. G. Goertzel, An algorithm for the evaluation of finite trigonometric series. Am. Math. Mon.
A swarm of autonomous miniature underwater robot drifters for exploring submesoscale 65, 34–35 (1958).
ocean dynamics. Nat. Commun. 8, 14189 (2017).
86. N. Correll, Ç. D. Önal, H. Liang, E. Schoenfeld, D. Rus, Soft autonomous materials—Using Acknowledgments: We thank D. Dorhout, A. DeMaille, S. Moon, and J. Wright for their
active elasticity and embedded distributed computation, in 2012 Experimental Robotics: contributions. We are grateful to the reviewers for providing very valuable feedback on earlier
The 12th International Symposium on Experimental Robotics, O. Khatib, V. Kumar, versions of the manuscript. Funding: This work was supported by the NSF via grant numbers NSF
G. Sukhatme, Eds. (Springer, 2014), vol. 79 of Springer Tracts in Advanced Robotics, 1117178, NSF IIS1226883, and NSF CCF1138967 and the NSF Graduate Research Fellowship
pp. 227–240. 1122374. Author contributions: R.K.K. and D.R. conceptualized the robotic fish. R.K.K. developed
87. C. D. Onal, D. Rus, Autonomous undulatory serpentine locomotion utilizing body the robotic fish including design, fabrication, and control, as well as experiments. R.K.K., J.D., R.M.,
dynamics of a fluidic soft robot. Bioinspir. Biomim. 8, 026003 (2013). and D.R. performed the ocean experiments and wrote the paper. R.K.K. and J.D. developed the
88. G. V. Lauder, B. Flammang, S. Alben, Passive robotic models of propulsion by the bodies control software of the robotic fish. J.D. developed the acoustic communication protocol,
and caudal fins of fish. Integr. Comp. Biol. 52, 576–587 (2012). demodulation algorithms, software related to acoustic signal processing and decoding, and
89. S. Alben, C. Witt, T. V. Baker, E. Anderson, G. V. Lauder, Dynamics of freely swimming acoustic experiments. J.D. and R.M. developed the software related to the acoustic transmitter. R.M.
flexible foils. Phys. Fluids 24, 051901 (2012). developed the diver interface module and designed the transmitter and receiver electronics. D.R.
90. R. K. Katzschmann, A. de Maille, D. L. Dorhout, D. Rus, Cyclic hydraulic actuation for soft was responsible for the overall research direction, objectives, and funding. Competing interests:
robotic devices, in 2016 IEEE/RSJ International Conference on Intelligent Robots and The authors declare that they have no competing financial interests. Data and materials
Systems (IROS) (IEEE, 2016), pp. 3048–3055. availability: Contact R.K.K. for source code and other materials.
SUPPLEMENTARY http://robotics.sciencemag.org/content/suppl/2018/03/19/3.16.eaar3449.DC1
MATERIALS
REFERENCES This article cites 60 articles, 5 of which you can access for free
http://robotics.sciencemag.org/content/3/16/eaar3449#BIBL
PERMISSIONS http://www.sciencemag.org/help/reprints-and-permissions
Science Robotics (ISSN 2470-9476) is published by the American Association for the Advancement of Science, 1200
New York Avenue NW, Washington, DC 20005. 2017 © The Authors, some rights reserved; exclusive licensee
American Association for the Advancement of Science. No claim to original U.S. Government Works. The title
Science Robotics is a registered trademark of AAAS.