1. Introduction
Currently, autonomous and hybrid underwater vehicles are increasingly equipped with multilink manipulators for a variety of applications—in particular, to perform various underwater research and technological operations in autonomous mode [
1,
2]. However, despite the fact that promising areas have been developing recently that do not require the physical contact of the AUV with objects of work—for example, so-called “sensor fields” [
3,
4]—most manipulation operations require the contact of the manipulator’s working tool with the target objects [
5,
6,
7]. Such operations can be both relatively simple (the collection of bacterial mats and sediment sampling) and relatively complex (the cleaning of surfaces suffering from fouling and silting, the insertion of samplers into control panels on underwater manifolds, etc.).
Research sampling operations require a sampler to be moved along a desired trajectory, with a specified orientation of this tool relative to the seabed surface. In this case, it is not necessary to exert a known force effect on the surface. However, for such operations as the cleaning of surfaces or interaction with underwater infrastructure objects, exerting a specified force on the surface of the object with the manipulator’s working tool is important.
The most convenient and safe mode for performing these operations is the stabilized hovering mode of the AUV near or above the target object [
1,
8,
9]. In this mode, the vehicle is holding the most convenient position for manipulation and does not stir up silt in the near-bottom layer of water, as happens when landing on the seabed. However, when the manipulator comes into contact with the surface of the object, a force begins to act on its working tool. This leads to undesirable external moments acting on the output shafts of the electric drives in the degrees of the manipulator’s mobility, and also to force and moment effects on the point of the manipulator’s attachment to the AUV. These impacts displace the AUV from its hovering point, which inevitably leads to deviations of the working tool from preset trajectories and loss of contact with the surface of the target object.
Currently, there are already solutions to the problem of providing position–force control of manipulators, including those installed on AUVs. For this, methods of parallel position–force control [
10,
11,
12] or impedance control [
13,
14,
15,
16,
17] are used. In the former case, to control the movements of the working tool, two control circuits of the manipulator drives are synthesized: by position and by the generated force. In turn, impedance control implies the formation of dependencies between the desired working tool’s position and the force created by this tool at the point of contact with the target object. At the same time, it was noted in [
18] that impedance control cannot be strictly attributed to either position or force control. There are also methods [
19] that combine both of the above approaches in the force control of underwater manipulators. In many studies, it is proposed to use six-axis force and torque sensors to measure the dynamic effects on the AUV and the manipulator that occur when the latter comes into contact with the target object [
20,
21]. For example, in [
22], the authors created a positional force control system for a hydraulic underwater manipulator of an ROV equipped with a six-axis sensor in the instrument. The method [
23] made it possible to move the working tool of an underwater manipulator equipped with a force–torque sensor along a wall, with this tool exerting a specified force effect on its surface. The performance of the developed method was tested using a computer simulation. The method [
10] is based on the use of an additional control loop for the AUV, which minimizes the coupling effects between the vehicle and the manipulator during contact operations. To make this method work, a torque sensor installed at the attachment point of the manipulator to the AUV was used. This made it possible to neutralize the emerging inaccuracies in the operation of the AUV navigation system. However, these studies did not take into account the specifics of the navigation system in underwater conditions and the associated delays in the formation of the AUV’s vectors of deviation from a certain stabilization point.
Adaptive methods of impedance control of underwater manipulators were presented in [
24,
25], and in [
25], a control system was built for a remote-controlled manipulator performing a contact operation. Both systems were investigated using computer modeling and showed high efficiency. In turn, the effectiveness of the control system developed in [
26] was investigated during a basin experiment taking into account underwater currents. However, in these works [
24,
25,
26], the bases of the manipulators were fixed while performing contact operations, and, accordingly, the inevitable deviations of the AUV from the stabilization point, which affect the quality of manipulation operations, were not taken into account.
In [
27], two control schemes for the manipulator and the AUV for the implementation of force manipulation operations are considered: the first scheme implies the formation of additional thrusts and moments by the propellers of the AUV and the drives of the manipulator, respectively; the second implies the correction of the movement speeds of the manipulator links and the AUV. In both proposed systems, it is clearly seen from computer simulation results that during the execution of the contact operation, the manipulator practically does not change its position, maintaining its original configuration, and the movement of the tool is mainly ensured by an accurate displacement of the AUV. In reality, achieving such a precision of AUV movement is very difficult [
28] due to its greater inertia compared to the manipulator, as well as the static characteristics of its thrusters. It can be seen from the graphs presented that the efficiency of the system decreases when additional impact occurs on the tool in a direction perpendicular to the direction of action of the desired force.
At the same time, in many works [
29,
30,
31], it was noted and shown during experiments and computer simulations that the use of six-axis force–torque sensors significantly complicates the practical implementation of the proposed methods for the following reasons: sensors are subject to noise; due to their design, they reduce the rigidity of the kinematic chain; they have a limited bandwidth; they have a high cost and imply changes in the design of the manipulator.
Approaches are also known to the position–force control of industrial manipulators that do not require force–torque sensors. For example, in works [
31,
32,
33,
34,
35], the estimation of the force exerted on the manipulator tool was carried out with the help of observers and Kalman filters. The effectiveness of these approaches has been confirmed by numerical simulation [
31,
32] and experiments [
33,
34,
35]. In particular, in studies [
36,
37], a method is proposed that allows the calculating of the desired values of external torques for each degree of mobility of multilink manipulators with an arbitrary kinematics, which together provide a given force effect of the working tool on target objects. Furthermore, correction devices have also been synthesized that allow simultaneously and accurately controlling the position of the output shaft of each electric drive of the manipulator and its external torque, through the simultaneous minimization of errors in these two components using a quadratic criterion. In study [
29], observers were used for the force control of an industrial manipulator, providing information about the torque effects acting in the drives. However, these approaches are efficient only in cases where the base of the manipulator is not displaced relative to the target object, which cannot be achieved when performing operations in the hovering mode of an AUV. The approach proposed in [
38] involves the creation of thrust at the attachment point of the manipulator by the AUV thrusters, which is necessary for the position–force control of a manipulator with a fixed base [
36], while taking into account the peculiarities of the influence of a viscous fluid on the moving links of this manipulator. However, the practical use of this approach will be limited by the insufficient accuracy of the stabilization of the AUV [
39] due to the inertia of the vehicle, the nonlinearity of the static characteristics of its thrusters and the limited accuracy of determining the displacements of the AUV relative to the object by means of the technical vision systems (TVS), as well as delays in obtaining navigation information.
In turn, in works [
30,
40,
41,
42], fuzzy algorithms and neural networks were used to evaluate the contact force. However, the use of such intelligent algorithms greatly complicates the system, since it requires the selection and configuration of many parameters, such as the number of layers and nodes of the neural network, the types of activation functions, the number and types of fuzzy rules and membership functions. Also, training and debugging such algorithms is a time-consuming process.
It is important to note that in many works, the calculation of the inverse of the Jacobian is often required, which can slow down the operation of the entire system [
18], since, often, the computing power of on-board computers is limited. In addition, the calculation of the inverse of the Jacobian can lead to computational problems when approaching degenerate positions or boundaries of the manipulator’s working area [
30].
Thus, the conclusion can be drawn that the known methods and approaches still do not provide a high performance of common contact manipulation operations in the AUV’s hovering mode. Therefore, in the present study, we aimed to develop a new control system for AUVs equipped with multilink manipulators to perform contact operations, devoid of the above disadvantages.
The remainder of this paper is organized as follows.
Section 2 briefly describes the methods used in the work, as well as describing the kinematic scheme of the AUV with manipulator considered in the work. The essence of the proposed method is described in detail in
Section 3.
Section 4 presents the results of a semi-realistic modeling of the control system, synthesized on the basis of the proposed method using data obtained during the basin experiment.
Section 5 provides a discussion of the simulation results obtained.
Section 6 summarizes all of the work and also provides plans for further work by the authors.
2. Specifics of Underwater Contact Operations and Methods Used
Before performing an underwater contact operation using system [
8] based on point clouds obtained from the onboard TVS of the AUV, the target object is identified, and the desired trajectory of the manipulator’s working tool is transferred onto its surface, taking into account the possible silting, fouling, and deformation of the object. In this case, the orientation of the working tool is set based on the triangulation surface of the object formed, taking into account the requirements for performing the specific operation. After that, the AUV takes a spatial position near the object. In this object, the trajectory of the working tool is located in the working area of the manipulator in such a way that this tool approaches the object’s surface at a certain service angle. This condition ensures the manipulator will exert minimal possible dynamic effects on the AUV when coming in contact with the surface, and also allows it to compensate for undesirable displacements of the AUV by changing its configuration. To perform research manipulation operations, this problem is addressed in [
43].
To be stabilized in the desired spatial position above or near the target object, the AUV should have a propulsion layout that controls the movements of the vehicle along six degrees of freedom by its thrusters. An example of such a layout for the thrusters of an AUV equipped with a multilink manipulator is shown in
Figure 1. To provide the movement of the working tool with a certain orientation within the working area, the manipulator must have at least six degrees of mobility. As an example, consider the kinematic configuration of a PUMA manipulator with six degrees of mobility (
Figure 1) attached under the center of the buoyancy of the vehicle, which allows for the minimizing of the dynamic effects on the AUV during operations of this manipulator. However, to perform manipulations with vertical structures, the manipulator can be mounted to the side of the vertical axis of the vehicle.
In
Figure 1, the designations are as follows:
is the absolute coordinate frame (CF) in which the AUV moves;
is the CF rigidly related to the AUV’s hull, the beginning of which is located at the center
of the buoyancy of the vehicle, the axis
coincides with the horizontal–longitudinal axis of the AUV, the axis
coincides with its vertical axis and is directed downward, and the
axis makes up the right-hand triple with them;
is the CF related with the base of the manipulator;
are the CF constructed using one of the most efficient varieties of the Denavit–Hartenberg approach [
44,
45] and are related with the origins of the respective links of the manipulator;
is the CF related with the working tool of the manipulator;
are the generalized coordinates of the manipulator;
are the thrusts created by the AUV’s thrusters;
,
,
are the geometric parameters of the layout of the AUV’s thrusters; and
is the vector determining the position of the manipulator’s base in the CF
.
The stabilization of the AUV in the hovering mode is provided by a combined system [
46] consisting of closed and open control loops. The open loop compensates for the negative dynamic effects from the manipulator moving in a viscous medium by the thrusters of the vehicle. The force and moment effects of the manipulator on the AUV are calculated using a recurrent algorithm for solving the inverse dynamics problem (IDP) modified for an underwater multilink manipulator [
47], taking into account the specifics of the effects of a viscous medium on its links. The closed-loop stabilization subsystem holds the AUV in a certain spatial position based on information about the actual linear and angular displacements of this vehicle. The angular displacements of the AUV are estimated by the onboard gyroscopes; linear displacements, by the visual navigation systems [
48,
49].
To compensate for the unavoidable errors of the AUV stabilization system which cause the manipulator’s working tool to shift from the preset trajectory, it is necessary to automatically correct the programmed trajectories and orientation of this tool by means of the system [
50], taking into account the actual displacements of the AUV relative to the initial position. The use of this system will allow the manipulator’s working tool to move along the surface of the target object, maintaining continuous contact with this surface, even with inevitable (albeit insignificant) displacements of the AUV from the stabilization point under the effect of the reaction force exerted by the surface of the object on the working tool.
Since many research manipulation operations do not require a specified force to act on the target object’s surface and are performed after achieving the desired positions of the working tool and the target surface relative to each other, it is sufficient to use the above-described AUV stabilization systems [
46] and make corrections of the manipulator’s programmed trajectories [
50] and orientation to perform such operations. However, the force acting on the working tool upon contact with the object leads to undesirable external moments on the output shafts of the manipulator’s electric drives in the degrees of mobility. These moments lead to errors in the positioning of the working tool and should be compensated for by means of additional control signals of the respective electric drives of the manipulator, formed by adaptive corrective devices [
47].
3. Description of the Method for the Force Control of an AUV with a Manipulator
To perform contact operations with an AUV in the stabilized hovering mode with the manipulator exerting the desired force effect on the object, a method is proposed that does not require high-cost and bulky six-axis force–torque sensors and the resource-consuming calculation of the Jacobian inverse. This method consists of three stages implemented simultaneously in real time.
At the first stage, as the manipulator’s working tool is smoothly approaching the surface of the target object, during the contact movement along this surface, the external moments are estimated that act on the output shafts of the manipulator’s drives in all degrees of mobility as a result of the specified force contact. Based on the estimated values of external moments for the manipulator’s specific kinematic configuration, the magnitude and direction of the vector of force exerted by the manipulator’s working tool on the target object during the contact operation are calculated.
At the second stage, based on information about the desired and actual vectors of force applied to the surface of the object, control signals are sent to the manipulator’s drives of all degrees of mobility. These signals provide extra movements of the working tool in the direction that ensures achievement of the desired magnitude of force effect of this tool on the surface of the target object. In addition, when undesirable linear and angular displacements of the AUV from the initial position appear, the configuration of the manipulator is corrected [
50] in such a way that the specified position and orientation of the working tool relative to the surface of the stationary object are maintained. As a result, such a double correction ensures the continuous contact of the moving tool with the surface of the target object, even with inevitable delays in obtaining information about the linear displacements of the AUV relative to the target object, as well as with the limited accuracy of the position closed-loop stabilization subsystem of the vehicle.
At the third stage, control signals are sent to the inputs of the AUV’s respective thrusters to compensate for the dynamic effects from the manipulator moving in a viscous medium on this vehicle and exerting a force on the target object. Moreover, the control signals of the AUV’s thrusters are formed in real time on the basis of analytical expressions that estimate the force and torque that this manipulator exerts on the AUV. To do this, the calculated magnitude and direction of the vector of the force exerted by the manipulator’s working tool on the target object, the effects of mutual influence between all degrees of mobility of the manipulator, and also the hydrostatic and hydrodynamic forces of resistance to its movement, including viscous frictions and the added masses of the surrounding fluid [
51,
52], are taken into account. As a result, the AUV is accurately stabilized in the hovering mode near or above the target object during the manipulator’s operation. This creates the necessary pull at the point of the manipulator’s attachment to the AUV, which allows the working tool of this manipulator to exert the desired force effects on the surface of the target object.
It should be noted that, when performing the most critical operations, the movement of the working tool along the trajectory should begin only after achieving the desired force effect of this tool on the target object at the start point of the trajectory.
The proposed method is implemented as follows. When the working tool of the underwater manipulator is moving along the surface of the target object, an external moment
, directed along the axis of the hinge
i, acts on the output shaft of the manipulator’s gear drive of the
i-th degree of mobility (
, where
is the number of degrees of mobility of the manipulator):
Here, is the moment caused by the mutual effects between all degrees of mobility of the manipulator, and also by the hydrostatic and hydrodynamic forces of resistance to its movement, including viscous friction and the added masses of the surrounding fluid; and is the moment caused by the support reaction force of the target object’s surface , which is equal in magnitude and opposite in direction to the force of the working tool’s impact on this object—.
Figure 2 shows the above-listed vectors of the forces and moments, and also the vectors of the force
and moment
effects on the AUV from the moving manipulator. The
index marks the vectors associated with the manipulator’s working tool, specified in the CF
.
As already noted above, the right CF with
is rigidly related to each link of the manipulator. The
value is measured using a relatively simple one-axis joint torque sensor [
53] or an observer of the drive load moment [
29,
47]. Thus, values of
moments are calculated using the analytical expressions of the IDP solution for the underwater manipulator [
47]. The magnitude of the
moment is calculated using the expression:
Afterwards, the components of the vector of force acting on the manipulator’s tool
are determined for a specific kinematic configuration of the manipulator, using the calculated values of external moments
acting on the output shafts of the drives in all degrees of mobility, as a result of the force contact of this manipulator’s working tool with the surface of the target object. To simplify the description of the proposed method, it is sufficient to consider the four degrees of mobility (three portable and one orienting) of a PUMA-type manipulator with
(
Figure 2). For the accepted kinematic configuration of an underwater multilink manipulator, the calculation of the above-mentioned vector is as follows.
It is obvious that with
in the joint of the fifth degree of the manipulator’s mobility, an additional moment of force arises. Taking into account
, this moment is calculated using the following recurrent ratios [
47]:
where
is the vector directed along the longitudinal axis of link
i and determining the position of the CF related with link
i + 1 in the CF of the
i-th link;
is the rotation matrix of vectors from the CF related with link
i + 1 into the CF related with the base of the
i-th link; (
) is a vector product of vectors.
The moment
component
directed along the pivot axis of the joint will have an effect on the output shaft of the manipulator’s gear drive of the fifth degree of mobility. Therefore, taking into account expression (3), the component
of the force
acting along the
axis can be found using the expression:
The components
of the vector
acting on the manipulator’s working tool are calculated in a similar way, on the basis of the measured values of the moments
and
arising in the drives of the third and first degrees of mobility, respectively, and caused by the effect of the vector
on the working tool. For the kinematic configuration of the manipulator used, the vector
, taking into account the direction of the CF axes located in the manipulator’s degrees of mobility and with
, will have the following form:
where
.
In this case, taking into account (3) and (5), the vector
will have the following form:
Based on (6), it is easy to calculate:
which makes it possible, taking into account expression (4), to express
as follows:
The vector
in the CF related with the base of the second link of the manipulator is calculated as follows:
where
.
Taking into account (8), we find the vector
in the CF related with the base of the first link of the manipulator:
where
.
Based on (9), it is easy to calculate:
which makes it possible to express:
Taking into account (4), (7) and (11), we find the result as follows:
To ensure that the manipulator tool continuously exerts the desired force effect on the surface of the work object, it is necessary to generate additional control signals for the degrees of mobility of this manipulator. These signals will provide additional tool movements to achieve the desired magnitude of force effect. This is achieved as follows.
Initially, at each point of the trajectory, a unit vector of the desired direction of action of force
, is set. Let us consider the case when, during the manipulation operation, at each moment of time, the manipulator’s working tool is located at right angles to the tangent to the surface of the object at each point of the trajectory. Taking into account the previously obtained ratios (12), there is a difference between the desired vector
and the projection of the actual acting vector
onto vector
:
The location of these vectors is shown in
Figure 3. Taking into account (13), the required value of the additional tool offset is formed using the PID controller:
where
are the corresponding coefficients of the controller; and
is the scalar value of the current difference between the values of the desired and actual forces. This scalar difference is calculated taking into account the direction of the
vector, determined by the value of angle
between vectors
and
(
Figure 3):
As a result, taking into account the above, it is not difficult to obtain the desired
vector of the additional displacement of the manipulator tool:
It is important to note that in the above example of calculating vector
(12) is relevant for one of the many possible configurations of the manipulator (
Figure 2) and was chosen to demonstrate the proposed calculation method. To accurately calculate vector
, other possible configurations must be taken into account during the operation of the manipulator. These calculations are carried out in a similar way to expressions (3)–(12) and are not given in detail in order to preserve the required volume of the article, but are briefly described below.
In general, when the manipulator is not in any of the special positions, vector is calculated based on information about the moments . If , then the calculation of is based on the moments . If , then is calculated based on .
To create the necessary pull at the manipulator’s attachment point to the AUV, which will allow the working tool of this manipulator to exert the desired force effects on the surface of the target object, signals are to be sent to the inputs of the respective AUV thrusters. This will compensate for the force and moment effects exerted on this AUV by the manipulator.
To create additional control signals for the AUV thrusters in real time, the vectors of the force
and moment
of the manipulator’s actions on the AUV’s center of displacement are calculated (
Figure 2). These vectors are determined by the magnitude and direction of the vector
(12) of force exerted on the manipulator’s working tool by the target object, by the mutual effects between all the manipulator’s degrees of mobility, and also by the hydrostatic and hydrodynamic forces of resistance to the movement of the links, including viscous friction and the added masses of the surrounding fluid:
,
, respectively. The above-mentioned dynamic effects
and
, taking into account the calculated value
(12), are estimated using analytical expressions describing the solution of the manipulator’s IDP [
47].
According to the layout of the axes of the manipulator links’ CF and to expression (12), the vectors of force and moment from the manipulator that act on the AUV are calculated as follows:
where
is the moment due to the force
; and
is the rotation matrix of vectors from the CF
related with the manipulator’s working tool into the AUV’s CF
.
The calculated effects are compensated for by the respective AUV thrusters using an open loop of the stabilization system [
46]. As a result, the AUV is stabilized in the hovering mode near or above the target object while its manipulator is performing operations. The necessary pull is created at the point of the manipulator’s attachment to the AUV, which allows the working tool of this manipulator to exert the desired force effects on the surface of the object.
However, even with above-mentioned stabilization system, the AUV will have small inevitable displacements from its stabilization point. These displacements will lead to the loss of force contact of the manipulator’s tool with the surface of the object. To compensate for these small displacements and keep the tool on its trajectories, an automatic correction of the programmed trajectories and orientation of the manipulator’s tool is required.
The corrected vectors of the position and orientation of the manipulator’s working tool
,
represented in the CF
, taking into account the linear and angular displacements of the AUV, will have the following form:
where
is the rotation matrix of the CF
relative to CF
; and
is the vector of the AUV linear displacement in the CF
.
It should be noted that to avoid chattering during the transient phase while establishing the contact of the manipulator’s tool with the object surface, the tool’s approach speed should be maintained as relatively low.
A block diagram of the control system synthesized on the basis of the proposed method is shown in
Figure 4. The new acronyms used in this figure are as follows:
TCU is the unit for correcting the trajectory and orientation of the manipulator’s working tool [
50];
MM and its CS is the model of a multilink manipulator and its control system [
47];
AUV SS is a stabilization system that forms the resulting thrust vector created by the AUV thrusters to compensate for the vector of external force and torque effects on this vehicle from sea currents and the moving manipulator;
AUV NS is the navigation system of the AUV that provides information about the current linear displacement vector in the absolute CF and the angles of the AUV’s roll, pitch, and yaw;
FCU is the unit for controlling the force action exerted by the manipulator on the surface of the target object;
ICU is the unit for calculating the current interaction force of the manipulator with the surface of the object;
IDP is the unit of the IDP solution for the underwater manipulator;
is the vector of external forces acting on the links and the working tool of the manipulator, caused by its interaction with the surrounding viscous medium and the surface of the target object;
is the vector of the actual position of the working tool.
4. Results of Semi-Realistic Simulation of System Operation
For the modeling in Matlab/Simulink R2018a, a well-tested mathematical model of AUVs [
54] was used, with a multilink manipulator whose kinematic configuration is shown in
Figure 1. The main parameters of the AUV and the manipulator are shown in
Table 1. A complete list of parameters of the AUV model used is provided in [
8]; a manipulator model and its parameters are described in detail in [
47]. In this case, the vector
in the CF
has the coordinates
(
Figure 1).
The model consists of a combined AUV stabilization system in the hovering mode [
46], including an open loop (17), and a system [
50] that allows the finding of the coordinates of the vector in the CF
that determines the current desired position and orientation of the working tool on the surface of the object, using information about the linear and angular displacements of the AUV from its initial position (18). Moreover, the information used by these systems about the angular displacements of the AUV, measured by the onboard gyroscopes, is obtained without time delays in the simulation. The vector
of the current linear displacements of the AUV relative to the stabilization point is formed with a delay of 0.25 s due to the speed of processing of the data received from the TVS.
To compensate for the external moments leading to errors in the positioning of the working tool that occur at the output shafts of the manipulator’s gear drives and are caused by its movement in a viscous medium with a force acting on the target object, adaptive corrective devices are used [
47].
To visualize the simulation process in the CoppeliaSim simulator, a seabed scene, including an AUV equipped with a manipulator, was reconstructed (
Figure 5).
A study of the quality of the synthesized system was carried out for two types of contact operations, which most clearly show the scope of application of this system.
The first case is an example of the simplest contact operation of soil sampling, using a sampling device installed in the end-effector of the manipulator. This type of work often involves the vertical or horizontal (as in the presented case) introduction of a sampler into the sediment layer of the soil in order to further study its composition. Such an operation is more straightforward, since it does not require the provision of a given force on the surface. When performing soil sampling, the most important thing is to maintain the relative position of the manipulator tool (sampler) and the surface of the work object (soil) in the case of force contact between them.
In the second case, the operation of cleaning an object of complex shape, previously identified with the help of TVS, is simulated. This operation, in addition to maintaining the specified orientation of the tool relative to a curved surface, requires the provision of a specified force action on this surface. This force’s magnitude and direction should be determined by the technical requirements for a specific force operation.
To simulate the process of performing sampling operations that do not require a desired force acting on the seabed surface, a trajectory of the working tool was formed that simulated the sampling of the surface sediment layer (
Figure 5). The manipulator guided the sampler along the seabed at a speed of 0.02 m/s. Also, during the modeling, the assumption was made that the soil at the sampling site had a homogeneous structure, and its surface was a horizontal plane.
At the moment of contact of the sampler with the sediment, a force with a vector opposite to the direction of the tool’s movement began to act on the working tool. As a result of this contact, moments
appeared in the corresponding drives of the manipulator, the graphs of the changes of which are shown in
Figure 6.
Taking into account the identified moments in the manipulator drives (
Figure 6), the vector of force action
was calculated using expression (12), the obtained components of which are shown in
Figure 7. From this figure, it can be seen that the identified value of the component of the
vector directed against the motion of the sampler varied from 0 to 70 N. At the same time, it can be noted that the manipulator tool was also affected by the
component, due to the reaction force of the support as a result of its partial immersion in the soil surface.
The identified components of the
vector (
Figure 7) made it possible to compensate for the effects of the manipulator on the AUV using the open loop of the stabilization system (17). At the same time, the position and orientation of the manipulator tool was corrected based on the navigation data of the AUV (18). This made it possible to maintain the sampler with the specified orientation relative to the surface.
Figure 8 clearly shows that at 15 s, the angular and linear deviations of the AUV from the stabilization point increased significantly. These deviations were caused by the occurrence of contact of the sampler with the soil surface, as well as delays in obtaining visual navigation information from the TVS. At the same time, it can also be seen from the figure that, even taking into account the presence of angular and linear deviations of the AUV (
Figure 8,
), the Euclidean norm of the vectors of linear deviations of the manipulator (
Figure 8,
) did not exceed its permissible values.
The process of cleaning the surface of an underwater object having a complex shape, with a manipulator’s working tool applying a specified force and using experimental data, was also simulated. To do this, a PET bottle with a diameter of 0.35 m (
Figure 9a) was placed in the testing pool to a depth of 1.5 m. Also, a TVS in a sealed box (
Figure 9b) [
55], developed at IMTP FEB RAS, was immersed in the pool. The TVS included a StereoLabs ZED2 stereo camera (San Francisco, USA), calibrated for operation in an aqueous environment, and an Nvidia Jetson computer (Silicon Valley, California, USA) that processed the received point clouds. After that, the scanning and recognition of the mentioned object was carried out using the TVS.
The point cloud obtained as a result of scanning, containing the object of manipulation, is shown in
Figure 10a,b.
Then, using the well-known methods of RANSAC [
56], Euclidean Cluster Extraction [
57] and Iterative Closest Points [
58], the object of work was selected from the resulting general point cloud of the scene by combining the point clouds of objects contained in the scene (highlighted in green in
Figure 10) with the point cloud of the reference object. At the same time, in order to increase the accuracy of alignment, those points that could not be contained in the point cloud of a real object due to the unidirectional nature of scanning were discarded from the reference point cloud. After that, the accuracy of the alignment of the two point clouds was evaluated. For this purpose, method [
59] was used, which consists in projecting special test trajectories onto the combined triangulation surfaces of the real object and its reference model. After that, the quadratic deviation between the corresponding points of these trajectories is calculated, on the basis of which the accuracy of the performed combination of the two point clouds is estimated.
As a result of the experiment, the target object, the bottle, was successfully identified based on the point clouds of the scanned scene (
Figure 9a). At the same time, the error in determining the location of the object did not exceed 5 mm when it was located at a distance of 1 m from the TVS.
Then the desired trajectory was projected onto the triangulation surface of the scanned real bottle (
Figure 10) perpendicular to its longitudinal axis (
Figure 11a), and the fouling cleaning operation, with movement along it, was simulated. In
Figure 11a, the purple and green surfaces are, respectively, the surfaces of the reference and scanned objects (
Figure 10). The formed trajectory was sent to Matlab/Simulink to be tested by a dynamic model of the manipulator installed on the AUV in the force control mode. The simulation of the identified bottle cleaning also was visualized in CoppeliaSim (
Figure 11b), where the triangulation model of the reference object was used. The speed of the tool’s movement was 0.02 m/s. The coefficient of surface elasticity
was equal to
N/m. To control the magnitude of the exerted force, a controller (14) with coefficients
,
,
was used.
During the operation, the manipulator guided its tool along the surface of the bottle, while maintaining its preset orientation perpendicular to the tangent to the surface at each point of the trajectory. During the process of this movement, a given force of 60 N was exerted on the surface of the bottle.
Figure 12 shows graphs of the changes in the generalized coordinates of the manipulator during the bottle-cleaning operation. In turn,
Figure 13 illustrates the identified components of the moments in the corresponding drives of the manipulator due to the action of the
vector on its tool. It is worth noting that moments identification errors did not exceed 0.5 Nm for all drives during the operation.
The components of the
vector, calculated taking into account the identified
moments (
Figure 13), are shown in
Figure 14. From this graph, it can be seen that after the completion of all transients, the manipulator tool acted on the object of work with a given force (
Figure 14,
). The same figure shows the
component due to the friction force of the tool with the surface of the processed bottle. The presented results show the absence of significant chattering between the working tool and the object of work, leading to periodic losses of force contact or to the complete impossibility of performing such operations.
Figure 15 shows the curves of variations in Euclidean norms
,
vectors of the working tool’s deviation from the specified trajectory and the deviation of the AUV center of displacement from the stabilization point in the absolute CF, and deviations of the AUV roll, pitch and yaw angles. As can be seen from the curves, at the beginning of the simulation, the vector
began to exert an effect on the working tool. However with the use of the calculated values
in the open loop of the AUV stabilization system, which take into account the value of the calculated vector
, the
deviation of the vehicle remained within 0.01 m in most parts of the simulation, while the value
did not exceed a few mm all along the trajectory.
It should be noted that the increasing errors in the position and orientation of the AUV (
Figure 15) that occur at the beginning of the simulation are due to several factors, such as delays in receiving navigation information from the TVS and the limited accuracy of the AUV propulsion control system, including the dynamic and static characteristics of its thrusters. These factors inevitably lead to an increase in the duration of transients during the establishment of a given force effect on the object of work (
Figure 13 and
Figure 14). At the same time, the effectiveness of the control system for the force exerted by the manipulator (
Figure 4) depends not only on the parameters of the controllers of the AUV stabilization system, but also on the selected coefficients of equation (14).
6. Conclusions
In the present article, we propose a new method for an AUV with a manipulator to perform contact operations by exerting the desired force effect on the target object in the mode of stabilized hovering. The control system of these dynamic objects, synthesized on the basis of the method, does not require six-axis force–torque sensors and the resource-consuming calculation of the Jacobian inverse. This system calculates the magnitude and direction of the force vector exerted by the manipulator’s working tool on the object during the operation. The information used for calculations are the external moments acting on the output shafts of the manipulator’s gear drives in all degrees of mobility as a result of the force contact of the working tool with the surface of the object, measured by relatively simple one-axis sensors or estimated by observers.
The manipulator continuously exerts a specified force effect on the object through the additional displacement of the working tool in the direction of the vector of difference between the vectors of the desired and actual force effects. As the results of the numerical simulation have shown, for precisely controlling the force, it is sufficient to use a PID controller of the value for the additional displacement of the tool.
Simultaneously, the thrusts of the AUV, formed by the open loop of its stabilization system, provide compensation for the real-time force and torque effects on the AUV from the manipulator performing the force operation. As a result, the necessary pull is created at the point of the manipulator’s attachment to the AUV, which allows the working tool of this manipulator to exert the desired force effects on the surface of the target object.
It is worth noting that the successful control of an AUV with a manipulator during a contact operation requires the contours of stabilization and correction of the trajectories and the orientation of the manipulator’s working tool that are closed in the position and orientation of the vehicle. This allows continuous contact with the surface to be maintained all along the trajectory of the tool.
To test the operability and functional features of the synthesized system, a numerical simulation using experimental data was performed. The simulation took into account the dynamic characteristics of the AUV and the manipulator, and also the delays in obtaining information from the navigation system of the vehicle using the TVS. It is worth noting that for the numerical simulation, real information about the object of manipulation work obtained during an experiment with a real TVS was used. During the simulation, the deviations of the AUV from the stabilization point did not exceed 0.013 m and 0.04 m for the sampling and cleaning operations, respectively. In the first case, the magnitude of the force effect of the tool on the surface reached 70 N. In the second case, the manipulator successfully reached the set value of the force effect of 60 N, and the overshoot did not exceed 85 N. In both cases, the tool deviations from the trajectory did not exceed 0.006 m. The simulation results have confirmed the high efficiency of the proposed system in performing contact manipulation operations.
It is worth noting that when performing some of the most crucial manipulation work, a given effort must be exerted, starting from the point of first contact of the tool with the object of work. In this case, it is necessary that the tool remains stationary at the starting point of the trajectory, until all transients are completed during the establishment of a given force, and only after that does it begin to move along the trajectory.
At the same time, it is obvious that the effectiveness of the developed system largely depends on the accuracy of identifying moments in the manipulator drives caused by contact with the object of work. This is because the accuracy of determining these values depends on the accuracy of identifying the force exerted by the tool, which in turn affects the efficiency of the open loop of the AUV stabilization system.
It is expected that the use of the created methods will allow one not only to achieve a high-quality solution to currently existing operational tasks in offline mode, but also to significantly expand the range of work performed by the AUV. These developments formed the basis for the creation of experimental samples of underwater manipulators [
60] and TVSs at the IMTP of the Far Eastern Branch of the Russian Academy of Sciences, which are based on the MMT-3500 AUV [
61]. Further research will be aimed at developing docking technology using the proposed system, which will allow the automatic docking of AUVs equipped with manipulators with docking platforms. This method will include the capture of a universal rod mounted on the docking platform using a manipulator grip, followed by the docking of the AUV by automatically changing the configuration of the manipulator. It is also planned to conduct marine tests of the developed systems.