IoT 03 00020 v2
IoT 03 00020 v2
Article
An Application of IoT in a Drone Inspection Service for
Environmental Control
Muriel Cabianca 1 , Maria Laura Clemente 1, * , Gianluca Gatto 2 , Carlo Impagliazzo 1 , Lidia Leoni 1 ,
Martino Masia 3, * and Riccardo Piras 3
1 CRS4, Center for Advanced Studies, Research and Development in Sardinia, Loc. Piscina Manna Ed. 1,
09050 Pula, Italy
2 Department of Electrical and Electronic Engineering, University of Cagliari, Via Marengo, 2,
09123 Cagliari, Italy
3 IT Euromedia, Sede Operativa, Via Luigi Galvani, 27/29, 09047 Selargius, Italy
* Correspondence: [email protected] (M.L.C.); [email protected] (M.M.)
Abstract: This paper presents an exploratory activity with a drone inspection service for environmen-
tal control. The aim of the service is to provide technical support to decision-makers in environmental
risk management. The proposed service uses IoT for the interaction between a mobile application, a
Smart City platform, and an Unmanned Aircraft System (UAS). The mobile application allows the
users to report risky situations, such as fire ignition, spills of pollutants in water, or illegal dumping;
the user has only to specify the class of the event, while the geographical coordinates are automatically
taken from device-integrated GPS. The message sent from the mobile application arrives to a Smart
City platform, which shows all the received alerts on a 3D satellite map, to support decision-makers
in choosing where a drone inspection is required. From the Smart City platform, the message is sent
to the drone service operator; a CSV file defining the itinerary of the drone is automatically built and
Citation: Cabianca, M.; Clemente, shown through the platform; the drone starts the mission providing a video, which is used by the
M.L.; Gatto, G.; Impagliazzo, C.; decision-makers to understand whether the situation calls for immediate action. An experimental
Leoni, L.; Masia, M.; Piras, R. An activity in an open field was carried out to validate the whole chain, from the alert to the drone
Application of IoT in a Drone mission, enriched by a Smart City platform to enable a decision-maker to better manage the situation.
Inspection Service for Environmental
Control. IoT 2022, 3, 366–380. Keywords: environmental control; drone inspection; smart city platform; IoT; UAS
https://doi.org/10.3390/iot3030020
Drones have proved to be very effective in managing safety in public places thanks to
some of their characteristics:
• they are fast;
• they can reach considerable heights;
• they are equipped with cameras that return high definition images;
• they are cheaper and more effective than other airborne monitoring systems (e.g., helicopters).
These features make drones a valuable ally in security management, from surveillance
in contexts such as major events to logistical support for interventions in difficult-to-access
sites that have suffered natural disasters.
Thanks to the different types of sensors with which drones can be equipped, it is easy
to detect, for example:
• illegal dumping and abandonment of waste;
• spills of pollutants in water;
• fire ignition.
Drones are therefore greatly effective in cases where monitoring is particularly expen-
sive and/or difficult: they can provide live images and videos to operational centers and
promptly activate risk mitigation operations.
However, a drone has many limitations, the most important of which are summarized
below. It has a short flight time, which is about 15 to 25 min depending on the type of
drone. The batteries need to be frequently replaced in order to use the drones for a longer
period. Their endurance strongly depends on the type of drone: multirotor drones are
subject to greater energy consumption, while fixed-wing drones can last longer, having
better performance at the expense of maneuverability.
On rainy or windy days, it is difficult to fly a drone as the battery as well as the
electrical components are sensitive to moisture, and water droplets can cause malfunctions.
Moreover, a strong wind could interfere with the flight and even cause a crash.
Another issue is related to safety. In fact, there have been cases of drones injuring the
drone operator or other people, as described in many studies, such as, for instance, [1–4].
For this reason, not everyone takes well to seeing a drone flying over their surroundings,
and for this reason flying over people not involved or not informed is generally forbidden
or strictly restricted. Several countries regulate the use of drones in order to reduce the
chances of accidents. In fact, regulations are a major reason for the slow development of
drone usage; a significant limitation on drone operations is the requirement that they must
be conducted within view of an operator. It is possible to request proper authorizations,
but these are difficult to obtain.
Some drones, such as the one used for the presented activity, make it possible to
minimize safety issues during flight; for example, in case of signal loss, the drone can
automatically go back to the position recorded as “Return to Home”.
This paper presents a system based on drone inspection to optimize environmental
surveillance that has been integrated with an existing platform, dedicated to the manage-
ment of a Smart City. Starting from alerts sent by users through a mobile application, all
the alerts are collected by the Smart City platform, and shown in a 3D satellite view to a
decision-maker; the platform supports the decision-maker in choosing the alerts which
require a drone inspection; he/she must then select the alert and click the ‘send drone’
button. This request is sent by the Smart City platform to the drone operating room where
a mission is automatically planned through an algorithm properly developed for the pre-
sented activity, which outputs a CSV file defining the route and other parameters for the
drone mission.
Related Work
The use of drones with an on-board camera or sensors for terrain surveillance pur-
poses has become increasingly widespread. For instance, in manufacturing monitoring, an
interesting application is described in [5], which is a paper about the use of drone inspection
IoT 2022, 3 368
of power facilities and structures, dealing with common difficulties: flight stability, control
accuracy, and safety; in particular, it provides a detailed state of the art review dating back
to 2018, based on a selection of 27 papers where the use of drones allows safe outdoor and
indoor location inspection of difficult/hazardous areas, mentioning also application of
methodologies based on Artificial Intelligence, and 3D reconstructions; however, none of
the described applications uses a Smart City platform to make the results of drone inspec-
tions available on a map to be consulted by a decision-maker. In a more recent work [6], a
Geographic Information System is used coupled with drones for bridge inspections.
Drones can also help in early fire detection, as described in some recent works [7,8]
discussed below, which detail technical improvements in inspections, but do not involve the
use of a Smart City platform to manage the whole controlled area in a 3D map, integrating
all the information coming from other available sources. One of these studies is [7], where
forest fire surveillance is performed with live video streaming from a UAV through multiple
LTE Networks, based on Scalable Video Coding (SVC); the authors tested the proposed
forest fire surveillance system in Indonesia using a cheap set of lightweight devices for
high-quality video streaming, that allows firefighters to easily control a wide area. Another
experimental activity with a fire surveillance system based on drones is presented in [8];
in this case the system is based on magnetometer sensors, temperature sensors, and night
vision cameras on drones to notify the controller.
An example of drone-assisted IoT is presented in [9], which describes the design and
implementation of an online drone-based target detection system that performs online
data processing and autonomous navigation through an adaptive motion planner. The
paper also describes an experimental activity of the system at high altitude. Another
example of drone-based surveillance IoT for industrial security application is presented
in [10]; the work describes a system to allow authenticated users to login from any device,
anywhere, and view real-time video or images sent from drones. A similar work on drone
surveillance applied to smart cities is presented in [11], which focuses on the challenging
issue related to energy conservation in UAVs in order to enhance flight time, and provides
an interesting discussion of two case studies of the use of drones in the smart cities of
Singapore and India, only mentioning the importance of a control room to manage the
complete technical infrastructure.
A major survey of the potential techniques and applications of drone and IoT collabo-
ration is presented in [12], based on an analysis of recent and ongoing research activities
aimed at improving real-time applications for smart cities, including the generation of
high-resolution 3D maps; in particular, the focus of the study is on the measurement of the
smartness of the cities based on quality of life, healthcare, public safety, disaster manage-
ment, environmental aspects (such as energy efficiency, air quality, traffic monitoring, etc.),
and services; less importance is given to the visualization of all the information on a 3D
map in order to support decision-making.
In the activity described in [13], drones are used for detection and identification of
pollutants on the water surface, by pictures taken from a camera on the drone. Another
paper on this topic is [14], which provides an interesting state-of-the-art survey of drones
and sensor systems in relation to the petroleum industry, including functions such as
offshore oil spill detection, oil leakage detection, pipeline monitoring, gas emission sensing,
remote facility inspection, petroleum exploration (i.e., land surveying, geologic mapping,
and petroleum exploration), and other related environmental monitoring.
Some significant EU-funded projects involving the use of drones in environmental
control are described below.
5G!Drones [15] uses 5G to enhance drones and UAVs in many real-world applications,
such as: traffic management; public safety; situation awareness (equipping drones with
IoT devices, such as HD camera, gas sensors, humidity/temperature sensors, and devices
for remote environmental monitoring interacting with a large network of sensors on the
ground); connectivity during crowded events where cellular networks face an extremely
high demand for communication capacity.
IoT 2022, 3 369
Figure 1. The main parts of the proposed system: the mobile application, the smart city platform
which includes the application server (back end) and the web front end, and the system to plan and
manage the inspections made by a drone. * Image from flaticon.com, accessed on 7 July 2022.
FigureFigure
2. Details of the mobile
2. Details application
of the mobile to report
application a dangerous
to report situation.
a dangerous situation.
Each alert message is in JSON format and also includes the geographical coordinates
of the mobile phone, along with the timestamp, and two unique identification strings: one
related to the device (“id”), and the other to the alert itself. An example of alert type ‘waste’,
in JSON format, is as follows:
{
“id”: “ae0af7284b27fd6c”,
“ts”: “17 February 2022 16:57:17”,
“id_event”: “ae0af7284b27fd6c17-Feb-2022 16:57:17”,
“lat”: 39.2686312,
Figure 2. Details of the mobile application to report a dangerous situation.
IoT 2022, 3 371
“lng”: 9.1757257,
“type”: “Waste”,
“msg”: ““
}
Figure3.
Figure 3. The
The ThingsBoard
ThingsBoardrule
rulechain
chainto
toreceive
receivealerts
alertsfrom
fromthe
themobile
mobileapplication.
application.
The platform’s front end is a powerful tool to support the decision-maker in the
selection of the alerts which require a drone inspection (see Figure 4).
IoT 2022, 3 372
Figure 3. The ThingsBoard rule chain to receive alerts from the mobile application.
The
The platform’s front end
platform’s front end is
is aa powerful
powerful tool
tool to
to support
support the
the decision-maker
decision-maker in
in the
the
selection of the alerts which require a drone inspection (see Figure 4).
selection of the alerts which require a drone inspection (see Figure 4).
Figure 4. The Smart City platform, with some alerts related to fire ignition and illegal dumping.
Figure 4. The Smart City platform, with some alerts related to fire ignition and illegal dumping.
In particular,
In particular, the
the front
front end
end of
of the
the platform
platform is
is made
made of
of the
the following:
following:
•• aa main
main menu,
menu, onon the
the top,
top, center;
center;
•• two sidebars, one on the
two sidebars, one on the left left and
and the
the other
other onon the
the right,
right, showing
showing analytical
analytical and
and
statistical information
statistical information about
about all
all the
the received
received requests;
requests;
•• a navigable 3D satellite map, in the center.
a navigable 3D satellite map, in the center.
Figure 44 shows
Figure shows different
different statistics
statistics regarding
regarding the the use
use casecase of
of drones.
drones. The The data
data shown
shown
in the sidebars refer to a time span that embraces the previous
in the sidebars refer to a time span that embraces the previous 30 days; however it 30 days; however it is
is
possible to modify the value of the time span parameter. In the left
possible to modify the value of the time span parameter. In the left bar it is possible to find bar it is possible to
find information
information ontypes
on the the types
of reportsof reports
and theirand cardinality;
their cardinality; the status
the status ID of theID reports
of the reports
is also
is also displayed
displayed makingmaking
it possible it possible to understand
to understand how many howof many
them are of them
new andare hownew many
and how are
many
still are still The
pending. pending.
bar onThe thebar onshows
right the right shows
a pie chartabased
pie chart based
on the on the cardinality
cardinality of the report of
the report
types and atypes
table and
withathe table
logwith
of thethe log ofand
reports thetheir
reports
status.andOn their
the status.
centralOn map, thedifferent
central
map, different geo-referenced
geo-referenced pins are shownpins are shown
to indicate to indicate
the points of thethe pointsthe
reports, of type
the reports,
of the iconthe
type of the icon matching with the type of report and the
matching with the type of report and the color with the progress of the request. color with the progress of the
request.
Whenever a message is sent through the mobile application, it is received by the Smart
Wheneverwhich
City platform, a message
worksisassent through
control room,the mobileallapplication,
showing the alerts in itthe is 3D
received
satellitebyview.
the
Smart
A proper City platform,
algorithm forwhich works as control
decision-making has not room, showing yet,
been developed all the
but alerts
from the in the
overall3D
view, shown
satellite view.inAFigure
proper 4, algorithm
the decision-maker is supportedhas
for decision-making in the
not careful analysis ofyet,
been developed all but
the
messages receivedview,
from the overall in order
shown to single out the
in Figure most
4, the dangerous ones
decision-maker is that call for in
supported anthe
inspection
careful
by drone. In order to do this, he/she simply has to select the
analysis of all the messages received in order to single out the most dangerous onesalert shown in the view, which
that
opens
call fortheanrelated widget
inspection (also called,
by drone. ‘infobox’);
In order the widgets
to do this, he/she simplyof all the
hasnew alertsthe
to select have an
alert
extra
shown button
in theto activate
view, which theopens
requestthefor a drone
related flight.(also
widget On called,
the map, the alertsthe
‘infobox’); arewidgets
shown of in
different colors, according to their status. Four progress statuses are possible:
• new requests, for which it is possible to select and eventually activate the alert mecha-
nism linked to the flight of the drone;
• mission requested (when the button has been clicked by the decision-maker);
• ongoing missions, showing the route of the drone;
• completed missions, after the drone completes its mission.
map, the alerts are shown in different colors, according to their status. Four progress
statuses are possible:
• new requests, for which it is possible to select and eventually activate the alert
mechanism linked to the flight of the drone;
IoT 2022, 3 • mission requested (when the button has been clicked by the decision-maker); 373
Figure 5. One of the new alerts (about illegal dumping) is selected on the 3D satellite map, along with
Figure 5. One of the new alerts (about illegal dumping) is selected on the 3D satellite map, along with
the widget where a button allows the decision-maker to require an inspection by drone.
the widget where a button allows the decision-maker to require an inspection by drone.
2.3.
2.3. Programming
Programming aa Mission
Mission
For
For the
the on
on field
field experimental
experimental activity,
activity, aa DJI
DJI Inspire
Inspire 22 drone
drone waswas used,
used, which
which can
can fly
fly
for 25 min and is able to take the required images images through
through the the DJI
DJI Zenmuse
Zenmuse x5s x5s optics.
optics.
According to the manufacturer, this is the first filmmaking drone in the world to
integrate an HD video transmission system, a 360 360°◦ rotating gimbal, and a 4K camera. This
model can detect obstacles up to 30 m ahead and 5 m above. above. When the drone operating
room receives a request for a new inspection by drone, the mission is planned and a CSV
file with the route is automatically built, starting from the coordinates of the place of the
original alert.
The algorithm to build the optimized route was designed and developed for the
presented application,
application, and and should
should be be explained
explainedin inmore
moredetail.
detail.InInfact,
fact,it itcan
canelaborate
elaboratea
a set
set ofof itineraries
itineraries forfor a fleet
a fleet ofof drones,
drones, to to inspect
inspect anan area
area which
which includes
includes several
several points
points of
of interest.
interest. In In this
this scenario,
scenario, thedrones
the dronesareareconsidered
consideredasasaa multi-agent
multi-agent system,
system, and and each
drone as a resource to be dynamically allocated to a sequence of tasks related to each of
the points of interest in the area. To do this, the area is split in sub-areas, called ‘equitable
partitions’,
partitions’, each
eachone oneincluding
includingonly onlyone
onepoint
pointof of
interest, following
interest, followingthe the
Voronoi
Voronoicriteria [24].
criteria
Each Each
[24]. dronedrone
is assigned a mission
is assigned made of made
a mission a sequence
of a of tasks minimizing
sequence two parameters:
of tasks minimizing two
the time fromthe
parameters: thetime
request
from to the
the mission
request andto thethe mission
sum of the anddistances
the sumtraveled
of the by all the
distances
drones involved.
traveled by all the Each itinerary
drones includes
involved. a circular
Each itinerary flight arounda acircular
includes point offlight
interest, where
around a
the radium of the circle is calculated as half the minimum diameter
point of interest, where the radium of the circle is calculated as half the minimum of that Voronoi cell. The
developedofalgorithm
diameter that Voronoi returns in output
cell. the set ofalgorithm
The developed itinerariesreturns
(one forin each
output drone)thedefined
set of
in a CSV file described in detail later in this paragraph. The presented experimental test
involved only one drone, and its itinerary was built with the described criteria, around the
only point of interest considered. But a further development will cover a greater area, with
more point of interests and an inspection by a fleet of drones.
The generated CSV file must be downloaded and imported on the “Litchi” plat-
form [25], a third-party software that allows mission planning and which integrates with
most of the drones on the market. In the CSV file, the coordinates of the points defining the
drone’s mission are listed; an example of a CSV file is shown in Figure 6.
was built with the described criteria, around the only point of interest considered. But a
further development will cover a greater area, with more point of interests and an
inspection by a fleet of drones.
The generated CSV file must be downloaded and imported on the ‘‘Litchi’’ platform
[25], a third-party software that allows mission planning and which integrates with most
IoT 2022, 3 374
of the drones on the market. In the CSV file, the coordinates of the points defining the
drone’s mission are listed; an example of a CSV file is shown in Figure 6.
In the
In the file,
file, each
each row
row represents
represents aa waypoint
waypoint position
position and
and aa set
set of
of actions
actions to
to perform
perform
over it.
over it.
Apart from
Apart fromthethe obvious
obvious meaning
meaning of latitude,
of latitude, longitude,
longitude, and aaltitude,
and altitude, a brief
brief description
description
of of theparameters
the nontrivial nontrivial can
parameters
be givencan be given as follows:
as follows:
•• controls the
heading(deg) controls the starting
starting rotation
rotation of
of the
the aircraft;
aircraft;
•• curvesize(m) controls the curve angle of the UAV UAV passing
passing wayway points.
points. By default, it is
set to (=0.0);
•• rotationdir camera control parameter sets the UAV basic turn direction to right (0) or
left (1);
•• gimbalmode camera
gimbalmode cameracontrol
controlparameter;
parameter;0 0deactivates
deactivates thethe gimbal
gimbal control;
control; 1 activates
1 activates the
the gimbal
gimbal for focusing
for focusing POIs;
POIs; 2 activates
2 activates the the gimbal
gimbal for for focus
focus andand interpolates
interpolates a field
a field of
of view
view in an
in an angle
angle of gimbalpitchangle
of gimbalpitchangle
• gimbalpitchangle vertical angleangle ofof camera
camera +30
+30 deg. −90deg;
deg.−90 deg;
• actiontypeX (with X from 0 to 5) specifies the type of
actiontypeX (with X from 0 to 5) specifies the type of action action of theofcamera (defined
the camera later);
(defined
• actionparamX
later); (with X from 0 to 5) provides corresponding parameter for the individ-
• ual actiontype.(with X from 0 to 5) provides corresponding parameter for the
actionparamX
individual
The actiontypeactiontype.
parameter could be:
0:
Thestay hovering;parameter could be:
actiontype
1: take hovering;
0: stay photo;
2: start recording;
1: take photo;
3: stop recording;
2: start recording;
4: rotaterecording;
3: stop aircraft;
5: tilt camera.
4: rotate aircraft;
After loading the CSV file on the platform, the mission, the point of interest, and the
5: tilt camera.
related
After loadingconfigured
waypoints the CSV filearound
on thethe target, will
platform, be displayed
the mission, on a georeferenced
the point of interest, andmapthe
2, 3, FOR PEER REVIEW of Litchi and then made available on any device connected to the 10 as shown in
platform,
related waypoints configured around the target, will be displayed on a georeferenced
Figure
map of7. Litchi and then made available on any device connected to the platform, as shown
in Figure 7.
The flight plan of the mission is therefore available on the device that is connected to
IoT 2022, 3
the drone controller, which allows the management of all the functions of the aircraft. 375
Before starting the aerial monitoring of the specified point of interest, it is possible to
modify or add waypoints around the target and/or complete the configuration of the
specific mission by varying some parameters.
From
From this
this moment
moment on,on, the
the mission
mission and
and all
all the
the functions
functions of
of the
the drone
drone can
can also
also be
be
managed directly via the controller (see Figure 8).
managed directly via the controller (see Figure 8).
Figure8.8.The
Figure Themission
missionisismanaged
managedthrough
throughthe
thedrone
dronecontroller.
controller.
Thedrone
The dronesends
sendsthe
thereal-time
real-timevideo
video
viavia YouTube,
YouTube, through
through thethe mobile
mobile phone
phone connected
connected
to the droneto controller.
the drone controller.
After theAfter the mission’s
mission’s end, its end, itschanges
status status changes from
from ‘ongoing’ to
‘ongoing’ toand
‘completed’ ‘completed’
the video and
shotthe video
from shot from
the drone the drone
becomes becomes
available to theavailable to the on
decision-maker
decision-maker
the on the
map of the smart map
city of the
(from thesmart
widgetcity (fromtothe
related thewidget related to the mission).
mission).
3.
3. Results
Results
The
Theon-field
on-fieldtesting
testingactivity
activitycovered
coveredthethe
whole
wholepresented
presentedsolution, from
solution, the alert
from to the
the alert to
end
the of
endtheofdrone mission,
the drone managed
mission, through
managed the Smart
through the City
Smartplatform. Unfortunately,
City platform. a large
Unfortunately,
no-fly
a largezone,
no-flydue to restrictions
zone, on drones
due to restrictions onover military
drones overand urbanand
military areas, led areas,
urban to the led
choice of
to the
achoice
rural place about 15 km from Cagliari. There, three people used a drone
of a rural place about 15 km from Cagliari. There, three people used a drone simulating an
operational
simulating an base (see Figurebase
operational 9), another person
(see Figure went nearby
9), another personwith a mobile
went nearbyphone
with atomobile
send
IoT 2022, 3, FOR PEER REVIEW alerts, while a person from the office pretended to be the decision-maker and selected one11
phone to send alerts, while a person from the office pretended to be the decision-maker
of
andtheselected
alerts toone
request
of thean inspection
alerts by drone.
to request an inspection by drone.
It must be specified that in a real context the number of people required is lower
than the number of people that were involved in the on-field simulation; in fact, only one
person is sufficient to make the report, who is supposed to be a common citizen willing to
communicate a risk situation. To manage the smart city platform, the decision-maker can
lead the environmental inspection along with a flight planner, and a pilot (but they can
be the same person). It must be said that in some countries (such as in Italy), due to the
already mentioned safety issues, the drone operator must guide the drone without losing
sight of it, but drones are already technically able to replace humans in environmental
inspections.
Figure9.9.AAphoto
Figure photoof
ofthe
theoperating
operatingbase,
base,taken
takenfrom
fromthe
thedrone.
drone.
ItThe
mustexperimental
be specifiedchain
thatwas
in acompleted
real contextin less than halfofanpeople
the number hour. An issue related
required is lowerto
the the
than precision
numberofofthe GPSthat
people coordinates,
were involvedarising
in thebecause
on-fieldthe mobile in
simulation; phone was one
fact, only not
connected
person to Wi-Fi,torequires
is sufficient make the some more
report, whoconsideration.
is supposed to be a common citizen willing to
communicate a risk situation. To manage the smart citydepends
The accuracy of the GPS system of smartphones platform,onthe
several factors. First
decision-maker of
can
all, when
lead a GPS is activated
the environmental or ifalong
inspection the GPS
withhas beenplanner,
a flight inactiveand
in the background
a pilot for too
(but they can be
long, the GPS needs to fetch data from the satellites that describe the position and timing
of all of the satellites in the system. This can take up to 4 min to be corrected, and during
this time the GPS is not reliable (this is the so called “cold start”). Usually, to cope with
GPS inaccuracy the Android subsystem uses several methods; one of these is the Wi-Fi
connection that can provide a first georeferentiation, which is then refined with satellite
IoT 2022, 3 376
Figure 9. Aperson).
the same photo ofItthe operating
must be saidbase,
thattaken from
in some the drone.
countries (such as in Italy), due to the already
mentioned safety issues, the drone operator must guide the drone without losing sight of
it, butThe experimental
drones are already chain was completed
technically in less humans
able to replace than halfinanenvironmental
hour. An issue related to
inspections.
the precision of the GPS
The experimental chain coordinates,
was completed arising
in lessbecause
than halfthe mobileAnphone
an hour. was not
issue related to
connected
the precision to Wi-Fi,
of the GPSrequires some more
coordinates, consideration.
arising because the mobile phone was not connected
The requires
to Wi-Fi, accuracysome of themoreGPSconsideration.
system of smartphones depends on several factors. First of
all, when a GPS is activated
The accuracy of the GPS system or if the GPS has beendepends
of smartphones inactiveoninseveral
the background
factors. First foroftoo
all,
long, the
when a GPSGPS is needs
activatedto fetch
or if data
the GPSfrom thebeen
has satellites
inactive that
indescribe the position
the background and
for too timing
long, the
GPS
of allneeds
of thetosatellites
fetch data in from the satellites
the system. thattake
This can describe
up tothe position
4 min to be and timing and
corrected, of allduring
of the
satellites
this time inthethe
GPSsystem.
is notThis can take
reliable (thisup to 4so
is the min to be“cold
called corrected, and
start”). during to
Usually, this timewith
cope the
GPS is not reliable
inaccuracy the(this is the so
Android called “cold
subsystem usesstart”).
several Usually,
methods;to cope with
one of GPSisinaccuracy
these the Wi-Fi
the Androidthat
connection subsystem
can provide uses several methods; one of these
a first georeferentiation, whichis the Wi-Fi
is then connection
refined with that can
satellite
provide a first georeferentiation, which is then
data; the absence of Wi-Fi slows down the “cold start” process. refined with satellite data; the absence of
Wi-FiAnother
slows down factorthe “cold start”
is related to theprocess.
Android energy management and its customizations:
the moreAnother factor is
aggressive it related to thethe
is, the more Android energy
sensor will tend management
to be turnedand itsimprove
off to customizations:
battery
the more aggressive it is, the more the sensor will tend to be turned off to improve bat-
performance.
tery performance.
The mobile app presented in this project is POC and so prone to several
The mobile to
enhancements; appfixpresented
several in of this project
these issuesis POC
it is and so prone
possible to to severalthe
enforce enhancements;
application
to fix several of these issues it is possible to enforce the application
development to force the app to be always active, and thus with the GPS coordinates development to force
the app
updated. to be always active, and thus with the GPS coordinates updated.
Figure 10
Figure 10 shows
shows the the drone
drone during
during thethe inspection.
inspection.
Figure 11 shows two alerts and the points for the inspection.
A detail of the points of the drone mission are shown in Figure 12.
As already mentioned, at present, the drone can share a streaming video of the area
on YouTube through the mobile phone connected to the drone controller. Once the mission
ends, the video is also made available on the platform, as shown in Figure 13. Based on the
video, the decision-maker can determine if an inspection by a team is necessary, and this
closes the chain.
It can be said that there are two kinds of limitations common to any drone-based
service: technical and regulatory. The technical limitations can be overcome by innovative
evolution, while the regulatory ones can be bypassed with a special license issued by the
authorities to operate in emergency situations. The on-field test was sufficient to better
understand the advantages and disadvantages of the proposed solution, which are the
challenges encountered by any similar system, and which are summarized below.
IoT 2022, 3, FOR PEER REVIEW
Figure 11 shows two alerts and the points for the inspection.
Figure 11. The on-site test shown on the smart city platform.
Figure 11. The on-site test shown on the smart city platform.
FigureA11. The on-site
detail of the test shown
points on the
of the smart
drone city platform.
mission are shown in Figure 12.
A detail of the points of the drone mission are shown in Figure 12.
Figure12.
Figure 12.AAdetail
detailofofthe
thepoints
pointsofofthe
theon-site
on-sitemission
missionasasshown
shownon
onthe
theplatform.
platform.
Figure 12. A detail of the points of the on-site mission as shown on the platform.
As already
The mentioned,
main advantage of at
thepresent, the drone
presented canisshare
solution a streaming
that in videocenter,
the operations of the area
the
on YouTube As
through already
the mentioned,
mobile phone at present,
connected the
to drone
the can
drone share a streaming
controller.
decision-maker can manage many kinds of reports coming from all the vertical applications Once video
the of the
mission ends,on
implemented on
the YouTube
thevideo
Smart through
is City the
also platform, mobile
made available phone
on the
not only connected
theones
platform,
related to the
astoshown drone controller.
in Figureuse
the presented 13. Onc
BasedInon
case. the
fact, mission
thevideo, ends, the video
the decision-maker
information is also
generated by can made available
this determine on the platform,
if an inspection
specific application as shown
by aofteam
is only one many,is in Figur
necessary,
built on dataand Based onfrom
this closes
collected the video,
chain. the
thesensors anddecision-maker
other sources, can determine
which togetherif compound
an inspection
the by a tea
necessary, and this closes the chain.
control room of a Smart City, providing the decision-maker with a holistic view of what is
happening in the area.
IoT 2022,3 3, FOR PEER REVIEW
IoT2022, 378
13
Figure13.
Figure 13.When
Whenthe
themission
missionends,
ends, the
the video
video is
is also
also made
made available
available on
on the
the platform.
platform.
It can
An be saidadvantage
important that thererelated
are two to kinds
the useofoflimitations
a drone is that common to any
it is easy drone-based
to fly at low and
service: technical
ultra-low and regulatory.
altitudes, compared to manned The aircraft;
technical for limitations can betoovercome
this reason, thanks the on-board by
innovative
video camera,evolution, while the
it was possible to getregulatory ones can
high-resolution be bypassed
images and playwith a special license
the video.
issued by the
Another authorities
advantage to operate
is related in emergency
to the possibility for thesituations. The on-field
drone to reach test was
difficult-to-access
sufficient
sites, such asto the
better
lake understand
nearby (clearly thevisible
advantages
in Figure and11), disadvantages
if necessary. of the proposed
solution, which
The main are the challenges
disadvantage is relatedencountered
to the battery: by theanydrone
similar system,
needed and
to be which are
recharged for
asummarized
couple of hours below.before the mission, and its autonomy would not have lasted more than
25 min The(asmain
alreadyadvantage
mentioned of the presented
in Section solution
2.3); this also is that in the
implies thatoperations
the dronecenter,
shouldthe be
decision-maker
kept fully chargedcan manage
in order to bemanyalwayskinds
readyof forreports
unexpected coming from all the vertical
missions.
applications
Another implemented
disadvantage on the Smart
is related City
to the platform,
Beyond VisualnotLine
onlyofthe
Sightones related restric-
(BVLOS) to the
presented
tions, use in
because case.
some In real-world
fact, the information
situationsgenerated
it would be byuseful
this specific
to haveapplication is only
the possibility to
one ofthe
guide many,
dronebuilt
for an oninspection
data collected from sensors
in impervious zones.and other sources, which together
compound
Lack of the control room
connection is alsoofa critical
a Smartissue
City,ofproviding
the proposed the decision-maker with a limiting
solution, significantly holistic
view
the of what isterritory,
operational happening in the
which is area.
already reduced by other types of no-flight zones, such
as urbanAn areas,
importantmilitary zones, etc.
advantage related to the use of a drone is that it is easy to fly at low
and Finally,
ultra-low harsh weather
altitudes, conditions
compared to can significantly
manned aircraft;complicate if not completely
for this reason, thanks to the ob-
struct
on-boardoperations.
video camera, it was possible to get high-resolution images and play the video.
Another advantage is related to the possibility for the drone to reach
4.difficult-to-access
Discussion sites, such as the lake nearby (clearly visible in Figure 11), if necessary.
An
Theexperimental
main disadvantage activityistesting
related the usebattery:
to the of drones the in environmental
drone needed to be control was
recharged
described.
for a couple Theofactivity is made
hours before theupmission,
of three and
mainitscomponents:
autonomy would a mobile notapplication
have lasted tomore
send
on-field
than 25 alerts,
min (as a Smart
alreadyCity platformintoSection
mentioned collect 2.3);
alertsthis
andalso
show themthat
implies on athe
3Ddrone
satellite map
should
to
besupport
kept fullya decision-maker
charged in orderintothe bechoice
alwaysofready
the alerts requiring an
for unexpected inspection by drone,
missions.
and the operating
Another base to manage
disadvantage the drone
is related to in
theitsBeyond
mission.VisualA complete
Line use case was
of Sight tested
(BVLOS)
in
restrictions, because in some real-world situations it would be useful to have The
the field, starting from an experimental alert, and ending with a flight by drone. the
application
possibility to could
guide have great potential
the drone to support
for an inspection a decision-maker
in impervious zones. in centralizing and
optimizing a control room which receives information about dangerous situations which
can be risky for the environment.
IoT 2022, 3 379
In the experiment, a multirotor drone was selected, but a fixed-wing drone, which
can cover longer distances thanks to its greater autonomy, could be particularly suitable in
scenarios of distant wildfires that are difficult to reach quickly.
The present version of the application could be improved in many ways. To begin with,
the mobile device could send more information about what is going on. Object detection
algorithms could be applied to analyze the video shot by the video camera on the drone.
A further improvement would be achieved by adding sensors to allow the application of
remote sensing algorithms, and so expand the potential use cases. It is worth noting that
without the limit of visual flight, many operational bases could be located on a territory,
where all the actions to be taken can be coordinated directly from the same central station;
depending on weather conditions and other parameters, the decision-maker can choose
which missions call for an inspection by drone, avoiding sending a human operator in
the field.
Author Contributions: Conceptualization, G.G., L.L. and M.M.; methodology, G.G., L.L. and M.M.;
software, M.C., M.L.C., C.I., and R.P.; validation, all authors; formal analysis, G.G. and C.I.; investi-
gation, all authors; project administration, L.L. and M.M. All authors have read and agreed to the
published version of the manuscript.
Funding: This work was partially supported by the Sardinian Local Government (RAS), within the
Joint Innovation Center (JIC) project.
Institutional Review Board Statement: Not applicable.
Informed Consent Statement: Not applicable.
Data Availability Statement: Not applicable.
Conflicts of Interest: The authors declare no conflict of interest. The funders had no role in the design
of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or
in the decision to publish the results.
References
1. Drone Dangers, Risks and Injuries. Available online: https://www.technik-consulting.eu/en/analysis/drone_risks.html
(accessed on 7 July 2022).
2. What Happens When a Drone Crashes Into Your Face? Available online: https://www.popularmechanics.com/flight/drones/a2
8774546/drone-head-collision/ (accessed on 7 July 2022).
3. With the Growing Popularity of Drones Comes an Increased Likelihood of Accidents and Personal Injuries. Available online:
https://www.gautreauxlawfirm.com/personal-injury-drone-accidents/ (accessed on 7 July 2022).
4. List of UAV-Related Incidents. Available online: https://en.wikipedia.org/wiki/List_of_UAV-related_incidents (accessed on 7
July 2022).
5. Jordan, S.; Moore, J.; Hovet, S.; Box, J.; Perry, J.; Kirsche, K.; Lewis, D.; Ho Tse, Z.T. State-of-the-art technologies for UAV
inspections. Inst. Eng. Technol. 2018, 12, 151–164. [CrossRef]
6. Goudarzi, H.; Hine, D.; Richards, A. Mission Automation for Drone Inspection in Congested Environments. In Proceedings of
the 2019 Workshop on Research, Education and Development of Unmanned Aerial Systems (RED UAS), Cranfield, UK, 25–27
November 2019; pp. 305–314. [CrossRef]
7. Nihei, K.; Kai, N.; Maruyama, Y.; Yamashita, T.; Kanetomo, D.; Kitahara, T.; Maruyama, M.; Ohki, T.; Kusin, K.; Segah, H. Forest
Fire Surveillance using Live Video Streaming from UAV via Multiple LTE Networks. In Proceedings of the 2022 IEEE 19th Annual
Consumer Communications & Networking Conference (CCNC), Las Vegas, NV, USA, 8–11 January 2022; pp. 465–468. [CrossRef]
8. Sivabalaselvamani, D.; Selvakarthi, D.; Rahunathan, L.; Munish, M.; SaravanaKumar, R.; Sruthi, S. Forest Fire and Landmines
Identification with the Support of Drones Surveillance for Better Environmental Protection: A Survey. In Proceedings of the
2022 4th International Conference on Smart Systems and Inventive Technology (ICSSIT), Tirunelveli, India, 20–22 January 2022;
pp. 1480–1485. [CrossRef]
9. Wang, Q.; Gu, J.; Huang, H.; Zhao, Y.; Guizani, M. A Resource-Efficient online Target Detection System with Autonomous
Drone-Assisted IoT. IEEE Internet Things J. 2022, 9, 13755–13766. [CrossRef]
10. Ali, H.; Hang, L.Y.; Suan, T.Y.; Polaiah, V.R.; Aluwi, M.I.F.; Mohd Zabidi, A.A.; Elshaikh, M. Development of surveillance
drone-based internet of things (IoT) for industrial security applications. In Proceedings of the International Conference on Man
Machine Systems (ICoMMS 2021), Perlis, Malaysia, 19–20 October 2021. [CrossRef]
IoT 2022, 3 380
11. Jain, R.; Nagrath, P.; Thakur, N.; Saini, D.; Sharma, N.; Hemanth, D.J. Towards a Smarter Surveillance Solution: The Convergence
of Smart City and Energy Efficient Unmanned Aerial Vehicle Technologies. In Development and Future of Internet of Drones (IoD):
Insights, Trends and Road Ahead. Studies in Systems, Decision and Control; Krishnamurthi, R., Nayyar, A., Hassanien, A.E., Eds.;
Springer: Cham, Switzerland, 2021; Volume 332. [CrossRef]
12. Alsamhi, S.H.; Ma, O.; Ansari, M.S.; Almalki, F.A. Survey on Collaborative Smart Drones and Internet of Things for Improving
Smartness of Smart Cities. IEEE Access 2019, 7, 128125–128152. [CrossRef]
13. Skorik, I.; Durmanov, M.; Yankovskiy, S.; Gimpilevich, Y.; Mikhaylyuk, Y.; Nacharov, D.; Shirokov, I. UAV for Ecological
Monitoring of Water Surface. In The 1st International Conference on Maritime Education and Development; Springer: Berline, Germany,
2021; pp. 63–67.
14. Asadzadeh, S.; de Oliveira, W.J.; de Souza Filho, C.R. UAV-based remote sensing for the petroleum industry and environmental
monitoring: State-of-the-art and perspectives. J. Pet. Sci. Eng. 2022, 208, 109633, Part D. [CrossRef]
15. 5G!Drones, EU Funded Project (2019–2022) Unmanned Aerial Vehicle Vertical Applications Trials Leveraging Advanced 5G
Facilities (Grant agreement ID: 857031). Available online: https://5gdrones.eu/ (accessed on 7 July 2022).
16. ResponDrone, EU Funded Project (2019–2022) Novel Integrated Solution of Operating a Fleet of Drones with Multiple Syn-
chronized Missions for Disaster Responses (Grant Agreement ID: 833717). Available online: https://respondroneproject.com/
(accessed on 7 July 2022).
17. InterAct, EU Funded Project (2011–2015) International Network for Terrestrial Research and Monitoring in the Arctic (Grant
Agreement ID: 262693). Available online: https://eu-interact.org/using-drones/ (accessed on 7 July 2022).
18. Geo-SAFE, EU Funded Project (2016–2020) Geospatial Based Environment for Optimisation Systems Addressing Fire Emergencies
(Grant Agreement ID: 691161). Available online: https://geosafe.lessonsonfire.eu/ (accessed on 7 July 2022).
19. AURORA-UAM, EU Funded Project (2020-2023) Safe Urban Air Mobility for European Citizens (Grant Agreement ID: 101007134)
Focuses on Emergency-Related Applications. Available online: https://aurora-uam.eu/ (accessed on 7 July 2022).
20. Fukushima, Best Practice (Japan). Available online: https://spectrum.ieee.org/robotic-aerial-vehicle-at-fukushima-reactors
(accessed on 7 July 2022).
21. Tararua, Best Practice (New Zealand). Available online: https://mulkeymedia.com/smart-city-initiatives-and-drones-tales-of-a-
perfect-partnership/ (accessed on 7 July 2022).
22. Singapore, Best Practice. Available online: https://www.straitstimes.com/singapore/unmanned-drones-to-be-used-for-
inspections-at-six-reservoirs-in-singapore (accessed on 7 July 2022).
23. ThingsBoard. Available online: https://thingsboard.io (accessed on 7 July 2022).
24. Okabe, A.; Boots, B.; Sugihara, K.; Chiu, S. Spatial Tessellations: Concepts and Applications of Voronoi Diagrams. In Wiley Series
in Probability and Statistics, 2nd ed.; Wiley: Chichester, UK, 2000.
25. Litchi Platform. Available online: https://flylitchi.com/ (accessed on 7 July 2022).