DTto CPSdubu
DTto CPSdubu
DTto CPSdubu
https://doi.org/10.1007/s10845-022-01928-x
Received: 29 September 2020 / Accepted: 28 February 2022 / Published online: 26 May 2022
© The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature 2022
Abstract
The development of modern manufacturing requires key solutions to enhance the intelligence of manufacturing such as digi-
talization, real-time monitoring, or simulation techniques. For smart robotic manufacturing, the modern approach regarding
robot programming and process planning aims for both high efficiency and energy-awareness. During the design and manu-
facturing stages, optimization becomes crucial and can be fulfilled by means of appropriate digital manufacturing tools. This
paper presents the development of a Digital Twin for a robotic deburring workcell along with the process planning and robot
programming. Considering a large size workpiece, a new robot programming solution was implemented, based on image
processing to safely re-machine only areas where burrs could not be completely removed in the main deburring routine.
The work also covers the development of a new web platform to remotely monitor the robotic workcell, to trigger alerts
for unexpected events and to allow the control to authorized personnel enabled by the employment of robot web services
following an architectural RESTful style which establishes a communication link to the robot virtual controller. The aim of
this research is to integrate the Digital Twin with the innovative proposals of Industry 4.0, offering a project-based model of
smart robotic manufacturing and experience concepts such as Cyber-Physical System, digitalization, data acquisition, contin-
uous monitoring, and intelligent solutions in a novel approach. Furthermore, the work covers energy consumption strategies
for energy-aware robotic manufacturing. Finally, the results of an energy-efficient motion planning along with signal-based
scheduling optimization of the robotic deburring cell are discussed.
123
2766 Journal of Intelligent Manufacturing (2023) 34:2765–2781
engineers the necessary robotic programming knowledge by studying the use of a tool with passive radial compliance
to practice and develop intelligent solutions for robotic in a robotic process of deburring an injection molded plastic
machining and path planning along with energy consump- workpiece.
tion analysis. The training environment offers the means to The aims of this work are to offer a detailed study on
tackle the innovative challenges of Industry 4.0 and get ready the development of a DT model of a physical robotic FMC
for the smart manufacturing demands by getting a hands- and of a web-based platform along with an in-depth robotic
on experience on concepts such as cyber-physical systems OLP technique, and to propose a deburring solution based
(CPS), virtualization, process planning, and interoperability on an algorithm that generates the machining toolpath of
concerning workcell components. Furthermore, the new web partially removed burrs after video inspection. The paper
platform enables research engineers to get accustomed with continues with a general study of the energy consumption
specific robotic cloud technologies, manufacturing process of the industrial robot, describes the benefits after imple-
monitoring and intelligent decision-making. menting the deburring solution and presents the monitoring
The employed software tools are currently used by engi- capabilities of the web platform on the robotic FMC.
neers in industry, making the knowledge acquired a valuable In the second section of the paper, relevant concepts for
skill for devoted researchers. For the development of the DT, modern robotic manufacturing, robotic deburring and tool-
ABB RobotStudio provided the necessary environment to path planning, robot energy consumption, remote monitoring
virtualize the robotic workcell, to generate a collision-free and related work are discussed. In the third section, the new
tool path and to program the robot via OLP techniques by DT model and the new toolpath algorithm are presented,
taking into consideration sensor data and virtual models of along with discussions on robot programming and energy
physical components included in the physical workcell, thus consumption. Another contribution of the work is presented
simulating the process, analyzing the motion results, and in the fourth section and consists in a novel web platform
evaluating the robot energy consumption. which is used for remote monitoring and control of the
Additionally, ABB RobotStudio was employed to define a robotic deburring cell. The results are summarized, and future
virtual controller which runs the robot considering the work- planned activities are discussed in the last section.
cell sensors layout that was mapped to be remotely accessible
via the web platform. The platform uses web services to com-
municate with the virtual robot controller and offers the most
suitable solutions for data acquisition, data storage, process Related work
monitoring, safety, and control. Data can be collected contin-
uously from the physical workcell, and relevant information Modern robotic manufacturing systems
can be stored in a database. With well-defined manufac-
turing Key Performance Indicators (KPIs), the production Cyber-Physical Systems (CPS), Digital Twins (DT), Cloud
volume can be monitored, and the cell reliability and effi- Computing (CC), Internet of Things (IoT), Big Data Analy-
ciency can be evaluated. Data visualization tools have been sis (BDA), sensor technologies and machine learning (ML)
implemented to the web platform for real-time monitoring techniques are all enabling concepts for intelligent manu-
and condition-based alerts have been set up to trigger warn- facturing and taking into consideration recent developments,
ings for unexpected events via a messaging system. For the new trends in research and design have emerged for smart
development of a messaging bot, ActiveChat’s Visual Builder factories.
was employed to set up the alerts along with appropriate The DT of a manufacturing system is described as a
instructions for authorized personnel offering the means to sensor-enabled digital model of a physical asset that sim-
react accordingly in a timely fashion. ulates the object in a live setting (Grieves, 2015) and over
The main contribution of the holistic approach is bringing the past decade more definitions have arisen from industrial-
together Industry 4.0 specific concepts (i.e., virtualization, filed perspectives (Stark et al., 2017), (Zhuang et al., 2018),
OLP, image acquisition and processing, energy-aware robot together with their use in various industries, such as manufac-
programming, and process monitoring) to work seamlessly, turing (Tao & Zhang, 2017), (Zhang et al., 2017), (J. Wang
collecting data, and presenting it in interactive visualization et al., 2019), (Tong et al., 2019) aerospace (Tuegel et al.,
modules enabled by robotic web services. 2011), (Uzun et al., 2019), automotive (Vachalek et al., 2017),
Robotic path planning strategies for machining have been (Tharma et al., 2018) and even healthcare (Liu et al., 2019),
well covered in the literature, although focusing mainly on (Rivera et al., 2019). In the most recent studies, (Lim et al.,
machining processes such as deflashing of metal casts or 2019), (Barricelli et al., 2019), the authors emphasize both the
finishing of stir-welded corner joints and on the employment major role of DTs in a wide range of applications, including
of tools with active or hybrid control systems, specific for manufacturing control, system maintenance, robotics, and
quality precision machining work. This research fills a gap associated financial advantages.
123
Journal of Intelligent Manufacturing (2023) 34:2765–2781 2767
Cyber–physical interaction and integration is an impor- tool path with tolerance specifications of the workpiece (Ivan
tant prerequisite for smart manufacturing. CPS are known et al., 2015). Intelligent solutions to overcome these problems
to be multidimensional and complex systems that integrate arose, such as the robot tool compliance, workpiece point
the cyber world and the dynamic physical world. While DTs cloud matching, force feedback or vision guided trajectory
are digital copies of physical entities that can simulate and planning. Liao et al. developed a double compliant tool head
reflect their behavior through modeling and simulation anal- that controls the deburring force according to the variation
ysis, make predictions and control their future states through of the geometry in order to maintain a constant contact stress
feedback, CPS consider sensors and actuators as the main between the tool and the part (Liao et al., 2008). Wang et al.
modules. Both CPS and DTs pave the way for smart manu- proposed an intelligent compliance control solution using
facturing by forming a closed loop between the cyber/digital fuzzy logic (X. Wang et al., 2006) and recently Berselli et al.
and physical worlds based on state sensing, real-time anal- proposed a virtual prototype of a radial-compliant spindle to
ysis, information feedback, scientific decision-making, and optimize the deburring efficiency (Berselli et al., 2019).
precise execution (Tao et al., 2019). Toolpath planning solutions for robotic machining have
Several papers also focused on the robustness and intel- emerged to address the need for faster robot programming.
ligence of CPS and DTs, and stated unique requirements Kuss et al. presented an iterative algorithm that compares
(Tomiyama & Moyen, 2018) for their security (Humayed and matches the point clouds derived from the workpiece
et al., 2017), (Wu et al., 2017), resilience as a response to CAD model with a sensor point cloud obtained from a 3D
the processes need for scalability, efficiency and reliability measurement of the part (Kuss et al., 2016) and Abele et al.
to generate trustworthy data (Xu & Duan, 2019). presented a tool path speed optimization solution for debur-
For CNC machining processes, the Twin Control follows ring cross holes of complex parts (Abele et al., 2016). A
the CPS concept and aims to improve the performance and hand-eye, vision-assisted robotic solution for finishing stir-
productivity of machine tools at each life-cycle stage. An welded parts was presented in (Gurdal et al., 2019), in which
increasing interest for machine tools virtualization is visible the robot is equipped with a line structured laser sensor and
in the raising number of published works for DTs for CNC a pneumatic spindle with an adjustable deflection unit. The
machining operations (Armendia et al., 2019) and tool life authors presented a scan-and-machine approach consisting of
prediction (Luo et al., 2020). scanning and locating the workpiece in the robot coordinate
The virtualization concepts were also recently discussed system, automatic path programming and process parameter
for robotic manufacturing, although mostly focused on planning. Villagrossi et al. proposed a human mimicking con-
robotic assembly applications, involving collaborative robots trol strategy to remove burrs of hard material workpieces on
(Bilberg & Malik, 2019) or reconfigurable robotic workcells the basis of force feedback by removing thin layers of mate-
for small-batch production (Priggemeyer et al., 2018). Erdős rial each time (Villagrossi et al., 2018). Caesarendra et al.
et al. also presented an approach to transform already existing discussed the implementation of machine learning and cloud
workcells to parametric digital twins and tackled the chal- computing to improve deburring processes in aerospace man-
lenges of robotic finishing, such as grinding and polishing ufacturing (Caesarendra et al., 2019).
of cast aluminum parts. They demonstrated that the DT is Process simulation for tool path planning and generation
able to realize accurate tool path generation for the physical can increase milling productivity and part accuracy. Leftover
workcell (Erdős et al., 2020). A methodology for advanced burrs may occur during milling due to the peculiarity of the
physic-based modeling aiming to enable the DT of an indus- tool with radial compliance. Compliance is the ability of a
trial robot arm in predictive maintenance applications was tool to maintain contact and cutting force with the workpiece.
proposed in (Aivaliotis et al., 2019). It can be achieved through a variety of techniques that include
The purpose of this paper is to fill a gap in the literature for both active and passive force control systems.
virtualization techniques in robotic machining by presenting Active control systems require a data link to the robot
the DT of a robotic workcell for deburring plastic parts of controller to provide information and therefore are closed
large size. loop systems. Active force control tools deliver real-time
prompts to the robot to change its program trajectory as
Robotic deburring defined by a controlled correction routine. This can adjust
the path speed and the cutting forces, but active systems are
Robotic systems are known to be cost-effective solutions that typically more expensive than passive devices, however they
have the potential to fully automate the deburring processes offer more accuracy and repeatability. Passive force control
as a result of their high flexibility when moving along the systems do not measure any cutting forces, but simply adapt
edges of complex shaped parts. The drawback of this solu- to the part shape and apply a constant force. They are best
tion is that the stiffness of the mechanical structure of the suited for applications that have relatively consistent burrs
robot is low and problems arise to tune the accuracy of the
123
2768 Journal of Intelligent Manufacturing (2023) 34:2765–2781
or flash but have poor part-to-part tolerances. These systems EC is influenced by the operating parameters and constrained
greatly reduce gouging of the part by the cutter. by the workcell layout, productivity requirements and envi-
Radial compliance allows the movement from a center ronmental operating conditions.
position through 360 degrees along a radius of compliance In 2014, Paryanto et al. published a study on the EC of a
with a constant contact force in milling machining. Because robot arm in an assembly system. Later on, they proposed a
the cutting action is radial, they are also well suited for remov- modular model of a robot to analyze its power consumption
ing parting lines and flash from cast parts. For a more in-depth and dynamic behavior and demonstrated that the power con-
read about radial compliance tools, the authors recommend sumption can be predicted (Paryanto et al., 2014), (Paryanto
Berselli et al.’s paper on a virtual prototype of a pneumatic et al., 2015). Studies on minimizing the EC by optimizing
compliant spindle (Berselli et al., 2016) and Ivan et al.’s study the robot trajectories proved to be efficient as well (Hansen
of robotic low force milling operations using radial compliant et al., 2012), (Pellicciari et al., 2013). In their work, Bukata
end effectors (A. M. Ivan et al., 2019). et al. presented an approach to optimize the EC of robotic
A vision-guided robotic system (Leo Princely & Selvaraj, cells as a whole. More recently they proposed a new algo-
2014) was conceived for the deburring of simple 2D work- rithm designed to minimize the EC by changing the robot
pieces to avoid OPL procedures and recently, Rahul et al. speed, taking into consideration the robot positions as well
proposed another approach to identify burrs for 2D work- as the power-saving modes (Bukata et al., 2017), (Bukata
pieces using image processing and to generate trajectories et al., 2019). Uhlmann et al. conducted a study on EC of
(Rahul et al., 2019). However, both approaches generate industrial robots for machining processes and their experi-
the toolpath required to deburr the complete profile of the mental tests also showed that the robot movement speed has
workpiece and do not presume that due to the tool’s radial a major impact on the EC along with the cooling systems
compliance and burr thickness, some burrs could be only par- (Uhlmann et al., 2016).
tially removed. Using laser measurement systems to scan the Nevertheless, the literature shows a lack of studies focused
workpiece, to detect its position in the robot workspace, to on energy consumption monitored in robotic deburring pro-
generate approximate points and a sequence of frames that cesses. The presented paper aims to contribute to the research
describe the desired poses of the tool frame are also covered in literature for energy efficient usage of industrial robots
the literature for robotic machining processes such as deflash- employed in deburring processes as a result of path planning
ing of metal casts, finishing of stir-welded corner joints or optimization.
edge deburring of aero engine components (Jayaweera &
Webb, 2010). Such solutions use active or hybrid control Remote monitoring and control
systems, or other offline/online error compensation strate-
gies (Schneider et al., 2016). These approaches for toolpath Equipment performance and condition monitoring has
planning (which are also more costly) are not well suited for always been an essential part of the information systems
light deburring/deflashing where part tolerances are poor and used in industry to improve effectiveness and to minimize
radial compliance tools are used, as it is our case. unplanned downtime. The widespread deployment of various
The present work aims to address the robotic deburring sensors has made smart manufacturing possible. Nowadays
literature by focusing on tools with passive force con- data from various manufacturing objects, such as energy con-
trol, specifically tools with passive radial compliance and sumption, temperature or vibration can be assessed in real
by proposing a deburring algorithm that reduces the robot time. Smart monitoring provides graphical visualization of
energy consumption by optimizing the number of passes in the collected data and alerts when abnormality occurs.
the deburring routine only in areas with partially removed Monitoring of the manufacturing systems can be classi-
burrs caused by the tool’s passive radial compliance limita- fied into two main groups: monitoring the status of resources
tion. (related to machinery and environment monitoring, such as
machine workload, downtime, performance, etc.) or monitor-
Robot energy consumption ing the status of jobs (related to data of each task, sequence,
estimated production time, etc.).
Reducing the energy consumption (EC) of the robot is an Monitoring the manufacturing system does not directly
important step to improve the manufacturing system’s effi- control the physical system but it tracks it. Detailed status
ciency. Several studies have been conducted focusing on the on every physical system is supported by key performance
hardware aspect by considering strategies such as a lighter indicators (KPIs) such as schedule attainment, availability,
design of components or by using energy storing and recov- quality rate and overall equipment effectiveness. Studies on
ery devices. Another approach focuses on the software aspect Continuous and Discrete control operations have emphasized
to enhance the motion planning via trajectory planning or the importance of monitoring tools and techniques (Ramis
operation scheduling. In the optimization stage, the robot’s Ferrer et al., 2018).
123
Journal of Intelligent Manufacturing (2023) 34:2765–2781 2769
123
2770 Journal of Intelligent Manufacturing (2023) 34:2765–2781
Fig. 2 Tool Center Points: 1 - robot tool mounting point. 2 - QC-41 master plate mounting point. 3 - deburring ATI RC300 tool. 4 - vacuum gripper
point
Fig. 3 Robot deburring tool path (1), operations sequence (2) and the robot program loaded and shown on the robot flex pendant (3)
in sync. In addition, the reliability of the robot can also be anymore by the S2 sensor, the C-in conveyor starts, and the
verified by tracking the energy consumption. In cases when waiting workpiece wp enters the cell and slides in the right
the DT is scheduled based on events, not all actions can be position on the aligning table.
confirmed and therefore the reliability may not be assured. When picking up the workpiece from the sliding table,
The efficiency is determined based on the operating times the S7 proximity sensor positioned on the vacuum gripper
and the energy consumption. Any energy or operating time confirms that the workpiece to be grasped is already located
increases are visible in the web platform monitoring panel. in the right position before starting the vacuum. To ensure
Efficiency is not statistically calculated for a standard cycle that the workpiece has been successfully gripped, the robot
but depends on the actual execution time of each part. enters a condition loop where it is programmed to execute a
The robotic manufacturing cell OLP and simulation are short retraction movement: if the workpiece is still detected
further detailed in the next chapter. by the S7 proximity sensor, the robot will continue its move-
ment and exits the conditioning loop, but if the workpiece
is no longer detected, the robot will come back again to the
Robotic manufacturing cell offline programming workpiece and retry the picking up operation until it exits the
conditioning loop. Because the workpiece is laying in a cell
The robotic deburring cell structure is illustrated in Fig. 4,
where plastic debris is present this conditioning loop ensures
together with the sensors layout. The working cycle has three
that the working cycle is not interrupted by an unsuccessful
main stages. In the 1st Stage, the plastic workpiece (wp) is
gripping of the workpiece during the pick-up process.
brought by the in-feeder conveyor (C-in) and stopped near the
In the 2nd Stage, the workpiece is brought by the robot to
S1 sensor, waiting for a signal from the S2 sensor to confirm
the vacuum fixturing system (VFS), where another proximity
that the workpiece can safely advance on the gravitational
sensor (S4) confirms that the part is in range before activat-
aligning table (AT) which assures that each workpiece (Awp)
ing the fixturing system’s vacuum and deactivating the robot
will have the same position and orientation before it is picked-
gripper’s vacuum. The S3 proximity sensor confirms that the
up by the robot effector. A Cognex Integrated Vision System
robot has correctly placed the vacuum gripper in its fixture
(IVS) double-checks the workpiece position previously to
frame (VeS) and another sensor (S6) confirms that the debur-
the pick-up by the ABB robot, which is equipped with the
ring tool (Dt) is properly placed in the tool storage device.
Schmalz vacuum gripper (Ve). After the Awp workpiece is
picked up from the aligning table and therefore, not detected
123
Journal of Intelligent Manufacturing (2023) 34:2765–2781 2771
The robot deburrs the plastic workpiece while a conveyor (C- the part (Dwp) is placed on the conveyor, it is detected by the
burrs) collects all the chips from the deburring process and S5 sensor which will stop the vacuum generator to detach the
evacuates them from the cell. When the deburring process part and then will start the conveyor with a certain delay, to
is completed, the robot places the deburring tool back in the allow a safely retract for the robot. The work cycle restarts,
tool storage system (TSS). The part is then video inspected and the robot will execute the operation of picking up the part
by the robot with a camera located inside the master flange from the sliding table when the S2 proximity sensor confirms
of the ATC system that follows the tool path. If burrs are that a workpiece is in the proper position.
still detected, a programming routine is activated to remove The conceptual CAD design comprises additional exten-
the remaining material from appropriate areas otherwise the sions, such as a gravitational aligning table or a storage device
robot picks up the vacuum gripper. for the deburring tool. Moreover, workcell components have
An algorithm was developed that generates the new tool- been designed in an effort to ensure that the DT closely
path required to remove remaining burrs captured by the emulates the physical workcell such as the Schmalz vacuum
visual inspection, limited only in the appropriate area where supply center (VSC) and the cell safety enclosure (SE). The
remaining burrs are present. This approach ensures that only workflow was analyzed together with the OLP and testing,
the strictly required time is spent to remove the remaining providing working cycle’s optimization. All sensor signals
burrs without having to redo the entire deburring process. were configured and synchronized to the virtual robot con-
The quality check is repeated until all the quality conditions troller I/O System and are illustrated in Fig. 5.
are completely satisfied. In the next section this approach is
further discussed and more details concerning the algorithm
Robotic deburring algorithm for partially removed
are provided.
burrs
In the 3rd Stage, the robot equipped with the vacuum
gripper approaches the deburred part secured in the vacuum
The tool employed in this work is a passively radial compliant
supporting frame. Then the robot proceeds to pick-up the
tool, which is particularly adept at flash removal. It is also
part and comes closer to the out-feeder conveyor. A proxim-
suitable for edge deburring and removal of parting lines. The
ity sensor (S5) placed on the conveyor confirms that it is clear
workpiece is a large sized 900 mm x 1800 mm injection
and safe for the robot to place the part on the conveyor. When
molded plastic part.
123
2772 Journal of Intelligent Manufacturing (2023) 34:2765–2781
Taking into consideration the size of the workpiece a solu- the video detected burr. Finally, the program is synchronized
tion to deburr only leftover burrs rather than re-doing the to the robot controller.
complete workpiece profile, can assure an important time The vision system employed in the visual inspection rou-
reduction to finish the workpiece and also benefits by an tine consists of a high acquisition speed VGA camera. Its
energy-wise approach. The workflow implemented is illus- compact size (35 mm x 32 mm x 75.5 mm) makes it suitable
trated in Fig. 6 and certifies that all the burrs have been for integrating it into tight spaces on the robot and mounting
successfully removed. it inside the master flange of the ATC system. The camera
The proposed algorithm uses image processing to identify model used is Cognex 8400 (embedded with image process-
partially removed burs and establish the areas to be machined. ing), having a resolution of 640 × 480, max acquisition speed
Leftover burrs may occur during deburring due to the pecu- of 217 fps, Gigabit Ethernet connectivity and Power supply
liarity of the tool with radial compliance which will deflect Ethernet (PoE). A connection with the robot controller can
in a direction perpendicular to the cut when thicker burrs are be established via the robot controller’s Integrated Vision
encountered. The proposed deburring algorithm is used to Interface. The vision system provides targets in a coordinate
detect only the location of the partially removed burrs and system shared with the robot. The RobotStudio environment
machine those areas in multiple passes (iterations) based on offers a toolset for part location and inspection. The authors
burr height and tool cutter radius. The block “New deburring configured and fine-tunned a vision job by defining the part
process” from Fig. 6 illustrates the routine which consists of the camera should locate, the inspection tool, and how the
multiple deburring passes. vision data is transferred to the robot program, employing
Most papers found in the literature for robot paths gener- the already defined Robot TCPs.
ated based on image processing either don’t cover the use of A crucial prerequisite for the vision job is to calibrate
passively radial compliant tools (rather use an active compli- the image to real-world units [mm] by using checkerboard
ance system) or the use case of large-sized workpieces with calibration plates with fiducial. When executing the visual
uneven burrs. Having the same approach of generating mul- inspection routine, the robot reaches the same position (rob-
tiple passes based on burr height and tool cutter radius for target) every time an image is acquired. Given its large size,
the full workpiece, for the studied use case, it would result in the workpiece has been divided into 6 views of interest. Each
a longer machining time and robot energy inefficiency since view has a designated position the robot must reach and
most of the burrs are removed in the main deburring routine. acquire an image that is next matched to its corresponding
To further optimize the generated robot tool path, taking reference portion of the workpiece by employing the Robot-
into account the workpiece symmetry and burrs location, the Studio vision job.
algorithm also provides the required data for robot tool posi- In terms of excesive burr identification the coordinates of
tioning and routines to safely approach the workpiece and A, B, C, D, L, M, N, P and Q points are extracted (Fig. 8). The
to retract. For this study, there are four possible cases where input values are the coordinates of the previously mentioned
partially removed burrs can be located: left or right side of points and the mill radius Rm . The L point locates the part in
the workpiece and on the outer or inner part. Thus, based the XOY reference coordinate system.
on the XY coordinates of the detected burr, a safe routine A reference workpiece was used in the vision job as model
to approach and to retract from the workpiece can be gener- for the location tool to determine the position of the work-
ated. The toolpath is created based on the shape and size of piece in XY coordinates as a fixture point. The location tool
123
Journal of Intelligent Manufacturing (2023) 34:2765–2781 2773
Fig. 6 Comprehensive
representation of the deburring
workflow
123
2774 Journal of Intelligent Manufacturing (2023) 34:2765–2781
As illustrated in Fig. 9, a record where the total energy Fig. 9 (2), the deburring of excess burr requires 3 consecu-
consumption and the total absorbed power for a single work tive passes. When employing a compliant tool, the maximum
cycle has been analyzed for a workpiece where burrs were excessive burr that can be removed at a single pass is equal
successfully removed from the first stage of the deburring to the tool radius.
process (1), as well for a workpiece where additional debur- The recorded data for a simulated work cycle demon-
ring routines were required to remove remaining burrs (2). strates how the robot speed and payload have an impact on the
Successfully deburred means that the robot visual inspec- energy consumption. By raising the payload, the energy con-
tion didn’t identify any remaining burrs along the workpiece sumption is increasing accordingly and higher or very slow
profile. Figure 9 (2) illustrates the energy recorded during speeds lead to augmented energy consumption. Thus, the
a work cycle of a workpiece for which the robot visual offline simulation brought a trade-off between the reduction
inspection identified a single area where burrs have been of the energy consumption, achieving quality and productiv-
partially removed, and the proposed algorithm generated ity requirements as well. Figure 10 shows the total energy
a second deburring routine focused only on the identified consumption report for a workpiece without remaining burrs
area. after the first deburring operation (1), for a workpiece with
An important time in this additional machining phase is remaining burrs that requires a second deburring operation in
consumed by the robot to change the tool and to reach the which our solution was employed (2), and one that requires
position for this new routine. It is presumed that burrs that a second deburring operation repeating the entire part pro-
are not entirely removed in the main deburring routine are file (3). A validation of the simulation results is possible by
thicker, causing the compliant tool to deflect, and success- comparing the data with physical records from actual mea-
fully removing them would require multiple passes. In the surements.
presented case study, the number of additional machining
passes was calculated in respect to the tool radius. This is
the reason why in this particular case the trajectory was not
much shorter in the second deburring phase. As illustrated in
123
Journal of Intelligent Manufacturing (2023) 34:2765–2781 2775
Fig. 9 Records of the total energy (marked in black) and total power (marked in orange) of the drive for the deburring process during a work cycle
of a workpiece with no remaining burrs (1) and with remaining burrs (2)
Web based platform for robotic deburring and GUI elements are used to present the information in
cell remote control and monitoring interactive charts and to be used for KPI reports. A messag-
ing system is employed to trigger condition-based alerts with
A web-based approach for a manufacturing monitoring sys- appropriate instructions. Based upon this data, authorized
tem allows the use of a wide range of devices with graphical people can take informed decisions concerning the produc-
interface support, but also has its drawbacks which are further tion system. All sensor signals have a digital copy in the
discussed. The novel web platform was developed to access virtual controller, as exhibited in Fig. 5. The virtual model
information from the virtual robot controller via web ser- simulates the robot behavior in the real world and provides
vices which follow the architectural form of RESTful APIs feedback. The virtual model simulates the robot behavior in
using the HTTP protocol while the messages are composed the real world and provides feedback since it can calculate
of XHTML and JSON. A user authentication is required via robot motions and handle I/O signals. Figure 11 illustrates
login data, such as username and password, which are defined the required components of the web platform.
in the virtual controller. The data is stored on a local server
123
2776 Journal of Intelligent Manufacturing (2023) 34:2765–2781
The user interface consists of seven main parts illustrated energy consumption, breakdowns or decreases of the daily
in Fig. 13: • the 1st section allows authorized personnel to delivery in the manufacturing batches.
select the robot controller unit to connect with (in this case,
a connection to the virtual robot controller was made); • the Web platform alerts
2nd section displays a 3D model of the selected workcell; •
in the 3rd section, the robotic deburring process can be moni- For triggering and sending customized notifications and pre-
tored via a livestream of the DT, or alternatively by switching set alerts to authorized users, a bot messaging method was
to a live recording of the real workcell supplied by a camera chosen as it can be easily integrated with a database. A Tele-
with 2 (tilt-pan) DoF; • the 4th section illustrates the remote gram bot is a small program that can embed in Telegram chats
control board, which allows authorized personnel to stop the and perform specific roles. Additionally, authorized person-
process in case of emergency and allows control over the DT nel can also react fast and accomplish specific actions when
simulation (such as starting, stopping, or resetting the virtual a notification is received. A sample of the received message
simulation); • the 5th section illustrates the remote monitor- alert is illustrated in Fig. 12 reporting unexpected peak energy
ing board, where the current state of selected manufacturing consumption along with two possible options for the user to
process sensors is displayed; • in the 6th section, an Energy act in response.
Consumption interactive graph is displayed • the last section
is an interactive manufacturing volume graph. System alerts
can be set based on the recorded data in case of abnormal
123
Journal of Intelligent Manufacturing (2023) 34:2765–2781 2777
123
2778 Journal of Intelligent Manufacturing (2023) 34:2765–2781
Fig. 13 Web based platform for remote monitoring and control of a robotic deburring cell. 1&3 - expected energy consumption and productivity;
2&4 energy consumption peak with a decline in productivity followed by a breakdown period
123
Journal of Intelligent Manufacturing (2023) 34:2765–2781 2779
tools, such as the possibility to remove burrs only par- nature of the current technology used to develop the web plat-
tially. From this perspective, the paper presents an improved form brings to light another possible limitation of this study:
method that is beneficial in this application for large work- the remote-control functionality only allows authorized per-
pieces. A new robot programming solution based on image sonnel to stop the robotic process in case of emergency due
processing was implemented to safely re-machine only areas to the typical operation mode of a robotic FMC since the
where burrs could not be completely removed in the main remote control is restricted in the programmed task.
deburring routine.
The DT offers a good opportunity to better understand
how the robot work cycles have an impact on the energy
consumption. EC is getting considerable attention as EC Conclusions
models and optimization approaches are very well covered
in recent studies since the energy-efficient use of IR has a The present work illustrates key concepts of modern man-
great impact on the production costs. Moreover, the work ufacturing such as virtualization, smart energy-aware robot
highlights the essential knowledge for modern robotic man- programming, data acquisition, process monitoring and con-
ufacturing on energy-aware robot programming. Since there trol in a synergic approach. The aim of this research was to
are several methods for reducing the energy consumption develop the Digital Twin of a robot deburring cell together
of IR discussed in the literature, this work followed another with a web platform to continuously monitor the manufac-
perspective on energy-efficient motion planning along with turing process, to allow authorized control on the physical
signal-based scheduling optimization. workcell for emergency stop, to alert on unexpected event
The main goal of the presented web platform was to occurrences, to track the workcell productivity and part qual-
conceive a simple and efficient way to monitor a robotic ity, and to provide relevant and trust-worthy information that
manufacturing system in real-time in an industrial setting, can be used for KPI reports.
by presenting the data collected from the virtual controller The following aspects have been considered in this paper:
in history-based visualization modules, focused on robot • The deburring algorithm which uses image processing
energy consumption, as well as workcell productivity, to to identify partially removed burrs and decides the areas to
notify authorized personnel on pre-set alerts and provide be machined.
the means to react accordingly. With the use of a secure • Ensuring a successfully deburred workpiece employing
remote connection, the remote control can be easily extended a tool with radial compliance, while minimizing the energy
to allow the remote transfer of the programs to the robot consumption.
controller. Before the COVID-19 pandemic, the authors did • The web platform to remotely monitor the robotic
not consider the need of an extended remote control over a deburring process (tracking the energy consumption and the
robotic manufacturing process and did not acknowledge the number of machined parts), allowing remote control over the
necessity to perform remote work in the robotic manufac- robot to authorized personnel.
turing system. Certainly, expanding the remote control of a A CAD-CAM environment was used to design a digital
robotic process is now a possible direction for future work. copy of a physical robotic deburring cell, to set up a virtual
The system can be extended to collect, visualize pro- robot controller along with all workcell digital sensor signals,
cesses, and analyze data across the factory floor, making to plan the manufacturing process and to program the robot.
it central for operations. Real-time production data and The challenges of modern robotic milling along with energy-
call-to-action alerts help improve operational efficiency and aware strategies for industrial robotics, benefits of and threats
cost-effectiveness. The robot-based manufacturing system to remote-monitoring solutions were also discussed.
can be improved by the wireless sensor network to acquire The available equipment enables the authors to continue
the dynamic status and queries, and then be driven by remote the work with new developments of intelligent strategies
control methods towards trustworthy performance using AI for digitalization, energy-aware trajectory, and process plan-
procedures and machine learning algorithms. The feasibility ning, along with robotic specific cloud technologies for
of future implementations was also reported in the literature monitoring, control, and smart decision-making. Work is
(Wang & Wang, 2021). in progress to extend the web platform to remote-monitor
A possible limitation in this study that could be addressed and control new robotic systems, to develop and imple-
by future research is that the proposed deburring algorithm ment other Industry 4.0-specific solutions such as machine
has been purposefully developed to complement passive learning techniques for robot programming, as well for pre-
compliant deburring tools. These are not assisted by a 6- dictive maintenance and security defenses. The system can
DoF force & torque sensorial system, which is mandatory be expanded to collect, visualize processes, and analyze data
for tools with an active control system, as their main perk is across the factory floor, making it central for operations.
to fully remove burrs while respecting part tolerances. The
123
2780 Journal of Intelligent Manufacturing (2023) 34:2765–2781
Acknowledgements This work has been funded by the European Fund Hansen, C., Öltjen, J., Meike, D., & Ortmaier, T. (2012). Enhanced
from the Sectorial Operational Programme Human Capital 2014–2020, approach for energy-efficient trajectory generation of industrial
through the Financial Agreement with the title “Scholarships for robots. IEEE International Conference on Automation Science and
entrepreneurial education among doctoral students and postdoctoral Engineering, 1–7. https://doi.org/10.1109/CoASE.2012.6386343
researchers (Be Entrepreneur!)”, Contract no. 51680/09.07.2019 - Humayed, A., Lin, J., Li, F., & Luo, B. (2017). Cyber-Physical Sys-
SMIS code: 124539. tems Security - A Survey. IEEE Internet of Things Journal, 4(6),
1802–1831. https://doi.org/10.1109/JIOT.2017.2703172
Ivan, M. A., Nicolescu, F. A., Aram, C. G., & Stan, L. (2015). Robotic
deburring cell virtual prototyping. Proceedings in Manufacturing
Systems, 10(4), 183–188
References Jayaweera, N., & Webb, P. (2010). Measurement assisted robotic edge
deburring of aero engine components. WSEAS Transactions on
Abele, E., Haehn, F., Pischan, M., & Herr, F. (2016). Time Optimal Path Systems and Control
Planning for Industrial Robots Using STL Data Files. Procedia Kuss, A., Drust, M., & Verl, A. (2016). Detection of workpiece
CIRP, 55, 6–11. https://doi.org/10.1016/j.procir.2016.08.038 shape deviations for tool path adaptation in robotic deburring
Aivaliotis, P., Georgoulias, K., Arkouli, Z., & Makris, S. (2019). systems. Procedia CIRP, 57, 545–550. https://doi.org/10.1016/j.
Methodology for enabling digital twin using advanced physics- procir.2016.11.094.
based modelling in predictive maintenance. Procedia CIRP. Liao, L., Xi, F., Jeff, & Liu, K. (2008). Modeling and control of
https://doi.org/10.1016/j.procir.2019.03.072 automated polishing/deburring process using a dual-purpose com-
Armendia, M., Cugnon, F., Berglind, L., Ozturk, E., Gil, G., & Selmi, pliant toolhead. International Journal of Machine Tools and
J. (2019). Evaluation of machine tool digital twin for machining Manufacture, 48(12–13), 1454–1463. https://doi.org/10.1016/j.
operations in industrial environment. Procedia CIRP. https://doi. ijmachtools.2008.04.009
org/10.1016/j.procir.2019.04.040 Lim, K. Y. H., Zheng, P., & Chen, C. H. (2019). A state-of-the-art
Baladrón, C., Jiménez, M. I., Aguiar, J. M., Carro, B., & Sánchez- survey of Digital Twin: techniques, engineering product lifecy-
Esguevillas, A. J. (2013). Improving teaching in engineering cle management and business innovation perspectives. Journal of
education: Adjunct enterprise professors programme. Journal Intelligent Manufacturing, 31(6), 1313–1337. https://doi.org/10.
of Intelligent Manufacturing. https://doi.org/10.1007/s10845-011- 1007/s10845-019-01512-w
0546-0 Liu, Y., Zhang, L., Yang, Y., Zhou, L., Ren, L., Wang, F., & Deen, M. J.
Barricelli, B. R., Casiraghi, E., & Fogli, D. (2019). A survey on digital (2019). A novel cloud-based framework for the elderly healthcare
twin: definitions, characteristics, applications, and design impli- services using digital twin. IEEE Access. https://doi.org/10.1109/
cations. IEEE Access, 7, 167653–167671. https://doi.org/10.1109/ ACCESS.2019.2909828.
ACCESS.2019.2953499. Luo, W., Hu, T., Ye, Y., Zhang, C., & Wei, Y. (2020). A hybrid predictive
Berselli, G., Pellicciari, M., Bigi, G., & Razzoli, R. P. (2019). Design maintenance approach for CNC machine tool driven by Digital
optimisation of cutting parameters for a class of radially-compliant Twin. Robotics and Computer-Integrated Manufacturing. https://
spindles via virtual prototyping tools. International Journal of doi.org/10.1016/j.rcim.2020.101974
Computer Aided Engineering and Technology, 11(2), 232–252. Mourtzis, D., Vlachou, E., Dimitrakopoulos, G., & Zogopoulos, V.
https://doi.org/10.1504/IJCAET.2019.098138 (2018). Cyber-physical systems and education 4.0–the teaching
Bilberg, A., & Malik, A. A. (2019). Digital twin driven human–robot factory 4.0 concept. Procedia Manufacturing, 23, 129–134. https://
collaborative assembly. CIRP Annals, 68(1), 499–502. https://doi. doi.org/10.1016/j.promfg.2018.04.005
org/10.1016/j.cirp.2019.04.011 Munteanu, A., Muradore, R., Merro, M., & Fiorini, P. (2018). On cyber-
Bukata, L., Sucha, P., Hanzalek, Z., & Burget, P. (2017). Energy opti- physical attacks in bilateral teleoperation systems: An experimen-
mization of robotic cells. IEEE Transactions on Industrial Infor- tal analysis. Proceedings – 2018 IEEE Industrial Cyber-Physical
matics, 13(1), 92–102. https://doi.org/10.1109/TII.2016.2626472. Systems, ICPS 2018, 159–166. https://doi.org/10.1109/ICPHYS.
Bukata, L., Šůcha, P., & Hanzálek, Z. (2019). Optimizing energy 2018.8387653
consumption of robotic cells by a Branch & Bound algorithm. Nicolescu, A. F., Stan, E. L., & Pupaza, C. (2019). E-Learning Platform
Computers and Operations Research. https://doi.org/10. for Robotic Appli—cations. ICERI2019 Proceedings. https://doi.
1016/j.cor.2018.09.012 org/10.21125/iceri.2019.1760
Caesarendra, W., Wijaya, T., Pappachan, B. K., & Tjahjowidodo, T. Paryanto, Brossog, M., Bornschlegl, M., & Franke, J. (2015). Reduc-
(2019). Adaptation to industry 4.0 using machine learning and ing the energy consumption of industrial robots in manufacturing
cloud computing to improve the conventional method of deburring systems. International Journal of Advanced Manufacturing Tech-
in aerospace manufacturing industry. Proceedings of 2019 Interna- nology, 78(5–8), 1315–1328. https://doi.org/10.1007/s00170-014-
tional Conference on Information and Communication Technology 6737-z
and Systems, ICTS 2019, 120–124. https://doi.org/10.1109/ICTS. Paryanto, Brossog, M., Kohl, J., Merhof, J., Spreng, S., & Franke, J.
2019.8850990 (2014). Energy consumption and dynamic behavior analysis of a
Erdős, G., Paniti, I., & Tipary, B. (2020). Transformation of robotic six-axis industrial robot in an assembly system. Procedia CIRP,
workcells to digital twins. CIRP Annals, 69(1), 149–152. https:// 23(C), 131–136. https://doi.org/10.1016/j.procir.2014.10.091
doi.org/10.1016/j.cirp.2020.03.003 Pellicciari, M., Berselli, G., Leali, F., & Vergnano, A. (2013). A method
Gollmann, D., Gurikov, P., Isakov, A., Krotofil, M., Larsen, J., & Win- for reducing the energy consumption of pick-and-place industrial
nicki, A. (2015). Cyber-Physical Systems Security. Proceedings of robots. Mechatronics, 23(3), 326–334. https://doi.org/10.1016/j.
the 1st ACM workshop on cyber-physical system security - CPSS mechatronics.2013.01.013
’15 (pp. 1–12). https://doi.org/10.1145/2732198.2732208 Priggemeyer, M., Losch, D., & Roßmann, J. (2018). Interactive calibra-
Grieves, M. (2015). Digital Twin: Manufacturing Excellence through tion and visual programming of reconfigurable robotic workcells.
Virtual Factory Replication. In A Whitepaper IEEE/ASME International Conference on Advanced Intelligent
Gurdal, O., Rae, B., Zonuzi, A., & Ozturk, E. (2019). Vision-assisted Mechatronics, AIM, 2018-July, 1396–1401. https://doi.org/10.
robotic finishing of friction stir-welded corner joints. Procedia 1109/AIM.2018.8452707
Manufacturing. https://doi.org/10.1016/j.promfg.2020.02.013
123
Journal of Intelligent Manufacturing (2023) 34:2765–2781 2781
Quarta, D., Pogliani, M., Polino, M., Maggi, F., Zanchettin, A. M., Uzun, M., Umut Demirezen, M., Koyuncu, E., & Inalhan, G.
& Zanero, S. (2017). An experimental security analysis of an (2019). Design of a hybrid digital-twin flight performance
industrial robot controller. Proceedings - IEEE symposium on secu- model through machine learning. 2019 IEEE Aerospace con-
rity and privacy (pp. 268–285). https://doi.org/10.1109/SP. ference (pp. 1–14). https://doi.org/10.1109/AERO.2019.
2017.20 8741729
Ramis Ferrer, B., Muhammad, U., Mohammed, W., & Martínez Lastra, Vachalek, J., Bartalsky, L., Rovny, O., Sismisova, D., Morhac, M., &
J. (2018). Implementing and visualizing ISO 22400 key perfor- Loksik, M. (2017). The digital twin of an industrial production line
mance indicators for monitoring discrete manufacturing systems. within the industry 4.0 concept. 2017 21st International conference
Machines, 6(3), 39. https://doi.org/10.3390/machines6030039. on process control (PC) (pp. 258–262). https://doi.org/10.
Rivera, L. F., Jiménez, M., Angara, P., Villegas, N. M., Tamura, G., & 1109/PC.2017.7976223
Müller, H. A. (2019). Towards continuous monitoring in person- Villagrossi, E., Pedrocchi, N., Beschi, M., & Molinari Tosatti, L. (2018).
alized healthcare through digital twins. Proceedings of the 29th A human mimicking control strategy for robotic deburring of hard
annual international conference on computer science and software materials. International Journal of Computer Integrated Manufac-
engineering, (pp. 329–335) turing, 31(9), 869–880. https://doi.org/10.1080/0951192X.2018.
Schneider, U., Drust, M., Ansaloni, M., Lehmann, C., Pellicciari, 1447688
M., Leali, F. … Verl, A. (2016). Improving robotic machining Wang, X. V., & Wang, L. (2021). A literature survey of the robotic
accuracy through experimental error investigation and modular technologies during the COVID-19 pandemic. Journal of Manu-
compensation. International Journal of Advanced Manufacturing facturing Systems. https://doi.org/10.1016/j.jmsy.2021.02.005
Technology. https://doi.org/10.1007/s00170-014-6021-2 Wang, J., Ye, L., Gao, R. X., Li, C., & Zhang, L. (2019). Digital Twin for
Stark, R., Kind, S., & Neumeyer, S. (2017). Innovations in digi- rotating machinery fault diagnosis in smart manufacturing. Inter-
tal modelling for next generation manufacturing system design. national Journal of Production Research. https://doi.org/10.1080/
CIRP Annals, 66(1), 169–172. https://doi.org/10.1016/j.cirp.2017. 00207543.2018.1552032
04.045 Wang, X., Wang, Y., & Xue, Y. (2006). Intelligent compliance control
Tao, F., Qi, Q., Wang, L., & Nee, A. Y. C. (2019). Digital twins and for robotic deburring using fuzzy logic. 2006 IEEE International
cyber–physical systems toward smart manufacturing and indus- Conference on Industrial Informatics, INDIN’06. https://doi.org/
try 4.0: Correlation and comparison. Engineering, 5(4), 653–661. 10.1109/INDIN.2006.275723
https://doi.org/10.1016/j.eng.2019.01.014. Wu, M., Song, Z., & Moon, Y. B. (2017). Detecting cyber-physical
Tao, F., & Zhang, M. (2017). Digital Twin Shop-Floor: A New Shop- attacks in CyberManufacturing systems with machine learning
Floor Paradigm Towards Smart Manufacturing. IEEE Access, 5, methods. Journal of Intelligent Manufacturing, 30(3), 1111–1123.
20418–20427. https://doi.org/10.1109/ACCESS.2017.2756069 https://doi.org/10.1007/s10845-017-1315-5
Tharma, R., Winter, R., & Eigner, M. (2018). An approach for Xu, L., Da, & Duan, L. (2019). Big data for cyber physical systems
the implementation of the digital twin in the automotive in Industry 4.0: a survey. Enterprise Information Systems, 13(2),
wiring harness field. Proceedings of international design confer- 148–169. https://doi.org/10.1080/17517575.2018.1442934
ence (pp. 3023–3032). https://doi.org/10.21278/idc.2018. Zhang, H., Liu, Q., Chen, X., Zhang, D., & Leng, J. (2017). A
0188 digital twin-based approach for designing and multi-objective
Tomiyama, T., & Moyen, F. (2018). Resilient architecture for cyber- optimization of hollow glass production line. IEEE Access, 5,
physical production systems. CIRP Annals, 67(1), 161–164. 26901–26911. https://doi.org/10.1109/ACCESS.2017.2766453.
https://doi.org/10.1016/j.cirp.2018.04.021 Zhuang, C., Liu, J., & Xiong, H. (2018). Digital twin-based smart pro-
Tong, X., Liu, Q., Pi, S., & Xiao, Y. (2019). Real-time machining data duction management and control framework for the complex prod-
application and service based on IMT digital twin. Journal of Intel- uct assembly shop-floor. The International Journal of Advanced
ligent Manufacturing, 31(5), 1113–1132. https://doi.org/10.1007/ Manufacturing Technology, 96(1–4), 1149–1163. https://doi.org/
s10845-019-01500-0 10.1007/s00170-018-1617-6
Tuegel, E. J., Ingraffea, A. R., Eason, T. G., & Spottswood, S. M.
(2011). Reengineering aircraft structural life prediction using a
Digital Twin. International Journal of Aerospace Engineering, Publisher’s Note Springer Nature remains neutral with regard to juris-
1–14. https://doi.org/10.1155/2011/154798 dictional claims in published maps and institutional affiliations.
Uhlmann, E., Reinkober, S., & Hollerbach, T. (2016). Energy Efficient
Usage of Industrial Robots for Machining Processes. Procedia
CIRP, 48, 206–211. https://doi.org/10.1016/j.procir.2016.03.241
123