Realization of Robotic Process Automation
Realization of Robotic Process Automation
Submitted by
DIVYAN S 142220104302
BACHELOR OF ENGINEERING
in
COMPUTER SCIENCE AND ENGINEERING
SIGNATURE SIGNATURE
We also thank our Vice Principal Dr.S.Visalakshi, M.E., Ph.D., for her
constant motivation to strive towards excellence.
ABSTRACT V
1. INTRODUCTION
1.2 Purpose 2
1.3 Scope 2
1.6.1 Advantages 9
1.6.2 Limitations 9
2.3.1 Embedded C 14
3. SYSTEM DESIGN
4. IMPLEMENTATION
5.1 Testing 35
7. APPENDIX 47
8. REFERENCES 72
ii
ABSTRACT
iv
க
அணிய ய ம ெதாட அ லாத ெச சா
ெதாழி ப க அவ ற எளிதான பய பா ம
பய பா ட பல ேவ ப ட ப த க பரவ ளன,
ேம ச ப தய ஆ களி ெதாழி ப
வள ச க ந ற ெதரிவ வைகய ப ேவ
பய பா க ேவகமாக அத கரி வ க றன. இ த
ேவைல ப ேவ ெதாழி ைற ைறகளி அணிய ய
ம ெதாட அ லாத ெச சா ெதாழி ப களி
பய பா ைட உ த ெச க ற .
இ த ஆ வ , ஆபேர ட க ஒ ச ற ந ரலா க ழ
ேதைவ இ லாம ந க ேநர த ெதாழி ைற
ேராேபா கைள எளிதாக க ப த எ பைத
ேநா கமாக ெகா ள .
வ , அற சா காதார ேராேபா ஒ த ய ைறைய
ஊ வ ம ஒ த ய தயாரி வழிவ
எ எத பா க ப க ற . ைமய வா ைக தர
ஒ டான ப ர ச ைனயாக மாற ளதா தவ க
ஆேரா க யமான ம மக ச யான வா ைக கான
ஆ வ ச ப காலமாக அத கரி ள . ேம ,
காதார த தான ஆ வ ெதாழி ைற ந வன கைள
காதார ெதாழி ப த கவன ெச த வழிவ த .
ெஹ ேக ேராேபா ெதாழி ப ேராேபா ைறய
மிக ெபரிய ச க களி ஒ றா , ேம பல
ந வன க ந வன க ெஹ ேக ேராேபா
ெதாழி ப ைத உ வா க ய ளன. ெஹ ேக
ேராேபா ஒ நப மன த யாக / அ ல உட
த யாக உதவ அ மத ச ல த ற கைள
ெகா க ேவ . வா க , ெந ம PIR
ஆக ய அத க ந இரசாயன கைள உண த , மனித களி
மிக க ப த ப ட ப த கைள உண த . இ த யாக
இதய , வாச ெச சா ேபா றவ ற
அ பைடய ெதாழிலாள உட நல ப ர ச ைனகைள
சரிபா க. தர தள AWS IOT ப ேள ஃபா ைம ேசமி க.
vi
19 A1 Output of clustering 59
INTRODUCTION
1. INTRODUCTION
1
1.2 PURPOSE
1.3 SCOPE
2
i.e., vision-based and accelerometer and/or gyroscope based.
• These have some limitations like ambient optical noise, slower
dynamic response, and relatively large data collections/processing of
vision-based method.
• Less accuracy.
• High maintaince
• High time consumption.
• Wired connection.
2020
3
activity. The end-effector of this setup is a mechanical human hand. This
model is constructed and then simulated in Simscape. Arduino boards and
IDE are utilized for instruction and data transfer.
2020
This study presents a simple Human Machine Interface (HMI) for gesture
recognition purpose, based on a wireless piezoresistive armband. The
armband embeds three sensors based on Force Sensitive Resistors (FSRs)
applied on specific forearm muscles, which provide signals comparable to
the electromyography linear envelope. The system aims to recognize in real
-time some hand gestures, opportunely processing the force signals. The
HMI control system is based on Arduino platform and implements a Linear
Discriminant Analysis (LDA) classifier to perform real-time gesture
recognition. The HMI, by means of a Bluetooth module can wireless
connect to a computer and provide commands to custom graphical
interfaces or other applications as videogames.
2021
4
require to work with digital content such as factory KPI dashboards, live
dashboards and controls on multiple displays. Manipulating and arranging
the displays and their layout with a user's face and hand gesture could be
more natural, automatic and interactive for the control room operators.
Therefore, a display control framework is developed in the Manufacturing
Intelligence Control Room (MICR) at the Advanced Remanufacturing and
Technology Centre (ARTC), using the open-source FaceNet facial
recognition and OpenPose hand feature recognition algorithms and
integrating with the display control system; Nerve Center from Mezzanine
system of Oblong Industries.
1.6.1 ADVANTAGES
Enhanced Efficiency
Cost Savings
5
Improved Accuracy and Quality
1.6.2 LIMITATIONS
6
Appendix and References are included.
7
CHAPTER 2
SYSTEM REQUIREMENTS AND
SPECIFICATION
8
2.1 SYSTEM REQUIREMENTS AND SPECIFICATIO
• Robotic setup
• Battery 12 v
• Gear motor
• Mq9
• Flame
• Pir
• Heart beat
• Respiratory
• Rfid reader
• Tags
• Iot moderm
• Arduino IDE
• Embedded c
• Proteus design
9
2.2 SOFTWARE ENVIRONMENT
Text Editor: The IDE provides a simple text editor where users can write
and edit their Arduino sketches (programs). It includes syntax
highlighting and auto-indentation to aid in code readability.
Compiler: The IDE includes a built-in compiler that translates the written
code (in Arduino programming language, a variant of C/C++) into
machine-readable code (binary) executable by Arduino microcontroller
boards.
10
Arduino boards via USB, allowing users to transfer the code from the
computer to the board for execution.
Serial Monitor: Arduino IDE includes a Serial Monitor tool that enables
users to communicate with the Arduino board, display serial output
(debug information, sensor readings, etc.), and send/receive data
between the board and the computer.
Board Manager: Users can select the type of Arduino board they are
working with through the Board Manager. It provides a list of supported
boards and allows for easy selection and configuration.
PROGRAMMING LANGUAGE:
11
EMBEDDED C
FEATURES OF EMBEDDED C
12
Interrupt Handling: It includes mechanisms to handle interrupts
efficiently. Embedded systems often rely on interrupt-driven
architectures to respond quickly to external events, and Embedded C
provides constructs to manage interrupts effectively.
13
Proteus is a widely used software tool for simulating and designing
electronic circuits and systems. While it's primarily focused on electronics
and microcontroller-based systems, it can be utilized to simulate and
design components or systems related to the realization of Robotic
Process Automation (RPA) initiatives in an industrial environment,
especially concerning control systems, sensors, and interfaces. While
Proteus doesn't directly simulate entire industrial processes or complete
RPA implementations, it serves as a valuable tool for simulating and
validating individual components, control systems, and interfaces
associated with RPA initiatives in an industrial context. Its simulation
capabilities aid in the design, testing, and validation phases, contributing to
the development of reliable and efficient RPA systems before actual
deployment in industrial environments. Proteus facilitates iterative
development by allowing designers and developers to prototype and refine
RPA-related systems in a virtual environment. It supports the testing of
different configurations and functionalities, enabling improvements and
optimizations before physical implementation. Proteus enables the
simulation of actuators or output devices, such as motors, servos, or relays.
Designers can simulate the response of these actuators based on the
signals received from the control system, allowing them to validate the
behavior of robotic mechanisms or automated processes.
14
Microcontroller Simulation: Proteus allows for the simulation of
microcontrollers commonly used in industrial automation systems.
Users can simulate and test the behavior of microcontroller-based
control systems that manage various aspects of RPA, such as robot
movement, sensor integration, and data processing.
15
Control Algorithm Validation: The software supports the validation of
control algorithms used in RPA. Engineers can simulate these
algorithms to ensure proper functioning, accuracy, and efficiency in
controlling robotic movements and automated processes.
16
successful realization and deployment of robotic process automation
initiatives, leading to increased efficiency, accuracy, and productivity in
industrial processes.These modules encompass various types of robotic
arms used in industrial automation. They come in different configurations
such as SCARA, articulated, delta, etc., capable of performing tasks like
pick-and-place, assembly, or material handling.
• Microcontroller ATmega328
• Operating Voltage 5V
ARDUINO UNO
17
• Input Voltage (limits) 6-20 V
18
undergo training.
19
Based on the findings presented in the theoretical framework, and the
ambitions to describe how RPA-implementation may be facilitated, the
following analytical model (seen in Figure 3) was created with the intention
to categorize important themes on the subject to be used in our analysis.
20
CHAPTER 3
SYSTEM DESIGN
21
3. SYSTEM DESIGN
Robotics and Actuators: This layer involves the physical robots or robotic
arms that perform tasks based on commands received from the control
layer. Images might include robotic arms or actuators used in industrial
automation.
22
Figure 3.1- Overall Architecture diagram
Use case diagrams depict interactions between users (actors) and the
system to showcase various functionalities and actions the system can
perform. In an industrial RPA context, it can illustrate different user roles
interacting with the automation system.
Example: A use case diagram might display actors like "Operator," "System
Administrator," or "Robot" interacting with use cases such as "Start
Process," "Monitor System," or "Execute Task."
23
ADVANTAGES
● The right decisions are made before you are given poorly written
code
● It is very easy to understand
24
3.2.1 Use Case Diagram
Figure 3.2 describes that use case diagram. Here the actors are user and
dataset. A use case diagram in the Unified Modeling Language is a type of
behavioral diagram defined by and created from a Use-case analysis. Its
purpose is to present a graphical overview of the functionality provided by a
system in terms of actor, their goals (represented as use cases), and any
dependencies between those use cases.
25
3.3.1 Feasibility Study
26
feasibility study helps in assessing the readiness of industrial systems,
processes, and infrastructure for implementing RPA technology. It enables
stakeholders to make informed decisions regarding technical requirements,
readiness, and challenges associated with deploying RPA in an industrial
setting.
Social Feasibility
27
.
Electrical Transformers:
Digital Transformation:
28
Transformer architecture developed by Google (used in models like BERT,
GPT), excel in sequence-to-sequence tasks and could potentially be applied
in optimizing RPA algorithms for language-based automation tasks or data
processing.
3.4.1 RECTIFIER:
29
the same.
30
seamless integration and operation of RPA technology within industrial
workflows.
Data Source Identification: Identify and specify the sources from which
input data will be obtained. This could include various sources such as
databases, IoT devices, sensors, manual inputs, or external
applications/systems.
31
results, and actions are presented, communicated, and utilized by the
automated systems or human stakeholders. By considering these aspects
during output design, RPA systems in industrial settings can effectively
present processed data, results, and notifications in a user-friendly,
informative manner, enhancing decision-making and operational efficiency.
This design phase ensures that the output generated by RPA initiatives
aligns with the needs and expectations of stakeholders within the industrial
environment.
o Output Delivery Mechanisms: Define how and where output data will be
delivered or accessed. This might involve email notifications, file exports,
integration with other systems, or displaying results on user interfaces.
32
o Real-time Monitoring and Alerts: Implement mechanisms for real-time
monitoring of processes and outputs. Define alert systems to notify
stakeholders of critical events, errors, or completed tasks.
33
CHAPTER 4
IMPLEMENTATION
34
4. IMPLEMENTATION
35
4.1.2 Training and Testing
4.1.3 Recognition
Simplified further, the logic of the analytical model of this thesis and
the above-described approach from understanding goals and intentions,
common issues and challenges to overcome to achieve these goals, and
finally looking at potential approaches to avoid/overcome issues and
generally facilitating implementation projects.
36
Fig 4.2.1 Flow Process of analytical model
37
which enables these objects to collect and exchange data. IoT allows
objects to be sensed and controlled remotely across existing network
infrastructure, creating opportunities for more direct integration between
the physical world and computer-based systems, and resulting in improved
efficiency, accuracy and economic benefit.
38
Fig 4.2.2 IOT in RPA
4.2.3 GYROSCOPES
A gyroscope is a device that uses Earth’s gravity to help determine
orientation. Gyro sensors are devices that sense angular velocity which is
the change in rotational angle per unit of time. Angular velocity is generally
expressed in deg/s (degrees per second). There are three basic types of
gyroscope Rotary (classical) gyroscopes, Vibrating Structure Gyroscope
and Optical Gyroscopes. Its design consists of a freely rotating disk called
a rotor, mounted onto a spinning axis in the centre of a larger and more
stable wheel. As the axis turns, the rotor remains stationary to indicate the
central gravitational pull, and thus which way is down. The gyroscope
maintains its level of effectiveness by being able to measure the rate of
rotation around a particular axis. When gauging the rate of rotation around
the roll axis of an aircraft, it identifies an actual value until the object
stabilizes out. Using the key principles of angular momentum, the
gyroscope helps indicate orientation. Gyroscopes are available that can
measure rotational velocity in 1, 2, or 3 directions. 3-axis gyroscopes are
often implemented with a 3-axis accelerometer to provide a full 6 degree-of
-freedom (DoF) motion tracking system. A gyroscope would be used in an
aircraft to help in indicating the rate of rotation around the aircraft roll axis.
As an aircraft rolls, the gyroscope will measure non-zero values until the
platform levels out, whereupon it would read a zero value to indicate the
direction of down.
39
Fig 4.2.3 Gyroscope sensor
40
transactions processed by RPA systems within a specific timeframe.
Higher throughput and faster processing speeds demonstrate
increased productivity.
41
utilization rates. Optimize robot utilization for maximum efficiency.
42
monitoring and control of industrial processes via mobile
networks. RPA systems can leverage GSM-enabled devices to
monitor equipment status, collect data, or even trigger
automated actions from a remote location.
Alerts and Notifications: Integrating GSM modules within RPA
systems enables real-time alerts and notifications. In case of
anomalies, GSM-based systems can send notifications to
relevant personnel or trigger predefined actions, ensuring
timely response to critical situations.
Data Connectivity and Communication: GSM technology
provides a reliable means of data connectivity for RPA systems.
It allows RPA software or devices to communicate with central
servers, databases, or cloud platforms, facilitating seamless
data exchange and updates.
IoT Integration: RPA initiatives in industrial automation often
involve integrating Internet of Things (IoT) devices. GSM
connectivity can enable communication between RPA-enabled
devices and a centralized control system, allowing for efficient
coordination and data transfer.
Backup Communication Channel: GSM serves as a backup
communication channel for RPA systems in case primary
network connections (e.g., Wi-Fi or Ethernet) face disruptions.
This redundancy ensures continuity in data transmission and
operation.
Asset Tracking and Management: GSM-based tracking
systems can be employed within RPA initiatives to track the
43
movement and status of assets within an industrial
environment. RPA systems can automate processes based on
the location or condition of assets detected through GSM-
enabled tracking.
Remote Access and Troubleshooting: RPA-enabled systems
integrated with GSM technology allow remote access and
troubleshooting. Personnel can remotely access RPA systems
to diagnose issues, perform maintenance, or make necessary
adjustments without physically being present at the industrial
site.
Security and Access Control: GSM-based systems can
contribute to security measures within RPA implementations.
Access control systems leveraging GSM technology can
restrict unauthorized access to RPA-enabled devices or
systems.
Integration of GSM technology with RPA initiatives in industrial
settings provides enhanced connectivity, remote access, and
efficient communication, contributing to improved automation
capabilities, streamlined processes, and better operational
control.
44
Fig 4.2.5 GSM Module
4.2.6 Registers
45
DD RAM or CG RAM. The data written to DR by the MPU, is
automatically written to the DD RAM or CG RAM as an internal
operation.
46
Fig 4.3.1 Working Model
47
the strategic objectives of the industrial facility. Establish Key Performance
Indicators (KPIs) to measure the success of automation efforts.
48
Development of Automation Workflows:
Develop RPA workflows, scripts, or bots based on the defined processes.
Design and build automation sequences that replicate human actions and
decision-making steps while adhering to defined rules and logic.
Pilot Implementation:
Conduct a pilot implementation of RPA in a limited operational setting or
specific processes to assess real-world performance. Gather feedback,
make necessary adjustments, and fine-tune the automation workflows
based on pilot results.
Full-Scale Deployment:
Roll out the validated and refined RPA workflows for full-scale deployment
across the targeted industrial processes. Ensure proper integration with
existing systems, and provide necessary training to users.
49
assess the impact on operational efficiency, cost savings, and other
predefined KPIs.
50
CHAPTER 5
51
5. SYSTEM TESTING AND MAINTANANCE
5.1 TESTING
Testing is a set of activities that can be planned in advance and
conducted systematically. There are two types of testing according to their
behaviors,
1. Unconventional Testing
2. Conventional Testing
52
the planned activities. Test data. The data that testers enter into the
software to verify certain features and their outputs. Examples of such data
can be fake user profiles, statistics, media content, similar to files that
would be uploaded by an end-user in a ready solution. Test plans. A file that
describes the strategy, resources, environment, limitations, and schedule of
the testing process. It’s the fullest testing document, essential for informed
planning. Such a document is distributed between team members and
shared with all stakeholders. Test scenarios. In scenarios, testers break
down the product’s functionality and interface by modules and provide real-
time status updates at all testing stages. A module can be described by a
single statement, or require hundreds of statuses,
depending on its size and scope.
● Testing can be done in the early phases of the software
development lifecycle when other modules may not be available
for integration.
● Fixing an issue in Unit Testing can fix many other issues
occurring in later development and testing stages.
● Cost of fixing a defect found in Unit Testing is very less than the
one found in the system or acceptance testing.
● Code coverage can be measured.
● Fewer bugs in the System and Acceptance testing.
● Code completeness can be demonstrated using unit tests. This
is more useful in the agile process. Testers don't get the
functional builds to test until integration is completed.
● Code completion cannot be justified by showing that you have
written and checked in the code. But running Unit tests can
53
demonstrate code completeness.
● Expect robust design and development as developers write test
cases by understanding the specifications first.
● Easily identify who broke the build.
● Saves development time: Code completion may take more time
but due to decreased defect count overall development time
can be saved.
54
tester should understand the software thoroughly and try to find the
possible ways in which the software can fail. For example, in a
program to divide two numbers, the possible way in which the
program can fail is when 2 and 0 are given as inputs and 2 is to be
divided by 0. In this case, a set of tests should be developed that can
demonstrate an error in the division operator.
55
produce valid outputs. The decision branches and internal code flow
should be validated. It is the testing of individual software unit of the
application. It is done after the completion of an individual unit before
integration. This structural testing relies on knowledge of its construction
and is invasive. Unit tests perform basic tests at component level and test
a specific business process, application, and system configuration. Unit
tests ensure that each unique path of a business process performs
accurately to the documented specifications and contains clearly defined
inputs and expected results.
56
by the diffuse standards of the software industry, so I’ve been wary of
using it in my writing. In particular, many people assume integration tests
are necessarily broad in scope, while they can be more effectively done
with a narrower scope.
57
a comprehensive testing methodology that is costeffective and efficient
while still incorporating enough variety—such as well-designed frontend UI
automated tests alongside targeted unit testing, based on smart risk
prioritization—to prevent any aspects of your software applications from
going unchecked. These days, many Agile work environments employing
workflow practices such as XP (Extreme Programming), RUP (Rational
Unified Process), or Scrum appreciate regression testing as an essential
aspect of a dynamic, iterative development and deployment schedule.
58
System testing is a process of testing the entire system that is fully
functional, in order to ensure the system is bound to all the requirements
provided by the client in the form of the functional specification or system
specification documentation. In most cases, it is done next to the
Integration testing, as this testing should be covering the end-to-end
system’s actual routine. This type of testing requires a dedicated Test Plan
and other test documentation derived from the system specification
document that should cover both software and hardware requirements. By
this test, we uncover the errors. It ensures that all the system works as
expected. We check System performance and functionality to get a quality
product. System testing is nothing but testing the system as a whole. This
testing checks complete end-to-end scenario as per the customer’s point
of view. Functional and Non-Functional tests also done by System testing.
All things are done to maintain trust within the development that the
system is defect-free and bug-free. System testing is also intended to test
hardware/software requirements specifications. System testing is more of
a limited type of testing; it seeks to detect both defects within the “inter-
59
assemblages”.
60
CHAPTER 6
CONCLUSION AND FUTURE WORK
61
6. CONCLUSION AND FUTURE WORK
6.1 CONCLUSION
The future work for the realization of Robotic Process Automation (RPA)
initiatives in industrial settings encompasses several areas aimed at
further enhancing automation capabilities, expanding application domains,
and ensuring sustained efficiency. The future work in RPA initiatives for
industrial settings involves ongoing innovation, adaptation to technological
advancements, and a strategic approach to leverage automation for
continued business growth, operational excellence, and positive societal
impact. Embracing eco-friendly automation strategies that focus on energy
efficiency, reduced waste, and sustainability in industrial processes,
contributing to environmentally conscious automation practices.
Facilitating collaboration between humans and robots in the workplace by
62
developing RPA systems that augment human capabilities rather than
replacing them. This involves designing interfaces and workflows for
effective human-robot interaction.
6.3 APPLICATIONS:
63
adherence, contributing to a safer workplace.
CHAPTER 7
APPENDIX
64
OUTPUT
65
IMPLEMENTATION OF CODE
void setup() {
pinMode(5, OUTPUT);
pinMode(6, OUTPUT);
pinMode(4, OUTPUT);
pinMode(7, OUTPUT);
pinMode(trigPin, OUTPUT);
pinMode(echoPin, INPUT);
void loop() {
digitalWrite(trigPin,HIGH);
delayMicroseconds(1000);
digitalWrite(trigPin, LOW);
duration=pulseIn(echoPin, HIGH);
distance =(duration/2)/29.1;
66
delay(10);
if((distance>20))
digitalWrite(5,HIGH);
digitalWrite(4,LOW);
digitalWrite(7,HIGH);
digitalWrite(6,LOW);
else if(distance<20)
digitalWrite(5,LOW);
digitalWrite(4,HIGH);
digitalWrite(6,LOW);
digitalWrite(7,HIGH);
67
}
68
REFERENCES
69
REFERENCES
[2] Yao D., Jiang M., Abulizi A. and You X. Decision-tree-based algorithm
for 3D sign classification 12th International Conference on Signal
Processing (ICSP2014). IEEExplore ScienceDirect. 19-23 October 2020.
Hangzhou, Pages: 1200 1204.
[4] Microsoft Kinect for Windows Programming Guide. (December 2022). [5]
Manual Asus Xtion Sensor. Developer Guide. (December 2021).
70