Automated Object Sorting System Using Robotics
Automated Object Sorting System Using Robotics
An interim capstone report submitted in partial fulfilment of the requirement for the
award of the degree of
Bachelor of Engineering
In
Electronics and Computer Engineering
Submitted By
Ishan Gupta (Leader) 101815016
Aryan Vikas Garg 101815015
Jayabrata Nath 101815021
Ishika Bansal 101995003
Ankita Gupta 101995004
Under Supervision of
March, 2021
Declaration
We hereby declare that the design principles and working prototype model of the project
entitled “Automated Object Sorting System Using Robotics ” is an authentic record of our
own work carried out in the Electronics and Communication Engineering Department, TIET,
Patiala, under the guidance of Dr. Anil Arora (Assistant Professor) And Dr. Hem Dutt Joshi
(Associate Professor) during 6th and 7th semesters (2020).
Date: 15/11/2021
Faculty Mentor:
2
Abstract
There is quite a lot of manual labour still being used to sort objects in places such as airports,
manufacturing factories and other public service areas (recycling plants) as well as industries.
This introduces human error as well as related logistic slowdowns and inaccuracies. Our
project is designed to eliminate such problems in previously mentioned industries and to
speed up logistics as well as increase the accuracy of the system as a whole.
In this project, we are making an object sorting robot which can detect the incoming objects
based on certain parameters which will be given to our machine learning algorithm. This
algorithm will control our robotic arm which in turn will sort the objects over different
conveyor belts as per their specifications.
Implementation methodology- We will have a single conveyor belt with sensors to detect the
incoming objects according to a sorting algorithm. Based upon the detection, the robotic arm
will direct/move the object to a specified location and release the object and come back to the
original position for subsequent action. Three different conveyor belts are placed on these
specific locations which will help the sorted objects to move to different locations as
required.
3
Acknowledgement
We would like to express our thanks to our mentor(s) Dr. Hem Dutt Joshi and Dr. Anil Arora.
They helped us in our venture with an indispensable resource of technical knowledge. He is
truly an amazing mentor to have. We are also thankful to Dr. Alpana Aggarwal, Head,
Electronics and Communication Engineering Department, entire faculty and staff of
Electronics and Communication Engineering Department, and also our friends who devoted
their valuable time and helped us in all possible ways towards successful completion of this
project.We thank all those who have contributed either directly or indirectly towards this
project.
Lastly ,we would also like to thank our families for their unyielding love and encouragement.
Date: 15/11/2021
4
Table of Contents
Declaration……………………………………………….….2
Abstract………………………………………………….…...3
Acknowledgement…………………………………….……...4
Chapter 1 Introduction ……………………………………...…..(8-9)
1.1 Introduction to RFID………………………….…..…...8
. 1.2 Purpose…………………………………………...……8
1.3 The advantages of the system……………….…..……..9
Chapter 2 Literature Survey………………………………........(10-12)
2.1 Introduction……………………………………….…..10
2.2 Remarks about RFID………………………………….11
Chapter 3 Methodology Adopted………………………………....13
3.1 Investigative Training………………………………....13
Chapter 4 Solution Development………………………………….14.
4.1 Introduction……………………………………….......14
4.2 Benefits of the System…………………………….......14
Chapter 5 Optimal Solution Selection……………………….….(15-18)
5.1 Components Required (Hardware)................................15
5.2 Programming Languages (Software).............................15
5.3Components and Function of Each Part..........................15
Chapter 6 Working…...…………………………………………..(19-20)
6.1 Process Overview……………………………………..19
6.2 Block Diagram………………………………………...20
Chapter 7 Project Design and Description……………………....(21-24)
7.1 Components Required………………………………….21
7.2 Components and Function of Each Part…………….….21
7.3 Analysis of Process………………………………...…..22
7.4 Database Module………………………………….........22
7.5 Database and Table Design……………………………..22
7.6 Data Acquisition Module…………………………….....23
7.7 Software Structure ………………………………….….23
7.8 Hardware and Costs………………… …………....…....24
7.9 Standards Used………………………………………….24
Chapter 8 Project Deployment……………………………..……(25-27)
8.1 Snapshots of Code……………...……………………....25
8.2 Image of Object Sorting arm…………………………...27
Chapter 9 Web Portal Snapshots…………………………………(28-29)
9.1 Homepage……………………………………………....28
9.2 Registration Form………………………………………28
9.3 Database Representation……………………....………..29
5
Chapter 10 Work Undertaken…………………………………………30
Chapter 11 Outcomes and Project Learning……………..................(31-32)
11.1 Individual Role Played …………………………………31
11.2 Project Outcomes………………………………………..31
11.3 Learning Outcomes……………………………………...32
11.4 Brief Analytical Assessment……………..……………...32
Chapter 12 Project Matrices……………………………...................(33-34)
12.1 Challenges Faced……….……………………………….33
12.2 Relevant Subject……………………….……………... .33
12.3 Interdisciplinary Knowledge Sharing……………..........34
12.4 Peer Assessment Matrix………..……………………...34
Chapter 13 Project Timeline………………………………...................35
References…………………………………………..………36
6
LISTS OF FIGURES
7
Chapter 1.
Introduction
Electronic label is divided into active tags, semi active tags, and passive tags. Active tags
require
batteries to provide energy for the communication between the tag and reader, so it's working
distance is far more than others, and the accuracy is relatively higher. Passive tags do not
require batteries to provide energy. It converts electromagnetic energy from the reader to
obtain energy, so it's read range is shorter, and the accuracy is lower, but it's cost is also
lower[4]. Semi-active tags require battery powered only when the circuit is working.
Compared with the passive tags, it provided further reading distance and accuracy. Compared
with the active tag, its price is cheaper[5]. In this project, passive RFID tags are used. The tag
will send out information by the antenna when the tag enters the RF signal coverage range,
the antenna on the reader receives signals reflected from the tag, and then transmitted to the
reader through the feeder line. Finally, it will send the signal to the computer which has been
demodulated and decoded.
1.2 Purpose
An automatic baggage handling and sorting system has been designed using microcontroller
for
cheap implementation on a small size terminal with a low cost and avoid issues faced at
airport by
airline industries.
• To improve baggage tracking and delivery.
• To improve security.
• To provide better services to premium customers.
• To ensure better services to track passenger progress through airports, reducing the
number of flyers arriving late at the gate and thus ensuring that planes depart on time
8
1.3 The advantages of the system
The sorting operation is the most complicated and the largest part of the workload in
distribution
center. With the popularization of the bar code, many express companies have introduced
bar-code technology to the auxiliary sorting. Bar-code technology has played an important
role in the express company. As the SF express, In the sorting operation of the SF express,
they used bar code technology to improve the sorting efficiency. However, there are also
inadequacies to using bar-code technology. For example, bar-codes and scanners must be
aligned when scanning bar-codes. This will not only increase the labor intensity of workers,
but also will increase the error rate. The automatic sorting system based on RFID relative to
manual sorting has the following advantages:
Firstly, this system can sort continuously, regardless of weather, time, and other physical
conditions of the human. The system can run efficiently, because the workers cannot work 8
hours in this labor intensity. The automatic sorting system of RFID can improve the sorting
efficiency greatly in the unit time.
Secondly, this system can reduce the sorting error rate. On the basis of experimental result, it
is
prone to error when manual method is used because of tiredness. If the bar-code auxiliary
sorting is used, bar codes may be wrinkled or damaged, etc. and the bar-code reading method
is contact reading, automatic sorting cannot be completed.
9
Chapter 2.
Literature Survey
2.1 Introduction
The development of global associations and dual transfer flights increases the passenger and
baggage volumes create big challenges to airports and airlines. Existing baggage handling
system relies on an aging Barcode system with a high error percentage.
In this system, transport operation is conducted at very low speed and precision. For reading
and
control of barcodes, barcode readers need to carefully read barcodes in direct sunlight.
Current bag tags include a barcode. These bag tags are printed using thermal or
barcode printers that print on an adhesive paper stock. This printed strip is then attached to
the
luggage at check in. This allows for automated sorting of the bags to reduce the number of
misrouted, misplaced or delayed bags. The limitations of this technology were apparent
when a
a fully automated cart-based system significantly delayed the airport's opening. While the
inability to reliably read all barcode tags in the installation was a part of the problem, it was
one of several technical reasons for the delayed opening. Nevertheless, automated sorting of
baggage using laser scanner arrays, known as automatic tag readers, to read bar-coded
bag tags is
standard at major airports. Bar codes cannot be automatically scanned without direct
sight and undamaged print. Forced by reading problems with poorly-printed, obscured,
crumpled, scored or otherwise damaged barcodes, radio-frequency identification (RFID)
chips
embedded in the tags can be very useful.
Thus airline requires a highly efficient method to handle the increasing passenger and
baggage volumes and thus the trending RFID technology has drawn the attention of the
airline. Barcode reading problems cause 9.7% of all mishandled baggage and failures to
receive baggage status messages contribute to a further 11% of mishandled baggage.
10
Fig 2.1 Main Causes of Baggage Delays Fig 2.2 No, of Passenger Complaints
This isn't a special idea, for the execution of an object sorting machine based on colour, size,
weight, etc. The idea has existed for quite a while, after there has been advancement in
technology.
Zimerman in his paper entitled 'Radio frequency identification (RFID): time to take another
look'
found that prices of RFID chips and equipment have dropped significantly. He opined that
RFID once set up, could place the burden of cataloguing, circulation and collection
management on the
computer rather than on staff. He strongly recommended that if a library cannot afford it now
in
its entirety, it should consider adopting and implementing it in carefully staged phases. He
concluded that RFID costs are coming down, efficiency is going up and libraries can
improve
their systems enormously.
Ghosh in his paper entitled 'Application of RFID Technology in Sardar Vallabhbhai National
Institute of Technology (SVNIT), Surat' described that RFID is the latest technology to be
used in different industries for security and theft detection. He observed that although the
system is costly and has some demerits, it is accurate, cost effective and requires less
manpower. He recommended that if the budget does not permit a library to introduce a
complete system at a time, it may be divided in two or three phases.
Hopkinson and Chandrakar in their study entitled 'Introducing RFID at Middlesex University
Learning Resource' observed that self check out and self-return quickly became very
popular amongst the users and usage quickly reached to 64 percent of issues and returns.
With the use of RFID technology, the amount of staff time engaged in circulation and stock
11
management has also reduced. They concluded that with the implementation of RFID, library
services became more user-friendly.
A camera located above the conveyor views the items orthographically. Boukouvalas et al
describes an integrated system developed for the detection of tiles.
12
Chapter 3
Methodology Adopted
Fair Testing It aims to find the relationship between to compromise between two
1. different factors(variables) that affect opposing but equally
the outcome. A single variable is important requirements,
changed while keeping the other We need to find a balance
variables are the same. Any differences are between the two. This is
said to be the result of the changed achieved by the Fair Testing
variables. method to find the most
effective balance.
3. Modelling Models are useful to understand how a all projects based on the
particular process works and why they techniques of object
work that way. Some models are detection and sorting .
already set or pre-defined while others
need to be formulated.
13
Chapter 4
Solution Development
4.1 Introduction
An automatic baggage handling and sorting system has been designed using microcontroller
for
cheap implementation on a small size terminal with a low cost and avoid issues faced at
airport by
airline industries.
• To improve baggage tracking and delivery.
• To improve security.
• To provide better services to premium customers.
• To ensure better services to track passenger progress through airports, reducing the
number
of flyers arriving late at the gate and thus ensuring that planes depart on time
1. Sorting mechanism is one of the biggest and lengthiest processes in distribution and
manufacturing centers. Making this process completely automated not only preserves time
but also makes use of manpower efficiently.
2. Using RFID instead of Bar-code technology makes the process more error free and
efficient since the bar-code technology needs the bar-code and the scanner to be aligned, any
misplacement in alignment may result in parcels not being scanned.
3. System can sort continuously, independent of various environmental factors.
4. System is prone to less error as compared to manual sorting
. 5. Manpower used for the same task is reduced and sorting becomes much more Orderly and
Energy efficient.
6. Tracking of parcels is easier.
14
Chapter 5
Optimal Solution Selection(Technology/Tools)
● Atmega 16 microcontroller
● RFID
● 7805 IC
● IC L293D
● Power supply
● Nodemcu
● Servo Motors
● DC Motor
● Screws
● Metal Plates
● PCB
● Wires
● Resistors,Capacitors and transistors and other electrical devices
● Soldering equipment and other relevant equipment
● Conveyor belt material
● Frontend : - HTML,CSS,JS
● Backend :- PHP ,MySQL
● H/W Level :- Arduino
5.3.1 RFID
A radio frequency identification reader (RFID reader) is a device used to gather
information from an RFID tag, which is used to track individual objects. Radio waves
are used to transfer data from the tag to a reader.
RFID is a technology similar in theory to bar codes. However, the RFID tag does not
have to be scanned directly, nor does it require line-of-sight to a reader. The RFID tag
must be within the range of an RFID reader, which ranges from 3 to 300 feet, in order
to be read. RFID technology allows several items to be quickly scanned and enables
fast identification of a particular product, even when it is surrounded by several other
items.
15
Fig :- 5.1 RFID Tags
5.3.2 Breadboard
A breadboard is used to build and test circuits quickly before finalizing any circuit
design. The breadboard has many holes into which circuit components like ICs and
resistors can be inserted.
The bread board has strips of metal which run underneath the board and connect the
holes on the top of the board. The metal strips are laid out as shown below. Note that
the top
and bottom rows of holes are connected horizontally while the remaining holes are
connected vertically
16
5.3.4 Servo Motor
A servomotor is a linear actuator or rotary actuator that allows for precise control of
linear or angular position, acceleration, and velocity. It consists of a motor coupled to
a sensor for position feedback. It also requires a relatively sophisticated controller,
often a dedicated module designed specifically for use with servomotors.
17
5.3.5 Node MCU
NodeMCU is an open source platform based on ESP8266 which can connect objects
and let data transfer using the Wi-Fi protocol. In addition, by providing some of the
most important features of microcontrollers such as GPIO, PWM, ADC, and etc, it
can solve many of the project’s needs alone.
18
Chapter 6
Working
The workers will put the express on the first conveyor belt once the system starts running.
After a certain time, goods reach the end of the belt.In this moment, the RFID reader can
read the tag's data, and the computer will send a control signal to the micro-
controller after the process. At the same time, when the object reaches the conveyor II, the
micro- controller will receive a pulse signal when it passes through the photoelectric
switch A. Then conveyor belt I will stop running, servo motor III will rotate according to the
signal from the PC. Shipment will be transported to the designated crossing, for
example, the number four crossing. Then servo motor III stops running and motor II starts
to work. At this point, the shipment will arrive at conveyor IV, then conveyor belt III
returns when the express passes through the photoelectric switch B. After that, the motor I
run again, and do the next sorting process above. Process of the sorting system is shown in
Figure 1.
19
6.6.2 Block Diagram
20
Chapter 7
Project Design and Description
● Atmega 16 microcontroller
● RFID
● 7805 IC
● IC L293D
● Power supply
● Raspberry Pie
● Servo Motors
● DC Motor
● Screws
● Metal Plates
● PCB
● Wires
● Resistors,Capacitors and transistors and other electrical devices
● Soldering equipment and other relevant equipment
● Conveyor belt material
Automatic sorting system based on RFID consists of a control device, the classification
system, the delivery device and sorting crossing. System configuration is shown in figure 6.1.
21
In the practical application, sorting crossing can be more than three. This system can be used
according to the actual application requirements, for example, the fourth conveyor can be
used as a delivery device, to meet the application requirements.
Control devices include RFID reader, PC machines as well as microcontroller. The role of the
classification system is that according to the control signal from the control module, control
servo motors take the package into the sorting crossing or right place. There are many
categories of classification devices, and it can be divided into delivery type,
push-out, surfaced style, tilt and branch type generally. Different classification devices
have
different requirements for cargo volume, weight and packaging bottom surface smooth
degree, in this paper, a transport-type classification system is used. Delivery device is
composed of a Conveyor Belt or conveyor, the main role is to deliver the parcel to the
corresponding locations for subsequent operations.
Design of the control module is the key part of this system.As shown in Figure 4.1,the
workers will put the express on the first conveyor belt once the system starts running. After a
certain time, goods reach the end of the belt.In this moment, the RFID reader can read the
tag's data, and the computer will send a control signal to the micro- controller after the
process. At the same time, when the object reaches the conveyor II, the micro- controller will
receive a pulse signal when it passes through the conveyor belt I. Then the conveyor
belt I will stop runn(ing, servo motor III will rotate according to the signal from the PC.
Shipment will be transported to the designated crossing, for example, the number four
crossing. Then servo motor III stops running and motor II starts to work. At this point, the
shipment will arrive at conveyor IV, then conveyor belt III returns when the express
passes through the conveyor belt. After that, the motor I run again, and do the next sorting
process above.
Courier will write related information to the tag by the hand held terminal
when he receives the information about Parcel, such as sender information, recipient
information,etc.
On the basis of the functional integrity of the system, in the actual design
process, we generally divided the system into a set of interrelated subsystems. Here is our
block
diagram of the system which is decomposed, On the basis of this, we design the detailed
module. As shown in Figure 6.2, the system includes the logic module, registration module,
sorting module, modification module, information query module, delete module and
information input module
23
7.8 Hardware and Cost
● ISO 24752 - System management protocol for automatic identification and data
capture using RFID
● IEEE 3652.1-2020 - Machine learning model standard
● IEEE 802.11ac -wireless communication standard
● LF – ISO/IEC 18000-2 for 125 kHz
● HF – ISO/IEC 18000-3 for 13.56 MHz
● ISO/IEC 15693
● ISO/IEC 14443
● ISO/IEC 15961 – Data Protocol: Application Interface (defines AFI = Application
Family Identifier, equivalent to EPC Header)
● ISO/IEC 15962 – Data Protocol: Data Encoding Rules and Logical Memory
Functions
● ISO/IEC 15963 – Unique Identification for RF Tags (related to TID Memory)
● GS1/EPCGlobal – EPC Tag Data Standards, Version 1.9
24
Chapter 8
Project Deployment
25
8.1.3 Database Insertion Code Snapshot
26
8.2 Image of Object Sorting Arm
27
Chapter 9
Web Portal Snapshots
As we open up our website for registration this shows up in the admin user end
Our Next step should be to register the customer details and shown below is the
registration page
We’ll have to store all of the user details till the checkout and the database with the user
details is shown below
29
Chapter 10
Work Undertaken
Database .
30
Chapter 11
Outcomes and Prospective Learning
● Completed the system and made the object sorting robotic arm functional.
● Successfully sorted the luggage using the RFID tag.
● Able to send a message to the owner of the luggage whose bag is sent to the desired
terminal.
● Detected luggage with unknown RFID tag successfully.
Q1. What sources of information did your team explorer to arrive at the list of possible
Project Problems?
Ans: The group was aware of the understanding of the project requirement and the problems
that need to be explored. We explored the required literature such as different research papers
published in different journals and magazines. The scope has been decided after consulting
our mentor.
Q2. What analytical, computational and/or experimental methods did your project team
use to obtain solutions to the problems in the project?
31
Ans: The first task was to work with an object detection model that fit best based on our
needs.We needed to create a dataset and retrain our model accordingly. Then we had to build
a UI that would be user friendly and incorporate features for the required output delivery.
Q3. Did the project demand demonstration of knowledge of fundamentals, scientific
and/or engineering principles? If yes, how did you apply?
Ans: In this project, we used the principles of Development. We used application dev and
software dev to create the UI and integrate the detection model with other features. Design,
architecture and documentation principles were covered with the knowledge gained from the
course of software engineering.
Q4. How did your team share responsibility and communicate the information of
schedule with others in the team to coordinate design and manufacturing dependencies?
Ans: We are a team of 5 and we're always in touch with each other for the entirety of this
project. We divided the project into sub-parts as per the need with each person handling a
section and helping each other. Effective communication was maintained through WhatsApp
groups and Zoom calls.
Q5. What resources did you use to learn new materials not taught in class for the course
of the project?
Ans: The team used different resources to learn new things. A vast pool of knowledge were
the research papers we went through to learn new techniques and get an understanding about
the working of the model. We also used youtube and search engines like Google for specific
queries and tutorials about things that were not taught in class. We studied official
documentation of web development through the Mozilla developers network and techniques
we used.
Q6. Does the project make you appreciate the need to solve problems in real life using
engineering and could the project development make you proficient with software
development tools and environments?
Ans: The project addresses a real-life problem and hopes to assist people in achieving day to
day tasks as well as impart knowledge. Working on this project has made us appreciate the
need to solve real world problems and has motivated the team to take up new problems in
diverse fields.
32
Chapter 12
Project Matrices
● Web Development
● SQL
● Software Engineering
● Database Management System
● Analog Circuits
● Electronics Engineering
● Circuit Design
Apart from using knowledge gained through subjects which had been taught in the course
curriculum, the team has gained a lot of information as well as knowledge from other sources
which are required in the completion of this project. The various other disciplines which are
included in this project are object detection which is the major requirement for the project.
The team learnt how object detection and sorting works.
33
12.4 Peer Assessment Matrix
Evaluation Of:
Ishan Aryan Jayabrata Ishika Ankita
Evaluation By:
Ishan 4 4 4.5 4 4
Aryan 4.5 4 4.5 4 4.5
Jayabrata 4.5 4 4 4.5 4
Ishika 4 4.5 4 4 4.5
Ankita 4.25 4.5 4.25 4.5 4
34
Chapter 13
Project Timeline
35
References
[1]Mishra P, Bolic M, Yagoub M C, etal. “RFID technology for tracking and tracing
explosives and
detonators in mining services applications,”Journal of Applied Geophysics, 2011, pp.33-43.
[2]Huang H, Chang Y. “Optimal layout and deployment for RFID systems,” J.
Advanced
Engineering Informatics, 2010, pp.4-10.
[3]Pan Zhang. Design and implementation of materials warehouse management system
based on RFID technology [D]. Electronic Science and Technology University,2013, in
Chinese.
[4] Hopkinson, A., & Chandrakar, R. (2006). Introducing RFID at Middlesex University
learning resources. Program: Electronic Library and Information Systems, 40(1), 89-97.
[5]J. V. Popov-Ralji, et al, “Investigations of bread production with postponed
staling applying instrumental
measurements of bread crumb color”, Sensors, vol 9, pp 8613- 8623, 2009.
[6] Palmer, Martin (2006). Using RFID to transform essex libraries. Library Hi Tech
News,
23(10), 21-22.
[7] Selamat, M.S. & Majlis, B.Y. (2006). Challenges in implementing RFID tag in a
conventional library. Paper presented at the IEEE International Conference on
Semiconductor Electronics, Kuala Lumpur.
[8]Shamsudin, T.M.W., Salami, M.J.E. & Martono, W. (2007). RFID based intelligent
books
shelving system. Paper presented at the IEEE 1st Annual RFID Eurasia, Istanbul.
[9]So, Stuart C.K. & Liu, J.J. (2007). Learning from failure: A case study of adopting
Radio
Frequency Identification technology in library services. International Journal of
Technology
Intelligence and Planning, 3(1), 75-95,
http://www.inderscience.com/info/inarticle.php?artid=13039
[10] Muir, S.P. (2007). RFID security concerns. Library Hi Tech
36