Department of Electrical and Computer Engineering

North South University

CSE 499A: senior Design Project

Industrial Product Sorting Robot (IPSR)

Iftekhar Mahmud ID - 2011922042

Mushfiqur Rahman ID - 2011106042
Ridwan Miad ID - 1731715642

Faculty Advisor:

Dr. Fariah Mahzabeen

Assistant Professor

Electrical and Computer Engineering Department

Summer, 2023
 CONFLICT OF INTEREST STATEMENTS

This is to certify that this Project is our original work. No part of this work has been
submitted elsewhere partially or fully for the award of any other degree or diploma.
Any material reproduced in this project has been properly acknowledged.

ABSTRACT
Bangladesh is on the verge of starting its 4th industrial revolution. We are aiming to revolutionize the
manufacturing landscape in Bangladesh by introducing the country's first Own made Industrial
Internet of Things (IoT) implementation through the development of an advanced Industrial Product
Sorting Robot. With the escalating demand for precision and efficiency in manufacturing processes,
leveraging IoT technologies is the next logical step for Bangladesh's industrial sector. The proposed
sorting robot will employ sensors arrays, artificial intelligence algorithms, and robotic automation to
streamline the sorting process of industrial products, significantly reducing labor costs and enhancing
overall production output. This project embodies a pivotal milestone in Bangladesh's journey towards
Industry 4.0 and will serve as a facilitator for further technological advancements in the country's
manufacturing sector to be specific food industry sector. Through collaboration with local industries,
north south university, we aim to not only develop a state-of-the-art sorting solution but also establish
a blueprint for future IoT implementations, fostering economic growth and technological innovation
in Bangladesh.

INTRODUCTION

After doing research at Bangladeshi industries we saw that there is a gap on sorting solutions as per
4th industrial revolution .Recognizing this gap, we have decided to introduce an Industrial Product
Sorting Robot tailored to address this specific challenge. Our primary goal is to offer a sustainable,
cost-effective solution that not only meets the highest quality standards but is also assembled and
serviced right here in our own country.

At the core of our vision lies the commitment to provide a product that not only enhances productivity
but also contributes to the sustainability of local industries. By designing and engineering our sorting
robot, we aim to optimize resource utilization and minimize waste, aligning with global sustainability
goals. This approach not only benefits our environment but also translates into cost savings for our
valued partners in the food industry.

One of our distinctive strengths is our ability to keep costs low without compromising on quality. By
leveraging local expertise and resources, we ensure that our Industrial Product Sorting Robot remains
an accessible solution for a wide range of businesses. Furthermore, our in-country assembly and after-
sales service infrastructure guarantee prompt and reliable support for our clients, reinforcing our
commitment to long-term partnerships.

This venture is more than just a project. it's a testament to our belief in the potential of Bangladesh's
industrial sector. By introducing this innovative sorting solution, we aim to not only bridge an existing
gap but also set the stage for future advancements in industrial automation. Through collaborative
efforts with local industries and stakeholders, we aspire to foster a culture of innovation and take
Bangladesh towards a brighter, technologically empowered future.

Literature review

Here in this review, it provides a comprehensive analysis of the research papers focused on the
development of sorting systems for Industrial Internet of Things (IIoT) applications. The reviewed
studies offer a wide array of insights, ranging from 3D visual perception to natural language
interaction, and encompassing the integration of robotics, computer vision, and AI technologies for
our project. There are many insights that can help us as well as there are many things that could be
upgraded from those researches and this is what we are going to do in our project.

The first study proposes an innovative approach, combining 3D visual perception, natural language
interaction, and automatic programming for industrial robot sorting. This system enables real-time
interaction with users, enhancing the robot's cognitive abilities and facilitating efficient sorting. [1] [2]
Another study focuses on using industrial cameras for workpiece recognition through QR codes,
streamlining communication between the robot and workpiece. This method demonstrates high
accuracy in workpiece handling and categorization. [3] This research introduces a system for sorting
objects through image segmentation, significantly enhancing factory efficiency and reducing costs by
automating the sorting process. [4] The study explores the application of color-identifying pneumatic
robots for sorting items based on their component colors, presenting a potential solution for conveyor
belt-based industries. [5] This research emphasizes the use of algorithm-based sorting, rather than
advanced technologies like AI or machine learning. While it aids in building the robot system, there is
a recognized need for technological improvement. [6] The paper centers on using industrial-level
heavy equipment, providing valuable insights for building industry-standard sorting systems.
However, the limitation of non-programmability restricts versatility in use. [7] While the paper
focuses on adaptive robots used in industry machinery, it falls short of fully addressing the project's
objectives. Nonetheless, it offers crucial insights into building adaptable, multi-purpose robots. [8]
This research provides a thorough exploration of advancements in industrial robotics, highlighting
enhanced productivity, safety, and flexibility through adaptive control algorithms, sensor fusion, and
real-time communication protocols. [9] The study introduces a cost-effective vision system for color-
based object sorting, integrating an ABB IRB 140 robot. While innovative, its affordability may limit
its suitability for high-quality industrial applications. [10] This statement defines a robotic arm as a
programmable manipulator and elucidates its functions, akin to a human arm, showcasing its
versatility in various tasks. [11] The IBM Institute for Business Value underscores the synergistic
relationship between the Internet of Things (IoT) and Artificial Intelligence (AI), asserting that the
true potential of IoT is realized through the incorporation of dynamic AI technology. [12] The
research underscores the pivotal role of robots in automating waste sorting processes, demonstrating
their ability to recognize and manipulate items based on various attributes. [13] This study showcases
the pivotal role of automation in the electronics industry, utilizing the Raspberry Pi processor as a
core component for efficient communication with output and input modules. [14] The paper
highlights the necessity for robots to understand unstructured environments, emphasizing the need for
safe, stable, and accurate sorting techniques, as conventional methods may cause damage to target
objects. [15]
These research papers collectively offer a diverse range of valuable insights for the development of
sorting systems in the IIoT domain. While each study contributes significantly, certain gaps were
identified, including limitations in programmability, technology integration, and cost-effectiveness.
By critically evaluating these papers, our IIoT sorting robot project aims to bridge these gaps and
deliver a comprehensive, efficient, and industry-standard solution in line with the evolving landscape
of automation and robotics.

OBJECTIVES

We are building a robot for industrial-level sorting. This robot will have a arm mechanism that will do
all the sorting work. It's going to use AI or machine learning to figure out which products should be
kept and which should be thrown away.

Imagine a conveyor belt bringing in all the products. Our robot will use our own tech to know which
ones are good to go and which ones need to be sorted out. Then, with a swinging or pushing arm, it
will neatly arrange everything in their right places.

All the research papers we've looked at have been a huge help. They've given us some really smart
ideas. But we've also noticed some things that could be improved. So, we're going to take all those
good ideas and fix up the parts that need some work. Our goal is to make the absolute best sorting
robot for industries. We're excited to bring together all these amazing insights and create a robot that
does a good job at sorting things out in factories.

METHODS AND MATERIALS

We are going to use –
ESP32-CAM WiFi + Bluetooth Camera Module Development Board ESP32 With Camera Module
OV2640
MB102 Breadboard (Large)
Breadboard Power Supply Module 3.3V 5V
ESP32-CAM-MB MICRO USB Download Module for ESP32 CAM Development Board
Jumper Wire 40 Pcs Set 20cm - Jumper Wire Type : Male to Male
Jumper Wire 40 Pcs Set 20cm - Jumper Wire Type : Male to Female
Jumper Wire 40 Pcs Set 20cm - Jumper Wire Type: Female to Female
1 Meter Electrical Flexible Cable/Wire - Red Reference: RBD-2282
Blue Led 5mm (pack of 5)
Breadboard Jumper Wire Set
High quality AC/DC 9V 2A Switching Power Supply Adapter 2.1mm Barrel Jack
MG996R 10kg Servo (Fully Metal)
50 cm Micro USB Cable for Arduino Leonardo and Node MCU
Rubber belt
Normal motors

Methods are going to be AI or machine learning powered.

PROJECT TIMELINE
Projects Tentative Timeline:
 Week Progress Remark
Week1-Week3 Research about topic 15 thesis papers were
researched. And gathered
information about the project.
Week4-Week6 Finalizing the topic and IOT based project - IPSR
buying the components.
Week8-Week12 Working on robotic arm and Within this period, the
conveyor belt hardware part will be done.
Week13-Week16 Will work with AI detecting Basically, within this
Censor and Train AI with timeline, mainly software part
sorting algorithm. will be built.
Week17-Week18 Finalizing, reviewing &
presenting.

PROJECT BUDGET

We have a budget of 5000 bdt approximately. It can be varied as the project goes on but we are
expecting 5000 bdt as of right now

REFERENCES
1. Y. Lin, H. Zhou, M. Chen, and H. Min, “Automatic sorting system for industrial robot with 3D visual
perception and natural language interaction,” Measurement & Control, vol. 52, no. 1–2, pp. 100–
115, Jan. 2019, doi: 10.1177/0020294018819552.https://www.researchsquare.com/article/rs-
2329674/v1
2. T. Gueye, Y. Wang, R. T. Mushtaq, M. Rehman, A. Ahmed, and H. Ali, “State of the art review on
automatic sorting system for industrial robots using Internet of Robotic Things,” Research Square
(Research Square), Dec. 2022, doi: 10.21203/rs.3.rs-2329674/v1.
3. Q. Qin, D. Zhu, Z. Tu, and J. Hong, “Sorting system of robot based on vision detection,” in Lecture
notes in electrical engineering, 2018. doi: 10.1007/978-981-10-5768-7_62.
https://link.springer.com/chapter/10.1007/978-981-10-5768-7_62
4. Y. Zhang and W. Cheng, “Vision-based robot sorting system,” IOP Conference Series, vol. 592, no.
1, p. 012154, Aug. 2019, doi: 10.1088/1757-899x/592/1/012154.
https://iopscience.iop.org/article/10.1088/1757-899X/592/1/012154/meta
5. K. R. Sughashini, V. Sunanthini, J. Johnsi, R. Nagalakshmi, and S. Ramasamy, “A pneumatic robot
arm for sorting of objects with chromatic sensor module,” Materials Today: Proceedings, vol. 45,
pp. 6364–6368, Jan. 2021, doi: 10.1016/j.matpr.2020.10.936.
https://www.sciencedirect.com/science/article/abs/pii/S2214785320385849
6. “Design and development of the sorting system based on robot,” IEEE Conference Publication |
IEEE Xplore, Oct. 01, 2015. https://ieeexplore.ieee.org/abstract/document/7364620
7. “Automatic sorting machine using industrial robot and digital image processing,” IEEE Conference
Publication | IEEE Xplore, Sep. 01, 2021. https://ieeexplore.ieee.org/abstract/document/9559793
8. Vladimir Kuts, Tauno Otto, Toivo Tähemaa, Khuldoon Bukhari, Tengiz Pataraia, “Adaptive Industrial
 Robots Using Machine Vision, https://asmedigitalcollection.asme.org/IMECE/proceedings-
abstract/IMECE2018/52019/V002T02A093/276346
9. M. Hägele, K. Nilsson, J. N. Pires, and R. Bischoff, “Industrial robotics,” in Springer handbooks,
2016, pp. 1385–1422. doi: 10.1007/978-3-319-32552-1_54.
10. “Low-Cost Vision System for Pick and Place application using camera and ABB Industrial Robot,”
IEEE Conference Publication | IEEE Xplore, Jul. 01, 2020.
https://ieeexplore.ieee.org/abstract/document/9225522
11. R. T. Shah and A. Pandey, “Concept for Automated Sorting Robotic arm,” Procedia Manufacturing,
vol. 20, pp. 400–405, Jan. 2018, doi: 10.1016/j.promfg.2018.02.058.
12. S. G. Tzafestas, “Synergy of IoT and AI in Modern society: The Robotics and Automation case,”
Ntua, Oct. 2018, [Online]. Available:
https://www.academia.edu/37573474/Synergy_of_IoT_and_AI_in_Modern_Society_The_Robotics
_and_Automation_Case
13. “IEEE Xplore Full-Text PDF:” https://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=9966530
14. “Artificial Intelligence Based Trash and Recyclable Sorting Robot ARM.”
https://www.jetir.org/papers/JETIR2111244.pdf
15. H. Zhang, H. Liang, T. Ni, L. Huang, and J. N. Yang, “Research on Multi-Object sorting system based
on deep learning,” Sensors, vol. 21, no. 18, p. 6238, Sep. 2021, doi: 10.3390/s21186238.
https://www.mdpi.com/1424-8220/21/18/6238
Powered by TCPDF (www.tcpdf.org)