0% found this document useful (0 votes)
60 views41 pages

Robo and Automation

Uploaded by

Prem Hari
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF or read online on Scribd
0% found this document useful (0 votes)
60 views41 pages

Robo and Automation

Uploaded by

Prem Hari
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF or read online on Scribd
You are on page 1/ 41
AMARAVATHIPUTHUR, KARAIKUDI-630 301 SRI RAAJA RAAJAN COLLEGE OF ENGINEERING TECHNOLOGY, DEPARTMENT OF MECHANICAL ENGINEERING FUNDED PROJECT Academic Year-2020-2021 ROBOTICS AND AUTOMATION LAB Students of Mechanical engineering, who always has the hunger to leam came up with a massive idea of setting up “ Robotics and Automation Laboratory”. With the development of Industry 4.0, the lab was planned to consolidate all the technologies involved in Industry 4.0. This lab incorporates advanced technologies like Intemet of Things, 3D printer, Robotics, Cyber security and many more which makes it to be more than a lab and be a smart factory. The lab focuses on training students with basic automation to advanced automation with the upcoming technologies. This would promote the knowledge of multidisciplinary fields and enhance student knowledge to be future ready. The lab is also supported with backup power generated using Solar energy. Our final year students S.Arunakanth and his team members A.Daison Vimalraj, A.Ashwin Prakash and C.Gokulnath done this project successfully under the guidance of MrP.Pradeep Castro, Assistant Professor of Mechanical department. The lab was funded by YaGen Robotics, Chennai by providing equipment and components of worth Rs 3,50,000/- at free of cost . The total cost incurred for the lab was Rs 3,50,000/-. . OR © scanned with OKEN Scanner COLLEGE OF ENGINEERING T! SRIRAAJA RAAJAN ‘AMARAVATIIPUTHUR, KARATKUDI-630 301 DEPARTMENT OF MECHANICAL ENGINEERING The lab was inaugurated by Dr. Selvam, Vice Chancellor of Bharathidasan University, Thiruchirappalli tu visited the lab and were very much surprised by the technologies Officials from the government of India and Tamilnad involved in the lab and the kind of training, given to the students. © scanned with OKEN Scanner NOLOGY, 630 301 SRI RAAJA RAAJAN COLLEGE OF ENGINEERING AMARAVATHIPUTHUR, KARAIKU DEPARTMENT OF MECHANICAL ENGINEERING Very notable visitors to the lab: 1. Verma, Shri Bhanu Pratap Singh, Minister of Micro, Small & Medium Enterprises (M/o MSME). © scanned with OKEN Scanner SRI RAAJA RAAJAN COLLEGE OF ENGINEERING TECHNOLOGY, AMARAVATIIPUTHUR, KARATKUDI-630 301 DEPARTMENT OF MECHANICAL ENGINEERING 3. Dr.G.Ravi, Vice-Chancellor, Alagappa University, Karaikudi. BLESS GP e xapauuol\s ‘Ss /o 1 Oy OSH © scanned with OKEN Scanner ENGINEERING TECHNOLOGY, SRIRAAJA RAAJAN COLLEGE OF ‘AMARAVATHIPUTHUR, KARATKUDI-630 301 DEPARTMENT OF MECHANICAL ENGINEERING Photos of Robotics and Automation Lab © scanned with OKEN Scanner AMARAVATHIPUTHUR, KARAIKUDI-630 301 SRI RAAJA RAAJAN COLLEGE OF ENGINEERING TECHNOLOGY, DEPARTMENT OF MECHANICAL ENGINEERING — ALEXA AT ALEXA A.1is the cloud based voice assistant to control the third party systems. © scanned with OKEN Scanner JAN COLLEGE OF ENGINEERING TECHNOLOGY, KARAIKUDI-630 301 SRIRAAJA RAA. "AMARAVATHIPUTHUR, DEPARTMENT OF MECHANICAL ENGINEERING © scanned with OKEN Scanner SRIRAAJA RAAJAN COL GINEERING TECHNOL MARAVATH IR, KARATKUDE-630 301 DEPARTMENT OF MECHANICAL ENGINEERING. Automated floor cleaner - It is a IOT based floor cleaner controlled by Alexa A I an PRINCIPAL 4a Ragjan College of Engg. & Ter ‘Amaravathipudur, Karaikudi "eos vagangai Dist, Tamil Nadu © scanned with OKEN Scanner YAG =N RoBsoTICS Bagh, 2nd & ded Floor, Thumoorthy 12125, Kotha ‘Nagar, Nungambakkam, Chennal - 600034. Tarnil Nadu. India, Mobile: +91 “91500 84761 [email protected] Bil To. SRRCET “Amaravathipudhur, ‘araikue 60001 7373711343 INVOICE #28 bate Fob 10, 2021 Balance Due: '¥350,000.00 45,000.00 90,000.00 3D Printor with 20 kg tament’s Market kits ‘Marks-2 kits Drone with ae lor kit Tools and Equiments Hromote Not 449,500,00 467,500.00 316,500.00 %62,500.00 240,000.00 280,000.00 35,000.00 15,000.00 315,000.00 215,000.00 This Products worth of 3,50,000/- is given to college at free of cost for student project Subtota +3350,000.00 Tax (0%) 20.00 Total 350,000.00 PRINGIFAL, 11 Raaya Raajan College of Engg. & | ‘Amaravathipudur, Karaikudi - 630 3¢ ivagangai Dist. Tamil Nadu © scanned with OKEN Scanner 1.4 Organization of Report The entire Project is composed of five chapters. each covering a section of work as summarized below: © Chapter one gives an introduction to automation as a whole and the different types of ‘automation. And also define project motivation and objectives. © Chapter two covers an extensive background overview of project working and which technology are involved in development with establishment of standards and protocols and benefits. © Chapter three highlights the project methodology, giving reasons for choice of specific platform and components, and also comprehensive details on project development timeline. + Chapter four is on the project design and implementation with clear practical details of the project design, construction, testing, microcontroller coding and debugging. Special emphasis is also made on the flexibility and scalability of the project work with real life illustration. © Chapter five is on the project results and analysis, that how project fill up the needs which ‘was analysis at initial stage. ‘© Last chapter is on the conclusion and recommendations based on the project work with emphasis on the reliability, maintainability and flexibility of the design. Also, recommendations based on the challenges encountered and further possible development of the project work. iS Sy CED © scanned with OKEN Scanner Chapter 2 BACKGROUND MATERIAL 2.1 Conceptual Overview Project developed two devices:- © Smart-Switch © IP-based Surveillance Camera 2.1.1 Conceptual view of Smart-Switch O sSmart-Fox. Cloud. [~@ Internet Mobile App Fig 2.1 Smart-Switeh overview i-module hardware which control and © Smart switch is operated by ESP8266 with Wi connect switch to internet though local Wi-Fi network i network and also using GSM ‘Mobile app can connect to smart-switch using local internet or other Wi-Fi network. Cloud provide accessible to control switch though internet. ‘Smart-Switch can be operated using manual switch and also through mobile app. Live ‘itch get used using manually. status of switch can be monitor from mobile app even 10 © scanned with OKEN Scanner 2.2 Technologi 2.2.1 Teel logy using for Smart-Switeh Hardware used to build Smart-Switeh, * NodeMCU ESP8266 Wi module. Type - 32-bit miero-controller CPU 160MIL GPO -16 pin Memory - 4MB + 4 owo-way switches, ‘+ A port electromagnet relay, + 220 Volt to $ Volt AC to DC power adapter. Software used (o program ESP8266 microcontroller © Arduino IDE sing C language, = Development of mobile application, © Android Studio 3.1.1 IntelliJ plattorm, Fig 2.8 Switch Setup NodeMCU ESP8266 Wi-Fi module "" The NodeMCU (Node MicroController Unit) is an open source software and hardware development environment that is built around a very inexpensive System-on-a-Chip (SoC) called the ESP8266, The ESP8266, designed and manufactured by Espres: elements of the modem computer: CPU, RAM, networking (Wi-Fi), and even a modem operating system and SDK. When purchased at bulk, the ESP8266 chip costs only $2 USD a piece. That makes it an excellent choice for this project. F Systems, contains all erucial Fig 2.5 NodeMCU architecture diagram 2 © scanned with OKEN Scanner ‘Android Mobile Application ‘About half of the population around the world prefers Android over another operating systems or devices. ToT is one of the biggest areas where Android app development technology is continuously contributing with its enormous benefits. Intemet of Things is generally recognized as the interconnectedness of different smart devices over the Internet. The devices make use of h helps them receive, collect and transmit information. So sensors and internet connectivity, w! development on android platform is the right option for this project. ‘Smart-Switch application named Smart-Fox is developed on android platform with API 19 compatible which covers 90.1% android device of the total devices. List of support used on android device to run mobile application. © WiFi © Internet GSM, © Location. © Room SQLite database. Fig 2.6 Android Mobile Application B © scanned with OKEN Scanner 2.2.1 Technology using for IP-Based Surveillance Cam Hardware used to build Surveillance Camera «Raspberry Pi Zero W. - 1GHz, single-core CPU -512MB RAM ~ Mini HDMI and USB On-The-Go ports ‘Micro USB power - HAT-compatible 40-pin header = Composite video and reset headers = CSI camera connector © Sony IMX219 image sensor. Software used to build Surveillance Cam ‘© 2.7 version python platform. © OpenCV. Fig 2.7 Cam Setup Raspberry Pi Zero W" The Raspberry Pi is a popular Single Board Computer (SBC) in that i is a full computer packed into a single board. Many may already familiar with the Raspberry Pi 3 and its predecessors, which comes inform factor that has become as highly recognizable. The Raspberry Pi comes in an even smaller form factor. The introduction of the Raspberry Pi Zero allowed one to embed an entire computer in even smaller projects. This project will use the latest version of the Zeto product line, the Raspberry Pi Zero - Wireless, which has an onboard Wi-Fi module. “ © scanned with OKEN Scanner Sony IMX219 image sensor #! Is, back-illuminated CMOS the fulfillment performance of "IMX219", Type 1/4.0, approximately 8,08M effective image sensor for the growing mobile market. The IMX219 satis “high sensitivity" and “high frame rate imaging” to meet the demands for high-quality camera applications, and can be easily put on eamera fronts of stylish and slim bezel devices achieved by the reduced size. Not only the normal rate of all-8M pixels at full field of view and 30 frame/s, 4 times faster ing is also possible by 2 x 2 analog binning mode. Also, a LSC function*| corrcets optical unevenness {0 adjust during the module fabrication process, and contributes to suppressing of system cost. Additionally, combining with a rear-end ISP supporting of BME-HDR*2 enables future scalability of the high-dynamic-range video imaging, ima Image sensor is prefect for video surveillance with low power consumption and high quality video. This make image sensor perfect fit for this project. Fig 2.10 Image Sensor COLLEGE, GFN a. © ( KARAIKUD!} 5) ® és AS. 15 © scanned with OKEN Scanner 2.1.2 Programming Language used during project Project has used three different programming languages for our project. For the development ofthe application on android, we have used Java Platform. Android Software Development kit incorporates IntelliJ software where Java programming is performed, TntelliJ software is used to write the codes for the application under Java Platform, Raspbian OS is used at the raspberry pi. Java: Java is a set of several computer software products and specifications from Oracle Corporation that provides a system for developing application software and deploying it ina cross-platform computing environment. Java is used in a wide variety of computing platforms fiom embedded devices and mobile phones on the low end, to enterprise servers and supercomputers on the high end. Python: Python is an interpreter, interactive, object-oriented programming language, It incorporates modules, exceptions, dynamic typing, very high level dynamic data types, and classes. Python combines remarkable power with very clear syntax, It has interfaces too many system calls and libraries, as well as to various window systems, and is extensible in C or C**. It is also usable as an extension language for applications that need a programmable interface. Python is a high-level general-purpose programming language that can be applied to many different classes of problems. 5.2.3 C: For embedded programming of NodeMCU for Smart Switch using Arduino IDE. it is a non- object-oriented high-level programming language. Raspbian OS: Raspbian is a free Operating System based on Debian optimized for the raspberry pi hardware. Raspbian comes with more than 35000 packages; pre-combined software bundled in a nice format for easy installation on Raspberry pi. ) 16 © scanned with OKEN Scanner Chapter 3 METHODOLOGY 3.1 Detailed methodology that will be adopted This section represent which development cycle project used and how it is implemented, 3.1.1 Software development cycle. This project used iterative software development!) An iteration incorporates a loosely sequential set of activities in business modeling, requirements, analysis and design, implementation, test, and deployment, in various proportions depending on where in the development cycle the iteration is located. Iterations in the inception and elaboration phases focus on management, requirements, and design activities; iterations in the construction phase focus on design, implementation, and test; and iterations in the transition phase focus on test and deployment. Peqursmsnn Flening Inplemernace trai Floveeng Dephe,mera Testing Fig 3.1 Software Development Cycle Project benefits using Iterative implementation An iterative approach is generally superior to a linear or waterfall approach for many different reasons. * Risks are mitigated carlier, because clements ar integrated progressively * Changing requirements and tactics are accommodated. {Improving and refining the product is facilitated, resulting in a more robust product. * Organizations can learn from this approach and improve their process + Reusability is increased. 7 \E f a s] © scanned with OKEN Scanner 3.2 Overall Project Timeline IP-based Surveillance Phase 1 Cam Surveillance Cam Development ‘Smart Switeh Development T]2) 3] 4] 5] 6] 7] 8] 9] 10] 14] 12) 13] 14] 15] 16] 17] 18) 19] 20] 21] 22/23 [24 Timeline (Weeks) Table 3.1 Overall Timeline Phase -1 - Development of IP-based Surveillance Cam. This development was choose at first because it required low amount of time for research to analysis and select perfect hardware which is highly efficient and robust in design as it was used as plug and play. Total three Iterative cycles were required to refine the device in to perfect ‘working condition, Camera & Hardware Research Interaction Device Control Video Processing Algorithm & Backup App Development Live Streaming Timeline (weeks) [1 2 3 4 5 ¢ 17 Table 3.2 IP-based Surveillance Cam Timeline © scanned with OKEN Scanner Phase -2 - Development of Smart-Switch. This development was choose at second because it required high amount of time to develop due to two different platform. Total six Iterative cycles were required to refine the device in to perfect working condition. Hardware selection and compatibility Embedded Programing Cloud setup ‘and data ‘management Android App Development Communication Between Device, ‘App and Cloud Add data monitoring on App Timeline (Weeks) ‘Table 3.3 Smart-Switch Timeline 19 © scanned with OKEN Scanner 4.1 Modules Chapter 4 IMPLEMENTATION Project is divided into two development modules :- 1) Smart Switch development 1 wee Hardware circuit development Different possible test ease Embedad sudo program. Web sevice format and data storage format. Mobile application flow and development. 2) IP-based Surveillance Camera development. we . Hardware circuit development Different test parameters. Embedad sudo program. Web sevice format and data storage format. Mobile application flow and development 20 © scanned with OKEN Scanner 4.1 Smart Switch development 1) Hardware Circuit development ‘Switch Board Fig 4.1 - Switch circuit diagram Except bulb connect, all device and circuit with be packed in switch board, Circuit diagram represent accurate layout of connection inside switch board. Where individual switch are connected with NodeMCU board and operate at § volt and electromagnetic trigger relay is also control by NodeMCU board. When switch is on board trigger relay to complete 240 volt circuit of bulb, result to light in bulb. So in Smart-Switch, NodeMCU board take decision when to turn on light, when switch is pressed manually or receive request from mobile app through Wi-Fi network over internet. 2 © scanned with OKEN Scanner 2) Different possible case studies. Initial case - Smart-switch is connected to web server using local Wi-Fi network over internet. And mobile application can be connected to switch and set server through local Wi-Fi network or over GSM internet connect as shown in Fig 4.2. Fig 4.2 Initial Stage Ist Case - when switch is turn on manually. Switch send request to server and update the status, web server also update status of mobile app by sending back request to mobile application. same process also repeat for turn off request. tent Fig 4.3 First ease of Smart switch 22 © scanned with OKEN Scanner 2nd Case - when switch is tum on from mobile app when switch is in same Wi-Fi network. Mobile app send direet request to smart switch and update status, same request is also sent to server. Smart Switeh paste Fig 44 Second case Smart Switeh, 3rd Case - when switch is turn on from mobile app when connect over internet. Mobile app sent request to web server and Switch get update from web server. /~ ———_—> Internet Mobite App J 2B © scanned with OKEN Scanner Fig 4.5 Forth ease Smart Switch 4th Case - When Switch is turn on from mobile app when to intemet services off-line and mobile is connected to same network Fig 4.6 Forth case Smart-Switch Last Case - When smart switch is off line. Even then switch can be turn on and off manually. 24 © scanned with OKEN Scanner 3) Embedad sudo program. void start) get wifi credentials () get web server credentials () connect to wifi) {foro connect) Start wifi AP mode to get connected) } get switch status() Start loop) void loop() ¢ iffconnected ){ check web server status() check mobile app status() check manual switch status() } update relay status() check status of switch delay() continue loop0 A general flow of code is mention above. Origenal code contain different checks and data storage which are not mention in sudo code. 25 © scanned with OKEN Scanner 4) Web sevice format and data storage format. itch and mobile app to web server. GET and POST request and response from Check request from mobile app to web server Request URL: hutps:/ismart-fox.info?key=wasdhikhasddéeswitchid=14920 Request Method: GET Status Code: 200 Remote Address: 128.30.52.100:443 Referrer Policy: origin Responce = 14920:true Update request from mobile app to web server Request URL: htips:lismart-fox:infor Request Method: POST Status Code: 200 Remote Address: 128.30.52.100:443 Referrer Policy: origin Date: key=wasdhlkhasdd & id= 14920 & stutus=true Update request from mobile app to smart switch. Request URL: htips://192,168.43.121:5000 // local ip of smart switch Request Method: POST Status Code: 200 Remote Address: 128.30,52.100:443 Referrer Policy: origin Date: key=wasdhlkhasdd & id=14920 & stutus=true 26 © scanned with OKEN Scanner Update request from switel to web server Request URL: hp sismart-fox.info Request Method: POST Status Code: 200 Remote Address: 128.30,52.100:443 Referrer Poliey: origin Date: key=wasdhtbhasd & id= 14920 & stu check request from switeh to web server forall switch Request URL: Intps:/Ismartfoxinfo Request Method: POST Status Code: 200 Remote Address: 128.30.52.100:443 Referrer Policy: origin ate: key=wasdhlkhasdd & deviceid = 4400006 Responee = Ivtrue, 2false, 3:true, 4: false sue & deviceid = A400006 D © scanned with OKEN Scanner Start Screen - Inital load all the data from room SQLite database from mobile and check varify login credentials and syne data with web server. Login Screen - Check login credentials and redirect to Wi-Fi configuration screen. Signup Screen - Submit new user login detail with email opt varification. Wifi Sereen - Save Wi-Fi creadentials localy, which help to device cofiguration to connect device to local Wi network. Home Screen - where user can control all configure switch. When connected to network. Device Config. - Configure new switch device to app and connect switch to local Wi-Fi network, when switch is in Wi-Fi AP mode. Switch Config. - When new switch device is configure to app it automatically add all device switch to app and configure at default mode. Which can edit my user as per need. Switch Power usage - Shows to detail utilization of power for each switch and device in Kilo-watts hours over a time of year. 29 © scanned with OKEN Scanner 4.2 Prototype 1) Smart Switch 34 © scanned with OKEN Scanner RTSP — Real-Time Streaming Protocol is like HTTP but it is built specifically for setting up, configuring, and tearing down streaming media sessions, such as a video chat session or a movie being streamed to a computer from streaming media server. RTSP is not involved with the actual video streaming, but just managing the streaming session. It has a set of directives like DESCRIBE, which asks the streaming media source to list the available media types and their capabilities, and SETUP, which is how the client app tells, the server which media type it wants to consume and gets a session ID back in the response. RTP — Real-time Transport Protocol is the low-level protocol used to break a video into packets that can be streamed between computers. Those packets of video data are often put into UDP datagrams. To get a feel for the kind of processing involved with RTP video streams, check out this high-level overview of the process on StackOverflow. H.264 and MJPEG — These are commonly used compression techniques for audio/video files. Most normal humans do not ever need to know or care about how such things work or can be decoded, since companies like Apple build support for them into their products. iOS uses hardware acceleration to decode H.264 video (by processing it on the GPU instead of the CPU). I’m not sure if they hardware accelerate MPEG4 but I assume they do. For a taste of what’s involved with decoding H.264 formatted for RTP, check out RFC 6184, The main advantage of MPEG is high quality video at fairly low data rates , In properly equipped pcs , this is an excellent solution , We can size/position the video anywhere on the screen in both AVI and MPEG format . For this project selecting MIPEG will be advenatages protocal to live stream and store video. 33 © scanned with OKEN Scanner 4) Web sevice format and data storage format, Video data flow processing ail ‘T | Sensor memory | Host Interface | Controler| |} Processor Lens Sensor Module | maze | Video Process | Module | ot Fig 4.11 block processes on video Selection of right stroage formate 4! UDP — User Datagram Protocol is a transport protocol that can deliver “datagrams” (data with some networking metadata attached to it) from one computer to another. The data in a datagram might be just a small chunk of the full data object being transferred between two computers, so cach datagram has a sequence number that aids in properly reconstructing the original data object. Unlike TCP, the UDP does not require a connection to be established and kept alive between two computers. One computer informs another ‘computer of its IP address and the port on which it is expecting to receive datagrams, and as long as a socket is listening on that port the datagrams can keep flowing in, Another difference between UDP and TCP is that the former does not make any guarantees that datagrams will arrive in the correct order (or arrive at all). It is the application developer's job to deal with reassembling the data and accommodating any missing datagrams. UDP is commonly used for applications that do not benefit from the strong delivery guarantees of TCP, such as video streaming where dropping an occasional video frame or two is not a noticeable problem. 32 © scanned with OKEN Scanner 5) Mobile application flow and development. Sign Up Login Device Config switch Config Fig 4.8 Flow chart of mobile application 28 © scanned with OKEN Scanner 4.2.1 IP-based Surveillance Camera development. 1) Hardware cireuit development Powered Fig 4.9 Camara Setup — Home Poneasicen loud / Fig 4.10 Surveillance flow diageam, 30 © scanned with OKEN Scanner 2) Different test case parameters. «Image processing - Motion Detection, video quality enhacement. © Video storage mangement in-build memory storage. © Live streaming video on mobile app. * Cloud communication. 3) Sudo program. import opence library void start() initial image capturing) connect to wifi() start loop) void loop() ifovifi connected) connect to cloud() start live steaming web serviceQ) iffmotion detected()) store image frame() 31 © scanned with OKEN Scanner Sees ecercm estes bol il Se ane Reve vse LN st rien Bani neil ee ch Fe Ngee ante te ts Aaa a amet Ange Seems ak yet aie mid nents me A amine Wepre Meta nee re i igi name) pa Oe ee ema Mier ane te tonne ET emit Hemme Nea eevee rae mamiesd oh mangas sant Wine

You might also like