Abstract
In order to improve the comprehensive performance of the traffic sign system, this paper proposes a lightweight and efficient network model for the existing traffic sign recognition system, which is characterized by the complex structure of the convolutional neural network, the number of parameters and the computational volume is too large, and the model is not lightweight enough. The model chooses the lighter MobileNetV1 as its backbone network, and redefines the output layer of MobileNetV1 to effectively reduce the overall number of parameters of the network, so as to achieve the purpose of simplifying the network structure. The experimental results show that the proposed model can reduce the number of parameters by 25.5%, 37.9% and 53.8%, compared with YOLOv5n, YOLOv8n and YOLOv3 respectively, and the model complexity/computation (GFLOPs) and image processing speed (FPS) show outstanding advantages compared with several models, under the premise that the detection accuracy of the proposed model is considerable. show outstanding advantages. Finally, by building an unmanned vehicle testbed configured with STM32F103 CPU and OV2640 camera, the model pre-training weights are deployed on the hardware testbed for real testing, and the results show that the proposed lightweight network model meets the requirements of traffic sign recognition accuracy and improves the model's operation efficiency on the computationally resource-constrained devices.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Zhang, Z., Zhou, F., Karimi, H., Fujita, H., Hu, X., Wen, C., Wang, T.: Attention gate guided multiscale recursive fusion strategy for deep neural network-based fault diagnosis. Eng. Appl. Artif. Intell. 126, 10705 (2023)
Yang, D., Karimi, H., Pawełczyk, M.: A new intelligent fault diagnosis framework for rotating machinery based on deep transfer reinforcement learning. Contr. Eng. Pract. 134, 105475 (2023)
Tumuluru, P., Burra, L.R., Sunanda, N., Hussain, S.S., Madhu, D., Varma, H.V.: SMS: SIGNS MAY SAVE–Traffic Sign Recognition and Detection using CNN. In: Proceedings of the 2022 6th International Conference on Electronics, Communication and Aerospace Technology. pp. 1272–1277 (2022)
Bhatt, N., Laldas, P., Lobo, V. B.: A Real-Time Traffic Sign Detection and Recognition System on Hybrid Dataset using CNN. In: Proceedings of the 2022 7th International Conference on Communication and Electronics Systems (ICCES). pp. 1354–1358 (2022)
Zheng, Q., Zhao, P., Zhang, D.: MR-DCAE: Manifold regularization-based deep convolutional autoencoder for unauthorized broadcasting identification. Int. J. Intell. Syst. 36(12), 7204–7238 (2021)
Zheng, Q., Zhao, P., Wang, H.: Fine-grained modulation classification using multi-scale radio transformer with dual-channel representation. IEEE Commun. Lett. 26(6), 1298–1302 (2022)
Zheng, Q., Zhao, P., Li, Y.: Spectrum interference-based two-level data augmentation method in deep learning for automatic modulation classification. Neural Comput. Appl. 33(13), 7723–7745 (2021)
Zheng, Q., Tian, X., Yu, Z.: Application of wavelet-packet transform driven deep learning method in PM2. 5 concentration prediction: A case study of Qingdao China. Sustain. Cities Soc. 92, 104486 (2023)
Prakash, A. S., Vigneshwaran, D., Ayyalu, R. S., et al.: Traffic Sign Recognition using Deep Learning for Autonomous Driverless Vehicles. In: Proceedings of the 2021 5th International Conference on Computing Methodologies and Communication (ICCMC). pp. 1569–1572 (2021)
Oza, R. M., Geisen, A., Wang, T.: Traffic Sign Detection and Recognition using Deep Learning. In: Proceedings of the 2021 4th International Conference on Artificial Intelligence for Industries (AI4I). pp. 16–20 (2021)
Peng, T., Wen, F.: Photovoltaic Panel Fault Detection Based on Improved Mask R-CNN. In: Proceedings of the 2023 IEEE International Conference on Control, Electronics and Computer Technology (ICCECT). pp. 1187–1191 (2023)
Mathew, A. B., Kurian, S.: Identification of Malicious Code Variants using SPP-net Model and Color Images. In: Proceedings of the 2020 IEEE 15th International Conference on Industrial and Information Systems (ICIIS). pp. 581–585 (2020)
Cao, M., Cheng, F., Wei, Y.: Vehicle Object Detection Algorithm with SSD Fused RFP Structure. In: Proceedings of the 2022 China Automation Congress (CAC). pp. 1485–1490 (2022)
Redmon, J., Divvala, S., Girshick, R., Farhadi, A.: You Only Look Once: Unified, Real-Time Object Detection. In: Proceedings of 2016 the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). pp. 779–788 (2016)
Redmon, J., Farhadi, A.: YOLO9000: Better, Faster, Stronger. In: Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). pp. 7263–7271 (2017)
Yu, Y., Yan, S., Hao, X.: Pedestrian Detection Based on Improved YOLOv3 Network. In: Proceedings of the 2023 IEEE International Conference on Control, Electronics and Computer Technology (ICCECT). pp. 297–301 (2023)
Lan, H., Zhu, H., Luo, R., et al.: PCB Defect Detection Algorithm of Improved YOLOv8. In: Proceedings of the 2023 8th International Conference on Image, Vision and Computing (ICIVC). pp. 178–183 (2023)
Malik, R., Khurshid, J., Ahmad, S. N.: Road Sign Detection and Recognition Using Colour Segmentation, Shape Analysis and Template Matching. In: Proceedings of the 2007 International Conference on Machine Learning and Cybernetics. pp. 3556–3560 (2007)
da Silva Soares, J. C., Borchartt, T. B., de Paiva, A. C., et al.: Methodology Based on Texture, Color and Shape Features for Traffic Light Detection and Recognition. In: Proceedings of the 2018 International Joint Conference on Neural Networks (IJCNN). pp. 1–7 (2018)
Redmon, J., Divvala, S., Girshick, R., Farhadi, A.: You Only Look Once: Unified, Real-Time Object Detection. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR). pp. 779–788 (2016)
Yan, F., Xu, Y.: Improved Target Detection Algorithm Based on YOLO. In: Proceedings of the 2021 4th International Conference on Robotics, Control and Automation Engineering (RCAE). pp. 21–25 (2021)
Chen, Z., Liu, G., Fan, S.: Research on Target Detection Algorithm Based on Improved YOLO. In: Proceedings of the 2022 International Conference on Image Processing, Computer Vision and Machine Learning (ICICML). pp. 485–489 (2022)
Handoko, A. B., Putra, V. C., Setyawan, I., et al.: Evaluation of YOLO-X and MobileNetV2 as Face Mask Detection Algorithms. In: Proceedings of the 2022 IEEE Industrial Electronics and Applications Conference (IEACon). pp. 105–110 (2022)
Raj, G. P., Bhavani, N. P. G.: Hand Posture Recognition on Photographic Images Using YOLO Algorithm in Comparison with Convolution Neural Network to Improve Accuracy. In: Proceedings of the 2023 International Conference on Artificial Intelligence and Knowledge Discovery in Concurrent Engineering (ICECONF). pp. 1–5 (2023)
Shyan, L. J., Lim, T. H., Muhammad, D. N. P. H.: Real-Time Road Traffic Sign Detection and Recognition Systems Using Convolution Neural Network on a GPU Platform. In: Proceedings of the 2022 International Conference on Digital Transformation and Intelligence (ICDI). pp. 236–240 (2022)
Joy, S., Reddy, U. A., Lal, R. C., et al.: Traffic Rule Violation Recognition for Two Wheeler Using YOLO Algorithm. In: Proceedings of the 2023 Second International Conference on Electronics and Renewable Systems (ICEARS). pp. 1477–1480 (2023)
Liu, S., Zhang, D.: Design and Implementation of Intelligent Medicine Delivery Car Based on K210. In: Proceedings of the 2022 2nd International Conference on Electrical Engineering and Mechatronics Technology (ICEEMT). pp. 164–171 (2022)
Jia, P., Zhou, Z., Wang, Q.: Dangerous Items Recognition and Face Recognition System Based on K210 and YOLO. In: Proceedings of the 2022 2nd International Conference on Networking, Communications and Information Technology (NetCIT). pp. 131–133 (2022)
Zhou, Q., Hu, J., Xu, Y.: Intelligent Drug Delivery Car System Using STM32. In: Proceedings of the 2022 11th International Conference of Information and Communication Technology (ICTech). pp. 547–553 (2022)
Yang, Y., Liao, Y., Ni, S., et al.: Study of Algorithm for Aerial Target Detection Based on Lightweight Neural Network. In: Proceedings of the 2021 IEEE International Conference on Consumer Electronics and Computer Engineering (ICCECE). pp. 422–426 (2021)
Bohong, L., Xinpeng, W.: Garbage Detection Algorithm Based on YOLO v3. In: Proceedings of the 2022 IEEE International Conference on Electrical Engineering, Big Data and Algorithms (EEBDA). pp. 784–788 (2022)
Howard, A., Sandler, M., Chu, G., et al.: Searching for MobileNetV3. In: Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision (ICCV). pp. 1314–1324 (2019)
Zhang, X., Zhou, X., Lin, M., et al.: ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices. In: Proceedings of the IEEE 2018 Conference on Computer Vision and Pattern Recognition (CVPR). pp. 6848–6856 (2018)
Han, K., Wang, Y., Tian, Q., et al.: GhostNet: More Features from Cheap Operations. In: Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). pp. 1580–1589 (2020)
Sridhar, P., Jagadeeswari, M., Sri, S. H., et al.: Helmet Violation Detection Using YOLO v2 Deep Learning Framework. In: Proceedings of the 2022 6th International Conference on Trends in Electronics and Informatics (ICOEI). pp. 1207–1212 (2022)
Dai, L., Tang, C., Yang, G., et al.: A Fault Detection Method and System for Highway Tunnel Dome Light Based on Improved YOLO with Localization Loss Function. In: Proceedings of the 2022 4th International Conference on Industrial Artificial Intelligence (IAI). pp. 1–6 (2022)
Zhang, D., Xu, Z., Wang, L., et al.: Digital Logic Experiment Design Based on FPGA Development Board and OV2640 Camera. In: Proceedings of the 2019 14th International Conference on Computer Science & Education (ICCSE). pp. 671–675 (2019)
Liu, Z., Xiao, Q.: Helmet Wearing Detection System for Non-Motor Vehicle Riders Based on K210 and YOLOv3. In: Proceedings of the 2022 2nd International Symposium on Artificial Intelligence and its Application on Media (ISAIAM). pp. 29–32 (2022)
Acknowledgements
The authors would like to express their gratitude to all their colleagues.
Funding
The work is supported by Foundation of Guangxi key laboratory of Automobile Components and Vehicle Technology (No.2022GKLACVTKF04, 2023GKLACVTZZ06), Foundation of Key Laboratory of AI and Information Processing (Hechi University) of Education Department of Guangxi (No. 2022GXZDSY002).
Author information
Authors and Affiliations
Corresponding authors
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License, which permits any non-commercial use, sharing, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if you modified the licensed material. You do not have permission under this licence to share adapted material derived from this article or parts of it. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by-nc-nd/4.0/.
About this article
Cite this article
Zhang, G., Li, Z., Huang, D. et al. A Traffic Sign Recognition System Based on Lightweight Network Learning. J Intell Robot Syst 110, 139 (2024). https://doi.org/10.1007/s10846-024-02173-5
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10846-024-02173-5