International Journal of Computer Network and Information Security (IJCNIS)
IJCNIS Vol. 15, No. 4, 8 Aug. 2023
Cover page and Table of Contents: PDF (size: 833KB)
Reliable Data Delivery Using Fuzzy Reinforcement Learning in Wireless Sensor Networks
Full Text (PDF, 833KB), PP.96-107
Views: 0 Downloads: 0
Author(s)
Sateesh Gudla
1,2,*
Kuda Nageswara Rao
3
Index Terms
Wireless Sensor Networks, Q-learning, Reinforcement Learning Algorithm, Fuzzy Logic, Energy Efficiency, Reliable Paths, Network Lifetime
Abstract
Wireless sensor networks (WSNs) has been envisioned as a potential paradigm in sensing technologies. Achieving energy efficiency in a wireless sensor network is challenging since sensor nodes have confined energy. Due to the multi-hop communication, sensor nodes spend much energy re-transmitting dropped packets. Packet loss may be minimized by finding efficient routing paths. In this research, a routing using fuzzy logic and reinforcement learning procedure is designed for WSNs to determine energy-efficient paths; to achieve reliable data delivery. Using the node’s characteristics, the reward is determined via fuzzy logic. For this paper, we employ reinforcement learning to improve the rewards, computed by considering the quality of the link, available free buffer of node, and residual energy. Further, simulation efforts have been made to illustrate the proposed mechanism’s efficacy in energy consumption, delivery delay of the packets, number of transmissions and lifespan.
Cite This Paper
Sateesh Gudla, Kuda Nageswara Rao, "Reliable Data Delivery Using Fuzzy Reinforcement Learning in Wireless Sensor Networks", International Journal of Computer Network and Information Security(IJCNIS), Vol.15, No.4, pp.96-107, 2023. DOI:10.5815/ijcnis.2023.04.09
Reference
[1]I.F. Akyildiz, W. Su, Y. Sankarasubramaniam, E. Cayirci,Wireless sensor networks: a survey, Computer Networks, Volume 38, Issue 4, 2002, Pages 393-422. https://doi.org/10.1016/S1389-1286(01)00302-4.
[2]Ian F. Akyildiz, Ismail H. Kasimoglu, Wireless sensor and actor networks: research challenges, Ad Hoc Networks, Volume 2, Issue 4, 2004, Pages 351-367. https://doi.org/10.1016/j.adhoc.2004.04.003
[3]U.Hariharan, K. Rajkumar, T. Akilan, A. Ponmalar, A multi-hop protocol using advanced multi-hop Dijkstra’s algorithm and tree based remote vector for wireless sensor network, Journal of Ambient Intelligence and Humanized Computing, Volume 14,Issue 16,2023,Pages 6877–6895. DOI:10.1007/s12652-021-03548-4
[4]S. Gudla, N.R. Kuda, Learning automata-based energy efficient and reliable data delivery routing mechanism in wireless sensor networks, Journal of King Saud University- Computer and Information Sciences, Volume 34, Issue 8, September 2022, Pages 5759-5765. https://doi.org/10.1016/j.jksuci.2021.04.006
[5]P. Neamatollahi, M. Naghibzadeh, S. Abrishami, Fuzzy Based Clustering-Task Scheduling for Lifetime Enhancement in Wireless Sensor Networks, IEEE Sensors Journal , Volume: 17, Issue: 20, 15 October 2017, Pages: 6837 – 6844. DOI: 10.1109/JSEN.2017.2749250
[6]Q. Ni, Q. Pan, H. Du, C. Cao, Y. Zhai, A Novel Cluster Head Selection Algorithm Based on Fuzzy Clustering and Particle Swarm Optimization, IEEE/ACM Transactions on Computational Biology and Bioinformatics, Volume: 14, Issue: 1, 01 Jan.- Feb. 2017, Pages: 76 – 84, DOI: 10.1109/TCBB.2015.2446475
[7]Baranidharan Balakrishnan and Santhi Balachandran, FLECH: Fuzzy Logic Based Energy Efficient Clustering Hierarchy for Nonuniform Wireless Sensor Networks, Hindawi Wireless Communications and Mobile Computing, Volume. 2017, 13 pages, 2017. https://doi.org/10.1155/2017/1214720
[8]R. Yousaf, R. Ahmad, W. Ahmed, A. Haseeb, Fuzzy Power Allocation for Opportunistic Relay in Energy Harvesting Wireless SensorNetworks,IEEEAccess,Volume:5,29-August-2017,Pages 17165 –17176,DOI: 10.1109/ACCESS.2017.2743063
[9]Zhang Siqing,Tao Yang ,Yang Feiyue, Fuzzy Logic-Based Clustering Algorithm for Multi-hop Wireless Sensor Networks, Volume 131, 2018, Pages 1095-1103. https://doi.org/10.1016/j.procs.2018.04.270
[10]S.K. Mothku, R.R. Rout, Adaptive Fuzzy-Based Energy and Delay-Aware Routing Protocol for a Heterogeneous Sensor Network, Journal of Computer Networks and Communications, Volume 2019, Article ID 3237623, https://doi.org/10.1155/2019/3237623
[11]Neha Singh, Deepali Virmani, Xiao-Zhi Gao, A Fuzzy Logic-Based Method to Avert Intrusions in Wireless Sensor Networks Using WSN-DS Dataset, International Journal of Computational Intelligence and Applications ,Volume. 19,Issue 3,2020 DOI: 10.1142/S1469026820500182.
[12]V. Rajaram, N. Kumaratharan, Multi-hop optimized routing algorithm and load balanced fuzzy clustering in wireless sensor networks, Journal of Ambient Intelligence and Humanized Computing,Volume12, Pages 4281–4289, 2021. https://doi.org/10.1007/s12652-020-01827-0.
[13]Stephan, T., Sharma, K., Shankar, A., Fuzzy-Logic-Inspired Zone-Based Clustering Algorithm for Wireless Sensor Networks,International Journal of Fuzzy Systems , Volume 23, Pages 506–517, 2021. https://doi.org/10.1007/s40815-020-00929-3.
[14]S. Phoemphon, C. So-In, P. Aimtongkham, T.G. Nguyen,An energy-efficient fuzzy-based scheme for unequal multi-hop Clustering in wireless sensor networks, Journal of Ambient Intelligence and Humanized Computing, Volume 12,2021,Pages 873–895.https://doi.org/10.1007/s12652-020-02090-z
[15]Giri, A., Dutta, S. & Neogy, S., An Optimized Fuzzy Clustering Algorithm for Wireless Sensor Networks, Wireless Personal Communications, Volume 126, Pages 2731–2751, 27 June 2022. https://doi.org/10.1007/s11277-022-09839-z.
[16]D. Praveen Kumar, Tarachand Amgoth, Chandra Sekhara Rao Annavarapu, Machine learning algorithms for wireless Sensor networks:A survey,Information Fusion, Volume 49, September-2019, Pages1-25, https://doi.org/10.1016/j.inffus.2018.09.013
[17]Z. Mammeri, Reinforcement Learning Based Routing in Networks: Review and Classification of Approaches, IEEE Access , Volume: 7, 29 April 2019, Pages 55916 – 55950, DOI: 10.1109/ACCESS.2019.2913776
[18]Farzad Kiani, Reinforcement Learning based Routing Protocol for Wireless Body Sensor Networks, 7th International Symposium on Cloud and Service Computing., Pages 22-25, November 2017. DOI: 10.1109/SC2.2017.18
[19]W. Guo, C. Yan, T. Lu, Optimizing the lifetime of wireless sensor networks via reinforcement-learning-based routing, International Journal of Distributed Sensor Networks , Volume 15, Issue 2, February 26, 2019, https://doi.org/10.1177/1550147719833541
[20]D. Kim, T. Lee, S. Kim, B. Lee, H.Y. Youn, Adaptive packet scheduling in IoT environment based on Q-learning, Journal of Ambient Intelligence and Humanized Computing, Volume 11, June 2000, Pages 2225–2235. https://doi.org/10.1007/s12652-019-01351-w
[21]Q. Yang, S. Jang, S. Yoo, Q-Learning-Based Fuzzy Logic for Multi-objective Routing Algorithm in Flying Ad Hoc Networks, Wireless Personal Communications,Volume 113,July 2020, Pages115–138, https://doi.org/10.1007/s11277-020-07181-w.
[22]R.Maivizhi, P. Yogesh, Q-learning based routing for in-network aggregation in wireless sensor networks, Wireless Networks Volume 27, April 2021, Pages 2231–2250, https://doi.org/10.1007/s11276-021-02564-8
[23]W.K. Yun, S.J. Yoo, Q-Learning-Based Data-Aggregation-Aware Energy-Efficient Routing Protocol for Wireless Sensor Networks, IEEE Access , Volume: 9, 13 January 2021, Pages10737 – 10750, DOI: 10.1109/ACCESS.2021.3051360
[24]Tripti Sharma , Archana Balyan , Rajit Nair , Paras Jain , Shivam Arora , and Fardin Ahmadi, ReLeC: A Reinforcement Learning-Based Clustering-Enhanced Protocol for Efficient Energy Optimization in Wireless Sensor Networks, Hindawi Wireless Communications and Mobile Computing, Volume 2022, Article ID 3337831, 16 Pages, https://doi.org/10.1155/2022/3337831