Project - Report Phase 1
Project - Report Phase 1
STATE INFORMATION
Project Report
Submitted to The APJ Abdul Kalam Technological University
Submitted by
Amritha S S (TVE20AE014)
Guided by
KERALA
December 2023
Declaration
the APJ Abdul Kalam Technological University, Kerala is a bonafide work done
represents our ideas in our own words and where ideas or words of others
have been included, we have adequately and accurately cited and referenced the
honesty and integrity and have not misrepresented or fabricated any data or idea
will be a cause for disciplinary action by the institute and/or the University and
can also evoke penal action from the sources which have thus not been properly
cited or from whom proper permission has not been obtained. This report has
not been previously formed the basis for the award of any degree, diploma or
Vaishnav Sankar
2
DEPT. OF ELECTRONICS & COMMUNICATION
2020 - 24
CERTIFICATE
This is to certify that the report entitled Fall Detection using WiFi
out by them under our guidance and supervision. This report in any form has
not been submitted to any other University or Institute for any purpose.
External Examiner
Acknowledgement
First of all, we would like to express our deepest appreciation and gratitude to
guidance and support. We could not have completed this project if it wasn’t for
Amritha S S
Anhajul S Rahman
Vaishnav Sankar
4
Abstract
Falling is recognized as one of the most frequent accidents among elderly people.
The project aims to develop a non-contact fall detection system using Wi-Fi
particularly for elderly individuals. The use of Wi-Fi technology allows for non-
intrusive monitoring without the need for wearable devices or expensive camera-
microcontrollers, to collect and analyze CSI data for accurate human activity
and costly. By leveraging Wi-Fi CSI data and machine learning algorithms, the
system can accurately recognize different human activities, including falls, and
its potential for real-world application in fall detection and human activity
recognition
The project exploits the Phase and Amplitude of the Fine-grained Channel
State Information (CSI) accessible in commodity Wi-Fi devices, and fulfils the
goal of segmenting and detecting the falls automatically in real-time, which allows
users to perform daily activities naturally and continuously without wearing any
Abstract i
1 Introduction 1
1.1 Background . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1
1.2 Motivation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2
1.3 Objective . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
2 Literature Review 4
3 Related Works 7
3.1 RT FALL . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
Information . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
3.3 WiFall . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
3.4 FallDeFi . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10
4 Theoretical Overview 12
4.2 Wi-Fi . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16
i
4.4 Machine Learning . . . . . . . . . . . . . . . . . . . . . . . . . . 21
5 Methodology 22
7 Conclusions 28
ii
List of Figures
iii
Chapter 1
Introduction
1.1 Background
The share of people over 65 years among the world population is on a steady
rise due to increases in human life expectancy. The size of the population of this
age group will be close to a quarter of the 20-64 age group by the year 2040.
Each year, about one third of people from this age group are vulnerable to falls
and about one out of five people who suffer falls are exposed to head injuries,
broken bones in wrists, arms, ankles and hip fractures. Many of those who are
not injured, are unable to get up on their own after a fall. This can result in
physical activities, low social contacts, depression resulting in low quality of life
and even death. Falls are the leading cause of both fatal and nonfatal injuries for
the elderly. Therefore, a system that can automatically detect a fall and inform
caregivers or relatives within a short time can be an important health care tool.
A reliable fall detection system is helpful to the elderly community in two ways:
it reduces the time those who have fallen remain lying on the floor and reduces
the fear of falling. The development of fall detection systems is essential for this
reason. Although many fall detection systems exist today, most of them are based
1
on wearable devices or computer vision, which have some critical drawbacks,
caused by the fundamental nature of the systems. This project is aimed to provide
a non-contact fall detection system that is free of those drawbacks and is yet as
1.2 Motivation
Sensor-based activity detection requires the user to wear a device containing the
sensors in many cases. Some methods use computer vision for the task, which
requires a camera to collect video or image data. Although these methods can
detect a fall incident quite accurately, some issues caused by these methods can
to use them.
• A wearable device is more prone to wear and tear than a stationary device.
expensive.
Comfort is of utmost importance for the elderly and the sick. A user might be
it is challenging, if not impossible when the users are not willing to cooperate.
2
create a non-contact fall detection system using wifi channel state information
1.3 Objective
We aim to build a non-contact fall detection system for monitoring the elderly
embedded devices.
review for the project is discussed. Chapter 3 gives an idea about the proposed
system used. Chapter 4 deals with the methodology of the system. Chapter 5
explain the system design. Results and discussions are conducted in chapter 6.
3
Chapter 2
Literature Review
prevention.
91343, USA
Falls in older people are a common problem that can lead to morbidity, mortality,
and nursing home admissions. Many falls are associated with identifiable risk
factors, and addressing these factors can reduce falling rates. Effective fall
is important for assessing and addressing fall risks. Unintentional falls are
a leading cause of death in older adults. Falls are a common and often
morbidity, mortality and use of health care services including premature nursing
home admission.
4
This article is a survey that provides a comprehensive review of WiFi sensing
WiFi sensing with CSI. The survey categorizes WiFi sensing applications into
detection, recognition, and estimation, and highlights three challenges for WiFi
with networking. It also presents three future trends for WiFi sensing, including
of different sensors.
Based Approaches
Dan Wu, Daqing Zhang, Chenren Xu, Hao Wang, and Xiang Li
interest for its potential as a ubiquitous sensing solution. This article categorizes
Fresnel zone model is considered a promising model for device-free human sensing
using fine-grained WiFi CSI. Some potential applications of device-free WiFi CSI-
gait identification, fall detection, tracking, activity recognition, and vital signs
monitoring.
Recent progress in Device-Free Wi-Fi Sensing (DFWS) has established the use
of wireless signals like Wi-Fi not only to communicate but also as a tool to
5
enable device-free sensing. As an emerging technique, DFWS has many capable
applications such as sensing activity and gesture and fall detection, monitoring
elderly, surveillance, and many more applications while waiving out the necessity
to mount devices on the object. A wide range of applications can use the channel
state information (CSI) from commercial Wi-Fi devices pervasively for ubiquitous
sensing. Existing CSI tools, such as the Intel 5300 network interface controller
tool or the Atheros 9390 tool, have limitations when deployed in large-scale
systems due to their high deployment costs and limitations in the resolution
ESP32-based Wi-ESP as a CSI gathering tool that can report detailed CSI
for DFWS applications. Wi-ESP can work as standalone device, unlike other CSI
tools, and can offer large-scale deployment to many DFWS applications. In this
paper, we have explored the options of Wi-ESP as a tool for CSI measurements
6
Chapter 3
Related Works
3.1 RT FALL
RT-Fall is its real-time detection capability. The system can detect falls within
assistance to the fallen person. RT-Fall exploits the phase and amplitude of
devices, and for the first time fulfils the goal of segmenting and detecting the falls
and continuously without wearing any devices on the body. Moreover, RT-
Fall can distinguish between falls and other activities, such as sitting, standing,
walking, and lying down, which reduces false alarms and improves the accuracy
of the system.
as interference, multipath, and mobility. The system can adapt to changes in the
WiFi signal caused by moving objects, changing furniture, or other factors that
may affect the CSI. This makes RT-Fall more reliable and resilient than other fall
Finally, RT-Fall has the potential to be integrated with other smart home
7
technologies, such as voice assistants, smart lighting, and security systems.
By combining fall detection with other services, RT-Fall can provide a more
risk of falling. For example, the system can automatically turn on the lights
or call for help when a fall is detected, or provide reminders for medication or
appointments.
The Deep Learning-Based Fall Detection Using WiFi Channel State Information
(CSI) involves three-step operations to detect falls: CSI data pre-processing, CSI
memory (LSTM).
The first step is CSI data pre-processing, which involves down-sampling and
reshaping the raw CSI data to reduce the dimensionality of the data and make
it suitable for feature extraction. The down-sampling reduces the number of CSI
samples per second, while the reshaping converts the 1D CSI data into a 2D
matrix format that can be used as an input to the deep learning-based classifiers.
The second step is CSI feature extraction, which involves extracting relevant
features from the pre-processed CSI data. The study uses three types of features:
(PSD) of the CSI amplitude and phase. The time-frequency domain features
The third step is event classification, which involves using deep learning-
based classifiers to classify the extracted features into fall or non-fall events. The
8
study uses three types of classifiers: support-vector machine (SVM), convolutional
neural network (CNN), and long short-term memory (LSTM). The SVM classifier
uses a linear kernel to separate the feature space into two classes: fall and non-fall.
The CNN classifier uses a deep neural network with convolutional and pooling
layers to learn the spatial and temporal features of the CSI data. The LSTM
classifier uses a recurrent neural network with long short-term memory cells to
comprehensive dataset consisting of over 700 CSI samples including different types
of falls and other daily activities, performed in four different indoor environments
on and off the dominant paths. The study shows that the proposed system
achieves high accuracy in detecting falls and outperforms existing fall detection
systems. The study also discusses the impact of the size and sample variety of
makes the dataset available in the public domain for further research.
3.3 WiFall
The system works by analyzing the variations in the radio signals caused by
human activities. The researchers first analyze the radio propagation model
fall detection system. WiFall uses the physical layer CSI as an indicator of
activities. It captures the CSI information from the wireless signals and applies
machine learning algorithms to classify different activities and detect falls. The
for motion detection. It then uses a one-class Support Vector Machine (SVM)
9
classifier and Random Forest algorithm to classify different human activities and
that WiFall can achieve high accuracy in fall detection for a single person. It
yields 90% detection precision with a false alarm rate of 15% on average using the
one-class SVM classifier, and 94% detection precision with a 13% false alarm rate
and effectiveness of using wireless networks for fall detection. It offers a low-cost
3.4 FallDeFi
The Feature Extraction module extracts relevant features from the spectrogram
to distinguish falls from other activities. It includes a CSI noise filtering technique
is used to extract features that can classify a wide range of falls, such as trips,
The Fall Classification module uses a trained Support Vector Machine (SVM)
classifier to classify the extracted features and determine whether an event is a fall
While FallDeFi improves on the current state of the art in fall detection, it
factors such as the density of WiFi access points and the coverage of WiFi signals
access points, mitigating false positives and false negatives, and exploring the
10
fusion of data from other fall detection technologies.
tection system that utilizes WiFi signals to monitor and classify falls in indoor
environments.
11
Chapter 4
Theoretical Overview
• Processors
• Wireless connectivity:
– Bluetooth: v4.2 BR/EDR and BLE (shares the radio with Wi-Fi)
• Peripheral interfaces:
12
– 34 × programmable GPIOs
– 2 × 8-bit DACs
– 4 × SPI
– 2 × I²S interfaces
– 2 × I²C interfaces
– Ethernet MAC interface with dedicated DMA and planned IEEE 1588
channels)
– Motor PWM
Infrastructure (WAPI)
– Flash encryption
management:
13
– Internal low-dropout regulator
• Bandwidth: 20 MHz
• Antenna: 1 RX and 1 TX
• Protocol: 802.11n
14
• Modulation: OFDM (16 QAM)
• Subcarrier Number: 64
application CPU
• Through its SPI / SDIO or I2C / UART interfaces, the esp32 may
modules.
15
4.2 Wi-Fi
fall detection. Wi-Fi, vastly used in high-speed internet access and wireless
IEEE 802.11 is part of the local area network (LAN) technical standards and
specifies the set of protocols for implementing wireless local area network (WLAN)
Electrical and Electronics Engineers (IEEE). Though the first edition of these
standards was released in 1997, continuous development is being made and new
standards are coming with more capabilities to meet the ever-increasing demand
802.11a
This was the first standard to use the 5 GHz band for Wi-Fi which might seem
to be ahead of its time. But because of the higher frequency, its coverage areawas
much lower than the traditional 2.4 GHz band and suffered much from interference
problem. That is why 802.11a was not so popular compared to its 2.4 GHz
counterpart even though it had a higher data rate and went obsolete quickly.
But the main contribution of this standard was the introduction of Orthogonal
interference that makes it possible to cope with severe channel conditions without
802.11a uses 52 subcarriers in OFDM, of which 48 subcarriers are used for data
802.11b
802.11b was the first widely accepted standard of Wi-Fi. Both 802.11a and
16
802.11b were released in 1999, with a major difference between them. Unlike
802.11a, 802.11b uses 2.4 GHz band. The 2.4 GHz band was not as crowded as
today and offered higher coverage and the capability to withstand interference.
These advantages made 802.11b popular despite having a much lower data rate
(up to 5.5 Mbit/s). This standard is still in use in some legacy devices.
802.11g
operated in the 2.4 GHz band like 802.11b and utilizes the same OFDM-based
in the data rate which could go up to 54 Mbit/s. 802.11g also uses a total of
802.11n
This standard is also known as Wi-Fi Generation 4 (Wi-Fi 4). It includes several
new technologies that increased the capability of Wi-Fi further. The most notable
• Frame aggregation
• Security enhancement
over multiple antennas. Frame aggregation allows sending two or more frames in
Wi-Fi beams in the user’s direction. Thus these new features along with OFDM
increased the data rate from 72 Mbit/s to 600 Mvit/s. 802.11n has support for the
17
2.4 GHz band and optionally for the 5 GHz band. Most Wi-Fi-enabled devices
Newer standards After 802.11n, a few major standards have come out that have
increased the data rate, reliability, and security further. 802.11ac (Wi-Fi 5) is
currently spreading in the consumer community which uses only the 5 GHz band.
80 MHz and 160 MHz channels, and Beamforming. 802.11ax (Wi-Fi 6E) is the
most recently approved standard adopted in 202 which uses three bands: 2.4
GHz, 5 GHz, and 6 GHz. The data rate can vary from 600 Mbit/s to 9608
Mbit/s. Currently, the development is being made for 802.11be standard or Wi-
Fi 7 which will provide even more data rate.The hardware used in our proposed
method, esp32 uses the popular IEEE 802.11n standard. It currently has the
largest user base and can utilize several recent technologies including OFDM,
OFDM
broadcasting, DSL internet access, wireless networks, power line networks, and
transmitters send the same signal at the same frequency at the same time, because
18
avoiding the interference that a traditional single-carrier system would face.
MIMO
that uses multiple transmitters and receivers to carry more data at once. MIMO
to achieve faster rates than goods that do not have 802.11n. MIMO must
implemented. Both the station and the access point must support MIMO for
off walls, ceilings, and other obstacles, arriving at the receiving antenna numerous
times at slightly varying angles and times. Multipath created interference and
streams arriving from diverse paths and at different times, MIMO boosts the
technology, which makes use of unused antennas. When the number of antennas
19
outnumbers the number of spatial streams, the antennas can boost receiver variety
and range.
CSI
IEEE 802.11 a/g/n/ac/ax networks, data transmission and reception is done us-
power loss. As the subcarriers follow different spatial paths, these obstructions
affect each subcarrier differently. Thus, this physical layer information specific to
depiction of the channel state that includes scattering, fading, and multipath
provided by RSSI, CSI statistics provide more information about the channel
degradation effects that the signal suffers due to its granularity of sub-carrier
frequencies and vector representation. Data is sent using MIMO and OFDM
20
systems. In narrow-band flat fading channel.
discovered and developed. The earliest machine learning techniques date back to
the 1950s, however there have been very few notable studies and advancements
in this field. However, this field of study underwent a resurgence in the 1990s and
has continued to this day. Future advancements in this field of study are expected.
learning is the idea that, with the help of this growing data, the best model for the
new data may be found among the old data. As a result, research into machine
learning will continue along with the growth in data. The actions performed
based on the current sample data, which is different from commands that are
computers may err in their decision-making just like people do. Putting it another
way, machine learning is the process of giving computers the capacity to learn
from data and experience just like a human brain. The primary goal of machine
learning is to develop models that can learn from previous data to become better,
21
Chapter 5
Methodology
first, we will describe the hardware setup used for collecting user data. Later, we
discuss how we intend to process the raw data to make them usable.
The main hardware we used for this system is a pair of ESP32 MCU manufactured
by espressif. This is an ESP32 based module with Wi-Fi 802.11 b/g/n and
22
Wi-Fi-based human activity recognition uses Intel 5300 or Atheros 9390 Network
Interface Card (NIC) of a laptop computer [7, 9, 12, 33, 34] which is not a realistic
choice for practical use because each node is a computer. The device we used is
For our experiment, we need to send CSI data from one ESP32 device to
another. But ESP32 does not transmit CSI data with the initially provided
Toolkit” is flashed to the devices to enable the transmission of CSI data. CSI
data is received using the broadcast method. In this method, one ESP32 device
acts as a transmitting device and all other devices are receiving device. The
transmitting ESP32 A sends CSI data using broadcasting. This method has the
highest detection accuracy and reliability and does not require any router device.
Each ESP32 module has one built-in PCB antenna that can transmit or receive
data. We used two ESP32 modules. Because of the movement of the subject,
the transmitting packets face multipath fading, scattering, reflection, and power
23
loss. The Channel State Information (CSI) of each packet can be analysed to find
patterns between the transmitting packets using machine learning algorithms and
The data we collected includes the raw signal information and packets. We
need to extract the CSI data from the raw signal and isolate the phase and
The accuracy and effectiveness of any data-driven study depend much on a well
prepared dataset. But there are only a few open datasets available for activity
recognition using ESP32 CSI data. But these datasets do not have enough data
or provide the activities we need for this system. Hence, we need to prepare our
Machine learning models are trained on these datasets comprising CSI values
collected from the environment. The models learn to recognize distinct features
and variations associated with normal activities and falling incidents. These
alterations caused by a fall. Once trained, the machine learning model can classify
real-time CSI data, distinguishing between regular movements and potential fall
24
events.
25
Chapter 6
ESP32 was configured to receive data from a WiFi router, enabling us to capture
This is the sample CSI Data Received with the ESP32 placed roughly 1m
from the router in a room thats approximately 3.5m to 7m. The ESP 32
26
Toolkit provides CSI values for all 64 subcarriers. Only the Amplitude value
The collected CSI values provide a rich source of information about the wire-
These details are crucial for understanding the unique characteristics of the
wireless signals in the area where the fall detection device will be deployed.
Moving forward, the dataset obtained in Phase 1 will serve as a foundation for
developing algorithms and models to detect falls based on changes in the wireless
environment. The precise and real-time nature of CSI data holds promise for
In summary, Phase 1 lays the groundwork for the fall detection device by
successfully collecting WiFi CSI values. This data will be instrumental in the
27
Chapter 7
Conclusions
facilitating seamless communication with a WiFi router and enabling the capture
of intricate details within the wireless environment. The gathered CSI dataset
wireless signals in our target area. The establishment of a robust data collection
process sets the stage for subsequent phases, where the focus will shift to
leveraging machine learning techniques for fall detection. The promising nature
of WiFi CSI data, coupled with the adaptability of machine learning algorithms,
holds great potential for the creation of an effective, non-intrusive fall detection
system. As we transition into the next phases, the insights gained in Phase 1 will
guide the development of algorithms and models, propelling our project towards
28
References
[5] D. Wu, D. Zhang, C. Xu, H. Wang and X. Li, ”Device-Free WiFi Human
Communications Magazine, vol. 55, no. 10, pp. 91-97, Oct. 2017, doi:
10.1109/MCOM.2017.1700143. .
29
Learning-Based Fall Detection Using WiFi Channel State Information,”
CESS.2023.3300726. .
[7] Sameera Palipana, David Rojas, Piyush Agrawal, and Dirk Pesch. 2018.
30