A Synopsis Report

on
App Control Using Accessibility
Submitted to the Department of Computer Science and Engineering

In partial fulfilment of the requirements

For the degree of

Bachelor of Technology

In

Computer Science and Engineering

By

Abhishek Goswami,Tanvi
2100140100004,2100140100113

Group No. 7

Guided By

Mr. Amit Karmakar

Department of Computer Science and Engineering

Shri Ram Murti Smarak College of Engineering & Technology, Bareilly
Dr. A. P. J. Abdul Kalam Technical University, Lucknow
September, 2022

I
 Acknowledgement

We would like to express our gratitude toward Dr. Prabhakar Gupta Dean Academics, SRMS CET, Bareilly
and the project incharge Ms. Shruti Agarwal Assistant Professor, CS Department as well as teaching staff of
Computer Science And Engineering department for providing us a great opportunity to work on project App
Control Using Accessiblity. Our sincere thanks go to Mr. Amit Karmakar Assistant Professor, CS
Department without his Support and guidance we do not work on this project. Last but not the least we
would like to thank all our friends and family members for their support, and all others who will contribute
to the work of this project directly or indirectly.

II
 Abstract

Face Recognition is a computer application that is capable of detecting, tracking, identifying or verifying
human faces from an image or video captured using a digital camera. Although lot of progress has been
made in domain of face detection and recognition for security, identification and attendance purpose, but still
there are issues hindering the progress to reach or surpass human level accuracy. These issues are variations
in human facial appearance such as; varying lighting condition, noise in face images, scale, pose etc. This
research paper presents a new method using Local Binary Pattern (LBP) algorithm combined with advanced
image processing techniques such as Contrast Adjustment, Bilateral Filter, Histogram Equalization and
Image Blending to address some of the issues hampering face recognition accuracy so as to improve the LBP
codes, thus improve the accuracy of the overall face recognition system. Our experiment results show that
our method is very accurate, reliable and robust for face recognition system that can be practically
implemented in real-life environment as an automatic attendance management system.

III
 Table Of Content

1. Acknowledgement

2. Abstract

3. Introduction of Project

3.1. Motivation

3.1. Problem Statement

4. Literature Review

5. Methodology

6 Technology Used

7 Requirement and Specifications

7.1 Hardware Requirement/Specification

7.2 Software Requirement/Specification

8. References

IV
 Introduction Of Project
Face detection is a new computer technology that determines the locations and sizes of human faces in
images. It detects facial features and ignores anything else, such as buildings, trees, bodies and any device
other than the face and so on [4] .This technology is used in many fields such as biometrics for identification
and recognition face, it is also used in video surveillance systems and many digital cameras use the latest
face detection for autofocus. Our work is divided into three parts: In the first part we present the method of
Viola and Jones face detection. Subsequently a second part deals with the face detection on C/C++. The
acceleration with OpenCV is presented later, a second implementation in FPGA was presented. Finally, we
conclude the paper.

Motivation:-

Recent media consumption & trends reveal that 90% of their mobile time is spent in apps, and only 10%
browsing the rest of the internet. But the user base of a specific product may be reluctant to move for a
mobile app, only to get done a specific service. And also the user may think twice before installing a new
app because of limited storage and memory. Most hesitated warning at this point is that to free up the space.
So web apps may be the newest trend in the upcoming future, with the tagline “no more mobile apps”. Its
worthy to find out the importance of a mobile app during this walk-through.

Problem Statement:-

Our project is based on a application that facilitates the use of smartphones and tablets for people with
movement difficulties, since it allows to handle the device through head movements.

The application only needs an internet connection to download it, once this process is finished it can be used
in offline mode.

There is no such user guide as with Ease Mouse and Ease Touch, however if you install the application the
wizard integrated in it will guide you to show the actions that can be carried out and how they
are carried out.

V
 Literature Review
This section gives an overview on the major human face recognition techniques that apply mostly to frontal
faces, advantages and disadvantages of each method are also given. The methods considered are eigenfaces
(eigenfeatures), neural networks, dynamic link architecture, hidden Markov model, geometrical feature
matching, and template matching. The approaches are analyzed in terms of the facial
representations they used.

A. Eigenface is one of the most thoroughly investigated approaches to face recognition. It is also known as
Karhunen- Loève expansion, eigenpicture, eigenvector, and principal component. References [26, 27] used
principal component analysis to efficiently represent pictures of faces. They argued that any face images
could be approximately reconstructed by a small collection of weights for each face and a standard face
picture (eigenpicture). The weights describing each face are obtained by projecting the face image onto the
eigenpicture. Reference [28] used eigenfaces, which was motivated by the technique of Kirby and Sirovich,
for face detection and identification.

B. Neural Networks The attractiveness of using neural networks could be due to its non linearity in the
network. Hence, the feature extraction step may be more efficient than the linear Karhunen-Loève methods.
One of the first artificial neural networks (ANN) techniques used for face recognition is a single layer
adaptive network called WISARD which contains a separate network for each stored individual [35]. The
way in constructing a neural network structure is crucial for successful recognition. It is very much
dependent on the intended application. For face detection, multilayer perceptron [36] and convolutional
neural network [37] have been applied.

C. Template Matching A simple version of template matching is that a test image represented as a two-
dimensional array of intensity values is compared using a suitable metric, such as the Euclidean distance,
with a single template representing the whole face. There are several other more sophisticated versions of
template matching on face recognition. One can use more than one face template from different viewpoints
to represent an individual's face

VI
 Methodology

Face detection applications use algorithms and ML to find human faces within larger images, which often
incorporate other non-face objects such as landscapes, buildings and other human body parts like feet or
hands. Face detection algorithms typically start by searching for human eyes -- one of the easiest features to
detect. The algorithm might then attempt to detect eyebrows, the mouth, nose, nostrils and the iris. Once the
algorithm concludes that it has found a facial region, it applies additional tests to confirm that it has, in fact,
detected a face.

To help ensure accuracy, the algorithms need to be trained on large data sets incorporating hundreds of
thousands of positive and negative images. The training improves the algorithms' ability to determine
whether there are faces in an image and where they are.

The methods used in face detection can be knowledge-based, feature-based, template matching or
appearance-based. Each has advantages and disadvantages:

• Knowledge-based, or rule-based methods, describe a face based on rules. The challenge of this approach is
the difficulty of coming up with well-defined rules.

• Feature invariant methods -- which use features such as a person's eyes or nose to detect a face -- can be
negatively affected by noise and light.

• Template-matching methods are based on comparing images with standard face patterns or features that
have been stored previously and correlating the two to detect a face. Unfortunately these methods do not
address variations in pose, scale and shape.

VII
 Technology Used

Facial recognition software uses a mix of artificial intelligence (AI) and biometric technology to identify
human faces through measuring nodal points, the distances between certain facial features.

VII
 Requirement and Specifications

Hardware Requirement/Specification:-

Different hardware and network resources may be available or desired for a given application. The common
architectural components are:

Persistent server / desktop – low quantity, high cost, high processing power and memory. These systems will
typically host FR libraries and/or system software. These systems will typically have server grade x64
processors and potentially GPU processors.

Embedded device – low-cost, high quantity devices with limited processing power and memory that can
either host FR libraries on-edge or operate as a “thin-client” that passes imagery to a server or cloud system
for processing. These systems typically have mobile grade ARM processors and potentially Neural
Processing Units (NPU’s).

Scalable cloud – arrays of server resources abstracted through a cloud resource management system.

Network – communication channels between devices. Networks will have varying amounts of bandwidth
depending on their properties.

Software Requirement/Specification:-

A smartphone or tablet that is running Android 5.0 (API level 21) OS or newer.

API level 22 is the recommended target for code compilation.

If you have a custom Android-based device or development board, contact us to find out if it is supported.

ARM-based 1.5 GHz processor recommended for face processing in the specified time. Slower processors
may be also used, but the face processing will take longer time.

At least 256 MB of free RAM should be available for the application.

Any smartphone's or tablet's built-in camera which is supported by Android OS. The camera should have at
least 0.3 MegaPixel (640 x 480 pixels) resolution.

PC-side development environment requirements:

Java SE JDK 8 (or higher)

AndroidStudio 4.0 ID

VIII
 References
1. M. Turk and A. Pentland. Eigenfaces for recognition. Journal of Cognitive Neuroscience, 3(1):71-86,
1991.
2. W. Zhao, A. Krishnaswamy, R. Chellappa, D. Swets and J. Weng. Discriminant analysis of principal
components for face recognition, page 6
3. M. Günther, D. Haufe and R.P. Würtz. Face recognition with disparity corrected Gabor phase
differences. In Artificial neural networks and machine learning
4. W. Zhang, S. Shan, W. Gao, X. Chen and H. Zhang. Local Gabor binary pattern histogram sequence
(LGBPHS): a novel non-statistical model for face representation and recognition. Computer Vision,
IEEE International Conference on, 1:786-791, 2005.
5. C. McCool, S. Marcel. Parts-based face verification using local frequency bands.
6. R. Wallace, M. McLaren, C. McCool and S. Marcel. Cross-pollination of normalisation techniques
from speaker to face authentication using Gaussian mixture models. IEEE Transactions on
Information Forensics and Security, 2012.
7. R. Wallace, M. McLaren, C. McCool and S. Marcel. Inter-session variability modelling and joint
factor analysis for face authentication. International Joint Conference on Biometrics. 2011.
8. S. J. D. Prince. Probabilistic linear discriminant analysis for inferences about identity. Proceedings of
the International Conference on Computer Vision. 2007.
IX
 App Control Using Accessibility
by
Group no. 7

Signature………………………….. Signature………………………

Name: Abhishek Goswami Name: Tanvi

Roll no: 2100140100004 Roll no: 2100140100113

Mr. Hiresh Gupta Er. Shruti Agarwal Mr. Amit Karmaker

HOD (CSE) PROJECT INCHARGE SUPERVISOR/GUIDE

Department of Computer Science and Engineering

Shri Ram Murti Smarak College of Engineering & Technology, Bareilly

Dr. APJ Abdul Kalam Technical University, Lucknow

September, 2022