Scribd
Upload
20 views22 pages

Presentation 1

Uploaded by

malkmoh781.mm
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
20 views22 pages

Presentation 1

Uploaded by

malkmoh781.mm
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 22

Features Selection

Prepared by / Zahwa Mumdouh Ali & Sara Effat Aziz


Definition
4

agenda Wrapper methods


5

Filter methods
10

Embedded methods
13
Definition
• A feature is an attribute that has an impact on a problem or is useful for the problem, and
choosing the important features for the model is known as feature selection. Each machine
learning process depends on feature engineering, which mainly contains two processes;
which are Feature Selection and Feature Extraction. Although feature selection and
extraction processes may have the same objective, both are completely different from
each other. The main difference between them is that feature selection is about selecting
the subset of the original feature set, whereas feature extraction creates new features.
Feature selection is a way of reducing the input variable for the model by using only
relevant data in order to reduce overfitting in the model.
• So, we can define feature Selection as, "It is a process of automatically or manually selecting
the subset of most appropriate and relevant features to be used in model building." Feature
selection is performed by either including the important features or excluding the
irrelevant features in the dataset without changing them.

20XX presentation title 3


Feature Selection
SUPERVISED FEATURE SELECTION TECHNIQUE

Supervised Feature selection techniques consider the


target variable and can be used for the labelled dataset.

UNSUPERVISED FEATURE SELECTION TECHNIQUE

Unsupervised Feature selection techniques ignore the target variable and can be
used for the unlabelled dataset.

20XX presentation title 4


Techniques :

20XX presentation title 5


Wrapper method
In wrapper methodology,
selection of features is done by
considering it as a search
problem, in which different
combinations are made,
evaluated, and compared with
other combinations. It trains
the algorithm by using the
subset of features iteratively.

20XX presentation title 6


Wrapper method
SBG

SFG

BG RG
SEQUENTIAL FORWARD GENERATION

Forward selection is an iterative process,


which begins with an empty set of features.
After each iteration, it keeps adding on a
feature and evaluates the performance to
check whether it is improving the
performance or not. The process continues
until the addition of a new variable/feature
does not improve the performance of the
model.

20XX presentation title 8


SEQUENTIAL BACKWARD GENERATION

Backward elimination is also an iterative


approach, but it is the opposite of forward
selection. This technique begins the process
by considering all the features and removes
the least significant feature. This elimination
process continues until removing the features
does not improve the performance of the
model.

20XX presentation title 9


BIDIRECTION GENERATION

Exhaustive feature selection is one


of the best feature selection
methods, which evaluates each feature
set as brute-force. It means this method
tries & make each possible combination
of features and return the best
performing feature set.

20XX presentation title 10


RANDOM GENERATION

Recursive feature elimination is a recursive


greedy optimization approach, where features
are selected by recursively taking a smaller and
smaller subset of features. Now, an estimator
is trained with each set of features, and the
importance of each feature is determined
using coef_attribute or through
a feature_importances_attribute.

20XX presentation title 11


20XX presentation title 12
20XX presentation title 13
20XX presentation title 14
20XX presentation title 15
270
230

20XX presentation title 16


20XX presentation title 17
20XX presentation title 18
20XX presentation title 19
20XX presentation title 20
20XX presentation title 21
thank you

You might also like