6.5. Overfitting
6.5. Overfitting
Overfitting
in Machine Learning
Overfitting
Overfitting refers to a model that models the training data too well. Overfitting happens
when a model learns the detail and noise in the training dataset to the extent that it
negatively impacts the performance of the model.
Sign that the model has Overfitted : High Training data Accuracy & very low Test data Accuracy
Overfitting
X 1 2 3 4 5 6 7 8 9 10
Y 1.38 101.41 23.34 39.89 55.23 129.91 119.33 221.09 207.43 287.80
Data points
350
300
250
200
Y values
150
100
50
0
0 2 4 6 8 10 12
X values
Overfitting
X 1 2 3 4 5 6 7 8 9 10
Y 1.38 101.41 23.34 39.89 55.23 129.91 119.33 221.09 207.43 287.80
Data
Goodpoints
Fit Over Fit
350
350 350
300
300 300
250
250 250
Y values
200
YY values
200
200
values
150
150 150
100
100 100
50
50 50
00 0
00 2 4 6 8 10
10 12
12 1 2 3 4 5 6 7 8 9 10
X values X values
Overfitting
1. Less Data
2. Increased Complexity of the model
3. More number of layers in Neural Network