EVALUATION PROBLEMS

1. The prediction of the model is 1/4 and the recall of the same is 2/4. What is the F1 score of the model?
2. There are some images of boys and girls. The girls are positive cases and boys are negative cases. The model
is given 20 images of girls and 30 images of boys. The machine correctly identifies 12 girls and 23 boys. Create a
confusion matrix for the particular cases.
3. Draw confusion matrix for below given description:
Positive/Negative: Mobile/Tables
No. of images: 125
No. of Tablet images: 25
No. of Mobile images: Rest of all
Images of tablets identified correctly: 23, Rest wrong but output given
Mobiles identified correctly: 96, Rest wrong but output given
4. There are 16 images, 9 are cat images and 7 are dog images. The cat images are positive cases and dog images
are negative cases. The model identifies 5 cat images correctly and 3 cat images as dog images. Similarly, it
identifies 4 of them correctly as dog images. Find the accuracy of the model.

5. Consider that there are 10 images. Out of these 7 are apples and 3 are quinces. Kirti has run the model on the
images and it catches 5 apples correctly and 2 quinces correctly. What is the accuracy of the model?

6. An AI model is able 250 tiger images as cats. The precision of the model is exactly 0.69. How many correct
predictions does the machine make out of 628 correct images?

7. An AI model analysed data for 500 students and predicts their result. The prediction are as follows:
i. Model predicted Pass students and student passed 230
ii. Model predicted Pass and students failed 70
iii. Model predicted fail and students failed 110
iv. Model predicted failed and student passed 90
Create a confusion matrix using above information. Also calculate accuracy and precision.
8. An AI model analysed data for share market ups and downs for 200 shares and predicts their result. The
prediction are as follows:
i. Model predicted shares up and shares up are 50
ii. Model predicted shares up and shares down are 40
iii. Model predicted shares down and shares down are 80
iv. Model predicted shares down and shares up are 30
Create a confusion matrix using above information. Also calculate F1 Score.
9. The task is to correctly identify the mobile phones as each, where photos of oppo and Vivo phones are taken
into consideration. Oppo phones are the positive cases and Vivo phones are negative cases. The model is given
10 images of Oppo and 15 images of Vivo phones. It correctly identifies 8 Oppo phones and 12 Vivo phones.
Create a confusion matrix for the particular cases.
10. Take a look at the confusion matrix:
Confusion Matrix Reality
Yes No
Prediction Yes True Positive (TP) False Positive (FP)
No False Negative (FN) True Negative (TN)
How do you calculate F1 score?
11. Calculate accuracy, precision, recall and F1 score for the following Confusion Matrix.
a)
Reality:1 Reality:0
Prediction:1 50 30
Prediction:0 15 25
b)
Reality:1 Reality:0
Prediction:1 30 20
Prediction:0 10 20
c)
True False
Positive 50 10
Negative 15 7
d)
True False
Positive 44 6
Negative 8 15
e)
True False
Positive 28 4
Negative 18 2
f)
Reality:1 Reality:0
Prediction:1 75 5 80
Prediction:0 5 15 20
80 20 100
g)
Reality:T Reality:F
Prediction:T 32 22
Prediction:F 57 28
h)
Reality:T Reality:F
Prediction:T 23 22
Prediction:F 11 12
-Identify the correct predictions and wrong predictions made by machine

------------------------------------------**********------------------------------------------------