Scribd
Upload
24 views2 pages

Ai Evalution

The document discusses evaluation in AI, including key concepts like confusion matrix, accuracy, precision, recall, and F1 score. It includes multiple-choice questions and practical scenarios related to confusion matrices and model performance metrics. Additionally, it presents a case study involving a medical diagnostic model and AI applications in retail and sports performance prediction.

Uploaded by

Hemavathi Kanniappan
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
24 views2 pages

Ai Evalution

The document discusses evaluation in AI, including key concepts like confusion matrix, accuracy, precision, recall, and F1 score. It includes multiple-choice questions and practical scenarios related to confusion matrices and model performance metrics. Additionally, it presents a case study involving a medical diagnostic model and AI applications in retail and sports performance prediction.

Uploaded by

Hemavathi Kanniappan
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 2

CHAPTER - EVALUTION

Q- 1 WHAT IS EVALUTION IN AI?


Q-2 WHAT IS CONFUSION MATRIX?
Q-3 WRITE DEFINITION AND FORMULA FOR FOLLOWING-

I) ACCURACY II) PRECISION III) RECALL


Q- 4 WHAT IS F1 SCORE ? MENTION THE VARIOTIONS IN IT.

MCQs
i) In a confusion matrix, the combination of True Positives (TP) and False Positives
(FP) is used to calculate which metric?
A) Precision
B) Recall
C) F1-Score
D) Accuracy
ii) The first layer of the neural network is known as __________ layer.
iii) Assertion: The True Positive (TP) value in a confusion matrix represents the
number of instances that were correctly predicted as the positive class.
Reasoning: The TP value is important for calculating metrics like Accuracy and
Recall, but it does not directly impact Precision.
A) Both Assertion and Reasoning are correct, and Reasoning is the correct
explanation for Assertion.
B) Both Assertion and Reasoning are correct, but Reasoning is not the correct
explanation for Assertion.
C) Assertion is correct, but Reasoning is incorrect.
D) Both Assertion and Reasoning are incorrect.
iv) Amit is learning about confusion matrices and comes across a scenario where the
model is consistently predicting "Animal" for every case, even when the actual
case is "Not an Animal." What is this condition called?
(A) False Positive
(B) True Positive
(C) False Negative
(D) True Negative
v) In a classification model, the Precision is 1 and the Recall is 1.
What will be the value of the F1 Score for this model?
(A) 0
(B) 0.5
(C) 1
(D) Cannot be determined
vi) What is the main purpose of the "Evaluation" step in the AI project cycle?
A) To gather data for training the model
B) To evaluate the model's performance based on specific metrics
C) To deploy the model in a real-world scenario
D) To define the problem and objectives of the project

Q -5 A medical diagnostic model is used to detect whether a patient has a certain disease. The
patients who have the disease are labeled as positive cases, and those who do not have the
disease are labeled as negative cases. The model is given 50 positive cases (patients with the
disease) and 40 negative cases (patients without the disease). The model correctly identifies
45 patients with the disease and 35 patients without the disease.
Create a confusion matrix.
Q- 6 With the rise of online shopping, retailers have started using AI models to predict
whether a customer will make a purchase after adding items to their cart. This helps them
decide on offering discounts or personalized deals. The confusion matrix for the model's
predictions is:
Reality
Confusion Matrix
Yes No
Yes 60 30
Prediction
No 20 90
a) Identify the total number of wrong predictions made by the model.
b) Calculate precision, recall, and F1 score for this model.
Q- 7 Based on the performance of various players enrolled at the sports university,
get picked up by the national teams and other professional teams. The university has
got an AI model developed that can predict if a player, based on their performance
data, will make to playing national or professional teams. The confusion matrix of the
model is shown below.
Compute all the classification metrics (accuracy, precision, recall, f1 score) for model

Predicted value
Actual Value Yes No
Yes 120 40
TP FN
No 70 1700
FP TN

Q8

You might also like