KCA-054 (Assignment 2)
KCA-054 (Assignment 2)
Assignment-2
UNIT -II
REGRESSION: Linear Regression and Logistic Regression
BAYESIAN LEARNING - Bayes theorem, Concept learning, Bayes Optimal Classifier, Naïve Bayes classifier, Bayesian belief
networks, EM algorithm.
SUPPORT VECTOR MACHINE: Introduction, Types of support vector kernel – (Linear kernel, polynomial kernel, and Gaussian
kernel), Hyperplane – (Decision surface), Properties of SVM, and Issues in SVM.
Q. Marks CO KL
Questions
No.
1 Derive the closed-form expression of Simple Linear Regression using first-order partial 6 CO2 K1, K3
derivatives. Use this derivation to solve the given numerical problem and determine the
regression line for the following dataset:
x = [1, 2, 3, 4, 5], y = [2, 4, 5, 4, 5].
2 In regression analysis, discuss which metric (R² score or Adjusted R² score) is more affected 3 CO2 K1
by the addition of relevant and irrelevant features. Provide a detailed explanation using
mathematical formulations and practical examples.
3 (a) Explain the role of the Kernel Trick in Support Vector Machines (SVMs) and how it helps 3 CO2 K1, K3
in handling non-linearly separable data.
1 2
(b) Given the vectors x = [ ] and y= [ ]compute the kernel similarities using:
2 3
(i) Linear Kernel
(ii) Polynomial Kernel (degree = 2, c = 1)
(iii) RBF Kernel (σ = 0.5)
4 (a) Discuss how the choice of the polynomial kernel degree affects the generalization ability 4 CO2 K3
of a Support Vector Machine (SVM). Explain the trade-off between underfitting and
overfitting.
(b) Compute the polynomial kernel similarity (degree = 2 and 3) for the given vectors:
2 3
x = [ ] and y= [ ]
−1 4
5 (a) Explain the concept of Bayesian Belief Networks (BBNs) and their application in 4 CO2 K1, K3
probabilistic reasoning.
(b) Consider a case scenario: Harry installed a new burglar alarm at his home to detect
burglary. The alarm reliably responds at detecting a burglary but also responds for minor
earthquakes. Harry has two neighbors David and Sophia, who have taken a responsibility
to inform Harry at work when they hear the alarm. David always calls Harry when he hears
1/2
[Approved by AICTE, GOVT. of India & Affiliated to
Dr. APJ Abdul Kalam Technical University, Lucknow, U.P. India]
the alarm, but sometimes he got confused with the phone ringing and calls at that time too.
On the other hand, Sophia likes to listen to high music, so sometimes she misses to hear
the alarm. Here we would like to compute the probability of Burglary Alarm.
Problem:
Calculate the probability that alarm has sounded, but there is neither a burglary, nor an
earthquake occurred, and David and Sophia both called the Harry.
*Note: Use A-4 size sheets to write their answer. Avoid copying assignments. Furthermore, No assignment
will be accepted after the submission date.
SIGNATURE
Name of Faculty: Ms. Pooja Thapar HOD Signature
Date: 28/03/2025
2/2