Scribd
Upload
25 views8 pages

Bayes Rule

Bayes Rule

Uploaded by

Shobhit Tyagi
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF or read online on Scribd
25 views8 pages

Bayes Rule

Bayes Rule

Uploaded by

Shobhit Tyagi
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF or read online on Scribd
You are on page 1/ 8
An Intuitive Introduction to Bayesian Decision Theory OOO 50+ Exitinglndustry Projects to become a FullStack Data Scientist, some ecinaee Maths Probability Si This article was published as part ofthe Data Science Blogathon Introduction Bayesian decision theory refers to the statistical approach based on tradeoff quantification among various classification Ptwalx) we would decide that the object belongs to class w, or else class wa, ‘Tojustify our decision we look at the probability of error, whenever we observe x, we have, & — Plerrorix Plows) if we decide ws, and Plwalx) if we decide ws ‘As they are exhaustive and if we choose the correct nature of an object by probability P then the leftover probability (1-P) will show how probable is the decision that it the not the decided object. We can minimize the probability of error by deciding the one which has a greater posterior and the rest as the probability of error will be minimum as possible. So we finally g 6 Plerrorlx) = min [P(axabd,Plw2)] ‘And our Bayes decision rule as, & Decide wa; iF Plersx) >PluvaLx) otherwise decide, An Intuitive Introduction to Bayesian Decision Theory rule in terms of conditional and prior probabilities, ‘The evidence is unimportant as far as the decision is concerned, As we discussed earlier itis working as justa scale factor that states how frequently we will measure the feature with value x: it assures P(t)x)+ Plwszbe) = 1. Soby eliminating the unrequired scale factor in our decision rule we have, the similar decision rule by Bayes theorem as, 6 Decide wo if pixlus)P(o04) »plxlers)P(exz); otherwise decide w. Now, let's consider 2cases: + Case-t: IFclassconditionals are equal ie, p(xlus)= p(x), then we arrive at our premature decision rule governed by just priors + Case-2: On the other hand, if priors are equal ie, Plxy)= Plus) then the decision is entirely based on class conditionals bel) This completes our example formulation! Generalization of the preceding ideas for Multiple Features and Classes Bayes classifi: ion: Posterior, likelihood, prior, and evidence Pw | X)= POX [ww) P(w) / POX) Posterior = Likelihood’ Prior/Evidence ‘We now discuss those cases which have multiple features as well as multiple classes, Let the Multiple Features be Xs, X; and Multiple Classes be w, W2s. Wn then: © PEW I Xtpne Xa) = POX tres Xa) POOP Xi) Where, Posteri Phos Xp Xd Likelinood = POX es XI) Prior = Piwi) Evidence = POX. Xq) In cases of the same incoming patterns, we might need to use a drastically different cost function, which will lead to different actions altogether. Generally, different decision tasks may require features and yield boundaries quite different from those Useful for our original categorization problem. So, In the later articles, we will discuss the Cost function, Risk Analysis, and decisive action which will further help to Understand the Bayes decision theory ina better way. An Intuitive Introduction to Bayesian Decision Theory Thanks for reading! I you iked this and want to know more, go visit my other articles on Data Science and Machine Learning by clicking on the Link Please fee free to contact me on Linkedin, Email Something not mentioned or want to share your thoughts? Feel free to comment below And Ill get back to you. About the author Chirag Goyal Currently, 1 am pursuing my Bachelor of Technology (B-Tech) in Computer Science and Engineering from the Indian Institute of ‘Technology Jodhpur(IIT).| am very enthusiastic about Machine learning, Deep Learning, and Artificial Intelligence. The media shown in this article are not owned by Analytics Vidhya and is used at the Author's discretion. Bi Decision Theory, blo, About the Author cchiRaG Govay {am currently pursuing my Bachelor of Technology (B.Tech in Computer Science and Engineering from the Fit Indian institute of Technology Jodhpur). Lam very enthusiastic about Machine learning, Deep Learning. and Artifill Intelligence, Fel fre to connect with men Linkedin, Our Top Authors Pavoni oo [ enerae Questions trom Movies! I wat and now Sect Custer Leave a Reply An Intuitive Introduction to Bayesian Decision Theory [Notify meo follow-up comments by email EaNotify me of new posts by email. Top Resources ri an” How to Read and Write With CSV Files in Python Microsoft Power Platform CopilotNo Coding Era Is Coming @ Harika onthu-sv62 2001 NISHANT TIWARI wa 20 2028 eature Selection Techniques in Machine Learning Updateg Understand Random Forest Algorithms With Examoles 7023) ‘Usdated 2023) @ AmanGupta=oct 102020 Seuthi€ = 317, 2001 An Intuitive Introduction to Bayesian Decision Theory

You might also like