Naive Bayes Classifier
  • Assumes the features are independent and contributes to the predict (Class conditional assumption)
  • Based on bayes theorem

H - Hypothesis E - Evidence P(H) - Prior Probability P(H|E) - Posterior Probability P(E|H) - Likelihood Ratio

Probability of occurrence of hypothesis H given E is,

P(H|E) = P(E|H) * P(H) / P(E)

P(A|B) = P(A inter B) / P(B)

P(B|A) = P(B inter A) / P(A)

\[posterior = prior x likelihood\]

Types #

  • Guassian - Normally distributed data
  • Multinomial -
  • Bernoulli - Feature vectors are binary