Skip to content
notesavo

Sample · synthetic lecture transcript

Conditional probability and Bayes’ theorem

Demo lecture, “Probability Theory”, lecture 3 · 15:12

In brief

The lecture introduces conditional probability — the probability of an event given that another event has already happened. From the definition come the multiplication rule, the law of total probability and Bayes’ theorem. The practical lesson is that even an accurate medical test can produce many false positives when a condition is rare and the prior probability is ignored.

Key points

  • P(A | B) = P(A ∩ B) / P(B): the probability of A given that B has happened.
  • Multiplication rule: P(A ∩ B) = P(B) · P(A | B).
  • Events are independent when P(A | B) = P(A): knowing B changes nothing about A.
  • Mutually exclusive events with positive probability cannot be independent.
  • The law of total probability splits the sample space into hypotheses and adds their contributions.
  • Bayes’ theorem updates the probability of a hypothesis after an observation.
  • With 1% prevalence, a 99%-accurate test can make a positive result correct only about half the time.
  • The base-rate fallacy is ignoring the prior probability of a hypothesis.

Chapters

  1. Why conditional probability matters
  2. Multiplication rule
  3. Independence
  4. Law of total probability
  5. Bayes’ theorem
  6. Medical test example
  7. Takeaways

Terms

Conditional probability
The probability of event A given that B has occurred.
Independent events
Events for which P(A ∩ B) = P(A) · P(B).
Prior probability
The probability of a hypothesis before observing new data.
Posterior probability
The probability of a hypothesis after taking the observation into account.

Takeaways

  • Write down the prior probabilities of all hypotheses before applying Bayes’ theorem.
  • Check independence from the definition rather than by intuition.
  • For test problems, draw a tree for 10,000 people — the error becomes visible immediately.

Check yourself

  1. What is P(A | B) if P(A ∩ B) = 0.1 and P(B) = 0.4?
  2. Can mutually exclusive events with non-zero probabilities be independent?
  3. What is most often forgotten in Bayes’ theorem problems?

Questions about the video

Why can a 99% test still be wrong so often?

Because the condition is rare: with 1% prevalence, 99 true positives are accompanied by roughly 99 false positives . Ignoring that base rate is the base-rate fallacy .

How do I check independence?

Use the definition: P(A ∩ B) = P(A) · P(B), or equivalently P(A | B) = P(A) .

Use the same kind of notes for your own lecture, webinar or video.