🧠 What actually is it?
Probability theory is the mathematical framework for quantifying uncertainty. In 1933, Andrey Kolmogorov established the foundations of modern probability using three simple axioms.
1. The 3 Axioms of Probability
- Non-negativity: For any event $A$, the probability is non-negative:
$$P(A) \ge 0$$
- Certainty: The probability of the entire sample space $S$ (all possible outcomes) is 1:
$$P(S) = 1$$
- Additivity: For any two mutually exclusive (disjoint) events $A$ and $B$:
$$P(A \cup B) = P(A) + P(B)$$
2. Types of Events
- Mutually Exclusive (Disjoint): Events that cannot happen at the same time. If $A$ happens, $B$ cannot.
$$A \cap B = \emptyset \implies P(A \cap B) = 0$$
- Independent: The occurrence of one event does not affect the probability of the other.
$$P(A \cap B) = P(A) \times P(B)$$
💡 Why was it invented & why do we need it?
Before axioms, mathematicians defined probability as "favorable cases divided by total cases". This failed for infinite possibilities (e.g., "what is the probability a random real number is between 1 and 2?"). Axioms made probability rigorous and allowed the creation of modern statistics.
A single coin toss can land on Heads ($H$) or Tails ($T$), but **not both**. Thus, $H$ and $T$ are mutually exclusive.
Rolling a 6 on Die #1 does not change your chances of rolling a 6 on Die #2. The events are independent.
Why GATE DA needs this: In Machine Learning, conditional independence is the foundational assumption behind algorithms like **Naive Bayes** and **Bayesian Networks**. Understanding how these events overlap prevents models from making false logical assumptions.
🔬 Venn Diagram Visualizer
Toggle the event states and watch the Venn diagram and probability formulas calculate dynamically.
📝 GATE Level Practice Question
Let $A$ and $B$ be two events in a sample space $S$ such that $P(A) = 0.6$ and $P(B) = 0.4$.
1. If $A$ and $B$ are independent, find $P(A \cup B)$ and $P(A \cap B)$.
2. If $A$ and $B$ are mutually exclusive, find $P(A \cup B)$ and $P(A \cap B)$.
💡 Reveal Step-by-Step Solution
Part 1: Independent Events
- By definition of independence:
$$P(A \cap B) = P(A) \times P(B) = 0.6 \times 0.4 = 0.24$$
- Using the addition rule of probability:
$$P(A \cup B) = P(A) + P(B) - P(A \cap B) = 0.6 + 0.4 - 0.24 = 0.76$$
Part 2: Mutually Exclusive Events
- By definition, mutually exclusive events cannot overlap:
$$P(A \cap B) = 0$$
- Using the addition rule:
$$P(A \cup B) = P(A) + P(B) - P(A \cap B) = 0.6 + 0.4 - 0 = 1.0$$