STOR 435 Midterm 1 Study Guide
Counting · Events · Probability rules · Conditional probability
0. Before you start
How to use this guide
- Read sections 1 to 5 in order. Each idea builds on the one before. Blue boxes are the formulas you must know. Orange boxes are the mistakes that cost points. Green boxes tell you how a question will probably be phrased.
- Do every "Check yourself" question with pen and calculator before opening the answer. On the exam you need the actual number, not just the setup.
- Section 6 is material taught just before the exam that is officially for Midterm 2. Read it if you have time.
- Section 8 is a full practice exam with worked answers. Section 9 is a one-page summary for the night before.
If you have one day
- Sections 1 and 2, about 45 minutes. Do the counting questions.
- Sections 3 and 4, about 45 minutes. Be able to write the three-event inclusion–exclusion formula from memory.
- Section 5, about 30 minutes. Do the multiplication-rule questions.
- Take the practice exam in section 8 in 50 minutes, then read every solution.
- Read the summary in section 9 before bed and again before the exam.
1. Three math facts you need
These are not probability, but they appear on the exam as quick questions and inside harder ones.
1.1 Geometric series
1 + a + a2 + ··· + an = 1 − an+11 − a
If −1 < a < 1 the terms shrink, and the infinite sum is1 + a + a2 + ··· = 11 − a, a + a2 + a3 + ··· = a1 − a
How to use it. Factor out whatever every term has in common until what is left looks like 1 + a + a2 + ···, then apply the formula.
- 1 + (1/4)2 + (1/4)4 + (1/4)6 + ··· has ratio a = 1/16, so it equals 1/(1 − 1/16) = 16/15.
- (1/3)2(1/4)2 + (1/3)3(1/4)4 + (1/3)4(1/4)6 + ··· : the n-th term is (1/3)(1/3)n(1/16)n = (1/3)(1/48)n. Summing from n = 1 gives (1/3) · (1/48)/(1 − 1/48) = 1/141 ≈ 0.0071.
1.2 The number e
Σn=0∞ xnn! = 1 + x + x22! + x33! + ··· = ex limn→∞ (1 − an)n = e−a
- Σ (−2)n/n! = e−2 ≈ 0.1353. Σ (−3)n/n! = e−3 ≈ 0.0498.
- lim (1 − 3/n)n = e−3 ≈ 0.0498. lim (1 + 2/n)n = e2.
1.3 Factorials and the calculator
- n! = n × (n − 1) × ··· × 2 × 1, and 0! = 1.
- A partial product like 10 × 9 × 8 equals 10!/7!. In general n(n − 1)···(n − r + 1) = n!/(n − r)!.
- Calculators overflow around 70!. Never compute 365!. Multiply fractions one at a time instead: (364/365)(363/365)···.
- Cancel before multiplying: (3003) = (300 · 299 · 298)/6.
- Find the nCr key on your calculator and practice with it before the exam.
1.4 Check yourself
Answer
e−1 ≈ 0.3679, so (0.3, 0.4].Answer
Ratio 1/3: 1/(1 − 1/3) = 1.5.Answer
e−2 ≈ 0.1353.Answer
Each term is (1/10)n. From n = 1: (1/10)/(1 − 1/10) = 1/9 ≈ 0.1111.Answer
12!/8! = 11,880. Divide by 4! to get (124) = 495.2. Counting
Why counting comes first. When every outcome is equally likely, the probability of an event is simply (outcomes in the event) ÷ (all outcomes). To use that, you must be able to count outcomes without listing them. This section gives you five counting tools and the patterns for combining them.
2.1 Multiply the stages
The only requirement is that the number of options at each stage does not depend on earlier choices. The options themselves may change (after using the letter A you cannot use it again), as long as the count stays the same.
- Two-letter strings, repeats allowed: 26 · 26 = 676. No repeats: 26 · 25 = 650.
- License plate with 3 letters then 4 digits: 263 · 104 = 175,760,000. With no repeated letter or digit: (26 · 25 · 24)(10 · 9 · 8 · 7) = 78,624,000.
- A pizza has 4 sizes and any subset of 8 toppings: 4 · 28 = 1024 options. Two pizzas ordered one after the other: 10242.
Example: a forbidden pair. How many subsets of a 10-student class do not contain both Brad and John? All subsets: 210 = 1024. Subsets containing both: the other 8 students are free, 28 = 256. Answer 1024 − 256 = 768.
2.2 Permutations: order matters
Example: books in blocks. 12 distinct books: 5 math, 3 sci-fi, 2 cookbooks, 1 environment, 1 teaching. Books of the same type must sit together. Treat each type as one block: 5 blocks in 5! orders. Inside the blocks: 5! · 3! · 2! · 1! · 1!. Total 5! · 5! · 3! · 2! = 172,800.
Example: visiting cities. Visit 4 of the 6 largest US cities. If the order of visits matters: 6 · 5 · 4 · 3 = 360. If it does not: (64) = 15. Same story, two different questions.
2.3 Combinations: order does not matter
(nr) = n!r!(n − r)!
Read "n choose r". (n0) = 1 and (nr) = (nn − r).Where it comes from. Ordered lists of r objects: n!/(n − r)!. Every group of r objects shows up r! times in that list, once per ordering. Divide by r! to count each group once.
Example: committee with a feud. From 5 juniors and 7 seniors, choose 3 juniors and 2 seniors. Two seniors refuse to serve together.
- Ignore the feud: (53)(72) = 10 · 21 = 210.
- Count committees with both feuding seniors: their two seats are taken, choose the 3 juniors: (53) = 10.
- Subtract: 210 − 10 = 200.
Example: party guests. Invite 5 of 8 friends; two of them will not both attend. (85) − (63) = 56 − 20 = 36 possible groups.
Example: "at least" with cases. Choose 6 of 20 courses: 5 Statistics, 6 Physics, 9 other. Need at least 2 Statistics and at least 3 Physics. List the possible (Stats, Physics, Other) splits: (2,3,1) gives (52)(63)(91) = 1800; (2,4,0) gives (52)(64) = 150; (3,3,0) gives (53)(63) = 200. Total 2150.
Example: no two defectives together. 100 batteries in a line, 80 working and 20 defective, same-type batteries identical. How many orderings have no two defectives adjacent? Lay out the 80 working ones; that creates 81 gaps (before, between, after). Put at most one defective in a gap: choose 20 of 81 gaps, (8120).
2.4 The binomial theorem
(x + y)n = Σr=0n (nr) xr yn−r
(x + y)n is n copies of (x + y) multiplied together. To produce xryn−r, pick x from exactly r of the copies: (nr) ways.Setting x = y = 1 gives Σr (nr) = 2n, the subset count again.
2.5 Multinomial coefficients: several groups, or repeated letters
(nn1, n2, …, nr) = n!n1! n2! ··· nr!
This one number answers two different questions:
- Splitting into labeled groups
- The number of ways to divide n distinct objects into groups of sizes n1, …, nr when the groups have names or jobs. It equals (nn1)(n − n1n2)··· (fill group 1, then group 2 from what is left, and so on).
- Arranging objects with repeats
- The number of ways to arrange n objects in a row when n1 are identical, n2 are identical, and so on. Start with n! and divide by ni! for each type, because swapping identical objects changes nothing.
- MISSISSIPPI: 11 letters, I×4, S×4, P×2, M×1: 11!/(4! 4! 2!) = 34,650. SEATTLE: 7!/(2! 2!) = 1260.
- Bridge: 52 cards into four players' hands of 13: 52!/(13!)4.
- Chess: 7 games, each a win (1 point), draw (½) or loss (0) for player A; A finishes with 4 points. The number of draws must be even. 0 draws: 4W 3L, 7!/(4! 3!) = 35. 2 draws: 3W 2D 2L, 7!/(3! 2! 2!) = 210. 4 draws: 2W 4D 1L, 105. 6 draws: 1W 6D, 7. Total 357.
Labeled or unlabeled groups?
2.6 Seating problems
8 animals sit in 8 chairs, 4 on each side of a table. Every chair is different, so a seating is an arrangement of 8 animals: 8! = 40,320 in total.
- 6 cats and 2 dogs, dogs not on the same side. Seat dog 1 anywhere (8), dog 2 on the opposite side (4), the cats fill the rest (6!): 8 · 4 · 720 = 23,040. Check by subtraction: same side = 2 sides × 4 · 3 chairs for the dogs × 6! = 17,280, and 40,320 − 17,280 = 23,040.
- 4 dogs and 4 cats, probability all dogs on one side. Favorable: choose the dogs' side (2), arrange the dogs there (4!), arrange the cats opposite (4!). Probability 2(4!)2/8! ≈ 0.0286.
2.7 Which formula?
| Situation | Count | Test |
|---|---|---|
| Several choices in a row | n1 · n2 ··· nr | Fixed number of options at each stage? |
| Arrange all n distinct things | n! | Does swapping two give a new outcome? |
| Arrange r of n distinct things | n!/(n − r)! | Order matters, not everything used. |
| Pick a group of r from n | (nr) | Order does not matter. |
| Split into labeled groups | n!/(n1! ··· nr!) | Groups have names? If not, also divide by (groups)!. |
| Arrange with repeated items | n!/(n1! ··· nr!) | Some items identical? |
| Any subset | 2n | Each item in or out. |
| "These two not both" | all − both | Count the complement. |
| "No two adjacent" | choose gaps | Place the others first. |
| "Must be together" | glue a block | Arrange inside the block too. |
2.8 Check yourself
Answer
26 · 25 · 24 · 23 · 22 = 7,893,600.Answer
5! · 7! = 604,800.Answer
A×3, N×2, B×1: 6!/(3! 2!) = 60.Answer
4 · 16 + 6x = 124, so x = 10.Answer
Labeled: 12!/(4!)3 = 34,650. Unlabeled: divide by 3!, giving 5775.Answer
Glue Ann and Ben: 4 units in 4! ways, times 2 for their order: 48.Answer
3 women and 1 man: (53)(61) = 60. 4 women: 5. Total 65.Answer
(83) = 56.3. Sample spaces and events
The idea. Before you can find the probability of something, you must say exactly what that something is. The sample space is the list of everything that could happen. An event is a part of that list. "Or", "and", "not" become union, intersection, complement. Exam questions test whether you can move between words, set notation, and pictures without slipping.
3.1 Sample spaces
The sample space depends on what you write down. Flip a coin twice. Recording each flip gives S = {HH, HT, TH, TT}. Recording only the number of heads gives S = {0, 1, 2}. Same experiment, different sample space. Read carefully what is being recorded.
- Six runners finish with no ties: S is the set of all orderings, and its size is 6! = 720. The sample space is the set; 720 is its size.
- Flip a coin until the first head: S = {H, TH, TTH, TTTH, …}. Infinite, but listable.
- Lifetime of a light bulb in hours: S = [0, ∞). Continuous.
- Draw 2 marbles from {2 red, 1 green, 1 blue}, recording colors in order. With replacement there are 9 outcomes (RR, RG, RB, GR, GG, GB, BR, BG, BB). Without replacement, GG and BB are impossible, leaving 7. RR stays possible because there are two reds.
- Roll a black die and note even/odd, then a white die and note even/odd: S = {(E,E), (E,O), (O,E), (O,O)}. Ordered pairs, black die first. Not the faces, not unordered pairs.
- Pick one of 27 flags on each of 3 days, repeats allowed: S = all triples of flags, 273 = 19,683 outcomes.
3.2 Events and the three operations
- Union E ∪ F
- Outcomes in E, in F, or in both. "E or F occurs." The "or" includes both.
- Intersection E ∩ F
- Outcomes in both. "E and F occur."
- Complement Ec
- Outcomes not in E. "E does not occur." Sc = ∅.
- Empty event ∅
- Contains no outcomes; cannot occur. If E ∩ F = ∅, E and F are disjoint (mutually exclusive): they cannot both happen.
- Containment E ⊆ F
- Every outcome of E is in F. If E happens, F happens. E = F means each contains the other.
For several events, ∪j Ej means "at least one occurs" and ∩j Ej means "all occur".
Example. S = {HH, HT, TH, TT}. E = first coin is H = {HH, HT}. F = the coins differ = {HT, TH}. Then E ∪ F = {HH, HT, TH}, E ∩ F = {HT}, Ec = {TH, TT}.
3.3 Rules for combining events
| Rule | Statement | In words |
|---|---|---|
| Commutative | E ∪ F = F ∪ E, E ∩ F = F ∩ E | Order does not matter. |
| Associative | (E ∪ F) ∪ G = E ∪ (F ∪ G), same for ∩ | Grouping does not matter when the operation is the same. |
| Distributive | (E ∪ F) ∩ G = (E ∩ G) ∪ (F ∩ G) (E ∩ F) ∪ G = (E ∪ G) ∩ (F ∪ G) | Like a(b + c) = ab + ac, but works both ways. |
| De Morgan | (E ∪ F)c = Ec ∩ Fc (E ∩ F)c = Ec ∪ Fc | "Not (E or F)" = neither. "Not (E and F)" = at least one fails. Complement swaps ∪ and ∩. |
De Morgan works for any number of events: the complement of "at least one Ej" is "no Ej", and the complement of "all Ej" is "at least one fails".
A useful split. E ∪ F = E ∪ (Ec ∩ F). "E or F" is "E" plus "F but not E", and those two pieces do not overlap. This is how the addition rule in section 4 is proved.
3.4 Turning words into events
For three events A, B, C:
| Words | Event |
|---|---|
| A and B but not C | A ∩ B ∩ Cc |
| Only A | A ∩ Bc ∩ Cc |
| Exactly one | (A ∩ Bc ∩ Cc) ∪ (Ac ∩ B ∩ Cc) ∪ (Ac ∩ Bc ∩ C) |
| Exactly two | (A ∩ B ∩ Cc) ∪ (A ∩ C ∩ Bc) ∪ (B ∩ C ∩ Ac) |
| At least two | (A ∩ B) ∪ (A ∩ C) ∪ (B ∩ C) |
| At most one | (A ∩ B)c ∩ (A ∩ C)c ∩ (B ∩ C)c (no pair occurs together) |
| At least one | A ∪ B ∪ C |
| None | Ac ∩ Bc ∩ Cc = (A ∪ B ∪ C)c |
Method: list the cases that satisfy the words, write each case as an intersection (what happens ∩ what does not), then join the cases with ∪.
3.5 Simplifying a messy expression
The exam gives a complicated expression and asks which simple event it equals. Two approaches.
Reason in words. (A ∪ B) ∩ (A ∪ C) ∩ (Bc ∩ Cc). The last part says B and C both fail. Then "A or B" forces A, and "A or C" forces A. The whole thing is A ∩ Bc ∩ Cc: only A.
Use the rules. (A ∪ B) ∩ (Ac ∪ B) ∩ (A ∪ Bc). First, (A ∪ B) ∩ (Ac ∪ B) = B: if B occurs both parts hold; if B fails you would need A and Ac at once. Then B ∩ (A ∪ Bc) = (B ∩ A) ∪ (B ∩ Bc) = A ∩ B.
3.6 Worked examples
Colored balls. Draw 3 balls without replacement from 5 black and 2 red, recording colors in order. RRR is impossible, so S = {BBB, BBR, BRB, RBB, BRR, RBR, RRB}. A2 = second ball black = {BBB, BBR, RBB, RBR}. A3c = third ball red = {BBR, BRR, RBR}. A2 ∩ A3c = {BBR, RBR}.
Integers from −7 to 7. A = {N ≤ 3}, B = {2 ≤ N ≤ 10} = {2,…,7} within range, C = {N even and positive} = {2, 4, 6}.
- A ∩ B ∩ C = {2}.
- Ac ∪ (B ∩ Cc) = {4,5,6,7} ∪ {3,5,7} = {3,4,5,6,7}.
- (A ∪ B) ∩ Cc: A ∪ B is everything, so remove {2,4,6}: {−7,…,1,3,5,7}.
- (A ∩ B) ∩ (A ∪ C)c: A ∩ B = {2,3}; (A ∪ C)c = {5,7}; no overlap, ∅.
Coin until the first tail. S = {T, HT, HHT, …}. Ek = at least k tosses needed. E4 ∩ E8c = at least 4 but fewer than 8 tosses = {HHHT, HHHHT, HHHHHT, HHHHHHT}.
Elevator. Three people each pick a floor from 1 to 10: S has 103 = 1000 outcomes. E = they pick three consecutive floors. The floor set is {k, k+1, k+2} for k = 1 to 8, and the three people can be matched to those floors in 3! ways: |E| = 8 · 6 = 48.
3.7 Check yourself
Answer
|S| = 36. E = {(1,6),(2,5),(3,4),(4,3),(5,2),(6,1)}, |E| = 6.Answer
Ac ∪ Bc = (A ∩ B)c.Answer
E ∪ (F ∩ Fc) = E ∪ ∅ = E.Answer
Strings with exactly one A and a different second letter: AB, AC, …, AZ, BA, CA, …, ZA. Not AA.Answer
No. Disjoint: E ∩ F = ∅. Complements: also E ∪ F = S. {HH} and {TT} are disjoint but not complements.Answer
At least one. By De Morgan it equals A ∪ B.Answer
E ∪ (Ec ∩ F). The first equals S; the third is ∅.4. The rules of probability
The idea. Probability is not defined as "long-run frequency" (how long is long? and you cannot repeat "Apple stock rises next year"). Instead, three rules say what any probability assignment must satisfy, and everything else follows. You need to: check whether an assignment obeys the rules, use the consequences (complement, inclusion–exclusion), and compute probabilities by counting when outcomes are equally likely.
4.1 The three axioms
- 1. 0 ≤ P(E) ≤ 1 for every event E.
- 2. P(S) = 1.
- 3. If E1, E2, … are disjoint, then P(E1 ∪ E2 ∪ ···) = P(E1) + P(E2) + ···.
Checking an assignment. S = {H, T} with P(H) = p and P(T) = 1 − p, 0 < p < 1. Axiom 1: both numbers are in [0, 1]. Axiom 2: P(S) = 1. Axiom 3: the only disjoint union to check is {H} ∪ {T} = S, and p + (1 − p) = 1. Valid.
Finite sample spaces. Give each outcome xi a number pi ≥ 0 with p1 + ··· + pN = 1. Then P(E) is the sum of the pi for outcomes in E. Unfair die with P(1) = P(2) = P(3) = 1/4 and P(4) = P(5) = P(6) = 1/12: P(even) = 1/4 + 1/12 + 1/12 = 5/12.
4.2 What follows from the axioms
- P(∅) = 0.
- Disjoint A, B: P(A ∪ B) = P(A) + P(B). Same for any finite list of disjoint events.
- Complement: P(Ec) = 1 − P(E).
- Monotone: if E ⊆ F then P(E) ≤ P(F).
- Addition rule: P(E ∪ F) = P(E) + P(F) − P(E ∩ F).
Why the addition rule subtracts. Adding P(E) and P(F) counts the overlap twice. Formally, E ∪ F = E ∪ (Ec ∩ F) is a disjoint union, and P(Ec ∩ F) = P(F) − P(E ∩ F).
P(E ∪ F ∪ G) = P(E) + P(F) + P(G)
− P(E ∩ F) − P(E ∩ G) − P(F ∩ G)
+ P(E ∩ F ∩ G)
Example: two overlapping groups. 80% of students have Facebook or Twitter; 60% have Facebook and 25% Twitter. Both? 0.80 = 0.60 + 0.25 − P(both), so P(both) = 0.05.
Example: three courses. 100 students: 65 in Prob, 45 in LA, 40 in COMP; 30 in Prob and LA, 25 in Prob and COMP, 20 in LA and COMP; 10 in all three.
- In at least one: 65 + 45 + 40 − 30 − 25 − 20 + 10 = 85. In none: 15, so P(none) = 0.15.
- In exactly one: Prob only = 65 − 30 − 25 + 10 = 20 (the +10 restores the all-three students, who were subtracted twice); LA only = 45 − 30 − 20 + 10 = 5; COMP only = 40 − 25 − 20 + 10 = 5. Total 30, P(exactly one) = 0.30.
Example: three sports. 28% watched track, 29% swimming, 19% gymnastics; 14% track and swimming, 12% swimming and gymnastics, 10% track and gymnastics; 8% all three. P(at least one) = 0.28 + 0.29 + 0.19 − 0.14 − 0.12 − 0.10 + 0.08 = 0.48, so P(none) = 0.52.
Example: bounds. If P(A) = 0.4 and P(B) = 0.7 and nothing else is known: since P(A ∪ B) ≤ 1, the addition rule gives P(A ∩ B) ≥ 0.4 + 0.7 − 1 = 0.1; since A ∩ B ⊆ A, P(A ∩ B) ≤ 0.4.
Example: working backwards. Given P(Ac ∩ Bc) = 0.1, P(A ∩ B) = 0.3, P(Bc) = 0.25. By De Morgan, P(A ∪ B) = 1 − 0.1 = 0.9. P(B) = 0.75. So P(A) = 0.9 − 0.75 + 0.3 = 0.45. Draw the Venn diagram if the algebra feels shaky.
4.3 Equally likely outcomes: probability by counting
P(E) = outcomes in EN = |E||S|
Three ways to sample two people from 900 (600 Democrats, 300 Republicans):
- Without replacement, keeping order: 900 · 899 outcomes, each equally likely.
- Without replacement, ignoring order: (9002) outcomes, each equally likely. Fine for any question that only depends on who was picked, since each pair corresponds to exactly two ordered outcomes.
- With replacement: 9002 ordered outcomes, each equally likely. Keep the order here: an unordered pair {x, y} with x ≠ y arises two ways but {x, x} only one way, so unordered outcomes would not be equally likely.
Example: ordered and unordered agree. 10 students, 6 first-years and 4 sophomores; pick 3 at random. P(1 first-year and 2 sophomores)?
Example: voters. 40 voters: 20 D, 15 R, 5 I. Pick 3 without replacement. P(no Independents) = (353)/(403) = 6545/9880 ≈ 0.6624. P(one of each) = (20 · 15 · 5)/9880 ≈ 0.1518.
Example: deer. 300 deer, 100 tagged. Pick 3 without replacement. P(at most 1 tagged) = [(2003) + (1001)(2002)] / (3003) ≈ 0.7415. Answers built from (2/3)3 would treat the draws as independent, which is wrong without replacement.
Example: prizes. 120 guests, 6 prizes drawn at random. P(you win) = 6/120. Counting confirms it: (1195)/(1206) = 6/120. With n guests and k prizes: k/n.
Example: difference divisible by 4. Pick m then n with replacement from 5 to 14 (100 ordered outcomes). |m − n| is a multiple of 4 when the difference is 0 (10 outcomes), 4 (12 outcomes), or 8 (4 outcomes). P = 26/100 = 13/50.
4.4 "At least one": use the complement
Birthday problem. n people, 365 equally likely birthdays. P(some two share) = 1 − P(all different), and
P(all different) = 365365 · 364365 · 363365 ··· 365 − n + 1365
| n | P(at least one shared birthday) |
|---|---|
| 5 | 0.0271 (so P(no match) = 0.9729) |
| 22 | 0.4757 |
| 23 | 0.5073, the first n above 50% |
| 100 | 0.9999997 |
- Flags. One of 27 flags is chosen on each of 3 days. P(the Dutch flag appears at least once) = 1 − (26/27)3 ≈ 0.1070.
- Shoes. 10 pairs, choose 8 shoes at random. P(no complete pair) = (108) · 28 / (208) ≈ 0.0915: choose which 8 pairs contribute one shoe, then left or right from each.
- Lottery repeat. A 6-of-42 lottery has N = (426) = 5,245,786 combinations. P(the next draw matches a fixed one) = 1/N. P(some pair of draws matches among m draws) is a birthday problem with N "birthdays", and crosses 50% at about m = 2697 draws. A specific coincidence is rare; some coincidence is not.
4.5 Poker hands
5 cards from 52: (525) = 2,598,960 equally likely hands. A full house is three of one denomination plus two of another. Build it in the order you would describe it: the triple's denomination (13), its suits (43) = 4, the pair's denomination (12), its suits (42) = 6. Favorable = 13 · 4 · 12 · 6 = 3744, P ≈ 0.00144.
4.6 Check yourself
Answer
The six numbers add to 1.1, so P(S) ≠ 1: Axiom 2 fails (via Axiom 3). Each number alone satisfies Axiom 1.Answer
0.7, then 1 − 0.7 = 0.3, then 0.5 − 0.2 = 0.3.Answer
Union = 90 + 70 + 50 − 30 − 20 − 15 + 10 = 155. None = 45, P = 0.225.Answer
Four aces plus any one of the other 48 cards: 48/(525) ≈ 0.0000185.Answer
(122)(182)/(304) = 10,098/27,405 ≈ 0.3685.Answer
1 − (5/6)4 ≈ 0.5177.Answer
(12 · 11 · 10 · 9 · 8 · 7 · 6 · 5)/128 ≈ 0.0464.Answer
F = E ∪ (F ∩ Ec) disjointly, so 0.5 − 0.3 = 0.2.Answer
One defective (10 ways), and the other 4 are either 3 iPads + 1 Samsung ((403) · 30 = 296,400) or 4 iPads ((404) = 91,390). Total 10 · 387,790 over (805) = 24,040,016, ≈ 0.1613.5. Conditional probability
The idea. Learning something changes probabilities. "The probability of E given that F happened" is written P(E | F). Once you know F happened, F becomes your new, smaller sample space. That single picture explains every formula in this section.
5.1 Definition
P(E | F) = P(E ∩ F)P(F)
Top: the part of F where E also happens. Bottom: the size of the new sample space F.P(E | F) = outcomes in E ∩ Foutcomes in F
The denominator is the number of outcomes in F, not in S.Example: a table.
| In-state | Out-of-state | Total | |
|---|---|---|---|
| Statistics major | 52 | 18 | 70 |
| Other major | 15 | 15 | 30 |
| Total | 67 | 33 | 100 |
Pick a student at random. P(in-state) = 67/100. Told the student is a Statistics major, only that row matters: P(in-state | Statistics) = 52/70. Told "other major": 15/30 = 1/2.
Example: two children. Outcomes {BB, BG, GB, GG}, equally likely. A = at least one girl = {BG, GB, GG}. B = both girls = {GG}. P(B | A) = P(GG)/P(A) = (1/4)/(3/4) = 1/3. Reduced sample space: three outcomes have at least one girl, one of them is GG.
Example: two hearts. Two cards without replacement. B = both hearts, A = at least one heart. Hands with at least one heart: (522) − (392) = 1326 − 741 = 585. Hands with two hearts: (132) = 78. P(B | A) = 78/585 = 2/15.
Example: divisibility. Pick an integer from 1 to 60. A = divisible by 4 or by 9, B = divisible by 3. Given B, the sample space is the 20 multiples of 3. Of those, A means divisible by 12 or by 9: 5 multiples of 12, 6 multiples of 9, 1 multiple of both (36). |A ∩ B| = 5 + 6 − 1 = 10, so P(A | B) = 10/20 = 1/2.
5.2 The multiplication rule: probability of a chain
P(E1 ∩ E2 ∩ E3) = P(E1) · P(E2 | E1) · P(E3 | E1 ∩ E2)
and so on for any number of events. First E1 happens; then E2, given E1; then E3, given both.- Two draws. 50 students, 20 love probability. Pick 2 without replacement. P(both love it) = (20/50)(19/49) ≈ 0.1551. Same as (202)/(502).
- Two exams. P(pass first) = 0.9, P(pass second | passed first) = 0.8. P(pass both) = 0.72.
- Four draws. 8 red and 6 blue candies drawn one at a time without replacement. P(blue, red, red, blue) = (6/14)(8/13)(7/12)(5/11) ≈ 0.0699. Each fraction is what is left in the box at that moment.
5.3 Splitting into cases
P(E) = P(E ∩ F) + P(E ∩ Fc) = P(E | F) P(F) + P(E | Fc) P(Fc)
Either F happens or it does not, and the two cases do not overlap.Example: emailing a student. Two course sections, each chosen with probability 1/2. Section 1 is 30% actuarial students, Section 2 is 50%. An actuarial student replies with probability 0.30 in Section 1 and 0.80 in Section 2; other students never reply.
- P(Section 1 and a reply): a reply needs an actuarial student, so multiply along the chain: (1/2)(0.30)(0.30) = 0.045.
- P(reply): add the two sections. Section 2 gives (1/2)(0.50)(0.80) = 0.20. Total 0.045 + 0.20 = 0.245.
Example: a screening test. 1% of babies have a condition. The test is positive for 90% of affected babies and for 5% of unaffected babies. P(positive) = (0.01)(0.90) + (0.99)(0.05) = 0.0585.
5.4 Conditioning on the wrong thing
- Multiplying P(A) · P(B) for two events only works if they are independent. Two crib deaths in one family are not independent (shared genes and home), so 1/8500 × 1/8500 was the wrong calculation in a real court case.
- P(partner is the killer | woman was abused) is small, about 1 in 2500. But once the woman has been murdered, the relevant number is P(partner is the killer | abused and murdered). Out of 100,000 abused women, about 40 are killed by the partner and about 5 by someone else, so that probability is about 40/45 ≈ 89%. The extra condition changes everything.
5.5 Check yourself
Answer
F = {(2,6),(3,5),(4,4),(5,3),(6,2)}. One of the five has a 3 first: 1/5.Answer
50 evens; even and divisible by 5 means divisible by 10: 10 of them. 10/50 = 0.2.Answer
(5/8)(4/7)(3/6) = 5/28 ≈ 0.1786.Answer
P(A ∩ B) = 0.30. P(B) = 0.30 + (0.4)(0.2) = 0.38.Answer
(13/52)(12/51)(11/50) ≈ 0.0129.Answer
11 outcomes contain a 6. Sum 8 among them: (2,6), (6,2). P = 2/11.Answer
All three. E may take up a bigger, smaller, or equal share of F compared with its share of S. "Equal" is what independence means (section 6).Answer
Thursday and Friday must both be other flags: (26/27)2 ≈ 0.9273.6. Just in case: total probability, Bayes, independence
These were taught in the two classes before the exam but are officially on Midterm 2. They are short extensions of section 5. Learn 6.1 at minimum.
6.1 Law of total probability
P(E) = P(E | F1) P(F1) + ··· + P(E | Fn) P(Fn)
Each case's conditional probability, weighted by how likely that case is.- Triage. 15% of patients are critical (50% die), 45% serious (20% die), 40% stable (2% die). P(die) = 0.075 + 0.09 + 0.008 = 0.173. P(survive) = 0.827.
- Voting. 45% independents (30% vote), 30% Democrats (50%), 25% Republicans (60%). P(voted) = 0.135 + 0.15 + 0.15 = 0.435.
- Spam. 85% of email is spam. "Free money" appears in 10% of spam and 1% of the rest. P(phrase) = 0.085 + 0.0015 = 0.0865.
- Mammogram. P(cancer) = 0.008, P(+ | cancer) = 0.9, P(+ | no cancer) = 0.07. P(+) = 0.0072 + 0.0694 = 0.0766.
6.2 Bayes' formula: flipping the condition
P(F | E) = P(E | F) P(F)P(E) = P(E | F) P(F)P(E | F) P(F) + P(E | Fc) P(Fc)
Top: the case you care about. Bottom: the total probability of the evidence.- Mammogram. P(cancer | +) = 0.0072/0.0766 ≈ 0.094. Only 9%, because the false positives from the large healthy group outnumber the true positives.
- Screening test. P(condition) = 0.01, positive for 90% of affected and 5% of unaffected. P(condition | +) = 0.009/0.0585 ≈ 0.154.
- Rare disease, near-perfect test. P(disease) = 0.0001, sensitivity 0.999, false-positive rate 0.0001. P(disease | +) = 0.0000999/(0.0000999 + 0.00009999) ≈ 0.50. A positive result is a coin flip.
- Noisy channel. A 0 or 1 is sent with equal probability. A sent 0 flips with probability 0.05, a sent 1 with 0.10. P(sent 1 | received 1) = (0.5)(0.9)/[(0.5)(0.9) + (0.5)(0.05)] = 0.45/0.475 ≈ 0.947.
Chained milestones. P(A2 | A1) = 0.8, P(A2 | A1c) = 0.3, and the same for A3 given A2; only the most recent milestone matters. Then P(A3 | A1) = (0.8)(0.8) + (0.3)(0.2) = 0.70, P(A3 | A1c) = (0.8)(0.3) + (0.3)(0.7) = 0.45, and with P(A1) = 0.75, P(A3) = (0.75)(0.70) + (0.25)(0.45) = 0.6375.
6.3 Independence
- Two coin tosses, E = first is H, F = second is T: P(E ∩ F) = 1/4 = (1/2)(1/2). Independent.
- One card, E = club, F = a 6: P(E ∩ F) = 1/52 = (1/4)(1/13). Independent.
- Two dice, F = first die is 4. E1 = sum is 6: P(E1 ∩ F) = 1/36 but P(E1)P(F) = (5/36)(1/6). Not independent. E2 = sum is 7: P(E2 ∩ F) = 1/36 = (6/36)(1/6). Independent.
- If E and F are independent, so are E and Fc.
- Three events are independent if every pair multiplies and P(E ∩ F ∩ G) = P(E)P(F)P(G).
Four friends, one flat tire. Each independently names which of four tires went flat. Two pick uniformly (1/4 each). One favors left tires (1/3 each, 1/6 for right); one favors right (the reverse). P(all four name the same tire) = 4 tires × (1/4)(1/4)(1/3)(1/6) = 1/72, since for every tire the two biased friends contribute 1/3 · 1/6 either way.
5 before 7. Roll two dice repeatedly. P(a sum of 5 appears before a sum of 7) = P(5)/(P(5) + P(7)) = (4/36)/(10/36) = 0.4. Rolls that are neither are ignored; only the first decisive roll counts.
7. Exam strategy
7.1 Four questions before you compute
- What is the sample space, and are outcomes equally likely? If you use |E|/|S|, count both at the same level (ordered with ordered, unordered with unordered).
- Does order matter? Swapping two items: new outcome or not? Permutation or combination.
- With or without replacement? With: powers like 273 or (26/27)3. Without: shrinking fractions like (20/50)(19/49), or binomial coefficients.
- Is the complement easier? "At least one", "no two the same", "not both": compute the opposite and subtract from 1.
7.2 Multiple-choice tactics
- Interval answers: compute to 4 decimals, then check whether the endpoints are included. (0.8, 0.85) excludes both; (0.1, 0.2] includes 0.2.
- Formula answers: check the pieces. Right denominator? Groups labeled or not? Are all the cases added ("at most 1" = 0 + 1)?
- Sanity limits: probabilities are in [0, 1]; P(E ∩ F) ≤ min(P(E), P(F)); P(E ∪ F) ≥ max(P(E), P(F)); an added condition can only lower a probability.
- Set questions: test concrete outcomes or write the eight-row yes/no table.
- Time: about 3.5 minutes per question. Every question is worth the same; skip and come back.
7.3 The traps
| Trap | Correct thinking |
|---|---|
| Dividing by 3! when splitting into three groups with different jobs | Named groups: plain multinomial, no 3!. |
| Using (2/3)3-style answers for draws without replacement | Draws without replacement are not independent: binomials or shrinking fractions. |
| Forgetting + P(E ∩ F ∩ G) | Singles − pairs + triple. |
| "At least one girl" giving 1/2 | Reduced space has 3 outcomes: 1/3. |
| Dividing by |S| in a conditional | Given F, divide by the number of outcomes in F. |
| Writing (E ∪ F)c as Ec ∪ Fc | Complement swaps the operation: Ec ∩ Fc. |
| Confusing disjoint with independent | Disjoint: cannot both happen. Independent: one does not affect the other. |
| Treating {0, 1, 2} heads as equally likely | Go back to {HH, HT, TH, TT}. |
| Computing 365! on the calculator | Multiply the fractions one at a time. |
| Mixing up (1 − a/n)n and a fixed base | Moving base → e−a. Fixed base below 1 → 0. |
8. Practice exams
Part A is the practice midterm posted for the course, with worked answers. Part B is a new set in the same style. Do each part in 50 minutes with only a calculator, then read every solution, including the ones you got right. The real exam will not just be variants of these, so focus on the reasoning.
8.1 Part A: the posted practice midterm
Answer
e−2 ≈ 0.1353. (A) (0.1, 0.2].Answer
P(at least one) = 0.28 + 0.29 + 0.19 − 0.14 − 0.12 − 0.10 + 0.08 = 0.48. P(none) = 1 − 0.48 = 0.52. (E) (0.5, 0.6].Answer
Equally likely unordered samples: (3003). Favorable: 0 tracked, (2003); or 1 tracked, (1001)(2002). (D) [(2003) + (1001)(2002)] / (3003) ≈ 0.7415. Options with (2/3)3 treat the draws as independent, which is wrong without replacement; option E forgets the (2002) factor; option B counts tracked deer only.Answer
Three labeled groups (different jobs): (A) (9030, 30, 30) = 90!/(30!)3. No 3! anywhere.Answer
Total seatings 8!. Favorable: choose the dogs' side (2), seat dogs there (4!), seat cats on the other side (4!). (C) 2(4!)2/8! ≈ 0.0286.Answer
Bc ∩ Cc says neither B nor C happens; then A ∪ B forces A and A ∪ C forces A. (B) A ∩ Bc ∩ Cc.Answer
Term n is (1/3)(1/3)n(1/16)n = (1/3)(1/48)n. Sum over n ≥ 1: (1/3) · (1/48)/(1 − 1/48) = (1/3)(1/47) = 1/141 ≈ 0.0071. None of the printed intervals contain this value (they all start at 0.1), so the options on the posted practice exam appear to have a typo. The method is what matters: factor out the common part, find the ratio, use a/(1 − a).Answer
210 − 28 = 1024 − 256 = 768. (D) (600, 800].Answer
Total labeled splits: 9!/(3!)3 = 1680. Favorable: send the 3 seniors to the 3 groups one each (3! ways), same for juniors (3!) and sophomores (3!): 216. P = 216/1680 ≈ 0.1286. (E) (0.1, 1.0].Answer
e−3 ≈ 0.0498. (B) (0.03, 0.07].Answer
(365 · 364 · 363 · 362 · 361)/3655 ≈ 0.9729. (E) (0.95, 1).Answer
(85) − (63) = 56 − 20 = 36. (C) (30, 45].8.2 Part B: a second exam
Answer
e−1.5 ≈ 0.2231 → (0.2, 0.3].Answer
Geometric starting at n = 2: 0.62/(1 − 0.6) = 0.36/0.4 = 0.9 → (0.8, 0.9].Answer
Letters: strings with an A among 3 distinct letters = 3 · 25 · 24 = 1800 out of 26 · 25 · 24 = 15,600, so 3/26. Digits: 4/10 by the same logic. The letter part and digit part are chosen independently, so multiply: (3/26)(4/10) ≈ 0.0462.Answer
Distributive law: A ∩ (B ∪ Bc) = A ∩ S = A. In words: "A with B" or "A without B" is just A.Answer
6 letters: P×3, E×2, R×1. 6!/(3! 2! 1!) = 60.Answer
Total (114) = 330. Complement: 0 women (54) = 5; 1 woman 6 · (53) = 60. So 330 − 65 = 265 favorable, P = 265/330 ≈ 0.8030 → (0.8, 0.85).Answer
A only = 0.5 − 0.2 − 0.15 + 0.05 = 0.20; B only = 0.4 − 0.2 − 0.1 + 0.05 = 0.15; C only = 0.3 − 0.15 − 0.1 + 0.05 = 0.10. Total 0.45. (Also: union = 1.2 − 0.45 + 0.05 = 0.80, so P(none) = 0.20.)Answer
1 − (12 · 11 · 10 · 9)/124 = 1 − 11,880/20,736 ≈ 1 − 0.5729 = 0.4271 → (0.4, 0.5].Answer
Unlabeled equal-size groups: 12!/((4!)3 3!) = 5775. The labeled count 34,650 overcounts each split 3! times.Answer
Sum ≥ 10: (4,6),(5,5),(6,4),(5,6),(6,5),(6,6), six outcomes. Doubles among them: (5,5),(6,6). P = 2/6 = 1/3.Answer
(7/12)(5/11)(6/10) = 210/1320 ≈ 0.1591.Answer
Each number is in [0, 1] (Axiom 1 fine), but by Axiom 3 P(S) = 0.5 + 0.3 + 0.3 = 1.1 ≠ 1, so Axiom 2 is violated (the assignment is inconsistent with Axioms 2 and 3 together).Answer
(ii). The two pair denominations are interchangeable, so choose them together: (132) (13 · 12 double counts). Suits: (42) each. Fifth card: any of the 44 cards not of those two denominations (48 would allow a full house). Value ≈ 0.0475.Answer
S = {0, 1, 2, 3}, four outcomes, not equally likely: P = 1/8, 3/8, 3/8, 1/8, because 1 head can occur in 3 of the 8 ordered sequences.Answer
At least 3 tosses but fewer than 5: exactly 3 or 4 tosses: {HHT, HHHT}.9. One-page summary
Read this the night before and again right before the exam.