Drawing at random
Before thisread these first
After thiswhat you will be able to doTurn a finite list of shares into one random draw, and multiply probabilities only after checking that the draws are independent.
Questionwhat this lesson answersA list of shares says what could happen and how much of the total each outcome holds. How do you get one actual outcome out of it, and when does the chance of several outcomes together become a multiplication?
Not coveredwhat this lesson leaves outWe build one draw, then many. We do not derive how a machine produces an even draw in the first place. We do not prove that repeated tallies must settle toward the shares. We do not say how many draws it takes to measure an unknown share, which is the lesson on telling a real difference from noise.
You have a list of shares. North holds 0.5, east 0.25, south 0.15, west 0.1. The list tells you what could happen and how much of the total each outcome holds.
Now you need one actual direction. Not a share, a direction. Nothing said so far gets you there. A share is a number attached to an outcome, and it is not an outcome.
Laying the shares along a line
Draw a line from 0 to 1. Give each outcome a stretch of that line as wide as its share, laid end to end in order.
North runs from 0 to 0.5. East runs from 0.5 to 0.75. South runs from 0.75 to 0.9. West runs from 0.9 to 1. The four stretches cover the line exactly once, with no gap and no overlap, because the shares add to one.
Now take one number from between 0 and 1, with no part of that range favoured over any other. That is an even draw, and it is the one thing this lesson takes as given rather than builds.
The drawn number lands in exactly one stretch. That stretch names the outcome.
Try it by hand. Draw 0.31 and you land in north. Draw 0.62 and you land in east. Draw 0.91 and you land in west. Draw 0.75 and you land in south, because a number landing exactly on a boundary belongs to the stretch that starts there. Somebody has to decide that case, and this is the decision.
One draw, one outcome
Each outcome owns a stretch of the line as wide as its share. A number drawn evenly between 0 and 1 lands in exactly one stretch.
No draw yet.
| Outcome | Share | Times | Of all draws |
|---|---|---|---|
| north | 0.500 | 0 | - |
| east | 0.250 | 0 | - |
| south | 0.150 | 0 | - |
| west | 0.100 | 0 | - |
The same chance, many times over
Each step succeeds with the chance below, and every step is independent of the others. Only then do the chances multiply.
| Steps | All succeed |
|---|---|
| 1 | 99% |
| 10 | 90.4% |
| 50 | 60.5% |
| 100 | 36.6% |
| 200 | 13.4% |
| 700 | 0.1% |
At 0.990 per step, 10 steps still succeed 90.4% of the time. Push the count up and watch a chance that looked like a near certainty stop being one.
Notice what has been arranged rather than discovered. North comes up half the time because north was given half the line. The construction was built to make that true. It is not a finding about the world.
Repeating the draw
One draw is a trial. Do it again and you may well get something else.
This is where intuition needs correcting. A share of 0.5 does not mean the outcomes alternate. Four norths in a row is not evidence that anything is broken, and it is not evidence that west is now due. The stretches do not move between draws. Each draw meets the same four as the one before.
Press the island’s button fifty times and the tally will drift toward the shares. Press it four times and it may not resemble them at all.
Independence
Two draws are independent when knowing how the first came out tells you nothing about how the second will.
Drawing again from the same unchanged list is independent. The stretches did not move.
Now take a bag of ten tickets, four of them marked, and draw two without putting the first back. These are not independent. If the first came out marked, only three marked tickets remain among nine, so the second draw faces different shares. Knowing the first result changed what you should expect from the second.
The failing case is the one to watch. Independence gets assumed silently, and it is false more often than people notice.
Why independent chances multiply
Take two draws, each with two outcomes: success with chance 0.9, failure with chance 0.1.
Write out all four combinations and how often each turns up. Success then success happens 0.9 of the time on the first draw, and of those, 0.9 again on the second. So it happens
of the time. The other three combinations account for 0.09, 0.09 and 0.01, and those four add to 1, which is the check that nothing was lost.
The multiplication came out of the counting. It works because the second draw’s shares did not depend on how the first came out. That is what independence means, and if it fails, this arithmetic says nothing at all.
Extend it to more draws and each one contributes another factor. For independent attempts each succeeding with chance , all of them succeed with chance
A near certainty is not a certainty
Suppose each of ten positions is filled correctly with chance 0.99. That is a very good chance. All ten together:
Ten steps have turned a 99 percent chance into a 90 percent chance. Now suppose two hundred steps each avoid a stumble with chance 0.97:
A 97 percent chance per step has become roughly one run in four hundred and forty. Nothing went wrong at any individual step. The steps simply accumulated.
Both of those numbers depend entirely on the steps being independent. If a mistake at one step makes the next more likely to go wrong, the product is not the answer, and the true chance is usually worse rather than better.
What this does not tell you
It does not tell you the shares were right. The whole construction takes them as given, and a list of shares that does not match how often things really happen will produce draws that are faithful to the list and wrong about the world.
It does not tell you how many draws you need to pin down a share you do not already know. Ten trials will not do it, and the reason is the subject of telling a real difference from noise, later in this topic.
Doorswhat to read next, and why
- Sampling and decodingnot written yetThis lesson builds a draw in the abstract, but it does not show how a selection rule picks one vocabulary entry from a model's shares.
- Telling a real difference from noiseThis lesson shows that repeated draws vary. It does not say how many draws you need before a difference between two rates is a measurement rather than an impression.
- Growth by a constant factorThe chance over many steps is written as a power, and the rules for powers are built there and used here.
- Average and spreadThis lesson says repeated results vary and stops there. It does not measure how much they vary.
- A distribution fixes the totalNothing here checks that the shares were right in the first place. Whether assigned shares match long-run rates is the calibration question that lesson raises.
Symbolswhat each one means, and whether we defined it, measured it, or just started there
- an even draw between 0 and 1Status: bottoms out
- One number taken from between 0 and 1 with no part of that range favoured. Everything in this lesson is built on top of it, and nothing here builds it. It is where this lesson starts.
- the stretch an outcome ownsStatus: defined
- Each outcome is defined to own a length of the line from 0 to 1 equal to its share, laid end to end so the stretches cover the line exactly once.
- an outcome arrives as often as its stretch is wideStatus: defined
- This follows from the construction rather than being a discovery. The stretch was built to that width, so a draw lands in it that often by design.
- a trialStatus: defined
- One draw is defined as a trial. The word says nothing about what the outcome was or whether it was the one you wanted.
- two draws being independentStatus: defined
- Two draws are defined as independent when knowing how the first came out tells you nothing about how the second will.
- whether two particular draws are independentStatus: empirical
- Whether any two real draws actually satisfy that condition is a claim about the world that can be false, and it usually is the thing that turns out to be wrong.
- multiplying the chances togetherStatus: defined
- The chance that several attempts all succeed is defined as the product of their separate chances, and that definition is only correct when the attempts are independent.
What these classifications mean
- defined
- circular by construction, true because we chose it
- empirical
- a measured claim about the world that could have come out otherwise
- bottoms out
- a primitive of the model, with nothing under it here
- door
- used here, explained elsewhere