Drawing at random

Before thisread these first

After thiswhat you will be able to doTurn a finite list of shares into one random draw, and multiply probabilities only after checking that the draws are independent.

Questionwhat this lesson answersA list of shares says what could happen and how much of the total each outcome holds. How do you get one actual outcome out of it, and when does the chance of several outcomes together become a multiplication?

Not coveredwhat this lesson leaves outWe build one draw, then many. We do not derive how a machine produces an even draw in the first place. We do not prove that repeated tallies must settle toward the shares. We do not say how many draws it takes to measure an unknown share, which is the lesson on telling a real difference from noise.

You have a list of shares. North holds 0.5, east 0.25, south 0.15, west 0.1. The list tells you what could happen and how much of the total each outcome holds.

Now you need one actual direction. Not a share, a direction. Nothing said so far gets you there. A share is a number attached to an outcome, and it is not an outcome.

Laying the shares along a line

Draw a line from 0 to 1. Give each outcome a stretch of that line as wide as its share, laid end to end in order.

North runs from 0 to 0.5. East runs from 0.5 to 0.75. South runs from 0.75 to 0.9. West runs from 0.9 to 1. The four stretches cover the line exactly once, with no gap and no overlap, because the shares add to one.

Now take one number from between 0 and 1, with no part of that range favoured over any other. That is an even draw, and it is the one thing this lesson takes as given rather than builds.

The drawn number lands in exactly one stretch. That stretch names the outcome.

Try it by hand. Draw 0.31 and you land in north. Draw 0.62 and you land in east. Draw 0.91 and you land in west. Draw 0.75 and you land in south, because a number landing exactly on a boundary belongs to the stretch that starts there. Somebody has to decide that case, and this is the decision.

One draw, one outcome

Each outcome owns a stretch of the line as wide as its share. A number drawn evenly between 0 and 1 lands in exactly one stretch.

north0.500
east0.250
south0.150
west0.100

No draw yet.

How often each outcome has come up across 0 draws
OutcomeShareTimesOf all draws
north0.5000-
east0.2500-
south0.1500-
west0.1000-

The same chance, many times over

Each step succeeds with the chance below, and every step is independent of the others. Only then do the chances multiply.

Chance that every step succeeds
StepsAll succeed
199%
1090.4%
5060.5%
10036.6%
20013.4%
7000.1%

At 0.990 per step, 10 steps still succeed 90.4% of the time. Push the count up and watch a chance that looked like a near certainty stop being one.

Notice what has been arranged rather than discovered. North comes up half the time because north was given half the line. The construction was built to make that true. It is not a finding about the world.

Repeating the draw

One draw is a trial. Do it again and you may well get something else.

This is where intuition needs correcting. A share of 0.5 does not mean the outcomes alternate. Four norths in a row is not evidence that anything is broken, and it is not evidence that west is now due. The stretches do not move between draws. Each draw meets the same four as the one before.

Press the island’s button fifty times and the tally will drift toward the shares. Press it four times and it may not resemble them at all.

Independence

Two draws are independent when knowing how the first came out tells you nothing about how the second will.

Drawing again from the same unchanged list is independent. The stretches did not move.

Now take a bag of ten tickets, four of them marked, and draw two without putting the first back. These are not independent. If the first came out marked, only three marked tickets remain among nine, so the second draw faces different shares. Knowing the first result changed what you should expect from the second.

The failing case is the one to watch. Independence gets assumed silently, and it is false more often than people notice.

Why independent chances multiply

Take two draws, each with two outcomes: success with chance 0.9, failure with chance 0.1.

Write out all four combinations and how often each turns up. Success then success happens 0.9 of the time on the first draw, and of those, 0.9 again on the second. So it happens

0.9×0.9=0.810.9 \times 0.9 = 0.81

of the time. The other three combinations account for 0.09, 0.09 and 0.01, and those four add to 1, which is the check that nothing was lost.

The multiplication came out of the counting. It works because the second draw’s shares did not depend on how the first came out. That is what independence means, and if it fails, this arithmetic says nothing at all.

Extend it to more draws and each one contributes another factor. For n{n} independent attempts each succeeding with chance p{p}, all of them succeed with chance

p×p××pn factors=pn.\underbrace{p \times p \times \cdots \times p}_{n \text{ factors}} = p^{n}.

A near certainty is not a certainty

Suppose each of ten positions is filled correctly with chance 0.99. That is a very good chance. All ten together:

0.99100.9044.0.99^{10} \approx 0.9044.

Ten steps have turned a 99 percent chance into a 90 percent chance. Now suppose two hundred steps each avoid a stumble with chance 0.97:

0.972000.0023.0.97^{200} \approx 0.0023.

A 97 percent chance per step has become roughly one run in four hundred and forty. Nothing went wrong at any individual step. The steps simply accumulated.

Both of those numbers depend entirely on the steps being independent. If a mistake at one step makes the next more likely to go wrong, the product is not the answer, and the true chance is usually worse rather than better.

What this does not tell you

It does not tell you the shares were right. The whole construction takes them as given, and a list of shares that does not match how often things really happen will produce draws that are faithful to the list and wrong about the world.

It does not tell you how many draws you need to pin down a share you do not already know. Ten trials will not do it, and the reason is the subject of telling a real difference from noise, later in this topic.

Doorswhat to read next, and why

Symbolswhat each one means, and whether we defined it, measured it, or just started there

an even draw between 0 and 1Status: bottoms out
One number taken from between 0 and 1 with no part of that range favoured. Everything in this lesson is built on top of it, and nothing here builds it. It is where this lesson starts.
the stretch an outcome ownsStatus: defined
Each outcome is defined to own a length of the line from 0 to 1 equal to its share, laid end to end so the stretches cover the line exactly once.
an outcome arrives as often as its stretch is wideStatus: defined
This follows from the construction rather than being a discovery. The stretch was built to that width, so a draw lands in it that often by design.
a trialStatus: defined
One draw is defined as a trial. The word says nothing about what the outcome was or whether it was the one you wanted.
two draws being independentStatus: defined
Two draws are defined as independent when knowing how the first came out tells you nothing about how the second will.
whether two particular draws are independentStatus: empirical
Whether any two real draws actually satisfy that condition is a claim about the world that can be false, and it usually is the thing that turns out to be wrong.
multiplying the chances togetherStatus: defined
The chance that several attempts all succeed is defined as the product of their separate chances, and that definition is only correct when the attempts are independent.
What these classifications mean
defined
circular by construction, true because we chose it
empirical
a measured claim about the world that could have come out otherwise
bottoms out
a primitive of the model, with nothing under it here
door
used here, explained elsewhere