When is evidence worth waiting for?

A mountain festival needs a shuttle from the village to the trailhead. Reserve one bus or a three-bus fleet? Wait for fresh booking counts, or pay for a demand survey before the hire reservation expires?

Fictional festival · one review per day · illustrative net service-value points. A teaching model, not a real transport plan or budget.

Follow what the evidence makes possible

One choice now. Different choices after evidence.

The recommended route

What keeping the choice open is worth

Whole recommended policy · expected service-value points

Evidence has to arrive while a choice is still open

Best first move in this toy model

Best policy, after costs
Best commitment now
Gain from keeping options open

Less uncertainty ≠ a better decision

Isolate one fresh test, then commit. This comparison is not the multi-review optimum above: a first test can also earn its value by guiding a second test.

Expected uncertainty removedShannon bits; information alone
Gross decision value, if timelyBefore test and waiting costs
Usable for this commitment

Does the answer change which reservation is best?

One bus wins at or below 56.25% high-demand belief; three buses win above it. This isolates one survey, not the full sequential policy.

Decision → information → updated state → decision

Walk the decision, not the hidden world

Inspect the recommended route or a different feasible choice. Select a possible signal to see what the next decision can know. These are branches to explore—not evidence you have collected.

Alternatives at this information state; values include future costs, not costs already paid.
Next moveExpected valueInspect

At a commitment, this essay ends. Evidence could matter to later operations, but those decisions are outside this model.

Every path the recommended policy may take

All possible signal histories under the policy—not sampled runs. Path values are conditional expectations, not guaranteed realised outcomes.

Information receivedChanceCommit atBelief: highScopeCosts paidNet value

The tempting answer that cheats

If we optimise each future world separately, we reserve three buses for high demand and one for low demand. But at review 0 we do not know which world we are in.

One decision from today’s information
Choose after seeing the true world
Perfect-information gap

The second number is a cost-free, same-time upper bound—not an available policy. The exact solver uses only review number and current belief, never the hidden world. A signal permits different later choices only after it arrives.

The model, assumptions and limits

The mountain-festival shuttle

The organiser reviews the booking every day. At the final review the bus operator needs a binding reservation. Weekend demand will be high or low; that hidden condition is fixed during this short booking window. A three-bus fleet serves a busy festival well but wastes resources at a quiet one; one bus is less ambitious but useful in either case.

The following net service-value points combine assumed visitor benefit and bus-hire costs. They are illustrative—not fares, visitor numbers or money. Only survey fees and the cost of keeping arrangements open are subtracted separately. The one-bus option deliberately stays available until the deadline.

ReservationHigh demandLow demand
Three buses60−40
One bus255
No shuttle00

One bus always beats no shuttle in this particular table. “Stop testing” does not mean “cancel the shuttle”. Three buses beat one when the chance of high demand exceeds 56.25%. At equality, the solver prefers one bus; otherwise ties prefer committing over waiting, and routine booking evidence over a paid survey.

Powell’s five components

State S
Daily review t and belief p that demand is high; fixed model settings are known. Past evidence costs are sunk and do not affect future choices here.
Decision x
Reserve three buses / one bus / no shuttle, wait for the next booking count, or commission a fresh demand survey.
New information W
A positive (high-demand) or negative (low-demand) signal, received after the chosen wait or survey.
Transition
Advance the daily review clock and update p by Bayes’ rule; reservation terminates the decision.
Objective
Maximise expected net service value less survey fees and waiting costs, before the hire reservation expires.

What is computed

For every feasible evidence choice, the solver enumerates both possible signals, updates the belief, and solves the remaining decision. At the deadline it considers commitment only. It backs up expected values and keeps the best move. This finite tree is evaluated exactly, apart from floating-point arithmetic; there is no training, Monte Carlo sampling or claim of general policy optimality.

V(t,p) = max { best commitment(p),
  − waiting cost + Σ P(signal | p) V(t+1, posterior),
  − test fee − latency × waiting cost
       + Σ P(signal | p) V(t+latency, posterior) }
Evidence choices are included only when their result arrives by T.

Gross one-test value = expected best commitment after the signal − best commitment before it. Information gain measures expected entropy reduction. They answer different questions.

Sources, predecessor and what this essay adds

The 220 foray asks how to separate scheduled work, management decisions and uncertainty-reduction actions, then align them to an appropriate cadence. This essay isolates a missing mechanism: evidence has value through the future decisions it changes.

The earlier two-tab simulator remains available. Its DLA representative samples latent parameters and lets its future tail policy use them, without learning inside the rollout. It is an illustrative comparison, not a valid valuation of information. This separate essay supplies an exact information-respecting witness; it does not silently replace that simulator.

Read the method and verification contract · Repository