Jonah Whitcombe 7 min readThe most capable AI systems are no longer judged only by the quality of an isolated answer. They are judged by whether they can enter an incomplete situation, identify the missing variable that matters, and move the work forward without turning every exchange into an interview.
That creates a new operating problem. Ask too few questions and the system may execute the wrong interpretation with confidence. Ask too many and it transfers the burden of reasoning back to the user. The useful middle ground is a clarification budget: an explicit policy for how much uncertainty an AI may resolve by inference, how many questions it may ask, and when it must stop and escalate.
These field notes examine what changed, what the shift means in practice, and what remains unresolved.
What changed: ambiguity became an execution risk
Earlier AI use centered on bounded outputs: summarize a document, draft an email, classify a ticket. If the result was imperfect, a person revised it before anything happened. Ambiguity affected quality, but it rarely propagated directly into operations.
Agents change that equation. A system may now search internal sources, update records, generate a customer response, schedule a meeting, or trigger another workflow. The distance between interpretation and consequence has narrowed.
Consider the instruction, “Move the renewal forward.” A language model can readily produce plausible activity. An operational agent must determine what “forward” means: draft a proposal, change the opportunity stage, contact procurement, schedule an executive review, or all four. Each action is reasonable in some context. Only one may be correct here.
The important change is not that AI encounters ambiguity. People have always issued incomplete instructions. The change is that AI can now conceal ambiguity behind competent execution. A polished result may make an unverified assumption harder to detect.
The practical model: ask, infer, propose, or act
A useful agent does not treat every missing detail equally. It selects among four responses based on consequence, reversibility, precedent, and evidence.
| Mode | Use when | Example | Required control |
|---|---|---|---|
| Ask | A missing fact could materially change an irreversible or external action | Which customer entity should receive the revised contract? | Block execution until answered |
| Infer | Context strongly supports one interpretation and the result is easy to correct | Use the account’s standard reporting period in an internal draft | Record the assumption |
| Propose | The likely action is clear, but human judgment or authority is required | Prepare a renewal email and recommend sending it tomorrow | Present rationale and alternatives |
| Act | The instruction is within policy, supported by evidence, and safely reversible | Add an internal follow-up task using the team’s established template | Log the action and provide an undo path |
This model prevents a common design error: equating autonomy with fewer questions. Mature autonomy is selective. The agent asks where uncertainty is expensive and proceeds where interruption is expensive.
The clarification budget is a workflow policy
A clarification budget should not be a universal number. “Ask no more than two questions” sounds efficient, but it ignores the difference between writing an internal outline and sending a legal commitment.
Set the budget by workflow. Define the action boundary, the evidence available, and the cost of a mistaken inference. A practical policy can contain five elements:
- Permitted assumptions: facts the agent may derive from authoritative records or stable conventions.
- Mandatory questions: missing information that must stop the workflow.
- Approval gates: actions the agent may prepare but not execute.
- Reversibility rules: actions that may proceed because they can be reliably undone.
- Escalation conditions: contradictions, absent records, policy conflicts, or low-confidence entity matching.
For example, an agent supporting sales operations may infer a customer’s account owner from the CRM, draft a follow-up from the latest meeting notes, and create an internal task. It should ask before changing a committed close date if the notes conflict with the CRM. It should propose, rather than send, any message that changes commercial terms.
The budget is therefore less about conversational patience than about delegated authority.
A worked example: “Prepare the launch update”
Suppose an executive asks an agent to “prepare the launch update for leadership.” The instruction leaves several variables open: audience, launch, reporting period, format, and whether “prepare” includes distribution.
A weak system asks for all five. Another weak system silently chooses all five. A better system inspects available context before spending its clarification budget.
- It identifies the active launch from the project portfolio and checks whether another launch has a similar name.
- It finds the recurring leadership-update format and the most recent approved example.
- It compares project status, issue logs, milestones, and prior commitments.
- It detects one material conflict: the project tracker says the beta begins Monday, while meeting notes say Wednesday.
- It asks one question: “Should the update use Monday from the tracker or Wednesday from the latest meeting notes?”
Everything else can be inferred with visible attribution. The agent can produce the draft, mark unresolved facts, and refrain from distribution unless sending authority is explicit.
The distinction matters. The agent has not merely reduced the number of questions. It has performed enough investigation to ask the only question whose answer changes the substance of the brief.
Context retrieval does not eliminate clarification
More context can reduce avoidable questions, but retrieval creates its own failure modes. Internal systems often contain duplicate records, stale fields, inconsistent terminology, and documents with different authority levels.
An agent needs an evidence hierarchy. A signed agreement may outrank a CRM note for commercial terms. A current incident record may outrank a quarterly planning document for operational status. A direct executive instruction may override a reusable template, but not a compliance policy.
Without that hierarchy, retrieval produces abundance rather than understanding. The agent may find the answer and still choose the wrong source.
Teams should distinguish three conditions:
- Missing evidence: the needed fact is not available, so the agent asks.
- Conflicting evidence: credible sources disagree, so the agent surfaces the conflict and identifies the decision owner.
- Weak evidence: a likely answer exists but is not authoritative, so the agent may use it only for a reversible draft and label the assumption.
This is where “understanding” becomes operational. It is not the appearance of intuition. It is disciplined treatment of evidence under uncertainty.
Measure avoided errors and avoided interruptions
Teams often evaluate agents through task completion and output quality. Those measures miss the central trade-off. An agent can complete every task by asking the user to specify every detail. It can also appear efficient by making unsafe assumptions.
Review both sides of the ledger. Track questions that prevented material errors, questions that could have been answered from available context, assumptions that required correction, actions reversed, and escalations triggered by contradictory evidence.
Conversation logs are especially useful when classified by reason. If the agent repeatedly asks which template to use, the problem may be missing workflow configuration rather than model capability. If it repeatedly misidentifies the relevant customer, entity resolution may be the constraint. If people override correct recommendations, authority or trust may be the real issue.
The objective is not minimum interaction. It is minimum unnecessary interaction at an acceptable level of decision risk.
What remains unresolved
Several difficult questions do not have stable answers yet.
How should confidence be calibrated?
A fluent model can state an inference more strongly than the evidence warrants. Confidence must be tied to observable conditions—source authority, agreement across records, recency, and precedent—not merely to the model’s self-assessment.
Who owns an inferred preference?
Agents can learn that an executive prefers concise updates or that a team usually schedules reviews on Thursdays. But repeated behavior is not always policy. Systems need a way to separate personal preference, temporary habit, and organizational rule.
When does reversibility justify action?
An internal task can be deleted, but it may already have caused confusion. A message can sometimes be recalled, but not unread. Technical reversibility is weaker than operational reversibility. Workflow designers must account for downstream human effects.
How much should the agent reveal?
Listing every assumption overwhelms the user; hiding them impairs oversight. A practical pattern is progressive disclosure: show material assumptions and conflicts in the main response, while retaining a complete action and evidence log for review.
The operating principle
The strongest agent is not the one that always knows what the user meant. It is the one that can distinguish what it knows, what it can safely infer, and what requires a decision.
That distinction should be designed into the workflow before autonomy is expanded. Give the agent an evidence hierarchy, explicit action boundaries, approval gates, and a clarification budget matched to consequence. Then inspect not only whether it finished the task, but whether it consumed human attention where judgment was actually needed.
The emerging standard is precise: investigate before asking, ask before risking, and act without interruption only when the evidence and authority are clear.
This post was drafted with AI assistance and reviewed against our editorial policy before publication. Corrections are made at the source, on the page, with the date shown.
From our own rounds
Measured on Agent Oracle, from real sessions people played on this site — not a third-party dataset.
- Rounds played here
- 27
- Questions per round
- 1
Rate this article
Discussion
Comments are moderated. Read our editorial policy.