Currently working on this (August 13, 2026)
Recognition of insufficiency during generative reasoning
The broader phenomenon is awareness of unawareness: an agent can become sensitive that something relevant may be missing before it knows what is missing. The current target is narrower:
What signals during ongoing reasoning lead an agent to recognize that the possibilities currently available may be insufficient?
Three working objects (abstractions, not brain modules):
Gt (generative reasoning): the processes that determine which candidate possibilities become available and how they change during reasoning.
Ct (currently available possibilities): what is on the table right now. A possibility can be fully specified, partial, vague, or weakly activated. Ct is not assumed to be a literal discrete set.
At (recognition of insufficiency): the metacognitive sensitivity that what is currently available may not be enough. This is the central target.
At is a working target rather than an assumed cognitive module or established distinct state. An initial empirical question is whether recognition of insufficiency can be distinguished from uncertainty, low confidence, impasse, and related states.
At ⇏ c* ∈ Ct
Recognition can happen before the missing possibility is known.
Uncertainty vs insufficiency
Uncertainty: I have plausible alternatives, but I do not know which is correct. The uncertainty concerns alternatives that are already represented.
Recognition of insufficiency: I have reason to suspect that what is currently available may not contain what I need.
What At is not
Recognition of insufficiency is different from simply making an error, low confidence, uncertainty between two represented alternatives, being stuck, already knowing the missing alternative, and an automatic strategy switch. Those can be signals, correlates, causes, or consequences of At, but they are not the thing itself.
Recognition vs control response
At is not defined by what it triggers. Given recognition, the control response can vary:
At ⟶ continue · retrieve · generate alternatives · reframe · search externally · nothing
Which response wins (including committing anyway) is a downstream question about costs and task demands, not the definition of At.
The reasoning trajectory (Clusterwords)
Clusterwords (the game on the home page) lets us observe something richer than commit-versus-don't-commit:
C0 ⟶ C1 ⟶ C2 ⟶ ⋯
Possibilities are generated, partially formed, refined, abandoned, recombined, and sometimes recognized as inadequate. Suppose the board hides EAGLE, BIRDIE, BOGEY, PAR:
"these feel related" ⟶ "these four belong together somehow" ⟶ "golf-related" ⟶ "golf scoring terms"
The question is no longer where exactly this becomes a hypothesis. It is: how does this possibility evolve inside Ct, and what does its evolution tell the reasoner about whether what is currently available is adequate? The guesses give observable anchors in that trajectory; the trajectory is the gold.
See more
Bounded agent
A bounded agent cannot consider every possible explanation, action, or future consequence due to limited resources.
How the framing evolved history
Version A: a literal hypothesis set.
ℋt = {h₁, h₂, h₃}, P(h* ∉ ℋt) > 0
"How do I know h* isn't in my set?"
Version B: but what even counts as h? Can hypotheses be partial?
h = these four share r, r = ?
Current: don't require a literal hypothesis set.
Gt ⟷ Ct ⟶ At
Possibilities of different degrees of specification become available during generative reasoning. The project studies what signals tell the reasoner that what is currently available may be insufficient, without first solving where a hypothesis begins.
Questions we still need to answer (Ct: what's on the table)
- What is the representational object? Is it a rule, causal model, gist, category, explanation, structured relation?
- Can it be incomplete or coarse? Can the person have "something about these belongs together" without the full explanation?
- Can that partial representation guide a deliberate decision?
- Can it later be refined while preserving earlier content?
- When does the literature treat it as the same representation becoming more specific versus a new hypothesis replacing the old one?
- What behavioral evidence shows that the representation is actually available to the person?
- What counts as a currently available possibility in a language model? Must a possibility have been explicitly generated into context by the time of a decision, or can an unexpressed internal representation count as available?
Open questions (At: recognizing insufficiency)
- How do humans recognize that the possibilities currently available during reasoning may be insufficient?
- What information in the dynamics of ongoing reasoning provides evidence that the currently available possibilities may not be enough?
- How does a reasoner distinguish "I have not solved this yet" from "what I currently have may itself be insufficient"?
- Can recognition of insufficiency occur before a reasoner can identify what possibility is missing?
- Does recognition of insufficiency depend on a single diagnostic signal, or on the integration of multiple signals over time?
- How do failure, confidence, progress, retrieval, and changes in candidate possibilities contribute to recognition of insufficiency?
- Does the history of reasoning matter (repeated failure, repeated return to the same possibilities), or is the current reasoning state sufficient?
- How does the partial development of a possibility affect judgments of insufficiency? Does a vague but promising possibility feel different from no promising possibility at all?
- When a useful possibility has failed to enter consideration, are there detectable signatures in the reasoning process before that possibility is eventually discovered?
- Can a computational model predict when a person will conclude that their currently available possibilities may be insufficient?
- Can that model distinguish recognition of insufficiency from low confidence, difficulty, retrieval failure, conflict, or simply needing more time?
- What causes recognition of insufficiency to change subsequent reasoning? Does it lead to more search, different search, refinement of partial possibilities, retrieval, or representational change?
- When does additional search reflect recognition of insufficiency rather than ordinary persistence?
- Do people differ systematically in their ability to recognize insufficiency, and do those differences predict successful discovery of previously unconsidered possibilities?
- Does experience with a task change recognition of insufficiency by changing which possibilities become available, by changing how their adequacy is monitored, or both?
- Do contemporary machine reasoners recognize when their currently available possibilities may be insufficient, or do they primarily continue evaluating and elaborating what they have already generated?
- When humans and machines fail because a useful possibility never entered consideration, do they show different signatures before the failure?
- Do machines use signals analogous to those that predict recognition of insufficiency in humans?
- Can a computational mechanism derived from human recognition of insufficiency predict machine failures that confidence alone cannot?
- Can introducing such a mechanism improve a machine reasoner's ability to change its search when its currently available possibilities are inadequate?
Papers closest to the center right now
- Thomas, Dougherty, Sprenger & Harbison, Diagnostic hypothesis generation and human judgment. Psychological Review, 2008.
- Dasgupta, Schulz & Gershman, Where do hypotheses come from?. Cognitive Psychology, 2017.
- Zhang, Langenkamp, Kleiman-Weiner, Oikarinen & Cushman, Similar failures of consideration arise in human and machine planning. Cognition, 2025.
- Ackerman & Thompson, Meta-reasoning: Monitoring and control of thinking and reasoning. Trends in Cognitive Sciences, 2017.
- Schulz, Fleming & Dayan, Metacognitive computations for information search: Confidence in control. 2023.
- Gronau, Steyvers & Brown, How do you know that you don't know?. Cognitive Systems Research, 2024.
- Glucksberg & McCloskey, Decisions about ignorance: Knowing that you don't know. 1981.
- Knoblich, Ohlsson, Haider & Rhenius, Constraint relaxation and chunk decomposition in insight problem solving. 1999.
- Ross & Arfini, Impasse-driven problem solving: The multidimensional nature of feeling stuck. 2024.
- LeGris, Lake & Gureckis, Predicting insight during physical reasoning. 2024.
- Halpern & Rêgo, Reasoning about knowledge of unawareness. 2009.
- Kang, Agranov, Nielsen & Sarnoff, Do individuals treat their posterior beliefs as sufficient statistics?. 2026.
- Qin et al., Hypothesis generation and inductive inference in children and language models. 2026.