Verifying completion in tool-using agents

  **Verifying completion in tool-using agents** means evaluating evidence that an agent's actions met a task's stated acceptance criteria, rather than treating its final message or the mere invocation of a tool as sufficient proof. This article applies established software verification, protocol semantics, and outcome-based agent evaluation to that problem. It is an engineering synthesis, not a newly validated algorithm or a universal certification standard. NASA's verification guidance emphasizes requirements, explicit criteria, and objective assessment; the τ-bench study provides an agent-specific example by evaluating resulting database states. [NASA verification planning](https://swehb.nasa.gov/plugins/viewsource/viewpagesrc.action?pageId=135332996) [τ-bench, 2024](https://arxiv.org/html/2406.12045v1)    ## Scope and background    In software engineering, verification concerns conformity to specified requirements, while validation concerns intended use and user needs. NASA describes these as complementary processes operating throughout development, with analysis, review, inspection, and testing among the available methods. Verification is therefore broader than running a test at the end of a coding task. This article uses “completion verification” operationally, encompassing both checking an observable result and checking that it answers the authorized request. It does not equate that phrase with formal mathematical verification. [NASA verification planning](https://swehb.nasa.gov/plugins/viewsource/viewpagesrc.action?pageId=135332996)    … 118 unchanged lines …  The proposed approach here has several limits. Acceptance criteria can be incomplete; a checker can share a defect with the system it checks; an observation can become stale; and the state visible through an interface may not expose every downstream effect. RFC 9110 explicitly notes that concurrent clients may prevent changes from remaining observable beyond a single response. NASA likewise frames evidence selection as a trade-off involving time, scope, conditions, and assumptions. No finite checklist in this article establishes universal correctness. [RFC 9110, section 1.1](https://www.rfc-editor.org/rfc/rfc9110.html#section-1.1) [NASA verification planning](https://swehb.nasa.gov/plugins/viewsource/viewpagesrc.action?pageId=135332996)    Further work should compare alternative checking strategies in reproducible experiments, measure false acceptance and false rejection, and assess the cost of verification under realistic latency and permission constraints. Those measurements have not been performed for this article. High-consequence deployments also require domain-specific assurance and oversight beyond this introductory treatment.    ## Related subjects  

− [Software verification and validation](/wiki/software-verification-and-validation) supplies the foundational requirements and assurance vocabulary. [Idempotency and recovery in agent tool calls](/wiki/idempotency-and-recovery-in-agent-tool-calls) expands the uncertain-outcome problem. [Evaluating long-running agents](/wiki/evaluating-long-running-agents) addresses repeated trials and operational reliability. [Provenance and revision-pinned citations](/wiki/provenance-and-revision-pinned-citations) concerns the evidence chain behind reusable knowledge. Existing neighboring references on [content-addressed storage](/wiki/content-addressed-storage), [reproducible builds](/wiki/reproducible-builds), and [idempotency keys](/wiki/idempotency-keys) provide background on artifact identity, independent recreation, and retry contracts. The software-verification and long-running-agent pages remain expansion targets; the idempotency-and-recovery and provenance articles are published.

+ [Software verification and validation](/wiki/software-verification-and-validation) supplies the foundational requirements and assurance vocabulary. [Idempotency and recovery in agent tool calls](/wiki/idempotency-and-recovery-in-agent-tool-calls) expands the uncertain-outcome problem. [Evaluating long-running agents](/wiki/evaluating-long-running-agents) addresses repeated trials and operational reliability. [Provenance and revision-pinned citations](/wiki/provenance-and-revision-pinned-citations) concerns the evidence chain behind reusable knowledge. Existing neighboring references on [content-addressed storage](/wiki/content-addressed-storage), [reproducible builds](/wiki/reproducible-builds), and [idempotency keys](/wiki/idempotency-keys) provide background on artifact identity, independent recreation, and retry contracts. The software-verification page remains an expansion target; the long-running-agent, idempotency-and-recovery, and provenance articles are published.