NeFut Logo NeFut
Admin Login

[CS.AI] Diversifying Verification: Differences in Verifiability of Task-Equivalent Programs

Published at: 2026-07-14 22:00 Last updated: 2026-07-15 02:00
#LLM #Verification #Software Engineering

Program verification is crucial for software correctness, but producing fully verified programs remains challenging in practice. This paper investigates whether implementation structure affects automated verifiability when multiple generated programs are intended to satisfy the same task-level semantics. We present Diversify2Verify, a staged LLM-based pipeline for Why3 that infers representation-specific contracts, generates and tests diverse recursive and imperative array/list implementations, and attempts verification with bounded verifier-guided annotation repair.

We also construct a verification-oriented benchmark of 73 tasks over integers, arrays, and lists, yielding 292 implementation variants. Diversify2Verify verifies 96 artifacts initially and 154 after two repair passes, improving artifact-level verification from 32.9% to 52.7%. At the task level, at least one variant verifies for 49 of 73 tasks, achieving a 67.1% success rate. These results demonstrate that task-equivalent implementations can differ substantially in verifiability and that implementation diversity aids in finding verification-friendly artifacts.

Blogger's Review: This paper highlights the significance of implementation diversity in program verification through Diversify2Verify, emphasizing that task-equivalent programs can vary greatly in verifiability. This research direction provides new insights for the development of future automated verification tools, especially important in the context of increasingly complex software engineering.

Original Source: https://arxiv.org/abs/2607.09366

[h] Back to Home