Skip to content

Add a Gauntlet director that mutation-checks tests can actually fail - #977

Merged
TheGreatAxios merged 2 commits into
mainfrom
cl-7658-add-a-gauntlet-director-that-mutation-checks-tests-can
Sep 13, 2026
Merged

Add a Gauntlet director that mutation-checks tests can actually fail#977
TheGreatAxios merged 2 commits into
mainfrom
cl-7658-add-a-gauntlet-director-that-mutation-checks-tests-can

Conversation

@TheGreatAxios

Copy link
Copy Markdown
Collaborator

Summary

Adds a closed Gauntlet leaf director covering the mutation/vacuity lane: apply one temporary breaking mutation, run the named test (must fail), restore the tree byte-identical, re-run (must pass), and leave the tree clean. Gauntlet does not replace tester (suite gate) or testsmith (case design); that non-overlap is pinned in its prompt and contract tests.

Verification

  • bun run check passes (7147 pass, 0 fail)
  • Targeted contract suites pass: gauntlet package, director registry, skywalker package, prompt sizes
  • Prompt budgets set from measured sizes (grok max 13990 chars / 14050 bytes)

Fixes CL-7658

@linear-code

linear-code Bot commented Sep 13, 2026

Copy link
Copy Markdown

CL-7658

@TheGreatAxios
TheGreatAxios force-pushed the cl-7658-add-a-gauntlet-director-that-mutation-checks-tests-can branch from 3e44f6d to 74e3f31 Compare September 13, 2026 04:19
@TheGreatAxios

Copy link
Copy Markdown
Collaborator Author

Audit (Gauntlet director): Approve with nits.

Findings:

The shared scaffold owns Summary / Findings / Blockers / Paths, so the lane report content is carried as a Findings sentence instead of re-specified headings.
@TheGreatAxios
TheGreatAxios merged commit 9e77d85 into main Sep 13, 2026
9 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant