Skip to content

Add measure-only prober leaf director - #962

Merged
TheGreatAxios merged 5 commits into
mainfrom
cl-7656-prober-director
Sep 13, 2026
Merged

Add measure-only prober leaf director#962
TheGreatAxios merged 5 commits into
mainfrom
cl-7656-prober-director

Conversation

@TheGreatAxios

Copy link
Copy Markdown
Collaborator

Summary

  • Adds a closed leaf director prober: measure-only lane reporting TTFT, per-turn latency, tool-only streak distribution, and salvage/nudge counts per family/model.
  • Consumes the existing harness only: bun run eval:capability (scripts/eval-capability.ts over evals/capability) and the PerfTrace harness under src/perf (rollup, assert-spans, attribution-report). No second harness.
  • Findings feed model-family-policy as follow-up tickets; the lane forbids shipping product code and tuning prompts or policy (never silent retunes). Leaf: maySpawn false.
  • Registry + prompt-contract tests; no Skywalker changes.

Verification

  • bun run typecheck, bun run build, and bun run test pass (via bun run check: lint + typecheck + build + guarded suite, 7146 pass / 0 fail)
  • Related suites: prober package contract, director registry, prompt-size budgets — 39 pass / 0 fail

Related to CL-7656

@linear-code

linear-code Bot commented Sep 13, 2026

Copy link
Copy Markdown

CL-7656

@TheGreatAxios

Copy link
Copy Markdown
Collaborator Author

Audit (Prober director): Approve with nits.

Findings:

The shared scaffold owns Summary / Findings / Blockers / Paths, so the lane report content is carried as a Findings sentence instead of re-specified headings.
@TheGreatAxios
TheGreatAxios force-pushed the cl-7656-prober-director branch from 00dedb5 to 84e90a5 Compare September 13, 2026 05:36
@TheGreatAxios
TheGreatAxios merged commit 040f0ed into main Sep 13, 2026
9 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant