The nightly real-framework run failed: https://github.com/evaluation-context-protocol/ecp/actions/runs/33309382561
A failure here usually means one of:
- a framework reshaped the internals an adapter traverses (regenerate
fixtures with ecp.testing.record_fixture and review the diff)
- a framework changed behaviour so the demo no longer satisfies its graders
- a live model call flaked
The replay suite in PR CI will still be green in the first two cases,
because it replays recorded shapes. That gap is what this job covers.
The nightly real-framework run failed: https://github.com/evaluation-context-protocol/ecp/actions/runs/33309382561
A failure here usually means one of:
fixtures with
ecp.testing.record_fixtureand review the diff)The replay suite in PR CI will still be green in the first two cases,
because it replays recorded shapes. That gap is what this job covers.