Skip to content

Retain full Claude and Codex red-team evidence for Apptainer - #231

Closed
merlerm wants to merge 5 commits into
pr/apptainer-network-auditfrom
pr/apptainer-full-red-team
Closed

merlerm wants to merge 5 commits into
pr/apptainer-network-auditfrom
pr/apptainer-full-red-team

Conversation

@merlerm

@merlerm merlerm commented Sep 19, 2026

Copy link
Copy Markdown
Collaborator

The existing agent probes did not provide a complete retained Apptainer run across both backends, and some verdicts confused echoed markers or broken requests with evidence.

Add a coordinator that runs every catalog case, keeps per-case raw streams/scripts/broker logs, continues after failures, and distinguishes failed, inconclusive, and passed results. Add strict interpreter/path/source inventories and a rendered-policy import attack. Randomize undisclosed canaries, recognize Codex tool events, require genuine result markers, and verify raw strict commands with fresh working connections and explicit denials.

Validation: 7 coordinator/checker tests passed at this layer. Both original full suites completed (44 cases plus network audit): Codex 38 passed / 6 inconclusive / 1 failed; Claude 35 / 8 / 2. Review found real package/bytecode defects fixed by earlier stack layers, checker false positives, and unresolved refusals/budget exhaustion. Targeted reruns and the final deterministic/network audits are documented; the original runs are not represented as all green. The new rendered-policy case expands the catalog to 45 plus network audit.

Paid probes are opt-in. Raw local audit logs, images, credentials, and unrelated campaign files are not committed.

Stack integration validation: 258 tests passed, 4 image/runtime tests skipped in the isolated worktree; pylint passed and mypy passed for 11 changed modules. Paid cluster audit results are summarized above where relevant.

Stack created with GitHub Stacks CLI

@merlerm
merlerm added this pull request to stack #232 September 19, 2026 14:53
@merlerm
merlerm marked this pull request as ready for review September 19, 2026 14:54
@merlerm
merlerm force-pushed the pr/apptainer-network-audit branch from 1ab0ace to 3949017 Compare September 19, 2026 14:57
@merlerm
merlerm force-pushed the pr/apptainer-full-red-team branch from ffb0114 to e149ead Compare September 19, 2026 14:57
@merlerm
merlerm force-pushed the pr/apptainer-network-audit branch from 3949017 to fa791fb Compare September 19, 2026 15:22
@merlerm
merlerm force-pushed the pr/apptainer-full-red-team branch from e149ead to 86fade0 Compare September 19, 2026 15:22
@merlerm
merlerm removed this pull request from stack #232 September 19, 2026 15:30
@merlerm
merlerm force-pushed the pr/apptainer-network-audit branch from fa791fb to c1ebb2a Compare September 19, 2026 15:31
@merlerm

merlerm commented Sep 19, 2026

Copy link
Copy Markdown
Collaborator Author

Consolidated into #230. Retained evidence and full-suite execution now live in the original red_team_sandbox.py; the separate coordinator has been removed.

@merlerm merlerm closed this Sep 19, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant