Skip to content

Build corpus images last, in a separate workflow step - #44

Open
tadamcz wants to merge 1 commit into
mainfrom
corpus-images-last
Open

Build corpus images last, in a separate workflow step#44
tadamcz wants to merge 1 commit into
mainfrom
corpus-images-last

Conversation

@tadamcz

@tadamcz tadamcz commented Sep 1, 2026

Copy link
Copy Markdown
Collaborator

The agent_corpus target is exceptionally slow (~9 GB corpus fetch + corpus build). This splits the build loop in two:

  • Build and push images (no corpus)agent and comparator for every FC pin
  • Build and push corpus imagesagent_corpus for every FC pin, always last

The discovery step now emits two lists (builds / corpus_builds); the build logic is otherwise unchanged, and the Dockerfile is untouched.

Benefits:

  • The fast images are pushed as early as possible instead of waiting behind the corpus per-commit.
  • The Actions step list (and gh run view --job) shows at a glance when everything except the corpus is done.

Both steps run in the same job on the same buildx builder, so agent_corpus still gets its FROM agent layers as cache hits from the first step — only the corpus stages actually run in step two.

agent_corpus is by far the slowest target (~9 GB corpus fetch + build).
Splitting it into its own step, after all other images, means the fast
images are never delayed behind it, and the job's step list shows when
everything except the corpus is done. Same runner and buildx builder,
so agent_corpus still gets its FROM agent layers as cache hits.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant