Skip to content

Feature/GitHub ingest#2

Open
bluegreenstone wants to merge 2 commits into
https-deeplearning-ai:mainfrom
bluegreenstone:feature/github-ingest
Open

Feature/GitHub ingest#2
bluegreenstone wants to merge 2 commits into
https-deeplearning-ai:mainfrom
bluegreenstone:feature/github-ingest

Conversation

@bluegreenstone

Copy link
Copy Markdown

Add optional git-repo notebook ingestion to /generate-spec

/generate-spec now accepts an optional git repo argument (/generate-spec ). When given one, it runs a deterministic ingest step before generating the spec, so notebooks no longer have to be downloaded and copied in by hand.

What the ingest does (.claude/skills/generate-spec/scripts/ingest_repo.py, stdlib-only):

  • Shallow-clones the repo using your own git credentials — SSH (git@…/ssh://…), HTTPS, or a local path/file:// dir (copied, not cloned). --ref pins a branch/tag/SHA.
  • Renders every .ipynb cell-by-cell into a single materials/notebooks/-context.md, matching the shape of a hand-downloaded course context dump.
  • Appends a de-duplicated "Helper Module Context" section from the repo's helper.py module(s) — identical defs collapse, same-name/different-body collisions keep both variants flagged inline.

Guardrails:

  • Writes only into materials/notebooks/; transcripts remain a manual download from the course site.
  • Idempotent — re-running overwrites the context file cleanly.
  • Without a repo argument, /generate-spec behaves exactly as before.

Also:

  • /new-course now mentions the shortcut when pointing users at the materials step.
  • README documents the feature (accepted repo forms, what gets rendered, scope guarantees).
  • .gitignore picks up .idea/ and Python bytecode.

bluegreenstone and others added 2 commits June 30, 2026 22:17
Automate producing the notebooks "context" markdown by cloning a course
repo over SSH instead of hand-downloading it, and — new — include the
repo's helper.py module(s) as context.

- New .claude/skills/generate-spec/scripts/ingest_repo.py (stdlib only):
  clones a repo (SSH/https/local), renders every .ipynb cell-by-cell in
  the existing context.md format under a Lesson Map, and appends a
  de-duplicated "Helper Module Context" section. Helper defs (functions
  and classes) are extracted via ast; identical/symlinked copies collapse;
  same-name-but-different-body collisions keep both, flagged inline. Output
  is guarded to materials/notebooks/ and never touches transcripts/.
- generate-spec SKILL.md: additive optional Step 2 — a repo argument
  triggers ingestion; no argument behaves exactly as before. Transcripts
  remain a manual drop.
- new-course SKILL.md: mention the /generate-spec <repo-ssh-url> shortcut.
- .gitignore: ignore .idea/ and Python bytecode.

Verified end-to-end against a local fixture (symlink collapse, conflict
flagging, zero-helper, clone failure, output guards) and against the real
course repo (5 notebooks, helper.py surfacing 22 deduped defs).

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Cover the new /generate-spec repo argument: accepted sources (SSH,
HTTPS, local path/file://), what ingest_repo.py renders, and its scope
guarantees (notebooks-only writes, manual transcripts, idempotent).
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant