Skip to content

Rewrite skills README and harden release guidance - #552

Draft
Yuge Zhang (ultmaster) wants to merge 2 commits into
microsoft:mainfrom
ultmaster:docs/skills-readme-rewrite
Draft

Rewrite skills README and harden release guidance#552
Yuge Zhang (ultmaster) wants to merge 2 commits into
microsoft:mainfrom
ultmaster:docs/skills-readme-rewrite

Conversation

@ultmaster

@ultmaster Yuge Zhang (ultmaster) commented Aug 21, 2026

Copy link
Copy Markdown
Contributor

Summary

This draft combines the skills README rewrite with the release-skill corrections from #555.

Skills README rewrite

  • lead with what the skill does for a coding agent
  • explain how the optimizer harness and Agent Lightning skill work together
  • clarify the experiment setup, coding-agent rows, budget control, and performance breakdowns

Release skill hardening

  • warn that failed uv version bumps can leave partial version state
  • correct the CI test-set and runtime-version explanations
  • make merge selection and tag-workflow lookup deterministic and noninteractive

Verification

Existing README review items

  • [agent-lightning] is used as a reference-style link but has no matching definition.
  • The finale-cost paragraph says every point is an average of three runs; confirm whether the charts instead plot individual replicates.
  • Confirm whether the charts still need the ALFWorld $0 finale-cost/jitter note, dotted score-only baseline, and pristine-baseline reference points.
  • Confirm whether to retain the note that skills/agent-lightning/ is both the canonical Agent Skills package and Claude Code plugin root.
  • The file starts at ## with no # heading.
  • Several pre-existing wording and typo fixes remain open.

Supersedes #555.

Yuge Zhang (ultmaster) and others added 2 commits August 22, 2026 11:59
Lead with what the skill does for a coding agent, add a "How It Works"
section with the baseline prompt that harnesses already respond to, and
reframe the results as coding-agent rows rather than "agentic optimizer
average". Describe the budget-controlled setup and the finale-cost
question in the performance breakdowns instead of the per-chart
methodology notes.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01SnuugZnz2GXy8F78zkSmcY
@ultmaster Yuge Zhang (ultmaster) changed the title Rewrite the skills README around how the skill works Rewrite skills README and harden release guidance Aug 22, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant