Skip to content

readme: add benchmark section (token consumption with and without the plugin) - #12

Merged
realgarit merged 1 commit into
mainfrom
readme-benchmark
Jul 12, 2026
Merged

realgarit merged 1 commit into
mainfrom
readme-benchmark

Conversation

@realgarit

Copy link
Copy Markdown
Owner

Summary

  • Adds a Benchmark section after Why, with results from a small controlled test (3 tasks, 2 reps each, plugin off vs on).
  • Shows total API cost stays roughly flat (sometimes higher) while Fable's own output token share drops, moving work to Sonnet, Haiku and Opus.
  • Adds the Benchmark nav entry to the top-line table of contents.

Test plan

  • Dash lint locally: git grep -nIP '\x{2014}|\x{2013}' -- . finds nothing in the new content
  • CI dash lint, JSON validation, shell syntax, and hook tests run on the PR

… plugin)

Adds a Benchmark section with a small controlled headless-run comparison (plugin on/off) showing total API cost is roughly flat while Fable's own output token share drops, moving work onto Sonnet/Haiku/Opus. Includes the nav entry and n=2 caveat.
@realgarit
realgarit merged commit 296309c into main Jul 12, 2026
1 check passed
@realgarit
realgarit deleted the readme-benchmark branch July 12, 2026 22:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant