llm-cost-optimization

Content-aware output compression for AI coding assistants. 36 specialized processors cut CLI output tokens by 60-99% (git, pytest, npm, terraform, kubectl, docker, and more) without losing errors, diffs, or stack traces.

Open-source Prompt Firewall — deflect up to 95% of redundant LLM traffic before it leaves your infrastructure. Documents: https://isartor-ai.github.io/Isartor/index.html

Research repository for TokenMizer, a graph-structured session-memory system for long-horizon LLM context management. This repository contains the benchmark suite, the labelled evaluation corpus, all raw results, and the manuscript for the associated paper.

A high-performance, multi-agent observability engine designed for the Model Context Protocol (MCP). It provides a non-blocking, transparent proxy layer that implements deterministic token attribution, real-time context-window alerting, and heuristic-driven static analysis to optimize LLM metadata overhead at scale.

Git-native granular cost accounting for AI-developed repos, what did this commit cost? Reads Claude Code / Codex / Gemini CLI / aider logs, joins them to git history, and prices every commit, PR and release. Measured from real tokens, never estimated.

Right-size every Claude task: advisory slash commands that recommend the cheapest model and effort level whose cost of error is acceptable.

Open-source, self-hosted Fastest AI security gateway for LLM and agent apps: guardrails, agentic PDP, semantic caching, MCP gateway.

Cost-aware subagent delegation workflow for Cursor: model-pinned dispatch, fail-closed premium gate, and process-driven QA

3,300 practical techniques to cut LLM token usage by up to 90% — 300 core principles + 3,000 context-specific applications.

Builds prompt-cost discipline into Claude Code: measure every prompt, surface avoidable spend, report org-wide. Skill + UserPromptSubmit hook + MCP rollup with cited dollar/Wh/CO2e receipts.

Sample code for two-tier LLM inference (cascading) on Amazon Bedrock, using a single Bedrock Converse API surface. NVIDIA Nemotron Nano handles routine support-ticket classification on every request; Anthropic Claude Sonnet handles cases the routing logic flags as harder. Includes a bake-off harness, sample data, and tests. Next.js + TypeScript.

Tamper-evident, stranger-verifiable receipts for LLM cost-savings — anyone can recompute your caching/routing savings math offline, no trust in your dashboard required. Pure stdlib, zero-dependency.

Stop your AI coding agent breaking things. Enforced guardrails that block unsafe edits, composable modes, and token-cost budgeting for Kiro CLI.

A lightweight OpenClaw model router that reduces LLM costs by switching requests to cheaper models using custom rules.

Production-ready tiered LLM cascade router — cuts API costs by 65%

Helix gives you agents that actually behave in production: hard budget limits, semantic caching that cuts API costs by 40-70%, persistent memory, multi-agent teams, YAML-based task pipelines, and a 5-scorer eval suite.

Sovereign Execution Layer for Autonomous Agents | gVisor-Hardened Governance | FinOps-Optimized Inference Routing.

LLM routing layer that classifies prompt complexity and routes to the cheapest capable model across OpenAI, Anthropic, and Gemini — with async quality verification and a self-improving classifier. 33.8% cost savings on a 492-prompt load test.

Cut Claude Code costs by 50–90% — free checklists + the complete 15-chapter system