feat!: align media capabilities and add grounded-query tooling - #135
Merged
Conversation
Replace the dialogue and videoprism capability identifiers with speech and action across shared contracts, packages, extras, adapters, generated catalogs, benchmarks, and documentation. Bump the index schema so repositories rebuild under the new collection names. BREAKING CHANGE: dialogue and videoprism are removed as capability names and package extras. Use speech and action, then rebuild existing indexes.
tulayha
force-pushed
the
benchmark/codex-mcp-ablation
branch
from
August 29, 2026 19:56
34544b5 to
c34373d
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
speech,scene,action, andsoundcapability names across the shared CLI, HTTP, MCP, Desktop, package, and generated contractsqwen3.5:4b-q4_K_M, while preserving deterministic evidence retrieval when the model is unavailableBreaking change
dialogueandvideoprismare removed as public capability names and package extras. Usespeechandaction, then rebuild existing indexes. No compatibility aliases are retained.Cost and ownership boundary
Promptfoo Community and the local VidXP/Ollama processes have no per-run fee. The approximately 3.4 GB Qwen model uses local disk, memory, compute time, and electricity. Codex benchmark runs consume the user's applicable Codex allowance or API usage; hosted judge calls would be additional paid model usage. Desktop asks before installing Ollama or downloading the model and does not bundle model weights.
Validation
uv run --no-sync ruff check .uv run --no-sync python -m pytest -q: 732 passed, 5 skipped, 106 subtests passeduv run --no-sync pytest -q tests/test_mcp.py tests/test_codex_plugin.py tests/test_cli.py: 99 passed, 7 subtests passednpm --prefix desktop run check: typecheck, lint, production build, and 47 tests passedcargo test --manifest-path desktop/src-tauri/Cargo.toml: 89 passedcargo test --release --locked --manifest-path desktop/src-tauri/Cargo.toml: 89 passednpm run model-catalog:checkfromdesktop/npm run notices:checkfromdesktop/npx --yes markdownlint-cli2@0.23.2 INSTALLATION_GUIDE.md docs/local-api.md docs/architecture/platform.md docs/integrations/openai-plugin.mdgit diff --checknpm --prefix premiere run check: typecheck, lint, 14 tests across 6 files, and both UXP and CEP production builds passeduv run --no-sync python -m pytest -q tests/test_api.py tests/test_query_service.py: 50 passedNo Codex inference runs, Ollama/Qwen model download, paid API call, dataset media download, or real Premiere host run was performed. The Ollama executable is not installed on this workstation, so the real Qwen schema/resource gate remains explicit follow-up validation rather than a claimed end-to-end result. Lychee was unavailable and the Docker daemon was stopped, so the pinned link check could not run. The direct
uv run --no-sync pytest -qWindows shim omitted the checkout root when collecting fiveutils.*modules; the complete suite passed throughuv run --no-sync python -m pytest -q.