feat(local-llm): slot pinning, task ceiling while waiting, measured context and throughput, SWA launch flags, first-token progress (F12–F16) - #436

Merged

plombeer31 merged 7 commits into

mainfrom

harness/11-llama

Sep 17, 2026

Commits on Sep 16, 2026

fix(llm): F13 sessions keep their slot — server-picked on the first request, pinned after
plombeer31
committed
c3f4094
fix(agent): F15 the task ceiling holds while waiting on a provider
plombeer31
committed
b809caf
feat(local-llm): F16 context, slots and fan-out sized from measurement
plombeer31
committed
cd39251
feat(local-llm): F12 sliding-window and hybrid models launched for cache reuse
plombeer31
committed
d21da13
feat(config): bump for localModels.managed.swaFull
plombeer31
committed
171cf82
fix(llm): F14 a slow first token is progress, not an outage
plombeer31
committed
908160e
chore(llama): integration reconcile
plombeer31
committed
bf1fd11