feat: add streaming endpoint for inference requests - #157

Merged

doringeman merged 7 commits into

docker:mainfrom

doringeman:requests-sse

Sep 16, 2025

Commits on Sep 12, 2025

feat: add streaming endpoint for inference requests
doringeman
committed
033cf83

Commits on Sep 15, 2025

refactor: combine the requests endpoints
doringeman
committed
a0ddf2e

Commits on Sep 16, 2025

refactor: on streaming return the same struct as on regular
doringeman
committed
d61cffb
OpenAIRecorder: add clarifying comment about modelRecords size assumption
doringeman
committed
98361c1
OpenAIRecorder: send error event for JSON marshaling failure
doringeman
committed
78f30f9
OpenAIRecorder: add error handling and logging for SSE response writes
doringeman
committed
2fca1f5
OpenAIRecorder: return an empty list instead of 404
doringeman
committed
296301f