Skip to content

STS: Reducing high latency issues #1034

Description

@PritamSGB

Is your feature request related to a problem?
We are experiencing high latency in STS flows, exceeding 40 seconds. This delays response times and impacts user experience.

Describe the solution you'd like

  • Track and reduce kaapi side latency (make intermediate callbacks async for llm/chain)
  • Explore ways to reduce latency at TTS
  • Conduct testing on Glific end before further action
Original issue
  • Track and reduce if any kaapi side latency (llm/chain: make intermediate callbacks async)
  • Explore reduction on latency at TTS

Comments: - STS with FS is done

  • Testing pending at Glific end
  • Then we will pick for latency

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions