Skip to content

Chat: Add speech-to-text support #167

Description

@Ayush8923

Is your feature request related to a problem?
Currently, there is no support for speech-to-text in chat, restricting users from using voice input. This limits accessibility and may hinder user experience.

Describe the solution you'd like
Implement speech-to-text support in chat with the following features:

  • Enable microphone input in chat
  • Convert voice input to base64
  • Send base64 to existing chat/LLM API
  • Handle loading and error states
  • Utilize Web Speech API to read the text
  • Enable STT only with configuration type:stt and google model
Original issue

Scope

  • Enable microphone input in chat
  • Convert voice input into base64
  • Send converted base64 into existing chat/LLM API
  • Handle loading and error states
  • Use the Web Speech API to read the text
  • This STT(Speech to text) only enabled if the configuration have type:stt and use the google model.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

  • Status
    Closed

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions