Skip to content

Evals: Decouple from Langfuse #1031

Description

@PritamSGB

Is your feature request related to a problem?
We need to enhance Evals on Glific for better flexibility and independence from langfuse. This current dependency limits our ability to assess and improve Eval efficiency.

Describe the solution you'd like

  • Implement Evals on Glific
  • Decouple Evals from langfuse
    • v0: Static LLM judge prompt for correctness
    • v1: Ability to change the prompt (versioning)
Original issue
  • Evals on Glific
  • Decouple Evals from langfuse
    v0 - static llm judge prompt for correctness
    v1 - ability to change the prompt (versioning)

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

  • Status
    Closed

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions