All issues

Search results

Pre-commit hook fails on clean main: 88 docs/*.md files fail 'ruff format --check'

Status: Open.

#2925 In vibrantlabsai/ragas;

· JohnCarl-30 opened on Aug 10, 2026

fix(llms): LiteLLMStructuredLLM.generate() double-tracks LLMUsageEvent on async clients

Status: Open.

#2912 In vibrantlabsai/ragas;

· Harsh23Kashyap opened on Aug 2, 2026

fix(metrics): MultiTurnMetric.{multi_turn_score,multi_turn_ascore} mis-label evaluation_type as SINGLE_TURN

Status: Open.

#2910 In vibrantlabsai/ragas;

· Harsh23Kashyap opened on Aug 2, 2026

ContextPrecision never returns exactly 1.0: unconditional 1e-10 in the average-precision denominator

Status: Open.

#2909 In vibrantlabsai/ragas;

· ErenAta16 opened on Aug 2, 2026

fix(metrics): SummarizationScore._compute_qa_score raises ZeroDivisionError on empty answers

Status: Open.

#2905 In vibrantlabsai/ragas;

· Harsh23Kashyap opened on Aug 1, 2026

fix(metrics): @metric decorator drops user kwargs when pydantic model creation fails

Status: Open.

#2903 In vibrantlabsai/ragas;

· Harsh23Kashyap opened on Jul 31, 2026

fix(metrics): InstanceRubrics formats 'None' into LLM prompt when user_input is None

Status: Open.

#2901 In vibrantlabsai/ragas;

· Harsh23Kashyap opened on Jul 30, 2026

[Proposal] OpenEval Import/Export Support

Status: Open.

#2898 In vibrantlabsai/ragas;

· adhabnr-ux opened on Jul 29, 2026

fix(dataset): train_test_split returns empty datasets when DataTable._data is empty

Status: Open.

#2896 In vibrantlabsai/ragas;

· Harsh23Kashyap opened on Jul 29, 2026

Docs example for LLM Context Recall gives score 1.0 but retrieved context doesn't support the reference claim

bugSomething isn't workingSomething isn't working

Status: Open.

#2895 In vibrantlabsai/ragas;

· pjreid opened on Jul 28, 2026

dataset_schema: add EvaluationResult.summary() returning per-metric mean/count/missing

Status: Open.

#2893 In vibrantlabsai/ragas;

· Harsh23Kashyap opened on Jul 26, 2026

BleuScore evaluates only the first sentence (corpus_bleu reference structure bug)

Status: Open.

#2888 In vibrantlabsai/ragas;

· feiiiiii5 opened on Jul 25, 2026