v0.4.2
What's Changed
- feat: migrate SQLSemanticEquivalence to collections API by @anistark in #2496
- feat: migrate DataCompyScore to collections API by @anistark in #2499
- fix: migrate CHRF Score to new metrics collections by @anistark in #2500
- Feat/improve rag quickstart by @anistark in #2501
- fix: handle classification array length mismatch in TopicAdherence metric by @anistark in #2503
- feat: migrate quoted spans metric to collections api by @anistark in #2504
- fix: handle instructor modes for json and tools by @anistark in #2505
- docs: remove obsolete 'write your own metric' guides by @sanjeed5 in #2488
- fix: BasePrompt.adapt() structured output + language adaptation guide by @sanjeed5 in #2487
- Add AG-UI Protocol Integration for Agent Evaluation by @contextablemark in #2395
- docs: fix modifying-prompts-metrics guide with correct API by @sanjeed5 in #2486
- fix: handle nested dicts/lists in ToolCallF1 args to prevent unhashable type error by @anistark in #2507
- feat: add Claude docs auto-update workflow by @sanjeed5 in #2508
- fix: allow unannotated parameters to accept any type by @dhyaneesh in #2513
- feat: migrate MultiModalFaithfulness to collections API by @anistark in #2515
- feat: migrate MultiModalRelevance to collections API by @anistark in #2518
- feat: add support for new google-genai SDK with backwards compatibility for deprecated google-generativeai by @anistark in #2517
- fix: use instructor Mode.JSON for litellm and generic providers to fix Dict type validation errors by @anistark in #2514
- [AG-UI] Replacing "OpenAI" with "AsyncOpenAI". by @contextablemark in #2520
- Feat: document PDF export workflow by @cgaswin in #2522
- refactor: deprecate legacy metrics by @anistark in #2519
- fix: claude workflows to use github token by @anistark in #2527
- feat: add HuggingFace tokenizer support in knowledge graph operations by @anistark in #2524
- feat: add generate_with_chunks for pre-chunked documents by @MinseongS in #2526
- feat(docs): add offline mermaid support to PDF export by @cgaswin in #2530
- fix: claude workflows to use pat token instead of github token to support forked PRs by @anistark in #2531
- docs: change query execution to use asyncio.run by @yangzq50 in #2532
- fix: increase max-turns and update prompt by @anistark in #2534
- chore: remove survey link by @anistark in #2535
- feat: add caching support for metrics collections by @anistark in #2533
- feat: add caching support for embeddings by @anistark in #2536
New Contributors
- @contextablemark made their first contribution in #2395
- @cgaswin made their first contribution in #2522
- @MinseongS made their first contribution in #2526
- @yangzq50 made their first contribution in #2532
Full Changelog: v0.4.1...v0.4.2