You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: CHANGELOG.md
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -9,7 +9,7 @@ Big CLI update with breaking changes and an overall focus on improving stability
9
9
- Support for multi-language Langium projects, previously we only handled the singular case
10
10
- Added the `-y` flag to most commands in lai to accept defaults, allowing automatic setup in CI environments and as part of scripted workflows
11
11
- Detection of outdated descriptors: loading a descriptor generated by an older LAI version now warns and recommends regenerating with `lai gen descriptor`
12
-
- Detection of outdated `lai.config.jsonc` files (also prompts to regen with `lai init`)
12
+
- Detection of outdated `lai.config.jsonc` files (also prompts to regen with `lai init config`)
13
13
- Auto-summarization of validations over 1k lines in the default generated system prompt
14
14
- Per-language validator detection: multi-language projects that add one validator per language are now picked up, and the generated system prompt adds a `Validation Rules` section for each
Copy file name to clipboardExpand all lines: packages/langium-ai-tools/README.md
+11-11Lines changed: 11 additions & 11 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -155,26 +155,26 @@ In general we stick to focusing on what Langium can do to help with evaluation,
155
155
156
156
### Testing API
157
157
158
-
Langium AI Tools provides a vitest-style testing API for writing programmatic evaluation test suites. This allows you to define test cases in TypeScript with familiar features like:
158
+
Langium AI Tools provides a vitest-style evaluation API for writing programmatic evaluation suites. This allows you to define evaluation cases in TypeScript with familiar features like:
159
159
160
-
- **Test suites** with `describe()`, `describe.skip()`, and `describe.only()`
160
+
- **Evaluation suites** with `describe()`, `describe.skip()`, and `describe.only()`
**For detailed documentation on the Testing API**, see the [Testing API Reference](../cli/docs/testing-api.md).
207
+
**For detailed documentation on the Evaluation API**, see the [Evaluation API Reference](../cli/docs/evaluation-api.md).
208
208
209
209
### Evaluation Matrix
210
210
211
-
The Evaluation Matrix provides a framework for testing multiple model configurations against a set of test cases using Langium AI evaluators. This is particularly helpful when comparing across models, prompt strategies, RAG setups, or other variations in your AI stack.
211
+
The Evaluation Matrix provides a framework for checking multiple model configurations against a set of evaluation cases using Langium AI evaluators. This is particularly helpful when comparing across models, prompt strategies, RAG setups, or other variations in your AI stack.
212
212
213
213
In practice an evaluation matrix can be helpful when deciding between which models or services to use up front, but this can also be done externally by levering the evaluator directly yourself.
0 commit comments