integrations/art_framework: add ART↔verifiers adapter #513
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
Adds ART ↔ verifiers integration under
integrations/art_framework:art_framework.py: loads ART task configs, converts tools toToolEnv, exact-match rubric by default, optionalJudgeRubric.utils/art_adapter.py: ART→verifiers tool conversion with strict JSON schemas (no additionalProperties).utils/verifiers_adapter.py: verifiers→ART export (schema-only).examples/calculator.json: small, real, runnable example.test_env.py: unit test for conversion, parser, and reward.Key behaviors:
ARTParserextracts the final answer from the configured completion tool.vf-install, not a core env).Type of Change
Testing
uv run pytestlocally.What I ran:
uv run pytest integrations/art_framework/test_env.py -quv run vf-install art_framework -p integrationsUV_NO_PROJECT=1 uv run vf-eval -s art_framework -a '{"task_config_path":"integrations/art_framework/examples/calculator.json"}' -m gpt-5-nano -n 2 -r 1OPENAI_API_KEY):export OPENAI_API_KEY=sk-...UV_NO_PROJECT=1 uv run vf-eval -s art_framework -a '{"task_config_path":"integrations/art_framework/examples/calculator.json","use_llm_judge":true,"judge_model":"gpt-5-nano"}' -m gpt-5-nano -n 2 -r 1i tested it myself since it's just integration didn't really need to see rollouts but it works

Checklist
AGENTS.mdintegrations/art_framework/README.mdwith Overview, Quickstart, Env Args, ART config format, PortabilityAdditional Notes
**kwargs) to satisfy agents’ strict JSON schema validation (noadditionalProperties).implementationsupports simple lambdas for demos; real deployments should provide proper functions/modules.