Skip to content

Conversation

Gal-bloch
Copy link
Contributor

Description

Added Watson X foundation model definitions to model_prices_and_context_window.json to support all currently available Watson X models.

Changes Made

  • Added 29 new Watson X models with pricing, context windows, and capability flags
  • Updated 2 existing Watson X models (granite-13b-instruct-v2, granite-13b-chat-v2) with correct information
  • Added validation test test_watsonx_models_in_model_prices_file() in tests/test_litellm/llms/watsonx/test_watsonx.py

Models Added

IBM Granite Models:

  • granite-4-h-small, granite-3-3-8b-instruct
  • granite-guardian-3-2-2b, granite-guardian-3-3-8b
  • granite-vision-3-2-2b
  • granite-ttm-512-96-r2, granite-ttm-1024-96-r2, granite-ttm-1536-96-r2

Meta Llama Models:

  • llama-3-2-1b-instruct, llama-3-2-3b-instruct
  • llama-3-2-11b-vision-instruct, llama-3-2-90b-vision-instruct
  • llama-3-3-70b-instruct, llama-4-maverick-17b, llama-guard-3-11b-vision

Mistral Models:

  • mistral-large-2411, mistral-medium-2505, mistral-small-2503, pixtral-12b-2409

Other Models:

  • Google flan-t5-xl-3b, OpenAI gpt-oss-120b, BigScience mt0-xxl-13b
  • SDAIA allam-1-13b-instruct, Core42 jais-13b-chat

Source

All model information sourced from official IBM Watson X documentation:
https://dataplatform.cloud.ibm.com/docs/content/wsj/analyze-data/fm-models.html

Testing

✅ All checks passed:

  • make format - Applied Black formatting
  • make lint - Passed (Black, Ruff, MyPy, circular imports, import safety)
  • make test-unit - Passed unit tests
  • Added new test: test_watsonx_models_in_model_prices_file() validates all watsonx models have required fields with correct data types and constraints

Checklist

  • Signed CLA
  • Added testing (new validation test in test_watsonx.py)
  • All checks pass (make lint, make test-unit)
  • Scope isolated (single feature: Watson X model definitions)
  • Followed Google Python Style Guide
  • Used type hints where applicable

Copy link

vercel bot commented Oct 5, 2025

Someone is attempting to deploy a commit to the CLERKIEAI Team on Vercel.

A member of the Team first needs to authorize it.

@CLAassistant
Copy link

CLAassistant commented Oct 5, 2025

CLA assistant check
All committers have signed the CLA.

Added comprehensive Watson X model support including:
- IBM Granite models (granite-4-h-small, granite-3-3-8b-instruct, granite-guardian variants, granite-vision, granite-ttm time series models)
- Meta Llama models (llama-3-2-1b/3b/11b-vision/90b-vision, llama-3-3-70b, llama-4-maverick-17b, llama-guard-3-11b-vision)
- Mistral models (mistral-medium-2505, mistral-small-2503, pixtral-12b-2409)
- Additional models (BigScience mt0-xxl-13b, Google flan-t5-xl-3b, OpenAI gpt-oss-120b, SDAIA allam-1-13b-instruct, Core42 jais-13b-chat)

All models include proper pricing, token limits, and capability flags (function calling, vision support, etc.) based on IBM Watson X documentation.
Copy link
Contributor

@ishaan-jaff ishaan-jaff left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@ishaan-jaff ishaan-jaff merged commit 27c64c9 into BerriAI:main Oct 6, 2025
4 of 6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants