New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat(openai): added support for non-streaming o1 (e.g. Azure) models #1687

Open

lgarbarini wants to merge 1 commit into huggingface:main from lgarbarini:lgarbarini/oai-non-streaming

Contributor

lgarbarini commented Feb 7, 2025 •

edited

Loading

Takes logic from @evalstate's fork and wraps it in a new streamingSupported option. Azure o1 models do not currently support streaming so for those of us using Azure this enables o1 usage.

{
    "id": "o1-preview",
    "name": "o1-preview",
    "displayName": "o1-preview",
    "systemRoleSupported": false,
    "endpoints": [
      {
        "type": "openai",
        "baseURL": "https://my-deployment.openai.azure.com/openai/deployments/o1-preview",
        "defaultHeaders": {
          "api-key": "$SECRET"
        },
        "streamingSupported": false,
      }
    ]
  },


          feat(openai): added support for non-streaming o1 (e.g. Azure) models

0ff826a

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet