Skip to content

Conversation

@devin-ai-integration
Copy link
Contributor

Remove Claude Sonnet 3.5 v2 model from Ask AI configuration

Anthropic and Bedrock are retiring Claude Sonnet 3.5 v2 (us.anthropic.claude-3-5-sonnet-20241022-v2:0). This PR removes all references to this model from the Ask AI model configuration.

What was the motivation & context behind this PR?

Claude Sonnet 3.5 v2 is being deprecated by Anthropic and AWS Bedrock, so we need to remove it from our model configuration to avoid future issues. The system will continue to work with the remaining models (claude-3.7, claude-4, claude-4.5) which are newer and more capable.

Changes made

Modified packages/fern-docs/search-server/ask-fern/src/utils/get-model-from-config.ts:

  • Removed "claude-3.5" from the ModelId type definition
  • Removed the "claude-3.5" entry from MODEL_CONFIGS (which mapped to us.anthropic.claude-3-5-sonnet-20241022-v2:0 in us-west-2)
  • Removed "claude-3.5" from the FALLBACK_ORDER array

The default model remains "claude-3.7" and the fallback chain is now: claude-4.5 → claude-4 → claude-3.7 → anthropic direct API.

Human review checklist

  1. Verify backward compatibility: Confirm that any existing code or configurations that might be passing "claude-3.5" as a model parameter will gracefully fall back to claude-3.7 via the resolveModelId function
  2. Check fallback order: Verify that the new fallback order (claude-4.5 → claude-4 → claude-3.7) is appropriate and that we're not removing a more stable/tested model
  3. Monitor after deployment: Watch for any Ask AI functionality issues after this deploys to dev

How has this PR been tested?

  • ✅ All linting checks passed (pnpm lint:biome, pnpm lint:style, pnpm format:yaml:check)
  • ✅ All tests passed (pnpm test)
  • ⚠️ Not tested: Actual runtime Ask AI functionality with the removed model (should be tested in dev after deploy)

Link to Devin run: https://app.devin.ai/sessions/93a5a406abf942e892901ab8a33f74f2

Requested by: [email protected] (@dannysheridan)

Remove all references to Claude Sonnet 3.5 v2 (us.anthropic.claude-3-5-sonnet-20241022-v2:0) from the model configuration as it is being retired by Anthropic and Bedrock.

Changes:
- Removed 'claude-3.5' from ModelId type definition
- Removed 'claude-3.5' entry from MODEL_CONFIGS
- Removed 'claude-3.5' from FALLBACK_ORDER array
- Default model remains 'claude-3.7'

Co-Authored-By: [email protected] <[email protected]>
@devin-ai-integration
Copy link
Contributor Author

🤖 Devin AI Engineer

I'll be helping with this pull request! Here's what you should know:

✅ I will automatically:

  • Address comments on this PR. Add '(aside)' to your comment to have me ignore it.
  • Look at CI failures and help fix them

Note: I can only respond to comments from users who have write access to this repository.

⚙️ Control Options:

  • Disable automatic comment and CI monitoring

@vercel
Copy link
Contributor

vercel bot commented Nov 2, 2025

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Preview Updated (UTC)
dev.ferndocs.com Ready Ready Preview Nov 2, 2025 2:47am
fern-dashboard Ready Ready Preview Nov 2, 2025 2:47am
fern-dashboard-dev Ready Ready Preview Nov 2, 2025 2:47am
ferndocs.com Ready Ready Preview Nov 2, 2025 2:47am
preview.ferndocs.com Ready Ready Preview Nov 2, 2025 2:47am
prod-assets.ferndocs.com Ready Ready Preview Nov 2, 2025 2:47am
prod.ferndocs.com Ready Ready Preview Nov 2, 2025 2:47am
1 Skipped Deployment
Project Deployment Preview Updated (UTC)
fern-platform Ignored Ignored Nov 2, 2025 2:47am

@dannysheridan
Copy link
Member

1/ Only customer I could find using this is here

2/ We should also remove from fern repo: fern-api/fern#10240

@devin-ai-integration
Copy link
Contributor Author

✅ Already done! I created PR #10240 for the fern repo: fern-api/fern#10240

Both PRs are now ready:

All CI checks have passed on the fern-platform PR. The fern PR is still running CI checks.

Regarding the customer using claude-3.5 in their config - they'll automatically fall back to claude-3.7 (the default) via the resolveModelId function when they update, so no breaking changes for them.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants