Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

TiktokenTokenizer #42662

Closed
torronen opened this issue Sep 19, 2024 · 0 comments · Fixed by #42868
Closed

TiktokenTokenizer #42662

torronen opened this issue Sep 19, 2024 · 0 comments · Fixed by #42868
Assignees
@gewarren
Labels
dotnet-ml/svc in-pr This issue will be closed (fixed) by an active pull request. Pri2 📌 seQUESTered Identifies that an issue has been imported into Quest. ⌚ Not Triaged Not triaged

Comments

@torronen
Copy link

torronen commented Sep 19, 2024 •
edited by sequestor bot
Loading

Type of issue

Code doesn't work

Description

Tokernizer.CreateForModel("gpt-4") should be now TiktokenTokenizer.CreateForModel("gpt-4")
It's just the What's New page but this page ranks high in search engine results so users may easilly reference it.

Page URL

https://learn.microsoft.com/en-us/dotnet/machine-learning/whats-new/overview

Content source URL

https://github.com/dotnet/docs/blob/main/docs/machine-learning/whats-new/overview.md

Document Version Independent Id

87bb7009-9c3f-5d5b-1c92-456cd2188954

Article author

@luisquintanilla

Metadata

  • ID: f888e18c-d07a-ea5b-6d83-4a6d37653ba2
  • Service: dotnet-ml

Associated WorkItem - 322617
@dotnet-bot dotnet-bot added ⌚ Not Triaged Not triaged labels Sep 19, 2024
@gewarren gewarren self-assigned this Oct 8, 2024
@gewarren gewarren added the 🗺️ reQUEST Triggers an issue to be imported into Quest. label Oct 8, 2024
@gewarren gewarren mentioned this issue Oct 8, 2024
Merged
@dotnet-policy-service dotnet-policy-service bot added the in-pr This issue will be closed (fixed) by an active pull request. label Oct 8, 2024
@sequestor sequestor bot added 📌 seQUESTered Identifies that an issue has been imported into Quest. and removed 🗺️ reQUEST Triggers an issue to be imported into Quest. labels Oct 8, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@gewarren gewarren

Labels
dotnet-ml/svc in-pr This issue will be closed (fixed) by an active pull request. Pri2 📌 seQUESTered Identifies that an issue has been imported into Quest. ⌚ Not Triaged Not triaged
Projects
No open projects
dotnet/docs October 2024 Sprint
Status: ✅ Done
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Various updates to what's new gewarren/docs
3 participants
@dotnet-bot @gewarren @torronen