Option to use TIKTOKEN_BPE_HOST environment variable for configurable BPE host URL#357

Open

AitBaali-Hamza-bcg wants to merge 1 commit intoopenai:mainfrom AitBaali-Hamza-bcg:main

+11-7

Commits on Nov 4, 2024

Use TIKTOKEN_BPE_HOST environment variable for configurable BPE host URL
AitBaali-Hamza-bcg
authored