Skip to content

Commit 8ec499c

Browse files
areibmanareibman
authored
Merge pull request #82 from joaonadkarni/fix-name-tokne-costs-not-defined
Fix 'Failed to update TOKEN_COSTS: name 'TOKEN_COSTS' is not defined'
2 parents cd7ee73 + 1f5b93d commit 8ec499c

6 files changed

+80
-35
lines changed

‎README.md

+13-6
Original file line numberDiff line numberDiff line change
@@ -287,10 +287,13 @@ Units denominated in USD. All prices can be located in `model_prices.json`.
287287
| claude-2 | $ 8.00 | $24.00 | 100,000 | 8191 |
288288
| claude-2.1 | $ 8.00 | $24.00 | 200,000 | 8191 |
289289
| claude-3-haiku-20240307 | $0.25 | $1.25 | 200,000 | 4096 |
290+
| claude-3-haiku-latest | $0.25 | $1.25 | 200,000 | 4096 |
290291
| claude-3-opus-20240229 | $15.00 | $75.00 | 200,000 | 4096 |
292+
| claude-3-opus-latest | $15.00 | $75.00 | 200,000 | 4096 |
291293
| claude-3-sonnet-20240229 | $ 3.00 | $15.00 | 200,000 | 4096 |
292294
| claude-3-5-sonnet-20240620 | $ 3.00 | $15.00 | 200,000 | 8192 |
293295
| claude-3-5-sonnet-20241022 | $ 3.00 | $15.00 | 200,000 | 8192 |
296+
| claude-3-5-sonnet-latest | $ 3.00 | $15.00 | 200,000 | 8192 |
294297
| text-bison | -- | -- | 8,192 | 2048 |
295298
| text-bison@001 | -- | -- | 8,192 | 1024 |
296299
| text-bison@002 | -- | -- | 8,192 | 1024 |
@@ -408,12 +411,12 @@ Units denominated in USD. All prices can be located in `model_prices.json`.
408411
| rerank-multilingual-v3.0 | $ 0.00 | $ 0.00 | 4,096 | 4096 |
409412
| rerank-english-v2.0 | $ 0.00 | $ 0.00 | 4,096 | 4096 |
410413
| rerank-multilingual-v2.0 | $ 0.00 | $ 0.00 | 4,096 | 4096 |
411-
| embed-english-v3.0 | $0.1 | $ 0.00 | 512 | nan |
412-
| embed-english-light-v3.0 | $0.1 | $ 0.00 | 512 | nan |
413-
| embed-multilingual-v3.0 | $0.1 | $ 0.00 | 512 | nan |
414-
| embed-english-v2.0 | $0.1 | $ 0.00 | 512 | nan |
415-
| embed-english-light-v2.0 | $0.1 | $ 0.00 | 512 | nan |
416-
| embed-multilingual-v2.0 | $0.1 | $ 0.00 | 256 | nan |
414+
| embed-english-v3.0 | $0.1 | $ 0.00 | 1,024 | nan |
415+
| embed-english-light-v3.0 | $0.1 | $ 0.00 | 1,024 | nan |
416+
| embed-multilingual-v3.0 | $0.1 | $ 0.00 | 1,024 | nan |
417+
| embed-english-v2.0 | $0.1 | $ 0.00 | 4,096 | nan |
418+
| embed-english-light-v2.0 | $0.1 | $ 0.00 | 1,024 | nan |
419+
| embed-multilingual-v2.0 | $0.1 | $ 0.00 | 768 | nan |
417420
| replicate/meta/llama-2-13b | $0.1 | $0.5 | 4,096 | 4096 |
418421
| replicate/meta/llama-2-13b-chat | $0.1 | $0.5 | 4,096 | 4096 |
419422
| replicate/meta/llama-2-70b | $0.65 | $2.75 | 4,096 | 4096 |
@@ -436,6 +439,7 @@ Units denominated in USD. All prices can be located in `model_prices.json`.
436439
| openrouter/anthropic/claude-3-haiku | $0.25 | $1.25 | nan | nan |
437440
| openrouter/anthropic/claude-3-haiku-20240307 | $0.25 | $1.25 | 200,000 | 4096 |
438441
| anthropic/claude-3-5-sonnet-20241022 | $ 3.00 | $15.00 | 200,000 | 8192 |
442+
| anthropic/claude-3-5-sonnet-latest | $ 3.00 | $15.00 | 200,000 | 8192 |
439443
| openrouter/anthropic/claude-3.5-sonnet | $ 3.00 | $15.00 | 200,000 | 8192 |
440444
| openrouter/anthropic/claude-3.5-sonnet:beta | $ 3.00 | $15.00 | 200,000 | 8192 |
441445
| openrouter/anthropic/claude-3-sonnet | $ 3.00 | $15.00 | nan | nan |
@@ -514,6 +518,7 @@ Units denominated in USD. All prices can be located in `model_prices.json`.
514518
| anthropic.claude-3-sonnet-20240229-v1:0 | $ 3.00 | $15.00 | 200,000 | 4096 |
515519
| anthropic.claude-3-5-sonnet-20240620-v1:0 | $ 3.00 | $15.00 | 200,000 | 4096 |
516520
| anthropic.claude-3-5-sonnet-20241022-v2:0 | $ 3.00 | $15.00 | 200,000 | 4096 |
521+
| anthropic.claude-3-5-sonnet-latest-v2:0 | $ 3.00 | $15.00 | 200,000 | 4096 |
517522
| anthropic.claude-3-haiku-20240307-v1:0 | $0.25 | $1.25 | 200,000 | 4096 |
518523
| anthropic.claude-3-opus-20240229-v1:0 | $15.00 | $75.00 | 200,000 | 4096 |
519524
| us.anthropic.claude-3-sonnet-20240229-v1:0 | $ 3.00 | $15.00 | 200,000 | 4096 |
@@ -762,6 +767,8 @@ Units denominated in USD. All prices can be located in `model_prices.json`.
762767
| databricks/databricks-mpt-7b-instruct | $0.50001 | $ 0.00 | 8,192 | 8192 |
763768
| databricks/databricks-bge-large-en | $0.10003 | $ 0.00 | 512 | nan |
764769
| databricks/databricks-gte-large-en | $0.12999 | $ 0.00 | 8,192 | nan |
770+
| azure/gpt-4o-mini-2024-07-18 | $0.165 | $0.66 | 128,000 | 16384 |
771+
| amazon.titan-embed-image-v1 | $0.8 | $ 0.00 | 128 | nan |
765772

766773
### Callback handlers
767774
You may also calculate token costs in LLM wrapper/framework libraries using callbacks.

0 commit comments

Comments
 (0)