Spaces:
Running
Running
Update README.md
Browse files
README.md
CHANGED
|
@@ -36,21 +36,11 @@ pinned: false
|
|
| 36 |
<p class="lg:col-span-3">
|
| 37 |
As is, CARROT supports routing to the following collection of large language models.
|
| 38 |
|
| 39 |
-
|
|
| 40 |
-
|
| 41 |
-
|
|
| 42 |
-
|
|
| 43 |
-
|
| 44 |
-
| openai-gpt-4o-mini | 0.15 | 0.6 |
|
| 45 |
-
| granite-3-2b-instruct | 0.1 | 0.1 |
|
| 46 |
-
| granite-3-8b-instruct | 0.2 | 0.2 |
|
| 47 |
-
| llama-3-1-70b-instruct | 0.9 | 0.9 |
|
| 48 |
-
| llama-3-1-8b-instruct | 0.2 | 0.2 |
|
| 49 |
-
| llama-3-2-1b-instruct | 0.06 | 0.06 |
|
| 50 |
-
| llama-3-2-3b-instruct | 0.06 | 0.06 |
|
| 51 |
-
| llama-3-3-70b-instruct | 0.9 | 0.9 |
|
| 52 |
-
| mixtral-8x7b-instruct | 0.6 | 0.6 |
|
| 53 |
-
| llama-3-405b-instruct | 3.5 | 3.5 |
|
| 54 |
</p>
|
| 55 |
|
| 56 |
|
|
|
|
| 36 |
<p class="lg:col-span-3">
|
| 37 |
As is, CARROT supports routing to the following collection of large language models.
|
| 38 |
|
| 39 |
+
| | claude-3-5-sonnet-v1 | titan-text-premier-v1 | openai-gpt-4o | openai-gpt-4o-mini | granite-3-2b-instruct | granite-3-8b-instruct | llama-3-1-70b-instruct | llama-3-1-8b-instruct | llama-3-2-1b-instruct | llama-3-2-3b-instruct | llama-3-3-70b-instruct | mixtral-8x7b-instruct | llama-3-405b-instruct |
|
| 40 |
+
|----------------------|---------------------|----------------------|---------------|--------------------|----------------------|----------------------|----------------------|----------------------|----------------------|----------------------|----------------------|----------------------|----------------------|
|
| 41 |
+
| **Input Token Cost ($ per 1M tokens)** | 3 | 0.5 | 2.5 | 0.15 | 0.1 | 0.2 | 0.9 | 0.2 | 0.06 | 0.06 | 0.9 | 0.6 | 3.5 |
|
| 42 |
+
| **Output Token Cost ($ per 1M tokens)** | 15 | 1.5 | 10 | 0.6 | 0.1 | 0.2 | 0.9 | 0.2 | 0.06 | 0.06 | 0.9 | 0.6 | 3.5 |
|
| 43 |
+
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 44 |
</p>
|
| 45 |
|
| 46 |
|