Spaces:
Running
Running
Update README.md
Browse files
README.md
CHANGED
|
@@ -33,5 +33,22 @@ Edit this `README.md` markdown file to author your organization card.
|
|
| 33 |
<div class="underline">Train CARROT</div>
|
| 34 |
|
| 35 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 36 |
|
| 37 |
|
|
|
|
| 33 |
<div class="underline">Train CARROT</div>
|
| 34 |
|
| 35 |
|
| 36 |
+
As is, CARROT supports routing to the following collection of large language models.
|
| 37 |
+
|
| 38 |
+
| Model | Input Token Cost ($ per 1M tokens) | Output Token Cost ($ per 1M tokens) |
|
| 39 |
+
|----------------------------|----------------------------------|-----------------------------------|
|
| 40 |
+
| claude-3-5-sonnet-v1 | 3 | 15 |
|
| 41 |
+
| titan-text-premier-v1 | 0.5 | 1.5 |
|
| 42 |
+
| openai-gpt-4o | 2.5 | 10 |
|
| 43 |
+
| openai-gpt-4o-mini | 0.15 | 0.6 |
|
| 44 |
+
| granite-3-2b-instruct | 0.1 | 0.1 |
|
| 45 |
+
| granite-3-8b-instruct | 0.2 | 0.2 |
|
| 46 |
+
| llama-3-1-70b-instruct | 0.9 | 0.9 |
|
| 47 |
+
| llama-3-1-8b-instruct | 0.2 | 0.2 |
|
| 48 |
+
| llama-3-2-1b-instruct | 0.06 | 0.06 |
|
| 49 |
+
| llama-3-2-3b-instruct | 0.06 | 0.06 |
|
| 50 |
+
| llama-3-3-70b-instruct | 0.9 | 0.9 |
|
| 51 |
+
| mixtral-8x7b-instruct | 0.6 | 0.6 |
|
| 52 |
+
| llama-3-405b-instruct | 3.5 | 3.5 |
|
| 53 |
|
| 54 |
|