Update README.md
Browse files
README.md
CHANGED
|
@@ -4,9 +4,11 @@ library_name: vllm
|
|
| 4 |
---
|
| 5 |
# Leanstral 119B A6B
|
| 6 |
|
| 7 |
-
Leanstral is the
|
|
|
|
| 8 |
|
| 9 |
-
Built as par of the [Mistral Small 4 family](https://huggingface.co/collections/mistralai/mistral-small-4),
|
|
|
|
| 10 |
|
| 11 |
For more information about the model and its scope, please read the related [blog post](https://mistral.ai/news/leanstral)
|
| 12 |
|
|
@@ -50,8 +52,8 @@ Make sure the latest version of `mistral-vibe` is installed.
|
|
| 50 |
uv pip install mistral-vibe --upgrade
|
| 51 |
```
|
| 52 |
|
| 53 |
-
Once installed,
|
| 54 |
-
Add
|
| 55 |
|
| 56 |
```
|
| 57 |
[[providers]]
|
|
@@ -68,10 +70,20 @@ thinking = "high"
|
|
| 68 |
temperature = 1.0
|
| 69 |
```
|
| 70 |
|
| 71 |
-
or via a local server:
|
| 72 |
|
| 73 |
```
|
| 74 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 75 |
```
|
| 76 |
|
| 77 |
Additionally, let's make sure we add a system prompt and that `leanstral` can be used as an agent.
|
|
|
|
| 4 |
---
|
| 5 |
# Leanstral 119B A6B
|
| 6 |
|
| 7 |
+
Leanstral is the first open-source code agent designed for [Lean4](https://github.com/leanprover/lean4), a proof assistant capable to express complex mathematical objects such as [perfectoid spaces](https://xenaproject.wordpress.com/2020/12/05/liquid-tensor-experiment/)
|
| 8 |
+
and software specifications like [properties of Rust fragments](https://github.com/AeneasVerif/aeneas)
|
| 9 |
|
| 10 |
+
Built as par of the [Mistral Small 4 family](https://huggingface.co/collections/mistralai/mistral-small-4),
|
| 11 |
+
it has multimodal capabilities, efficient architecture it is both formant and cost-efficient against existing closed-source competitors.
|
| 12 |
|
| 13 |
For more information about the model and its scope, please read the related [blog post](https://mistral.ai/news/leanstral)
|
| 14 |
|
|
|
|
| 52 |
uv pip install mistral-vibe --upgrade
|
| 53 |
```
|
| 54 |
|
| 55 |
+
Once installed, let's add the `leanstral` as a provider.
|
| 56 |
+
Add the model as a provider to your config (`~/.vibe/config.toml`) either via *the official API*:
|
| 57 |
|
| 58 |
```
|
| 59 |
[[providers]]
|
|
|
|
| 70 |
temperature = 1.0
|
| 71 |
```
|
| 72 |
|
| 73 |
+
or via a *local server* (see [vLLM](#vllm-recommended)):
|
| 74 |
|
| 75 |
```
|
| 76 |
+
[[providers]]
|
| 77 |
+
name = "vllm"
|
| 78 |
+
api_base = "http://<your-host-url>:800/v1"
|
| 79 |
+
reasoning_as_structured_content = true
|
| 80 |
+
reasoning_field_name = "reasoning_content"
|
| 81 |
+
[[models]]
|
| 82 |
+
name = "labs-leanstral-2603"
|
| 83 |
+
provider = "mistral-testing"
|
| 84 |
+
alias = "leanstral"
|
| 85 |
+
thinking = "high"
|
| 86 |
+
temperature = 1.0
|
| 87 |
```
|
| 88 |
|
| 89 |
Additionally, let's make sure we add a system prompt and that `leanstral` can be used as an agent.
|