vllm
oss-enab commited on
Commit
dc964b7
·
verified ·
1 Parent(s): 79756d6

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +31 -0
README.md ADDED
@@ -0,0 +1,31 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Leanstral 119B A6B
2
+
3
+ Leanstral is the firsd open-source code agent designed for Lean4, a proof assistant capable to express complex mathematical objects such as [perfectoid spaces](https://xenaproject.wordpress.com/2020/12/05/liquid-tensor-experiment/) and software specifications like [properties of Rust fragments](https://github.com/AeneasVerif/aeneas)
4
+
5
+ Built as par of the Mistral Small 4 family, it has multimodal capabilities, efficient architecture it is both formant and cost-efficient against existing closed-source competitors.
6
+
7
+ For more information about the model and its scope, please read the related [blog post]()
8
+
9
+ ## Key Features
10
+
11
+ Leanstral consists of the following architectural choices:
12
+
13
+ - MoE: 128 experts and 4 active.
14
+ - 119B with 6.5B activated parameters per token.
15
+ - 256k Context Length.
16
+ - Multimodal Input: Accepts both text and image input, with text output.
17
+
18
+ Leanstral offers the following capabilities:
19
+
20
+ - **Proof Agentic**: Leanstral is specifically design to perform proof engineer scenarios.
21
+ - **Vision**: Enables the model to analyze images and provide insights based on visual content, in addition to text.
22
+ - **Multilingual**: Supports dozens of languages, including English, French, Spanish, German, Italian, Portuguese, Dutch, Chinese, Japanese, Korean, Arabic.
23
+ - **System Prompt**: Maintains strong adherence and support for system prompts.
24
+ - **Speed-Optimized**: Delivers best-in-class performance and speed.
25
+ - **Apache 2.0 License**: Open-source license allowing usage and modification for both commercial and non-commercial purposes.
26
+ - **Large Context Window**: Supports a 256k context window.
27
+
28
+ ### Examples
29
+
30
+ ## Usage
31
+