Hugging Face's logo

mistralai
/
Pixtral-Large-Instruct-2411

vllm
mistral-common
Model card Files
xet
Community
24
pandora-s commited on
Commit
e8630b4
·
verified ·
1 Parent(s): 077572a

fix name

Browse files
Files changed (1) hide show
  1. README.md +4 -4
README.md CHANGED
@@ -160,10 +160,10 @@ With vision:
160
 
161
  | Model | MathVista (CoT) | MMMU (CoT) | ChartQA (CoT) | DocVQA (ANLS) | VQAv2 (VQA Match) | AIZD (BBox) | MM MT-Bench |
162
  |:----------------------------:|:---------------:|:----------:|:-------------:|:--------------:|:-----------------:|:-----------:|:-----------:|
163
- | **Mistral Large Vision** | **<u>69.4</u>** | 64.0 | 88.1 | **<u>93.3</u>**| **<u>80.9</u>** | 93.8 | 7.4 |
164
- | Gemini-1.5 Pro (measured)| 67.8 | 66.3 | 83.8 | 92.3 | 70.6 | **<u>94.6</u>**| 6.8 |
165
- | GPT-4o (measured) | 64.6 | **<u>68.6</u>**| 85.1 | 88.9 | 77.8 | 92.8 | **<u>7.7</u>**|
166
- | Claude-3.5 Sonnet (measured)| 67.1 | 68.4 | **<u>89.1</u>**| 88.6 | 69.5 | 76.9 | 7.3 |
167
 
168
  ## Usage
169
 
 
160
 
161
  | Model | MathVista (CoT) | MMMU (CoT) | ChartQA (CoT) | DocVQA (ANLS) | VQAv2 (VQA Match) | AIZD (BBox) | MM MT-Bench |
162
  |:----------------------------:|:---------------:|:----------:|:-------------:|:--------------:|:-----------------:|:-----------:|:-----------:|
163
+ | **Pixtral Large** | **<u>69.4</u>** | 64.0 | 88.1 | **<u>93.3</u>**| **<u>80.9</u>** | 93.8 | 7.4 |
164
+ | Gemini-1.5 Pro (measured) | 67.8 | 66.3 | 83.8 | 92.3 | 70.6 | **<u>94.6</u>**| 6.8 |
165
+ | GPT-4o (measured) | 64.6 | **<u>68.6</u>**| 85.1 | 88.9 | 77.8 | 92.8 | **<u>7.7</u>**|
166
+ | Claude-3.5 Sonnet (measured) | 67.1 | 68.4 | **<u>89.1</u>**| 88.6 | 69.5 | 76.9 | 7.3 |
167
 
168
  ## Usage
169