MyeongHoJeong commited on
Commit
d037e34
·
verified ·
1 Parent(s): c0d2387

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +18 -8
README.md CHANGED
@@ -5,6 +5,13 @@ license: apache-2.0
5
  pipeline_tag: text-generation
6
  language:
7
  - en
 
 
 
 
 
 
 
8
  - ko
9
  tags:
10
  - mistral3
@@ -14,6 +21,8 @@ tags:
14
  - jevbench
15
  - calibration
16
  - decode-free
 
 
17
  ---
18
 
19
  # Standard One 3B
@@ -43,16 +52,17 @@ served versus offline conditions; measured 24 September 2026.*
43
  - Send a state and a bounded rubric to receive probabilities for the supplied labels:
44
  `choice` selects among labeled options, `noul` is yes/no, and `score` uses an ordinal scale.
45
  The endpoint scores the labels in one forward pass without decoding answer text.
46
- - In the same-run **offline** comparison with the untuned base, 3B improves on all six suites. The
47
- public hard gain is only 1.80 percentage points and should not be read as a broad hard-task gain.
 
48
  - Probabilities are temperature-scaled and calibration-checked (hard-tier ECE, distribution
49
  total-variation) — see Benchmarks below.
50
- - The card metadata lists English and Korean. The training mixture is multilingual, and the reported
51
- nine-language MASSIVE intent evaluation has per-language results in
52
- [`docs/public-classification-suites.md`](docs/public-classification-suites.md); quality should not
53
- be assumed uniform across languages. The retained Pixtral vision tower accepts image data URLs;
54
- this card does not report a separate image-input benchmark.
55
- - Apache-2.0 throughout: base model, adapter and merged weights.
56
 
57
  ## Quick start
58
 
 
5
  pipeline_tag: text-generation
6
  language:
7
  - en
8
+ - ja
9
+ - zh
10
+ - es
11
+ - fr
12
+ - de
13
+ - pt
14
+ - ru
15
  - ko
16
  tags:
17
  - mistral3
 
21
  - jevbench
22
  - calibration
23
  - decode-free
24
+ - multilingual
25
+ - vision-language
26
  ---
27
 
28
  # Standard One 3B
 
52
  - Send a state and a bounded rubric to receive probabilities for the supplied labels:
53
  `choice` selects among labeled options, `noul` is yes/no, and `score` uses an ordinal scale.
54
  The endpoint scores the labels in one forward pass without decoding answer text.
55
+ - In the same-run **offline** comparison with its untuned base, 3B improves on all six suites; the
56
+ public hard gain is just 1.80 percentage points. These are not served-endpoint results, and that
57
+ small hard-tier gain is not evidence of broad hard-task improvement.
58
  - Probabilities are temperature-scaled and calibration-checked (hard-tier ECE, distribution
59
  total-variation) — see Benchmarks below.
60
+ - The shared training mixture covers English, Japanese, Chinese, Spanish, French, German,
61
+ Portuguese, Russian, and a smaller Korean share. See the nine-language MASSIVE intent results in
62
+ [`docs/public-classification-suites.md`](docs/public-classification-suites.md); performance varies
63
+ by language. The retained Pixtral vision tower accepts image data URLs; no separate image-input
64
+ decision benchmark is reported.
65
+ - Apache-2.0: base model, adapter, merged weights, and shared server code hosted in the 8B repository.
66
 
67
  ## Quick start
68