Hugging Face's logo

GaMS-Beta
/
GaMS-9B-Instruct-DPO-Translator

Text Generation
Safetensors
gemma2
conversational
Model card Files
xet
Community
DarioVajda commited on
Commit
319c507
·
verified ·
1 Parent(s): cabc1ce

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -84,9 +84,9 @@ The model was evaluated by our custom script on three types of data. The results
84
 
85
  | Model | Overall Comet | ccnews | nemotron | wikipedia | Bad Lang (%) | Short (%) | Bad Markdown (%) |
86
  | --- | --- | --- | --- | --- | --- | --- | --- |
87
- | gemini-2.5-flash | **0.717982** | 0.702981 | **0.697498** | **0.753924** | **0.35%** | 0.42% | **3.70%** |
88
- | GaMS-9B-Instruct-DPO-Translator | 0.714729 | **0.708317** | 0.689316 | 0.746768 | 1.88% | 1.56% | 13.22% |
89
- | GaMS-9B-SFT-Translator-DPO | 0.708042 | 0.702903 | 0.679462 | 0.742583 | 0.91% | **0.28%** | 18.28% |
90
  | GaMS-27B-Instruct | 0.701284 | 0.686480 | 0.680014 | 0.730733 | 27.28% | 5.36% | 62.07% |
91
  | GaMS-9B-Instruct | 0.693659 | 0.685006 | 0.673394 | 0.723470 | 13.50% | 4.83% | 33.15% |
92
  | EuroLLM-9B-Instruct | 0.689321 | 0.668084 | 0.670723 | 0.729227 | 8.97% | 1.89% | 35.08% |
 
84
 
85
  | Model | Overall Comet | ccnews | nemotron | wikipedia | Bad Lang (%) | Short (%) | Bad Markdown (%) |
86
  | --- | --- | --- | --- | --- | --- | --- | --- |
87
+ | gemini-2.5-flash | 0.717982 | 0.702981 | 0.697498 | 0.753924 | 0.35% | 0.42% | 3.70% |
88
+ | **GaMS-9B-Instruct-DPO-Translator** | **0.714729** | **0.708317** | **0.689316** | **0.746768** | **1.88%** | **1.56%** | **13.22%** |
89
+ | GaMS-9B-SFT-Translator-DPO | 0.708042 | 0.702903 | 0.679462 | 0.742583 | 0.91% | 0.28% | 18.28% |
90
  | GaMS-27B-Instruct | 0.701284 | 0.686480 | 0.680014 | 0.730733 | 27.28% | 5.36% | 62.07% |
91
  | GaMS-9B-Instruct | 0.693659 | 0.685006 | 0.673394 | 0.723470 | 13.50% | 4.83% | 33.15% |
92
  | EuroLLM-9B-Instruct | 0.689321 | 0.668084 | 0.670723 | 0.729227 | 8.97% | 1.89% | 35.08% |