Hugging Face's logo

CarrotAI
/
Llama-3.2-Rabbit-Ko-3B-Instruct

Text Generation
Safetensors
Korean
English
llama
conversational
Model card Files
xet
Community
CarrotAI commited on
Commit
7232fbd
·
verified ·
1 Parent(s): 8c9d5fc

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -2
README.md CHANGED
@@ -19,8 +19,14 @@ new_version: CarrotAI/Llama-3.2-Rabbit-Ko-3B-Instruct-2412
19
 
20
  |Tasks|Version| Filter |n-shot| Metric | |Value | |Stderr|
21
  |-----|------:|----------------|-----:|-----------|---|-----:|---|-----:|
22
- |gsm8k| 3|flexible-extract| 5|exact_match|↑ |0.6179|± |0.0134|
23
- | | |strict-match | 5|exact_match|↑ |0.6171|± |0.0134|
 
 
 
 
 
 
24
 
25
  | Tasks |Version|Filter|n-shot| Metric | |Value | |Stderr|
26
  |-------------------------------|------:|------|-----:|--------|---|-----:|---|-----:|
 
19
 
20
  |Tasks|Version| Filter |n-shot| Metric | |Value | |Stderr|
21
  |-----|------:|----------------|-----:|-----------|---|-----:|---|-----:|
22
+ |gsm8k| 3|flexible-extract| 5|exact_match|↑ |0.6490|± |0.0131|
23
+ | | |strict-match | 5|exact_match|↑ |0.0023|± |0.0013|
24
+ |gsm8k-ko| 3|flexible-extract| 5|exact_match|↑ |0.3275|± |0.0134|
25
+ | | |strict-match | 5|exact_match|↑ |0.2737|± |0.0134|
26
+ |ifeval| 4|none | 5|inst_level_loose_acc |↑ |0.8058|± | N/A|
27
+ | | |none | 5|inst_level_strict_acc |↑ |0.7686|± | N/A|
28
+ | | |none | 5|prompt_level_loose_acc |↑ |0.7320|± |0.0191|
29
+ | | |none | 5|prompt_level_strict_acc|↑ |0.6858|± |0.0200|
30
 
31
  | Tasks |Version|Filter|n-shot| Metric | |Value | |Stderr|
32
  |-------------------------------|------:|------|-----:|--------|---|-----:|---|-----:|