Hugging Face's logo

Edentns
/
DataVortexS-10.7B-v0.1

Text Generation
Transformers
Safetensors
Korean
llama
conversational
text-generation-inference
Model card Files
xet
Community
Jeongwon Choi commited on
Commit
ff13f5a
·
verified ·
1 Parent(s): a1c9cde

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -8
README.md CHANGED
@@ -55,14 +55,13 @@ text = """\
55
 
56
  ### **[Ko LM Eval Harnesss](https://github.com/Beomi/ko-lm-evaluation-harness)**
57
 
58
- On Benchmarking ...
59
-
60
- | Task | 0-shot | 5-shot | 10-shot | 50-shot |
61
- | :--------------- | -----: | -----: | ------: | ------: |
62
- | kobest_boolq | 0.0 | 0.0 | 0.0 | 0.0 |
63
- | kobest_copa | 0.0 | 0.0 | 0.0 | 0.0 |
64
- | kobest_hellaswag | 0.0 | 0.0 | 0.0 | 0.0 |
65
- | kobest_sentineg | 0.0 | 0.0 | 0.0 | 0.0 |
66
 
67
  ### **[Ko-LLM-Leaderboard](https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard)**
68
 
 
55
 
56
  ### **[Ko LM Eval Harnesss](https://github.com/Beomi/ko-lm-evaluation-harness)**
57
 
58
+ | Task | 0-shot | 5-shot | 10-shot | 50-shot |
59
+ | :--------------- | -------------: | -----------: | ------------: | -----------: |
60
+ | kobest_boolq | 0.334282 | 0.642861 | 0.691496 | 0.638754 |
61
+ | kobest_copa | 0.584962 | 0.564325 | 0.570654 | 0.581035 |
62
+ | kobest_hellaswag | 0.340022 | 0.339401 | 0.341917 | 0.337713 |
63
+ | kobest_sentineg | 0.328257 | 0.414905 | 0.464711 | 0.888914 |
64
+ | **Average** | **0.39688075** | **0.490373** | **0.5171945** | **0.611604** |
 
65
 
66
  ### **[Ko-LLM-Leaderboard](https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard)**
67