Hugging Face's logo

Edentns
/
DataVortexS-10.7B-v0.3

Text Generation
Transformers
Safetensors
Korean
llama
conversational
text-generation-inference
Model card Files
xet
Community
Jeongwon Choi commited on
Commit
4b9cecf
·
verified ·
1 Parent(s): 7faa21d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -8
README.md CHANGED
@@ -55,14 +55,13 @@ text = """\
55
 
56
  ### **[Ko LM Eval Harnesss](https://github.com/Beomi/ko-lm-evaluation-harness)**
57
 
58
- On Benchmarking ...
59
-
60
- | Task | 0-shot | 5-shot | 10-shot | 50-shot |
61
- | :--------------- | -----: | -----: | ------: | ------: |
62
- | kobest_boolq | 0.0 | 0.0 | 0.0 | 0.0 |
63
- | kobest_copa | 0.0 | 0.0 | 0.0 | 0.0 |
64
- | kobest_hellaswag | 0.0 | 0.0 | 0.0 | 0.0 |
65
- | kobest_sentineg | 0.0 | 0.0 | 0.0 | 0.0 |
66
 
67
  ### **[Ko-LLM-Leaderboard](https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard)**
68
 
 
55
 
56
  ### **[Ko LM Eval Harnesss](https://github.com/Beomi/ko-lm-evaluation-harness)**
57
 
58
+ | Task | 0-shot | 5-shot | 10-shot | 50-shot |
59
+ | :--------------- | -------------: | -------------: | ------------: | -------------: |
60
+ | kobest_boolq | 0.606754 | 0.553485 | 0.583201 | 0.587602 |
61
+ | kobest_copa | 0.603643 | 0.625567 | 0.618533 | 0.627404 |
62
+ | kobest_hellaswag | 0.360793 | 0.366002 | 0.37105 | 0.357439 |
63
+ | kobest_sentineg | 0.652929 | 0.751097 | 0.742426 | 0.760152 |
64
+ | **Average** | **0.55602975** | **0.57403775** | **0.5788025** | **0.58314925** |
 
65
 
66
  ### **[Ko-LLM-Leaderboard](https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard)**
67