Hugging Face's logo

kyujinpy
/
Sakura-SOLRCA-Instruct-DPO

Text Generation
Transformers
Safetensors
English
llama
conversational
Eval Results (legacy)
text-generation-inference
Model card Files
xet
 Community
2

Update README.md

#2
by cherry0328 - opened
base: refs/heads/main
←
from: refs/pr/2
Discussion Files changed
+15
-8
Files changed (1) hide show
  1. README.md +15 -8
README.md CHANGED
@@ -23,7 +23,8 @@ model-index:
23
  value: 71.16
24
  name: normalized accuracy
25
  source:
26
- url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=kyujinpy/Sakura-SOLRCA-Instruct-DPO
 
27
  name: Open LLM Leaderboard
28
  - task:
29
  type: text-generation
@@ -39,7 +40,8 @@ model-index:
39
  value: 88.49
40
  name: normalized accuracy
41
  source:
42
- url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=kyujinpy/Sakura-SOLRCA-Instruct-DPO
 
43
  name: Open LLM Leaderboard
44
  - task:
45
  type: text-generation
@@ -56,7 +58,8 @@ model-index:
56
  value: 66.17
57
  name: accuracy
58
  source:
59
- url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=kyujinpy/Sakura-SOLRCA-Instruct-DPO
 
60
  name: Open LLM Leaderboard
61
  - task:
62
  type: text-generation
@@ -72,7 +75,8 @@ model-index:
72
  - type: mc2
73
  value: 72.1
74
  source:
75
- url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=kyujinpy/Sakura-SOLRCA-Instruct-DPO
 
76
  name: Open LLM Leaderboard
77
  - task:
78
  type: text-generation
@@ -89,7 +93,8 @@ model-index:
89
  value: 82.95
90
  name: accuracy
91
  source:
92
- url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=kyujinpy/Sakura-SOLRCA-Instruct-DPO
 
93
  name: Open LLM Leaderboard
94
  - task:
95
  type: text-generation
@@ -106,8 +111,11 @@ model-index:
106
  value: 63.46
107
  name: accuracy
108
  source:
109
- url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=kyujinpy/Sakura-SOLRCA-Instruct-DPO
 
110
  name: Open LLM Leaderboard
 
 
111
  ---
112
 
113
  # **Sakura-SOLRCA-Instruct-DPO**
@@ -166,5 +174,4 @@ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-le
166
  |MMLU (5-Shot) |66.17|
167
  |TruthfulQA (0-shot) |72.10|
168
  |Winogrande (5-shot) |82.95|
169
- |GSM8k (5-shot) |63.46|
170
-
 
23
  value: 71.16
24
  name: normalized accuracy
25
  source:
26
+ url: >-
27
+ https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=kyujinpy/Sakura-SOLRCA-Instruct-DPO
28
  name: Open LLM Leaderboard
29
  - task:
30
  type: text-generation
 
40
  value: 88.49
41
  name: normalized accuracy
42
  source:
43
+ url: >-
44
+ https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=kyujinpy/Sakura-SOLRCA-Instruct-DPO
45
  name: Open LLM Leaderboard
46
  - task:
47
  type: text-generation
 
58
  value: 66.17
59
  name: accuracy
60
  source:
61
+ url: >-
62
+ https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=kyujinpy/Sakura-SOLRCA-Instruct-DPO
63
  name: Open LLM Leaderboard
64
  - task:
65
  type: text-generation
 
75
  - type: mc2
76
  value: 72.1
77
  source:
78
+ url: >-
79
+ https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=kyujinpy/Sakura-SOLRCA-Instruct-DPO
80
  name: Open LLM Leaderboard
81
  - task:
82
  type: text-generation
 
93
  value: 82.95
94
  name: accuracy
95
  source:
96
+ url: >-
97
+ https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=kyujinpy/Sakura-SOLRCA-Instruct-DPO
98
  name: Open LLM Leaderboard
99
  - task:
100
  type: text-generation
 
111
  value: 63.46
112
  name: accuracy
113
  source:
114
+ url: >-
115
+ https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=kyujinpy/Sakura-SOLRCA-Instruct-DPO
116
  name: Open LLM Leaderboard
117
+ base_model:
118
+ - kyujinpy/Sakura-SOLAR-Instruct
119
  ---
120
 
121
  # **Sakura-SOLRCA-Instruct-DPO**
 
174
  |MMLU (5-Shot) |66.17|
175
  |TruthfulQA (0-shot) |72.10|
176
  |Winogrande (5-shot) |82.95|
177
+ |GSM8k (5-shot) |63.46|