Hugging Face's logo

vicgalle
/
ConfigurableBeagle-11B

Text Generation
Transformers
Safetensors
mistral
conversational
Eval Results (legacy)
text-generation-inference
Model card Files
xet
Community
4
vicgalle commited on
Commit
caa986d
·
verified ·
1 Parent(s): 50340c4

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +14 -9
README.md CHANGED
@@ -2,7 +2,7 @@
2
  license: apache-2.0
3
  library_name: transformers
4
  datasets:
5
- - jondurbin/truthy-dpo-v0.1
6
  model-index:
7
  - name: ConfigurableBeagle-11B
8
  results:
@@ -21,7 +21,8 @@ model-index:
21
  value: 72.53
22
  name: normalized accuracy
23
  source:
24
- url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=vicgalle/ConfigurableBeagle-11B
 
25
  name: Open LLM Leaderboard
26
  - task:
27
  type: text-generation
@@ -37,7 +38,8 @@ model-index:
37
  value: 88.85
38
  name: normalized accuracy
39
  source:
40
- url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=vicgalle/ConfigurableBeagle-11B
 
41
  name: Open LLM Leaderboard
42
  - task:
43
  type: text-generation
@@ -54,7 +56,8 @@ model-index:
54
  value: 66.71
55
  name: accuracy
56
  source:
57
- url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=vicgalle/ConfigurableBeagle-11B
 
58
  name: Open LLM Leaderboard
59
  - task:
60
  type: text-generation
@@ -70,7 +73,8 @@ model-index:
70
  - type: mc2
71
  value: 77.13
72
  source:
73
- url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=vicgalle/ConfigurableBeagle-11B
 
74
  name: Open LLM Leaderboard
75
  - task:
76
  type: text-generation
@@ -87,7 +91,8 @@ model-index:
87
  value: 83.27
88
  name: accuracy
89
  source:
90
- url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=vicgalle/ConfigurableBeagle-11B
 
91
  name: Open LLM Leaderboard
92
  - task:
93
  type: text-generation
@@ -104,7 +109,8 @@ model-index:
104
  value: 63.91
105
  name: accuracy
106
  source:
107
- url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=vicgalle/ConfigurableBeagle-11B
 
108
  name: Open LLM Leaderboard
109
  ---
110
 
@@ -121,5 +127,4 @@ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-le
121
  |MMLU (5-Shot) |66.71|
122
  |TruthfulQA (0-shot) |77.13|
123
  |Winogrande (5-shot) |83.27|
124
- |GSM8k (5-shot) |63.91|
125
-
 
2
  license: apache-2.0
3
  library_name: transformers
4
  datasets:
5
+ - vicgalle/configurable-system-prompt-multitask
6
  model-index:
7
  - name: ConfigurableBeagle-11B
8
  results:
 
21
  value: 72.53
22
  name: normalized accuracy
23
  source:
24
+ url: >-
25
+ https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=vicgalle/ConfigurableBeagle-11B
26
  name: Open LLM Leaderboard
27
  - task:
28
  type: text-generation
 
38
  value: 88.85
39
  name: normalized accuracy
40
  source:
41
+ url: >-
42
+ https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=vicgalle/ConfigurableBeagle-11B
43
  name: Open LLM Leaderboard
44
  - task:
45
  type: text-generation
 
56
  value: 66.71
57
  name: accuracy
58
  source:
59
+ url: >-
60
+ https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=vicgalle/ConfigurableBeagle-11B
61
  name: Open LLM Leaderboard
62
  - task:
63
  type: text-generation
 
73
  - type: mc2
74
  value: 77.13
75
  source:
76
+ url: >-
77
+ https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=vicgalle/ConfigurableBeagle-11B
78
  name: Open LLM Leaderboard
79
  - task:
80
  type: text-generation
 
91
  value: 83.27
92
  name: accuracy
93
  source:
94
+ url: >-
95
+ https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=vicgalle/ConfigurableBeagle-11B
96
  name: Open LLM Leaderboard
97
  - task:
98
  type: text-generation
 
109
  value: 63.91
110
  name: accuracy
111
  source:
112
+ url: >-
113
+ https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=vicgalle/ConfigurableBeagle-11B
114
  name: Open LLM Leaderboard
115
  ---
116
 
 
127
  |MMLU (5-Shot) |66.71|
128
  |TruthfulQA (0-shot) |77.13|
129
  |Winogrande (5-shot) |83.27|
130
+ |GSM8k (5-shot) |63.91|