Hugging Face's logo

prithivMLmods
/
Calcium-Opus-14B-Elite2-R1

Text Generation
Transformers
Safetensors
English
qwen2
SFT
Opus
R1
trl
CoT
text-generation-inference
rL
conversational
Eval Results (legacy)
Model card Files
xet
Community
1
prithivMLmods commited on
Commit
603ad1f
·
verified ·
1 Parent(s): 3ef8f15

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +13 -9
README.md CHANGED
@@ -8,7 +8,6 @@ pipeline_tag: text-generation
8
  library_name: transformers
9
  tags:
10
  - SFT
11
- - Qwen
12
  - Opus
13
  - Reasoner
14
  - R1
@@ -31,7 +30,8 @@ model-index:
31
  value: 63.26
32
  name: averaged accuracy
33
  source:
34
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FCalcium-Opus-14B-Elite2-R1
 
35
  name: Open LLM Leaderboard
36
  - task:
37
  type: text-generation
@@ -47,7 +47,8 @@ model-index:
47
  value: 47.34
48
  name: normalized accuracy
49
  source:
50
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FCalcium-Opus-14B-Elite2-R1
 
51
  name: Open LLM Leaderboard
52
  - task:
53
  type: text-generation
@@ -63,7 +64,8 @@ model-index:
63
  value: 29.83
64
  name: exact match
65
  source:
66
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FCalcium-Opus-14B-Elite2-R1
 
67
  name: Open LLM Leaderboard
68
  - task:
69
  type: text-generation
@@ -79,7 +81,8 @@ model-index:
79
  value: 18.79
80
  name: acc_norm
81
  source:
82
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FCalcium-Opus-14B-Elite2-R1
 
83
  name: Open LLM Leaderboard
84
  - task:
85
  type: text-generation
@@ -94,7 +97,8 @@ model-index:
94
  value: 21.42
95
  name: acc_norm
96
  source:
97
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FCalcium-Opus-14B-Elite2-R1
 
98
  name: Open LLM Leaderboard
99
  - task:
100
  type: text-generation
@@ -111,7 +115,8 @@ model-index:
111
  value: 47.2
112
  name: accuracy
113
  source:
114
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FCalcium-Opus-14B-Elite2-R1
 
115
  name: Open LLM Leaderboard
116
  ---
117
  ![r1.gif](https://cdn-uploads.huggingface.co/production/uploads/65bb837dbfb878f46c77de4c/iHEhTX2ZGk9wmBMIcueTf.gif)
@@ -192,5 +197,4 @@ Summarized results can be found [here](https://huggingface.co/datasets/open-llm-
192
  |MATH Lvl 5 (4-Shot)| 29.83|
193
  |GPQA (0-shot) | 18.79|
194
  |MuSR (0-shot) | 21.42|
195
- |MMLU-PRO (5-shot) | 47.20|
196
-
 
8
  library_name: transformers
9
  tags:
10
  - SFT
 
11
  - Opus
12
  - Reasoner
13
  - R1
 
30
  value: 63.26
31
  name: averaged accuracy
32
  source:
33
+ url: >-
34
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FCalcium-Opus-14B-Elite2-R1
35
  name: Open LLM Leaderboard
36
  - task:
37
  type: text-generation
 
47
  value: 47.34
48
  name: normalized accuracy
49
  source:
50
+ url: >-
51
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FCalcium-Opus-14B-Elite2-R1
52
  name: Open LLM Leaderboard
53
  - task:
54
  type: text-generation
 
64
  value: 29.83
65
  name: exact match
66
  source:
67
+ url: >-
68
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FCalcium-Opus-14B-Elite2-R1
69
  name: Open LLM Leaderboard
70
  - task:
71
  type: text-generation
 
81
  value: 18.79
82
  name: acc_norm
83
  source:
84
+ url: >-
85
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FCalcium-Opus-14B-Elite2-R1
86
  name: Open LLM Leaderboard
87
  - task:
88
  type: text-generation
 
97
  value: 21.42
98
  name: acc_norm
99
  source:
100
+ url: >-
101
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FCalcium-Opus-14B-Elite2-R1
102
  name: Open LLM Leaderboard
103
  - task:
104
  type: text-generation
 
115
  value: 47.2
116
  name: accuracy
117
  source:
118
+ url: >-
119
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FCalcium-Opus-14B-Elite2-R1
120
  name: Open LLM Leaderboard
121
  ---
122
  ![r1.gif](https://cdn-uploads.huggingface.co/production/uploads/65bb837dbfb878f46c77de4c/iHEhTX2ZGk9wmBMIcueTf.gif)
 
197
  |MATH Lvl 5 (4-Shot)| 29.83|
198
  |GPQA (0-shot) | 18.79|
199
  |MuSR (0-shot) | 21.42|
200
+ |MMLU-PRO (5-shot) | 47.20|