Hugging Face's logo

budecosystem
/
code-millenials-34b

Text Generation
Transformers
Safetensors
llama
code
Eval Results
text-generation-inference
Model card Files
xet
Community
2
dittops commited on
Commit
7d71bb0
·
1 Parent(s): fdb4dc3

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +17 -4
README.md CHANGED
@@ -5,6 +5,19 @@ metrics:
5
  library_name: transformers
6
  tags:
7
  - code
 
 
 
 
 
 
 
 
 
 
 
 
 
8
  ---
9
 
10
 
@@ -30,10 +43,10 @@ Note: The humaneval values of other models are taken from the official repos of
30
 
31
  ### Models
32
 
33
- | Model | Checkpoint | HumanEval |
34
- |---------|-------------|-----------|
35
- |Code Millenials 34B | <a href="https://huggingface.co/budecosystem/code-millenials-34b" target="_blank">HF Link</a> | 80.48 |
36
- |Code Millenials 13B | <a href="https://huggingface.co/budecosystem/code-millenials-13b" target="_blank">HF Link</a> | 76.21 |
37
 
38
 
39
 
 
5
  library_name: transformers
6
  tags:
7
  - code
8
+ model-index:
9
+ - name: Code Millenials
10
+ results:
11
+ - task:
12
+ type: text-generation
13
+ dataset:
14
+ type: openai_humaneval
15
+ name: HumanEval
16
+ metrics:
17
+ - name: pass@1
18
+ type: pass@1
19
+ value: 0.8048
20
+ verified: false
21
  ---
22
 
23
 
 
43
 
44
  ### Models
45
 
46
+ | Model | Checkpoint | HumanEval (+) | MBPP (+) |
47
+ |---------|-------------|---------------|----------|
48
+ |Code Millenials 34B | <a href="https://huggingface.co/budecosystem/code-millenials-34b" target="_blank">HF Link</a> | 80.48 (75) | 74.68 (62.9) |
49
+ |Code Millenials 13B | <a href="https://huggingface.co/budecosystem/code-millenials-13b" target="_blank">HF Link</a> | 76.21 (69.5) | 70.17 (57.6) |
50
 
51
 
52