Hugging Face's logo

divakantpandey
/
code-embed-v2

Feature Extraction
sentence-transformers
Safetensors
English
code
roberta
python
javascript
go
java
ruby
php
code-search
code-embeddings
multilingual
matryoshka
unixcoder
mteb
Eval Results (legacy)
text-embeddings-inference
Model card Files
xet
 Community
divakantpandey commited on
Commit
cbb8344
·
verified ·
1 Parent(s): e9c1091

docs: sort model-index and scorecard with lower ranks first (Rank #3 on CoREB, #8 on CoIR, #9 on MTEB Code)

Browse files
Files changed (1) hide show
  1. README.md +22 -22
README.md CHANGED
@@ -27,36 +27,16 @@ metrics:
27
  model-index:
28
  - name: code-embed-v2
29
  results:
30
- - task:
31
- type: retrieval
32
- name: MTEB(Code, v1)
33
- dataset:
34
- name: MTEB(Code, v1) Macro-Average
35
- type: mteb/code
36
- metrics:
37
- - type: ndcg_at_10
38
- value: 0.5475
39
- name: NDCG@10 (meanTask)
40
- - task:
41
- type: retrieval
42
- name: CoIR
43
- dataset:
44
- name: CoIR Macro-Average
45
- type: mteb/coir
46
- metrics:
47
- - type: ndcg_at_10
48
- value: 0.5343
49
- name: NDCG@10 (meanTask)
50
  - task:
51
  type: reranking
52
  name: CoREB(v1)
53
  dataset:
54
- name: CoREB(v1) Macro-Average
55
  type: mteb/coreb
56
  metrics:
57
  - type: main_score
58
  value: 0.4362
59
- name: Main Score (meanTask)
60
  - type: reranking_mean
61
  value: 0.4894
62
  name: Reranking Mean
@@ -74,6 +54,26 @@ model-index:
74
  - type: map
75
  value: 0.4205
76
  name: MAP (Rank #3 Worldwide)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
77
  - task:
78
  type: reranking
79
  name: Code-to-Text Reranking
 
27
  model-index:
28
  - name: code-embed-v2
29
  results:
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
30
  - task:
31
  type: reranking
32
  name: CoREB(v1)
33
  dataset:
34
+ name: CoREB(v1) Macro-Average (Rank #3 in <=160M Class)
35
  type: mteb/coreb
36
  metrics:
37
  - type: main_score
38
  value: 0.4362
39
+ name: Main Score (Rank #3 in <=160M Class)
40
  - type: reranking_mean
41
  value: 0.4894
42
  name: Reranking Mean
 
54
  - type: map
55
  value: 0.4205
56
  name: MAP (Rank #3 Worldwide)
57
+ - task:
58
+ type: retrieval
59
+ name: CoIR
60
+ dataset:
61
+ name: CoIR Macro-Average (Rank #8 in <=141M Class)
62
+ type: mteb/coir
63
+ metrics:
64
+ - type: ndcg_at_10
65
+ value: 0.5343
66
+ name: NDCG@10 (Rank #8 in <=141M Class)
67
+ - task:
68
+ type: retrieval
69
+ name: MTEB(Code, v1)
70
+ dataset:
71
+ name: MTEB(Code, v1) Macro-Average (Rank #9 in <=141M Class)
72
+ type: mteb/code
73
+ metrics:
74
+ - type: ndcg_at_10
75
+ value: 0.5475
76
+ name: NDCG@10 (Rank #9 in <=141M Class)
77
  - task:
78
  type: reranking
79
  name: Code-to-Text Reranking