minishlab
/

potion-code-16M-v2

static-embeddings

Model card Files Files and versions

stephantulkens commited on Jul 8

Commit

d3daf3e

·

verified ·

1 Parent(s): 48e7bd7

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -65,8 +65,8 @@ Results on the [CoIR benchmark](https://github.com/CoIR-team/coir) on [MTEB](htt
 |---|---|---|---|---|---|---|---|---|---|---|---|---|
 | CodeRankEmbed | 137M | 59.14 | 23.46 | 94.70 | 42.61 | 78.11 | 76.39 | 66.43 | 34.84 | 35.92 | 80.53 | 58.37 |
 | BM25 | — | 42.31 | 4.76 | 40.86 | 59.19 | 68.15 | 53.97 | 47.78 | 34.42 | 18.75 | 70.26 | 24.94 |
-| potion-code-16M | 16M | 37.31 | 3.96 | 41.93 | 36.26 | 50.17 | 43.70 | 39.76 | 31.72 | 23.80 | 57.47 | 44.29 |
 | **potion-code-16M-v2** | **16M** | **40.89** | **5.20** | **46.32** | **37.97** | **53.43** | **43.70** | **43.63** | **32.64** | **27.80** | **59.63** | **58.62** |
 | potion-retrieval-32M | 32M | 32.10 | 4.22 | 31.80 | 36.71 | 45.11 | 38.64 | 29.97 | 32.62 | 8.70 | 56.26 | 36.93 |
 | potion-base-32M | 32M | 31.42 | 3.37 | 29.58 | 34.77 | 42.69 | 37.88 | 28.51 | 30.55 | 14.61 | 53.36 | 38.88 |

 |---|---|---|---|---|---|---|---|---|---|---|---|---|
 | CodeRankEmbed | 137M | 59.14 | 23.46 | 94.70 | 42.61 | 78.11 | 76.39 | 66.43 | 34.84 | 35.92 | 80.53 | 58.37 |
 | BM25 | — | 42.31 | 4.76 | 40.86 | 59.19 | 68.15 | 53.97 | 47.78 | 34.42 | 18.75 | 70.26 | 24.94 |
 | **potion-code-16M-v2** | **16M** | **40.89** | **5.20** | **46.32** | **37.97** | **53.43** | **43.70** | **43.63** | **32.64** | **27.80** | **59.63** | **58.62** |
+| potion-code-16M | 16M | 37.31 | 3.96 | 41.93 | 36.26 | 50.17 | 43.70 | 39.76 | 31.72 | 23.80 | 57.47 | 44.29 |
 | potion-retrieval-32M | 32M | 32.10 | 4.22 | 31.80 | 36.71 | 45.11 | 38.64 | 29.97 | 32.62 | 8.70 | 56.26 | 36.93 |
 | potion-base-32M | 32M | 31.42 | 3.37 | 29.58 | 34.77 | 42.69 | 37.88 | 28.51 | 30.55 | 14.61 | 53.36 | 38.88 |