Update README.md
Browse files
README.md
CHANGED
|
@@ -31,7 +31,8 @@ For a version fine-tuned specifically for code search tasks, please refer to [Sh
|
|
| 31 |
* Fine-tuning: Domain-specific code tasks
|
| 32 |
|
| 33 |
The results below were obtained by randomly sampling 10,000 examples per language from the CodeSearchNet dataset, training them in a Sentence-BERT fashion, and evaluating on the MTEB CodeSearchNetRetrieval benchmark.
|
| 34 |
-
All models listed in the table below were fine-tuned using the same approach. Those marked with 200 and the Finch models were trained with a Multiple Negatives Ranking Loss batch size of 200. Others were trained with a batch size of 40 (because larger batches could not fit into memory)
|
|
|
|
| 35 |
|
| 36 |
| Model | go | java | javascript | php | python | ruby |
|
| 37 |
| ---------------------------------- | ----- | ----- | ---------- | ----- | ------ | ----- |
|
|
|
|
| 31 |
* Fine-tuning: Domain-specific code tasks
|
| 32 |
|
| 33 |
The results below were obtained by randomly sampling 10,000 examples per language from the CodeSearchNet dataset, training them in a Sentence-BERT fashion, and evaluating on the MTEB CodeSearchNetRetrieval benchmark.
|
| 34 |
+
All models listed in the table below were fine-tuned using the same approach. Those marked with 200 and the Finch models were trained with a Multiple Negatives Ranking Loss batch size of 200. Others were trained with a batch size of 40 (because larger batches could not fit into memory).\
|
| 35 |
+
Finch-SmallBatch was trained with a smaller batch size of 40 to create a comparison model against the standard Finch models trained with batch size 200.
|
| 36 |
|
| 37 |
| Model | go | java | javascript | php | python | ruby |
|
| 38 |
| ---------------------------------- | ----- | ----- | ---------- | ----- | ------ | ----- |
|