Shuu12121 commited on
Commit
eb8b5fe
·
verified ·
1 Parent(s): 8d9663c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -1
README.md CHANGED
@@ -31,7 +31,8 @@ For a version fine-tuned specifically for code search tasks, please refer to [Sh
31
  * Fine-tuning: Domain-specific code tasks
32
 
33
  The results below were obtained by randomly sampling 10,000 examples per language from the CodeSearchNet dataset, training them in a Sentence-BERT fashion, and evaluating on the MTEB CodeSearchNetRetrieval benchmark.
34
- All models listed in the table below were fine-tuned using the same approach. Those marked with 200 and the Finch models were trained with a Multiple Negatives Ranking Loss batch size of 200. Others were trained with a batch size of 40 (because larger batches could not fit into memory).
 
35
 
36
  | Model | go | java | javascript | php | python | ruby |
37
  | ---------------------------------- | ----- | ----- | ---------- | ----- | ------ | ----- |
 
31
  * Fine-tuning: Domain-specific code tasks
32
 
33
  The results below were obtained by randomly sampling 10,000 examples per language from the CodeSearchNet dataset, training them in a Sentence-BERT fashion, and evaluating on the MTEB CodeSearchNetRetrieval benchmark.
34
+ All models listed in the table below were fine-tuned using the same approach. Those marked with 200 and the Finch models were trained with a Multiple Negatives Ranking Loss batch size of 200. Others were trained with a batch size of 40 (because larger batches could not fit into memory).\
35
+ Finch-SmallBatch was trained with a smaller batch size of 40 to create a comparison model against the standard Finch models trained with batch size 200.
36
 
37
  | Model | go | java | javascript | php | python | ruby |
38
  | ---------------------------------- | ----- | ----- | ---------- | ----- | ------ | ----- |