Initial commit + eval table

README.md

@@ -178,7 +178,18 @@ full evaluation not complete
 
 # Fin-MPNET-Base (v0.1)
 
-This is a [sentence-transformers](https://www.SBERT.net) model: It maps sentences & paragraphs to a 768 dimensional dense vector space and can be used for tasks like clustering or semantic search.
+This is a fine-tuned [sentence-transformers](https://www.SBERT.net) model: It maps sentences & paragraphs to a 768 dimensional dense vector space and can be used for tasks like clustering or semantic search.
+
+This model aims to be very strong on Financial Document Retrieval Tasks, while trying to maintain as much generalized performance as possible.
+
+
+|                   | FiQA  | SciFact | AmazonReviews | OnlineBankingIntent |
+|-------------------|-------|---------|---------------|---------------------|
+| fin-mpnet-base    | 79.91 | 65.40   | 29.12         | 80.25               |
+| all-mpnet-base-v2 | 49.96 | 65.57   | 31.92         | 81.86               |
+| previous SoTA     | 56.59 |         |               |                     |
+
+v0.1 shows SoTA results on FiQA Test set while other non-financial benchmarks only drop a few small %.
 
 
 ## Usage (Sentence-Transformers)