Instructions to use FFI/SimCSE-NB-BERT-large with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use FFI/SimCSE-NB-BERT-large with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("FFI/SimCSE-NB-BERT-large", dtype="auto") - Notebooks
- Google Colab
- Kaggle
Commit ·
a69b830
1
Parent(s): c76d504
Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,7 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
This is a Norwegian sentence embedding model trained using the SimCSE methodology (Gao et.al, SimCSE: Simple Contrastive Learning of Sentence Embeddings, EMNLP 2021). It is trained from the NB-BERT-large model (https://huggingface.co/NbAiLab/nb-bert-large/). It is trained supervised on the Norwegian automatically translated mnli dataset (https://huggingface.co/datasets/NbAiLab/mnli-norwegian).
|
| 2 |
|
| 3 |
The training and performance of this model is described in the paper "Training and Evaluating Norwegian Sentece Embedding Models", published at NoDaLiDa 2023 (https://openreview.net/forum?id=tcxy7vRVKlg). In that paper we describe training several different Norwegian sentence embedding models. This is the best performing model on STS data of those described in the paper.
|
|
|
|
| 1 |
+
---
|
| 2 |
+
language:
|
| 3 |
+
- no
|
| 4 |
+
---
|
| 5 |
This is a Norwegian sentence embedding model trained using the SimCSE methodology (Gao et.al, SimCSE: Simple Contrastive Learning of Sentence Embeddings, EMNLP 2021). It is trained from the NB-BERT-large model (https://huggingface.co/NbAiLab/nb-bert-large/). It is trained supervised on the Norwegian automatically translated mnli dataset (https://huggingface.co/datasets/NbAiLab/mnli-norwegian).
|
| 6 |
|
| 7 |
The training and performance of this model is described in the paper "Training and Evaluating Norwegian Sentece Embedding Models", published at NoDaLiDa 2023 (https://openreview.net/forum?id=tcxy7vRVKlg). In that paper we describe training several different Norwegian sentence embedding models. This is the best performing model on STS data of those described in the paper.
|