Fill-Mask
Transformers
PyTorch
Norwegian
Norwegian Bokmål
Norwegian Nynorsk
BERT
NorBERT
Norwegian
encoder
custom_code
Instructions to use ltg/norbert3-base with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use ltg/norbert3-base with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="ltg/norbert3-base", trust_remote_code=True)# Load model directly from transformers import AutoModelForMaskedLM model = AutoModelForMaskedLM.from_pretrained("ltg/norbert3-base", trust_remote_code=True, dtype="auto") - Notebooks
- Google Colab
- Kaggle
Update config.json
Browse files- config.json +9 -0
config.json
CHANGED
|
@@ -2,6 +2,15 @@
|
|
| 2 |
"architectures": [
|
| 3 |
"NorbertForMaskedLM"
|
| 4 |
],
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 5 |
"attention_probs_dropout_prob": 0.1,
|
| 6 |
"hidden_dropout_prob": 0.1,
|
| 7 |
"hidden_size": 768,
|
|
|
|
| 2 |
"architectures": [
|
| 3 |
"NorbertForMaskedLM"
|
| 4 |
],
|
| 5 |
+
"auto_map": {
|
| 6 |
+
"AutoConfig": "configuration_norbert.NorbertConfig",
|
| 7 |
+
"AutoModel": "modeling_norbert.NorbertModel",
|
| 8 |
+
"AutoModelForMaskedLM": "modeling_norbert.NorbertForMaskedLM",
|
| 9 |
+
"AutoModelForSequenceClassification": "modeling_norbert.NorbertForSequenceClassification",
|
| 10 |
+
"AutoModelForTokenClassification": "modeling_norbert.NorbertForTokenClassification",
|
| 11 |
+
"AutoModelForQuestionAnswering": "modeling_norbert.NorbertForQuestionAnswering",
|
| 12 |
+
"AutoModelForMultipleChoice": "modeling_norbert.NorbertForMultipleChoice"
|
| 13 |
+
},
|
| 14 |
"attention_probs_dropout_prob": 0.1,
|
| 15 |
"hidden_dropout_prob": 0.1,
|
| 16 |
"hidden_size": 768,
|