Instructions to use answerdotai/ModernBERT-base with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use answerdotai/ModernBERT-base with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="answerdotai/ModernBERT-base")# Load model directly from transformers import AutoTokenizer, AutoModelForMaskedLM tokenizer = AutoTokenizer.from_pretrained("answerdotai/ModernBERT-base") model = AutoModelForMaskedLM.from_pretrained("answerdotai/ModernBERT-base") - Notebooks
- Google Colab
- Kaggle
Tom Aarsen commited on
Commit ·
1a13461
1
Parent(s): 290243f
Remove unpad_inputs for now
Browse filesShould depending on user's attn_implementation instead
- config.json +0 -1
config.json
CHANGED
|
@@ -43,7 +43,6 @@
|
|
| 43 |
"tie_word_embeddings": true,
|
| 44 |
"torch_dtype": "float32",
|
| 45 |
"transformers_version": "4.47.0.dev0",
|
| 46 |
-
"unpad_inputs": true,
|
| 47 |
"unpad_no_grad": true,
|
| 48 |
"vocab_size": 50368
|
| 49 |
}
|
|
|
|
| 43 |
"tie_word_embeddings": true,
|
| 44 |
"torch_dtype": "float32",
|
| 45 |
"transformers_version": "4.47.0.dev0",
|
|
|
|
| 46 |
"unpad_no_grad": true,
|
| 47 |
"vocab_size": 50368
|
| 48 |
}
|