Instructions to use zeromodels/modernbert_large with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Keras
How to use zeromodels/modernbert_large with Keras:
# Available backend options are: "jax", "torch", "tensorflow". import os os.environ["KERAS_BACKEND"] = "jax" import keras model = keras.saving.load_model("hf://zeromodels/modernbert_large") - Notebooks
- Google Colab
- Kaggle
Add Available classes section to model card
Browse files
README.md
CHANGED
|
@@ -55,6 +55,24 @@ Load any ModernBERT variant the same way with `from_weights("kerasformers/<varia
|
|
| 55 |
| `modernbert_base` | [`kerasformers/modernbert_base`](https://huggingface.co/kerasformers/modernbert_base) | 22 | 768 |
|
| 56 |
| `modernbert_large` | [`kerasformers/modernbert_large`](https://huggingface.co/kerasformers/modernbert_large) | 28 | 1024 |
|
| 57 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 58 |
## Tips
|
| 59 |
|
| 60 |
- Set `KERAS_BACKEND` **before** importing Keras / kerasformers.
|
|
|
|
| 55 |
| `modernbert_base` | [`kerasformers/modernbert_base`](https://huggingface.co/kerasformers/modernbert_base) | 22 | 768 |
|
| 56 |
| `modernbert_large` | [`kerasformers/modernbert_large`](https://huggingface.co/kerasformers/modernbert_large) | 28 | 1024 |
|
| 57 |
|
| 58 |
+
## Available classes
|
| 59 |
+
|
| 60 |
+
Load any of these from this repo with `from_weights("kerasformers/modernbert_large")` (or on the fly via the `hf:` prefix). The pretrained backbone is shared; task heads not stored in this checkpoint start randomly initialized, ready for fine-tuning (or load a `hf:` fine-tune).
|
| 61 |
+
|
| 62 |
+
| Class | Task |
|
| 63 |
+
|---|---|
|
| 64 |
+
| `ModernBertModel` | Encoder backbone |
|
| 65 |
+
| `ModernBertMaskedLM` | Masked language modeling (fill-mask) |
|
| 66 |
+
| `ModernBertSequenceClassify` | Sequence classification |
|
| 67 |
+
| `ModernBertTokenClassify` | Token classification (NER / POS) |
|
| 68 |
+
| `ModernBertQnA` | Extractive question answering |
|
| 69 |
+
| `ModernBertMultipleChoice` | Multiple choice |
|
| 70 |
+
|
| 71 |
+
```python
|
| 72 |
+
from kerasformers.models.modernbert import ModernBertSequenceClassify
|
| 73 |
+
model = ModernBertSequenceClassify.from_weights("kerasformers/modernbert_large")
|
| 74 |
+
```
|
| 75 |
+
|
| 76 |
## Tips
|
| 77 |
|
| 78 |
- Set `KERAS_BACKEND` **before** importing Keras / kerasformers.
|