Instructions to use akhooli/ModernBERT-ar-base-tiny with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use akhooli/ModernBERT-ar-base-tiny with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="akhooli/ModernBERT-ar-base-tiny")# Load model directly from transformers import AutoTokenizer, AutoModelForMaskedLM tokenizer = AutoTokenizer.from_pretrained("akhooli/ModernBERT-ar-base-tiny") model = AutoModelForMaskedLM.from_pretrained("akhooli/ModernBERT-ar-base-tiny") - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -13,9 +13,10 @@ should probably proofread and complete it, then remove this comment. -->
|
|
| 13 |
# ModernBERT-ar-base-tiny
|
| 14 |
|
| 15 |
This model was trained on [Fineweb2 Ar sample](https://huggingface.co/datasets/akhooli/fineweb2_ar_24_sample) dataset.
|
| 16 |
-
The tokenizer was also trained using the same dataset.
|
| 17 |
See [sample code](https://colab.research.google.com/drive/1CUsUsJQV4ZzJar2987yAzCTn8ve4hR5b?usp=sharing)
|
| 18 |
-
(usage and training) and [initial post](https://www.linkedin.com/posts/akhooli_a-micro-arabic-modern-bert-a-couple-weeks-activity-7282005813357875202-SAGk)
|
|
|
|
| 19 |
|
| 20 |
## Model description
|
| 21 |
|
|
|
|
| 13 |
# ModernBERT-ar-base-tiny
|
| 14 |
|
| 15 |
This model was trained on [Fineweb2 Ar sample](https://huggingface.co/datasets/akhooli/fineweb2_ar_24_sample) dataset.
|
| 16 |
+
The tokenizer was also trained using the same dataset.
|
| 17 |
See [sample code](https://colab.research.google.com/drive/1CUsUsJQV4ZzJar2987yAzCTn8ve4hR5b?usp=sharing)
|
| 18 |
+
(usage and training) and [initial post](https://www.linkedin.com/posts/akhooli_a-micro-arabic-modern-bert-a-couple-weeks-activity-7282005813357875202-SAGk)
|
| 19 |
+
Updated: Jan. 12, 2025.
|
| 20 |
|
| 21 |
## Model description
|
| 22 |
|