Fill-Mask
Transformers
PyTorch
Safetensors
Portuguese
modernbert
portuguese
encoder
masked-lm
long-context
moberto
Eval Results (legacy)
Instructions to use Tropic-AI/moBERTo-orig-tokenizer with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Tropic-AI/moBERTo-orig-tokenizer with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="Tropic-AI/moBERTo-orig-tokenizer")# Load model directly from transformers import AutoTokenizer, AutoModelForMaskedLM tokenizer = AutoTokenizer.from_pretrained("Tropic-AI/moBERTo-orig-tokenizer") model = AutoModelForMaskedLM.from_pretrained("Tropic-AI/moBERTo-orig-tokenizer") - Notebooks
- Google Colab
- Kaggle
File size: 355 Bytes
9414127 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 | {
"backend": "tokenizers",
"clean_up_tokenization_spaces": true,
"cls_token": "[CLS]",
"is_local": true,
"mask_token": "[MASK]",
"model_input_names": [
"input_ids",
"attention_mask"
],
"model_max_length": 8192,
"pad_token": "[PAD]",
"sep_token": "[SEP]",
"tokenizer_class": "PreTrainedTokenizerFast",
"unk_token": "[UNK]"
} |