File size: 799 Bytes
0db164e | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 | ---
license: mit
library_name: keras
pipeline_tag: fill-mask
tags:
- keras
- kerasformers
- tf
- jax
- pytorch
- backend-agnostic
- roberta
- fill-mask
base_model:
- FacebookAI/roberta-base
---
# RoBERTa (roberta_base)
A pure [Keras 3](https://keras.io) port of **RoBERTa**, converted from [`FacebookAI/roberta-base`](https://huggingface.co/FacebookAI/roberta-base) (Hugging Face Transformers).
The weights are **backend-agnostic**: the same checkpoint loads and runs identically under the JAX, TensorFlow, or PyTorch Keras backend (`KERAS_BACKEND=jax|tensorflow|torch`), via [kerasformers](https://github.com/IMvision12/KerasFormers).
## Usage
```python
from kerasformers.models.roberta import RobertaModel
model = RobertaModel.from_weights("kerasformers/roberta_base")
```
|