roberta_base / README.md
IMvision12's picture
Upload folder using huggingface_hub
0db164e verified
|
Raw
History Blame Contribute Delete
799 Bytes
metadata
license: mit
library_name: keras
pipeline_tag: fill-mask
tags:
  - keras
  - kerasformers
  - tf
  - jax
  - pytorch
  - backend-agnostic
  - roberta
  - fill-mask
base_model:
  - FacebookAI/roberta-base

RoBERTa (roberta_base)

A pure Keras 3 port of RoBERTa, converted from FacebookAI/roberta-base (Hugging Face Transformers).

The weights are backend-agnostic: the same checkpoint loads and runs identically under the JAX, TensorFlow, or PyTorch Keras backend (KERAS_BACKEND=jax|tensorflow|torch), via kerasformers.

Usage

from kerasformers.models.roberta import RobertaModel

model = RobertaModel.from_weights("kerasformers/roberta_base")