capemox
/

longformer-8192

Feature Extraction

Model card Files Files and versions

Longformer 8192

Longformer model with 8192 tokens sequence length. Initialized from FaceboookAI/roberta-base. No additional pre-training has been done.

Model can be loaded and run using AutoModel and AutoTokenizer.

Downloads last month: 3

Safetensors

Model size

0.2B params

Tensor type

F32

·

Model tree for capemox/longformer-8192

Base model

FacebookAI/roberta-base

Finetuned

(2311)

this model