How to use from the
Use from the
Transformers library
# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("feature-extraction", model="capemox/longformer-8192")
# Load model directly
from transformers import AutoTokenizer, AutoModel

tokenizer = AutoTokenizer.from_pretrained("capemox/longformer-8192")
model = AutoModel.from_pretrained("capemox/longformer-8192")
Quick Links

Longformer 8192

Longformer model with 8192 tokens sequence length. Initialized from FaceboookAI/roberta-base. No additional pre-training has been done.

Model can be loaded and run using AutoModel and AutoTokenizer.

Downloads last month
3
Safetensors
Model size
0.2B params
Tensor type
F32
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for capemox/longformer-8192

Finetuned
(2311)
this model