File size: 402 Bytes
fe4bc8a ac18bd9 fe4bc8a 74a39e8 fe4bc8a 74a39e8 | 1 2 3 4 5 6 7 8 9 10 11 12 | ---
library_name: transformers
base_model:
- FacebookAI/roberta-base
---
# Longformer 8192
<!-- Provide a quick summary of what the model is/does. -->
Longformer model with 8192 tokens sequence length. Initialized from [FaceboookAI/roberta-base](https://huggingface.co/FacebookAI/roberta-base). No additional pre-training has been done.
Model can be loaded and run using AutoModel and AutoTokenizer. |