Instructions to use OxxoCodes/lsg-roberta-base-4096 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use OxxoCodes/lsg-roberta-base-4096 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="OxxoCodes/lsg-roberta-base-4096", trust_remote_code=True)# Load model directly from transformers import AutoTokenizer, AutoModelForMaskedLM tokenizer = AutoTokenizer.from_pretrained("OxxoCodes/lsg-roberta-base-4096", trust_remote_code=True) model = AutoModelForMaskedLM.from_pretrained("OxxoCodes/lsg-roberta-base-4096", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
In its current state, this model has not yet been finetuned on long-context data. Do not use this model without performing additional pretraining, as performance will likely suffer.
Similar to the other publicly available LSG models, this model was created using the LSG conversion script found here: https://github.com/ccdv-ai/convert_checkpoint_to_lsg
- Downloads last month
- 5