Instructions to use giant-oak/lsg-roberta-base-4096 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use giant-oak/lsg-roberta-base-4096 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="giant-oak/lsg-roberta-base-4096", trust_remote_code=True)# Load model directly from transformers import AutoTokenizer, AutoModelForMaskedLM tokenizer = AutoTokenizer.from_pretrained("giant-oak/lsg-roberta-base-4096", trust_remote_code=True) model = AutoModelForMaskedLM.from_pretrained("giant-oak/lsg-roberta-base-4096", trust_remote_code=True) - Notebooks
- Google Colab
- Kaggle
YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
Similar to the other publicly available LSG models, this model was created using the LSG conversion script found here then MLM pretrained on a sample of the OSCAR and BookCorpus datasets: https://github.com/ccdv-ai/convert_checkpoint_to_lsg
- Downloads last month
- 8