How to use from the
Use from the
Transformers library
# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="lysandre/arxiv-nlp")
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("lysandre/arxiv-nlp")
model = AutoModelForCausalLM.from_pretrained("lysandre/arxiv-nlp", device_map="auto")
Quick Links

ArXiv-NLP GPT-2 checkpoint

This is a GPT-2 small checkpoint for PyTorch. It is the official gpt2-small fine-tuned to ArXiv paper on the computational linguistics field.

Training data

This model was trained on a subset of ArXiv papers that were parsed from PDF to txt. The resulting data is made of 80MB of text from the computational linguistics (cs.CL) field.

Downloads last month
172
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support