# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM
tokenizer = AutoTokenizer.from_pretrained("AryanNsc/QuantGPT")
model = AutoModelForCausalLM.from_pretrained("AryanNsc/QuantGPT")Quick Links
QuantGPT as a small base model leveraging GPT-2 parameters, trained on a dataset of 100 million tokens. The model, which can be fine-tuned for custom applications, runs on Google Colab to ensure accessibility and ease of use for researchers and developers
Github - > https://github.com/Guney-olu/Quantgpt
- Downloads last month
- -
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="AryanNsc/QuantGPT")