How to use from the
Use from the
Transformers library
# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="giuid/mistral-7b_QR")
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("giuid/mistral-7b_QR")
model = AutoModelForCausalLM.from_pretrained("giuid/mistral-7b_QR")
Quick Links

YAML Metadata Warning:empty or missing yaml metadata in repo card

Check out the documentation for more information.

giuid/mistral-7b_qrecc_128_lr_5e-6_batch_8

Downloads last month
4
Safetensors
Model size
7B params
Tensor type
F32
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support