# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM
tokenizer = AutoTokenizer.from_pretrained("BricksDisplay/Yi-6B-q4")
model = AutoModelForCausalLM.from_pretrained("BricksDisplay/Yi-6B-q4")Quick Links
Convert from 01-ai/Yi-6B, and 4 bits quantized.
- Downloads last month
- -
Model tree for BricksDisplay/Yi-6B-q4
Base model
01-ai/Yi-6B
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="BricksDisplay/Yi-6B-q4")