13B
Collection
11 items • Updated
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM
tokenizer = AutoTokenizer.from_pretrained("R136a1/MaximalSlerp-exl2")
model = AutoModelForCausalLM.from_pretrained("R136a1/MaximalSlerp-exl2")Quick Links
EXL2 Quantization of Brouz's MaximalSlerp.
Model details
Quantized at 5.33bpw
Prompt Format
Alpaca format:
### Instruction:
### Response:
- Downloads last month
- 7
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="R136a1/MaximalSlerp-exl2")