# Load model directly
from transformers import AutoModelForCausalLM
model = AutoModelForCausalLM.from_pretrained("crumb/44m-Z", trust_remote_code=True, dtype="auto")Quick Links
distilled zephyr-7b over 44m-textbooks on textbook codex, 1 epoch, 0.3 dropout
| avg | arc | hellaswag | mmlu | truthfulqa |
|---|---|---|---|---|
| 30.16 | 22.4 | 25.54 | 23.11 | 49.59 |
- Downloads last month
- 4
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="crumb/44m-Z", trust_remote_code=True) messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)