# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM
tokenizer = AutoTokenizer.from_pretrained("mhenrichsen/tinymix-8x1b")
model = AutoModelForCausalLM.from_pretrained("mhenrichsen/tinymix-8x1b")Quick Links
This model is MoE consisting of 8 experts of TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T
This model is untrained, and will likely perform worse than the dense version.
Will start training it very soon.
Idea by eastwind, who did it for the chat version of the model.
- Downloads last month
- 9
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="mhenrichsen/tinymix-8x1b")