YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
pip install mlx-lm
from mlx_lm import load, generate
model, tokenizer = load("mlx-community/Mistral-7B-Instruct-v0.3-4bit") response = generate(model, tokenizer, prompt="hello", verbose=True)
- Downloads last month
- 19
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support