argilla/dpo-mix-7k
Viewer • Updated • 7.5k • 1.06k • 173
How to use mlx-community/CapybaraHermes-2.5-Mistral-7B with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir CapybaraHermes-2.5-Mistral-7B mlx-community/CapybaraHermes-2.5-Mistral-7B
This model was converted to MLX format from argilla/CapybaraHermes-2.5-Mistral-7B.
Refer to the original model card for more details on the model.
pip install mlx
git clone https://github.com/ml-explore/mlx-examples.git
cd mlx-examples/llms/hf_llm
python generate.py --model mlx-community/CapybaraHermes-2.5-Mistral-7B --prompt "My name is"
Quantized
Base model
mistralai/Mistral-7B-v0.1