Text Generation
MLX
Safetensors
English
Chinese
hy_v4
quantized
hy4
Mixture of Experts
conversational
8-bit precision
Instructions to use Xylolabs/Hy4-MLX-8bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use Xylolabs/Hy4-MLX-8bit with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("Xylolabs/Hy4-MLX-8bit") prompt = "Write a story about Einstein" messages = [{"role": "user", "content": prompt}] prompt = tokenizer.apply_chat_template( messages, add_generation_prompt=True ) text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Pi
How to use Xylolabs/Hy4-MLX-8bit with Pi:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "Xylolabs/Hy4-MLX-8bit"
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "mlx-lm": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "Xylolabs/Hy4-MLX-8bit" } ] } } }Run Pi
# Start Pi in your project directory: pi
- MLX LM
How to use Xylolabs/Hy4-MLX-8bit with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Interactive chat REPL mlx_lm.chat --model "Xylolabs/Hy4-MLX-8bit"
Run an OpenAI-compatible server
# Install MLX LM uv tool install mlx-lm # Start the server mlx_lm.server --model "Xylolabs/Hy4-MLX-8bit" # Calling the OpenAI-compatible server with curl curl -X POST "http://localhost:8080/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Xylolabs/Hy4-MLX-8bit", "messages": [ {"role": "user", "content": "Hello"} ] }' - Hermes Agent
How to use Xylolabs/Hy4-MLX-8bit with Hermes Agent:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "Xylolabs/Hy4-MLX-8bit"
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default Xylolabs/Hy4-MLX-8bit
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use Xylolabs/Hy4-MLX-8bit with OpenClaw:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "Xylolabs/Hy4-MLX-8bit"
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "Xylolabs/Hy4-MLX-8bit" \ --custom-provider-id mlx-lm \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Commit History
Today
-
Add hardware recommendation table
Verified signature286075c -
Edit the card text
Verified signaturedaf6354 -
Add Updates section
Verified signature9894ed2 -
Remove two chart images that no card line references
Verified signature331ed34 -
Files table: model files only
Verified signature1b0d258
Yesterday
-
Add vision tower and DFly2 drafter files
Verified signaturea4085a8 -
Card: add 8-bit held-out row and KL axis label
Verified signaturea9c171d -
Card: add 8-bit accuracy and update metric charts
Verified signature30797c8 -
Card: publish corrected accuracy and metric charts
Verified signature457155e -
Card: simplify accuracy table and add provider curves
Verified signaturecbce8a7
2 days ago
-
Card: shorter text in our sections
Verified signaturebb1296f -
Card: shorter text in our sections
Verified signatureb364f04 -
Add the model card and NOTICE
Verified signature128e0b6 -
Add 11 files (LICENSE .. tokenizer_config.json)
Verified signature139f595 -
Add 6 files (model-00238-of-00245.safetensors .. model-00243-of-00245.safetensors)
Verified signaturede93d8d -
Add model-00244-of-00245.safetensors
Verified signature0b1481f -
Add 6 files (model-00232-of-00245.safetensors .. model-00237-of-00245.safetensors)
Verified signatureb4d87be -
Add 6 files (model-00226-of-00245.safetensors .. model-00231-of-00245.safetensors)
Verified signaturefa67d35 -
Add 6 files (model-00220-of-00245.safetensors .. model-00225-of-00245.safetensors)
Verified signature974d95f -
Add 6 files (model-00214-of-00245.safetensors .. model-00219-of-00245.safetensors)
Verified signaturea6988d1 -
Add 6 files (model-00208-of-00245.safetensors .. model-00213-of-00245.safetensors)
Verified signaturede2b7ef -
Add 6 files (model-00202-of-00245.safetensors .. model-00207-of-00245.safetensors)
Verified signature1968406 -
Add 6 files (model-00196-of-00245.safetensors .. model-00201-of-00245.safetensors)
Verified signature56f84f3 -
Add 6 files (model-00190-of-00245.safetensors .. model-00195-of-00245.safetensors)
Verified signature5f3698f -
Add 6 files (model-00184-of-00245.safetensors .. model-00189-of-00245.safetensors)
Verified signatureeaf63f6 -
Add 6 files (model-00178-of-00245.safetensors .. model-00183-of-00245.safetensors)
Verified signature09f2aa4 -
Add 6 files (model-00172-of-00245.safetensors .. model-00177-of-00245.safetensors)
Verified signaturef31861a -
Add 6 files (model-00166-of-00245.safetensors .. model-00171-of-00245.safetensors)
Verified signature8712695 -
Add 6 files (model-00160-of-00245.safetensors .. model-00165-of-00245.safetensors)
Verified signaturea4591ae -
Add 6 files (model-00154-of-00245.safetensors .. model-00159-of-00245.safetensors)
Verified signaturef4ebd23 -
Add 6 files (model-00148-of-00245.safetensors .. model-00153-of-00245.safetensors)
Verified signature17872b6 -
Add 6 files (model-00142-of-00245.safetensors .. model-00147-of-00245.safetensors)
Verified signatured8ae2fe -
Add 6 files (model-00136-of-00245.safetensors .. model-00141-of-00245.safetensors)
Verified signatureba6605a -
Add 6 files (model-00130-of-00245.safetensors .. model-00135-of-00245.safetensors)
Verified signaturee0ee518 -
Add 6 files (model-00124-of-00245.safetensors .. model-00129-of-00245.safetensors)
Verified signature93dde43 -
Add 6 files (model-00118-of-00245.safetensors .. model-00123-of-00245.safetensors)
Verified signature900bd01 -
Add 6 files (model-00112-of-00245.safetensors .. model-00117-of-00245.safetensors)
Verified signatureaab4a1a -
Add 6 files (model-00106-of-00245.safetensors .. model-00111-of-00245.safetensors)
Verified signatured2e6431 -
Add 6 files (model-00100-of-00245.safetensors .. model-00105-of-00245.safetensors)
Verified signature2fddb0e -
Add 6 files (model-00094-of-00245.safetensors .. model-00099-of-00245.safetensors)
Verified signatureebdf613 -
Add 6 files (model-00087-of-00245.safetensors .. model-00093-of-00245.safetensors)
Verified signature3ff2abe -
Add 6 files (model-00081-of-00245.safetensors .. model-00086-of-00245.safetensors)
Verified signaturee959e5d -
Add 6 files (model-00073-of-00245.safetensors .. model-00078-of-00245.safetensors)
Verified signature6ea3d38 -
Add 2 files (model-00079-of-00245.safetensors .. model-00080-of-00245.safetensors)
Verified signaturec3d3eda -
Add 6 files (model-00067-of-00245.safetensors .. model-00072-of-00245.safetensors)
Verified signature6e1179f -
Add 6 files (model-00061-of-00245.safetensors .. model-00066-of-00245.safetensors)
Verified signature93ff5c0 -
Add 6 files (model-00055-of-00245.safetensors .. model-00060-of-00245.safetensors)
Verified signature7907e8b -
Add 6 files (model-00049-of-00245.safetensors .. model-00054-of-00245.safetensors)
Verified signaturee8e3fc5 -
Add 6 files (model-00043-of-00245.safetensors .. model-00048-of-00245.safetensors)
Verified signature598745a -
Add 6 files (model-00037-of-00245.safetensors .. model-00042-of-00245.safetensors)
Verified signature6338c0b