Text Generation
MLX
Safetensors
qwen4_exp
apple-silicon
macos
speculative-decoding
multi-token-prediction
qwen
qwen3.8-flash-next
Mixture of Experts
mtp
mtplx
local-ai
chat
conversational
4-bit precision
Instructions to use Youssofal/Qwen3.8-Flash-Next-MTPLX-Optimized-Speed with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use Youssofal/Qwen3.8-Flash-Next-MTPLX-Optimized-Speed with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("Youssofal/Qwen3.8-Flash-Next-MTPLX-Optimized-Speed") prompt = "Write a story about Einstein" messages = [{"role": "user", "content": prompt}] prompt = tokenizer.apply_chat_template( messages, add_generation_prompt=True ) text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Pi
How to use Youssofal/Qwen3.8-Flash-Next-MTPLX-Optimized-Speed with Pi:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "Youssofal/Qwen3.8-Flash-Next-MTPLX-Optimized-Speed"
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "mlx-lm": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "Youssofal/Qwen3.8-Flash-Next-MTPLX-Optimized-Speed" } ] } } }Run Pi
# Start Pi in your project directory: pi
- MLX LM
How to use Youssofal/Qwen3.8-Flash-Next-MTPLX-Optimized-Speed with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Interactive chat REPL mlx_lm.chat --model "Youssofal/Qwen3.8-Flash-Next-MTPLX-Optimized-Speed"
Run an OpenAI-compatible server
# Install MLX LM uv tool install mlx-lm # Start the server mlx_lm.server --model "Youssofal/Qwen3.8-Flash-Next-MTPLX-Optimized-Speed" # Calling the OpenAI-compatible server with curl curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Youssofal/Qwen3.8-Flash-Next-MTPLX-Optimized-Speed", "messages": [ {"role": "user", "content": "Hello"} ] }' - Hermes Agent
How to use Youssofal/Qwen3.8-Flash-Next-MTPLX-Optimized-Speed with Hermes Agent:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "Youssofal/Qwen3.8-Flash-Next-MTPLX-Optimized-Speed"
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default Youssofal/Qwen3.8-Flash-Next-MTPLX-Optimized-Speed
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use Youssofal/Qwen3.8-Flash-Next-MTPLX-Optimized-Speed with OpenClaw:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "Youssofal/Qwen3.8-Flash-Next-MTPLX-Optimized-Speed"
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "Youssofal/Qwen3.8-Flash-Next-MTPLX-Optimized-Speed" \ --custom-provider-id mlx-lm \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Add files using upload-large-folder tool
Browse files- .metadata_never_index +0 -0
- model-00001-of-00019.safetensors +3 -0
- model-00002-of-00019.safetensors +3 -0
- model-00003-of-00019.safetensors +3 -0
- model-00004-of-00019.safetensors +3 -0
- model-00005-of-00019.safetensors +3 -0
- model-00006-of-00019.safetensors +3 -0
- model-00007-of-00019.safetensors +3 -0
- model-00008-of-00019.safetensors +3 -0
- model-00009-of-00019.safetensors +3 -0
- model-00010-of-00019.safetensors +3 -0
- model-00011-of-00019.safetensors +3 -0
- model-00012-of-00019.safetensors +3 -0
- model-00013-of-00019.safetensors +3 -0
- model-00014-of-00019.safetensors +3 -0
- model-00015-of-00019.safetensors +3 -0
- model-00016-of-00019.safetensors +3 -0
- model-00017-of-00019.safetensors +3 -0
- model-00018-of-00019.safetensors +3 -0
- model-00019-of-00019.safetensors +3 -0
- model-vision.safetensors +3 -0
- mtp.safetensors +3 -0
- ngram-table.safetensors +3 -0
.metadata_never_index
ADDED
|
File without changes
|
model-00001-of-00019.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3786e36e1731fa1356cddc185f75a4790cc780581740797a36f7c4ff419a0a4e
|
| 3 |
+
size 4613737928
|
model-00002-of-00019.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:431f7be1eda55b0b2acde98518a5fe12b7549dfdb153a6276028c06f73a90b4a
|
| 3 |
+
size 4299165294
|
model-00003-of-00019.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:156deb400f6ca548171288658efadba0bd1ee0f8bea454982f413418a622c319
|
| 3 |
+
size 4613737948
|
model-00004-of-00019.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:dd66cbd9d6923f20a6ec5ad58a1e294a050a10febb1b7196b00c56fa7590cae3
|
| 3 |
+
size 4299165288
|
model-00005-of-00019.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d753795a9bd347d9fb88126915df68a0bee1e4480766cb290c8acfc640ebdf6c
|
| 3 |
+
size 4613737941
|
model-00006-of-00019.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7a6b39b58189de9b949934bdadb7b9ebbd6c849941faffdc8831819deb4209a3
|
| 3 |
+
size 4299165282
|
model-00007-of-00019.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4719cb7305232b0a65c315b39be0b36f3b2abb2d6c5254b2adffc7cc03f99864
|
| 3 |
+
size 4613737956
|
model-00008-of-00019.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:430c51a77b91345e5848d86c13be8028f778c1487049365081d617c1edcdf220
|
| 3 |
+
size 4299165288
|
model-00009-of-00019.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8a5d7deb2d5f18d1526005278c39f883ff804945fa74300cc434c17a9b4e8cd0
|
| 3 |
+
size 4613737939
|
model-00010-of-00019.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:0698d84a47fdba6c7b68d2eaf37a35320e05aa0e4a7adb3be02d93b3fbec7e2d
|
| 3 |
+
size 4299165286
|
model-00011-of-00019.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c879fb63ba27351d1733171c836cb376aa64b8eb0ed155c61619924ff648fb21
|
| 3 |
+
size 4613737944
|
model-00012-of-00019.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:14ce62fef5f84e645ea159024764611e8016ac82eab9dd2765ae4725d3cbf4dc
|
| 3 |
+
size 4299165286
|
model-00013-of-00019.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b34ac3e49513a7bcca514adc9b0110ad66706819916c7972a4e2f9f34a34c3ce
|
| 3 |
+
size 4613737945
|
model-00014-of-00019.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e8a4f079f94f232aea844e3f2a46d13b0dcba6b34f9e14c2f6ddd4c3dfe95e00
|
| 3 |
+
size 4299165290
|
model-00015-of-00019.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:120a79647b403b6b11afda7c4526b21976c14427e4cad5d39f7a1b4557e8467e
|
| 3 |
+
size 4613737952
|
model-00016-of-00019.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ac4ba50985a8df69c453c84fd318fa487eb8e126f716d4462630458b40f80763
|
| 3 |
+
size 4299165265
|
model-00017-of-00019.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3a4b72af100af7e5469bf95a24623c459e9c1cb03f9ada4186317ce02782155d
|
| 3 |
+
size 4830006690
|
model-00018-of-00019.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:dd8995ebe60a0f3f9fe9f1a424b59ecd04c64ea925b6ba40c38dacf1781e23f6
|
| 3 |
+
size 4307505704
|
model-00019-of-00019.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:40060cdb5cb73ebc5a7475ecce973ac4e2398a8ba8ad29521e8e90ce198eecd9
|
| 3 |
+
size 20813169
|
model-vision.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5aff6983f36f52acbecc1f61f703ae7b927e74525bf3b1133ba276bb7a5b52b1
|
| 3 |
+
size 897899145
|
mtp.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3498cbee477938de1dd3a42242387bb8fa6ad921053af010543473ab020f717c
|
| 3 |
+
size 1678147375
|
ngram-table.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:af7f0880c1798e60353b07cc6b0faa0d41f78734818d858ff013ab7e3bce9de5
|
| 3 |
+
size 32000154008
|