Text Generation
MLX
Safetensors
modilify_mk2
diffusion
mixture-of-experts
custom-code
modilify-mk2
conversational
Instructions to use modilify/Modilify-Mk2-mlx with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use modilify/Modilify-Mk2-mlx with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("modilify/Modilify-Mk2-mlx") prompt = "Write a story about Einstein" messages = [{"role": "user", "content": prompt}] prompt = tokenizer.apply_chat_template( messages, add_generation_prompt=True ) text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Pi
How to use modilify/Modilify-Mk2-mlx with Pi:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "modilify/Modilify-Mk2-mlx"
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "mlx-lm": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "modilify/Modilify-Mk2-mlx" } ] } } }Run Pi
# Start Pi in your project directory: pi
- MLX LM
How to use modilify/Modilify-Mk2-mlx with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Interactive chat REPL mlx_lm.chat --model "modilify/Modilify-Mk2-mlx"
Run an OpenAI-compatible server
# Install MLX LM uv tool install mlx-lm # Start the server mlx_lm.server --model "modilify/Modilify-Mk2-mlx" # Calling the OpenAI-compatible server with curl curl -X POST "http://localhost:8080/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "modilify/Modilify-Mk2-mlx", "messages": [ {"role": "user", "content": "Hello"} ] }' - Hermes Agent
How to use modilify/Modilify-Mk2-mlx with Hermes Agent:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "modilify/Modilify-Mk2-mlx"
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default modilify/Modilify-Mk2-mlx
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use modilify/Modilify-Mk2-mlx with OpenClaw:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "modilify/Modilify-Mk2-mlx"
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "modilify/Modilify-Mk2-mlx" \ --custom-provider-id mlx-lm \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Download export_manifest.json from modilify/Modilify-Mk2-mlx: direct link, hf CLI and curl.
- Browser
- Download file 3.22 kB
-
https://huggingface.co/modilify/Modilify-Mk2-mlx/resolve/main/export_manifest.json
- Command line
-
hf download hf://modilify/Modilify-Mk2-mlx/export_manifest.json
-
curl -L -o export_manifest.json https://huggingface.co/modilify/Modilify-Mk2-mlx/resolve/main/export_manifest.json
3.22 kB
| { | |
| "global_step": 4400, | |
| "state_schema_version": 25, | |
| "memory_scheme": "dual_timescale_gdn2_trajectory_memory", | |
| "memory_architecture": "compact_gdn2_v2", | |
| "base_model": "google/diffusiongemma-26B-A4B-it", | |
| "precision_policy": "gdn2_small_fp32_v1", | |
| "total_tensor_count": 1323, | |
| "shards": [ | |
| { | |
| "file": "model-00001-of-00016.safetensors", | |
| "bytes": 3898256004, | |
| "sha256": "d3aa3fc0393a51acec27161569d566774030e0306a74748dd2a7a11fd8b535ec" | |
| }, | |
| { | |
| "file": "model-00002-of-00016.safetensors", | |
| "bytes": 3798073636, | |
| "sha256": "89339fd6f0521977fff9d4ae498e485ff409dbb8716cc924c8667c8bceaa19cd" | |
| }, | |
| { | |
| "file": "model-00003-of-00016.safetensors", | |
| "bytes": 3290562732, | |
| "sha256": "b9351e59c7c604b26712960b5d9f3460f5c1aace9ccb348999a2334d93fb613d" | |
| }, | |
| { | |
| "file": "model-00004-of-00016.safetensors", | |
| "bytes": 3319472948, | |
| "sha256": "1c89ba68a1f56e986dbf43175a7a7a6f2d046b04ac993c2837024f71b5d5923d" | |
| }, | |
| { | |
| "file": "model-00005-of-00016.safetensors", | |
| "bytes": 3290562732, | |
| "sha256": "4e42f45a5c409649c0ac8a262b26a0f644d10619d5f857568db855d12a865183" | |
| }, | |
| { | |
| "file": "model-00006-of-00016.safetensors", | |
| "bytes": 3290562772, | |
| "sha256": "da6e7d99f9801cb1b7007044f3baa66e767412d4350211a637174321eacee401" | |
| }, | |
| { | |
| "file": "model-00007-of-00016.safetensors", | |
| "bytes": 3319473028, | |
| "sha256": "ce1f462e324e162f9c0f41b1db3945290eb06c520da3d8ff0f582cde79a6fa96" | |
| }, | |
| { | |
| "file": "model-00008-of-00016.safetensors", | |
| "bytes": 3290562812, | |
| "sha256": "a163f6df13b9a3fbe1df187e42700b74d71fa08b331c521be568f71dec77a8f0" | |
| }, | |
| { | |
| "file": "model-00009-of-00016.safetensors", | |
| "bytes": 3290562812, | |
| "sha256": "eacc2e9ac62fa45f4fd1d391bfff490e327c19df3f70e7835e556287fc9926bd" | |
| }, | |
| { | |
| "file": "model-00010-of-00016.safetensors", | |
| "bytes": 3319473028, | |
| "sha256": "5fa9c8080a9c3954985226496dee261938f3d05cf81e4436932de593e5a01ae1" | |
| }, | |
| { | |
| "file": "model-00011-of-00016.safetensors", | |
| "bytes": 3290562812, | |
| "sha256": "7df1df1cea73133a94aec88056e2514e04a3467d42c0dd55ad0b922af2e5e986" | |
| }, | |
| { | |
| "file": "model-00012-of-00016.safetensors", | |
| "bytes": 3290562812, | |
| "sha256": "797078b4703d602cc3a323dba676fa38bb959b70d455bdc8c673663261eee2d4" | |
| }, | |
| { | |
| "file": "model-00013-of-00016.safetensors", | |
| "bytes": 3319473028, | |
| "sha256": "35923e8f76bc78ae89b3f83d1cdd175649f64cc898f1862baf543d7cdfbcd0e1" | |
| }, | |
| { | |
| "file": "model-00014-of-00016.safetensors", | |
| "bytes": 3290562812, | |
| "sha256": "105ceea4ed17c811fb79036c199db1f7d2392a5cc4c05003085f7217e8a938bb" | |
| }, | |
| { | |
| "file": "model-00015-of-00016.safetensors", | |
| "bytes": 3290562812, | |
| "sha256": "d3569ec55bc4f7e89de00efaedfbca3df44096526291731ec14bd7fc245c3b39" | |
| }, | |
| { | |
| "file": "model-00016-of-00016.safetensors", | |
| "bytes": 1202380654, | |
| "sha256": "23c9c00fc04b475c744458f498178a6e9a20fd673c36af981dd22e963b7ca49b" | |
| } | |
| ], | |
| "format": "modilify_mk2_mlx_inference_v1", | |
| "source": "Modilify/Modilify-Mk2", | |
| "tensor_dtypes": { | |
| "bfloat16": 1297, | |
| "float32": 26 | |
| } | |
| } | |