Instructions to use spicyneuron/Kimi-K2.5-MLX-2.5bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use spicyneuron/Kimi-K2.5-MLX-2.5bit with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("spicyneuron/Kimi-K2.5-MLX-2.5bit") prompt = "Write a story about Einstein" messages = [{"role": "user", "content": prompt}] prompt = tokenizer.apply_chat_template( messages, add_generation_prompt=True ) text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps
- LM Studio
- Pi new
How to use spicyneuron/Kimi-K2.5-MLX-2.5bit with Pi:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "spicyneuron/Kimi-K2.5-MLX-2.5bit"
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "mlx-lm": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "spicyneuron/Kimi-K2.5-MLX-2.5bit" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Hermes Agent new
How to use spicyneuron/Kimi-K2.5-MLX-2.5bit with Hermes Agent:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "spicyneuron/Kimi-K2.5-MLX-2.5bit"
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default spicyneuron/Kimi-K2.5-MLX-2.5bit
Run Hermes
hermes
- MLX LM
How to use spicyneuron/Kimi-K2.5-MLX-2.5bit with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Interactive chat REPL mlx_lm.chat --model "spicyneuron/Kimi-K2.5-MLX-2.5bit"
Run an OpenAI-compatible server
# Install MLX LM uv tool install mlx-lm # Start the server mlx_lm.server --model "spicyneuron/Kimi-K2.5-MLX-2.5bit" # Calling the OpenAI-compatible server with curl curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "spicyneuron/Kimi-K2.5-MLX-2.5bit", "messages": [ {"role": "user", "content": "Hello"} ] }'
Add files using upload-large-folder tool
Browse files- model-00004-of-00066.safetensors +3 -0
- model-00005-of-00066.safetensors +3 -0
- model-00012-of-00066.safetensors +3 -0
- model-00013-of-00066.safetensors +3 -0
- model-00016-of-00066.safetensors +3 -0
- model-00018-of-00066.safetensors +3 -0
- model-00019-of-00066.safetensors +3 -0
- model-00020-of-00066.safetensors +3 -0
- model-00021-of-00066.safetensors +3 -0
- model-00024-of-00066.safetensors +3 -0
- model-00025-of-00066.safetensors +3 -0
- model-00032-of-00066.safetensors +3 -0
- model-00033-of-00066.safetensors +3 -0
- model-00036-of-00066.safetensors +3 -0
- model-00037-of-00066.safetensors +3 -0
- model-00038-of-00066.safetensors +3 -0
- model-00039-of-00066.safetensors +3 -0
- model-00040-of-00066.safetensors +3 -0
- model-00041-of-00066.safetensors +3 -0
- model-00044-of-00066.safetensors +3 -0
- model-00045-of-00066.safetensors +3 -0
- model-00052-of-00066.safetensors +3 -0
- model-00053-of-00066.safetensors +3 -0
- model-00057-of-00066.safetensors +3 -0
- model-00058-of-00066.safetensors +3 -0
- model-00059-of-00066.safetensors +3 -0
- model-00060-of-00066.safetensors +3 -0
- model-00061-of-00066.safetensors +3 -0
- model-00064-of-00066.safetensors +3 -0
- model-00065-of-00066.safetensors +3 -0
- tiktoken.model +3 -0
model-00004-of-00066.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:cabd3c69ed0efd9bdaca32816ae3dcf3415b21f8bcadedc4ffe066a704327e8d
|
| 3 |
+
size 3985771533
|
model-00005-of-00066.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:51b5d7cb21ea57a29c5478a3bb4c6695effdcdd6f034e7e6cfe00e404651b057
|
| 3 |
+
size 5202119696
|
model-00012-of-00066.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:722573953c7b5e76e1dbcd0312c546cb1315d2daa0f9e9ee5f054c74610ee797
|
| 3 |
+
size 5202119736
|
model-00013-of-00066.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:bb65ae45e046f9ee10f1d01f97636b500946cd34d8e4e16dcbc15c9e0a79ece4
|
| 3 |
+
size 5216799757
|
model-00016-of-00066.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:05cc7b856ba45883aad330cb8c9783d99298eef9fd42103c796b442b3be01764
|
| 3 |
+
size 5216799804
|
model-00018-of-00066.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9b25b40df5dc912d27fd997dc28c1f2a878d7e993d45117585a97f50b8ec9471
|
| 3 |
+
size 5202119731
|
model-00019-of-00066.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a3b091517d4087f11fbdb91e9010a9ca7cb30f9ad8920bc278e247edc86d2e4b
|
| 3 |
+
size 5202119731
|
model-00020-of-00066.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1e2a759ca7d9ffe844e1940e4b0981d022e15c3e7e4627c2de183834703f1380
|
| 3 |
+
size 3968994264
|
model-00021-of-00066.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:0b95e70b26c1330e1d94c9a9a2e602926de54cc74d3904002a40938aafa0b92a
|
| 3 |
+
size 5345250041
|
model-00024-of-00066.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a1e8e2c6fc34012b90b0f712be2924aee3289f072c78e91c1328f88d9df85e31
|
| 3 |
+
size 5362223604
|
model-00025-of-00066.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:fdd4e223461facd1ac4aa2c2808fc3188f066f903bc51f2f5eb2b7f42b3581d9
|
| 3 |
+
size 5364515823
|
model-00032-of-00066.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4e87f0765eed0b0cbf4a7eb98256024020d55a9f8db2fc5fb292646b4cb6ffce
|
| 3 |
+
size 5202119737
|
model-00033-of-00066.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b09740389baef06c4f9275e8f79c043fdd839840e9f2bfd4a9d9ffb4e268d142
|
| 3 |
+
size 5209459695
|
model-00036-of-00066.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:215275aadaf3560ffec932cdac5b487aa5d28376024ba51640fd39f7c80c5879
|
| 3 |
+
size 5364978490
|
model-00037-of-00066.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3237d60f8ec328a4815de17ee7a485d8bbcb58361375a3856749a68f713bae9f
|
| 3 |
+
size 5368318823
|
model-00038-of-00066.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4fad113c9fa10e51033fda149656416ee3bc5dff3367e15f56bd72ad09dde89d
|
| 3 |
+
size 5362223604
|
model-00039-of-00066.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4382f09fcd34dfe68ffe87cea280ded1f05e13cee51f5af9bc0918fa2dcc8cfd
|
| 3 |
+
size 5203035017
|
model-00040-of-00066.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:81dd6ddc5d25b4507904b909aeb502bf923fc9ded27574e225bc9b3dea64b0dc
|
| 3 |
+
size 5209459768
|
model-00041-of-00066.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3ab50b332342143f61bcf77d0ebe38e70aba673b6abec5014a1ed849e29a9267
|
| 3 |
+
size 3976334388
|
model-00044-of-00066.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3d496d22c8e53be42102a06995c30b980845e7fa0cb8dbe974d539b0c1f484db
|
| 3 |
+
size 3983674379
|
model-00045-of-00066.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f2f021dcca88ad0f38fa54a9f23a4badb45de3d452744bf08d83faf502e46a92
|
| 3 |
+
size 5209459657
|
model-00052-of-00066.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e75b10762a4c68d2beddbddf7ab73e34c2e49f0958ee2dac451b0b3f6161b2e8
|
| 3 |
+
size 5224139832
|
model-00053-of-00066.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9c74394a8231f28d77c1ebea9e25dd21ccaf4e606881144ba5bfbe1b940d562b
|
| 3 |
+
size 3976334392
|
model-00057-of-00066.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:08ec66bd0c48a6108b34a9eb1a55588a049fb49902528afac58870c984cd23f4
|
| 3 |
+
size 5224139763
|
model-00058-of-00066.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b219b2bea4cb6578dc5e5d566f6a7b44ed557df7812330c28c3f231dd5a8d0d9
|
| 3 |
+
size 5224139739
|
model-00059-of-00066.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4ccd904457d48b95dd467367ae0d582f8ed2aad6facd657d7f7d70b4de7a7899
|
| 3 |
+
size 3976334350
|
model-00060-of-00066.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a8f722a230cea4fc13c8f5f8552f59308f704ade19c434d6210d4da98ec4f0b7
|
| 3 |
+
size 5352590037
|
model-00061-of-00066.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:dac3571305c2b6d54560f5b25fc03e13448defd2091c7a8c1ec47b2401708de7
|
| 3 |
+
size 5368693908
|
model-00064-of-00066.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:25d7ca48d5c4bba2a87556389b3bf9d1f0638cd896464c26718e0352300a6a82
|
| 3 |
+
size 5224139832
|
model-00065-of-00066.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:79b39d6d12492755e4c54e0c578074d9864a3ce08c823d67f51d33e836575751
|
| 3 |
+
size 3976334392
|
tiktoken.model
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b6c497a7469b33ced9c38afb1ad6e47f03f5e5dc05f15930799210ec050c5103
|
| 3 |
+
size 2795286
|