Instructions to use kernelpool/LongCat-2.0-3bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use kernelpool/LongCat-2.0-3bit with MLX:

# Make sure mlx-lm is installed
# pip install --upgrade mlx-lm

# Generate text with mlx-lm
from mlx_lm import load, generate

model, tokenizer = load("kernelpool/LongCat-2.0-3bit")

prompt = "Write a story about Einstein"
messages = [{"role": "user", "content": prompt}]
prompt = tokenizer.apply_chat_template(
    messages, add_generation_prompt=True
)

text = generate(model, tokenizer, prompt=prompt, verbose=True)

Notebooks
Google Colab
Kaggle
Local Apps Settings
LM Studio

How to use kernelpool/LongCat-2.0-3bit with Pi:

Start the MLX server

# Install MLX LM:
uv tool install mlx-lm
# Start a local OpenAI-compatible server:
mlx_lm.server --model "kernelpool/LongCat-2.0-3bit"

Configure the model in Pi

# Install Pi:
npm install -g @mariozechner/pi-coding-agent
# Add to ~/.pi/agent/models.json:
{
  "providers": {
    "mlx-lm": {
      "baseUrl": "http://localhost:8080/v1",
      "api": "openai-completions",
      "apiKey": "none",
      "models": [
        {
          "id": "kernelpool/LongCat-2.0-3bit"
        }
      ]
    }
  }
}

Run Pi

# Start Pi in your project directory:
pi

Hermes Agent new

How to use kernelpool/LongCat-2.0-3bit with Hermes Agent:

Start the MLX server

# Install MLX LM:
uv tool install mlx-lm
# Start a local OpenAI-compatible server:
mlx_lm.server --model "kernelpool/LongCat-2.0-3bit"

Configure Hermes

# Install Hermes:
curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash
hermes setup
# Point Hermes at the local server:
hermes config set model.provider custom
hermes config set model.base_url http://127.0.0.1:8080/v1
hermes config set model.default kernelpool/LongCat-2.0-3bit

Run Hermes

hermes

OpenClaw new

How to use kernelpool/LongCat-2.0-3bit with OpenClaw:

Start the MLX server

# Install MLX LM:
uv tool install mlx-lm
# Start a local OpenAI-compatible server:
mlx_lm.server --model "kernelpool/LongCat-2.0-3bit"

Configure OpenClaw

# Install OpenClaw:
npm install -g openclaw@latest
# Register the local server and set it as the default model:
openclaw onboard --non-interactive --mode local \
  --auth-choice custom-api-key \
  --custom-base-url http://127.0.0.1:8080/v1 \
  --custom-model-id "kernelpool/LongCat-2.0-3bit" \
  --custom-provider-id mlx-lm \
  --custom-compatibility openai \
  --custom-text-input \
  --accept-risk \
  --skip-health

Run OpenClaw

openclaw agent --local --agent main --message "Hello from Hugging Face"

MLX LM

How to use kernelpool/LongCat-2.0-3bit with MLX LM:

Generate or start a chat session

# Install MLX LM
uv tool install mlx-lm
# Interactive chat REPL
mlx_lm.chat --model "kernelpool/LongCat-2.0-3bit"

Run an OpenAI-compatible server

# Install MLX LM
uv tool install mlx-lm
# Start the server
mlx_lm.server --model "kernelpool/LongCat-2.0-3bit"
# Calling the OpenAI-compatible server with curl
curl -X POST "http://localhost:8000/v1/chat/completions" \
   -H "Content-Type: application/json" \
   --data '{
     "model": "kernelpool/LongCat-2.0-3bit",
     "messages": [
       {"role": "user", "content": "Hello"}
     ]
   }'

kernelpool commited on 7 days ago

Commit

a7e1687

verified ·

1 Parent(s): 85f23bf

Add files using upload-large-folder tool

Browse files

This view is limited to 50 files because it contains too many changes. See raw diff

Files changed (50) hide show

.gitattributes +1 -0
model-00005-of-00206.safetensors +3 -0
model-00012-of-00206.safetensors +3 -0
model-00013-of-00206.safetensors +3 -0
model-00016-of-00206.safetensors +3 -0
model-00017-of-00206.safetensors +3 -0
model-00018-of-00206.safetensors +3 -0
model-00019-of-00206.safetensors +3 -0
model-00020-of-00206.safetensors +3 -0
model-00021-of-00206.safetensors +3 -0
model-00024-of-00206.safetensors +3 -0
model-00025-of-00206.safetensors +3 -0
model-00032-of-00206.safetensors +3 -0
model-00037-of-00206.safetensors +3 -0
model-00038-of-00206.safetensors +3 -0
model-00041-of-00206.safetensors +3 -0
model-00044-of-00206.safetensors +3 -0
model-00052-of-00206.safetensors +3 -0
model-00053-of-00206.safetensors +3 -0
model-00056-of-00206.safetensors +3 -0
model-00058-of-00206.safetensors +3 -0
model-00059-of-00206.safetensors +3 -0
model-00060-of-00206.safetensors +3 -0
model-00061-of-00206.safetensors +3 -0
model-00064-of-00206.safetensors +3 -0
model-00065-of-00206.safetensors +3 -0
model-00068-of-00206.safetensors +3 -0
model-00073-of-00206.safetensors +3 -0
model-00076-of-00206.safetensors +3 -0
model-00079-of-00206.safetensors +3 -0
model-00080-of-00206.safetensors +3 -0
model-00085-of-00206.safetensors +3 -0
model-00092-of-00206.safetensors +3 -0
model-00093-of-00206.safetensors +3 -0
model-00096-of-00206.safetensors +3 -0
model-00097-of-00206.safetensors +3 -0
model-00098-of-00206.safetensors +3 -0
model-00099-of-00206.safetensors +3 -0
model-00100-of-00206.safetensors +3 -0
model-00101-of-00206.safetensors +3 -0
model-00104-of-00206.safetensors +3 -0
model-00105-of-00206.safetensors +3 -0
model-00113-of-00206.safetensors +3 -0
model-00116-of-00206.safetensors +3 -0
model-00119-of-00206.safetensors +3 -0
model-00121-of-00206.safetensors +3 -0
model-00124-of-00206.safetensors +3 -0
model-00132-of-00206.safetensors +3 -0
model-00133-of-00206.safetensors +3 -0
model-00136-of-00206.safetensors +3 -0

.gitattributes CHANGED Viewed

@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text

 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+tokenizer.json filter=lfs diff=lfs merge=lfs -text

model-00005-of-00206.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:6f2e47b67a260d57156723c048276e828ad88625f561fbc4772d02fe42bf5338
+size 3690827335

model-00012-of-00206.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:7597a9e97862be4d19b19b3c1ff81a4a268649d7d1e43155c74d72bb2498c57e
+size 3690830474

model-00013-of-00206.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:345077719b1eff83770e6cfe6ce42a6b6ebca0354ebd613ad3ab31e554c21d19
+size 3690830922

model-00016-of-00206.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c51aade132e7b8531988ff068192c779b84eaf67544098673bc326d5484a8b48
+size 3720197900

model-00017-of-00206.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e34ef72cb80fdd56bd3486d1e4efc6d916c3c4df812e6b131dd697a3f8c4f631
+size 5234491677

model-00018-of-00206.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:74a17ad528b2143ba88fde9c841b2ae8714df2c2188c86fac22ba0845d751075
+size 5234491677

model-00019-of-00206.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:87c3f60b8af8c7cdbd45a26e71af942530ad295f4a97914ef797502abe78b1b8
+size 805306649

model-00020-of-00206.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:9d0f21b54bba92a1cad8fab0611bcc82cdb7ff9f344a2a82267abd7e7434105c
+size 5234491676

model-00021-of-00206.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:dc67fb7b89d3bb4985f9de62c79e719681e092a73c3b434907443f1b0184fe5c
+size 776295036

model-00024-of-00206.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:9cd60d3053c71716ad6e2b45c259c7af6501c0f77bd8d69f4ad8e178f17462e2
+size 805306649

model-00025-of-00206.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c696e34582376e5e546a1be4f8e18a94017d0a18374fbf39d085b0f99f6ae98f
+size 5234491676

model-00032-of-00206.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:2bc1676df0841af6ba3d67b86c5cae51f1b2850ff95951ad5edcc12991bf5337
+size 5234491677

model-00037-of-00206.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:faa2b2814dcb5eaf8608f430729ec481d633253e847dea7fb17e484036e0c419
+size 5234491677

model-00038-of-00206.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:602b1fd064afb5a8cd97b72cc9c1c0802c67f2bd5f1c9cb8b9c4c1ad78a9bbaa
+size 5234491677

model-00041-of-00206.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:bd147453455e11b90f89e55a2621372a98c174ce472719fd1e399058358ccfde
+size 776295054

model-00044-of-00206.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:8f8e7b0647767acaa74c9cfcebd6c2d81f889be92333e7eb4a7fa2169615da62
+size 805306649

model-00052-of-00206.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:84ed3e0351478908cc85314be1d1798492c6f58647e93b6c0ffc8175bedcc68b
+size 5234491677

model-00053-of-00206.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:101066fc68151f9dbd5bf71e4e233eec59168146e6cdcfbb83af5a7992126655
+size 5234491677

model-00056-of-00206.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:993b2082999855fd30603c9ddca4a76bfe04f1b75c4b2979dadb80a4746d72a9
+size 776295052

model-00058-of-00206.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:7d7938eda9157508a539db6ce2051493574aeaa092bd74977f55c900a4cdf696
+size 5234491677

model-00059-of-00206.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:dffa351f97189a47b86f759004164c094d94092a99cbaf8e80f6eaf35704b93c
+size 805306649

model-00060-of-00206.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:8b64b930a61fe4c6b3b942baa696f663e1b99709384cfcb21300c0a0d2564e6b
+size 5234491676

model-00061-of-00206.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:57edf226225f752bd9b5d99a5445a0930928cc2fb02913ae68966f73a69234da
+size 776295026

model-00064-of-00206.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:747d96e30a2aa9245a8591e2b021884379fc2a567b8b906217e83eca91cb5924
+size 805306649

model-00065-of-00206.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:506ea7680b7a1bf99a02a87addb777952deb429ef66e383fb16061e1bfe6a099
+size 5234491676

model-00068-of-00206.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c00eba822dd009b46789f041fd492c1a42f145855229c73109dc034d179f2be0
+size 5234491679

model-00073-of-00206.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:adab9f3512eaeefa48a9e66687f3256542226c2a10aaf1ef6d0716a8e7088bd5
+size 5234491679

model-00076-of-00206.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:3156eb0f89b7af4ab0c04cbc8a437eff78e4b417dd3e1646c0e4f5d3e9ed689d
+size 776295129

model-00079-of-00206.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:46d1d5202801aeccbae075b922fb96a098509a84341d41cdf33a10081be5e370
+size 805306651

model-00080-of-00206.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:81cb5f49467737dfd961a4c80cda3bf9e032fd579a6d2c95b1e6ae2784468ec8
+size 5234491678

model-00085-of-00206.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:21ae8427a808ef59f173e842431288135c2943a3481281183a734e5f5aeb1723
+size 5234491678

model-00092-of-00206.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:8f1d906098c5bbdeda88ec98fb11c00a6a8cc9b430ca9b3d91d42031f2909900
+size 5234491679

model-00093-of-00206.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:854fc21b7b2c5f28c047ebcf0f8f8d0432586727f67e2ef23636530133c1224d
+size 5234491679

model-00096-of-00206.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:647955c14b99cb4c71e34a99a8ab4c55970f8f40d770c302e4ddc0ece165cfca
+size 776295095

model-00097-of-00206.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:55c63963c22687926f91416e1d128f0efdc7452207c6de5e6b584abbe22fb110
+size 5234491679

model-00098-of-00206.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:074a0aec389c5c8a1b34d597f2f976324c0d9485aed31af40004ad5ba55f1bb7
+size 5234491679

model-00099-of-00206.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:a2d756e82051dcb39c936bc344c1cd2107df98203da79d9f884124eecd487774
+size 805306651

model-00100-of-00206.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e507f5cbc519f2da5909cb57d7cf1e8dce7740d4dd9668d1e6dec34797b18448
+size 5234491678

model-00101-of-00206.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:27972067aa5ece40aa8e8b9be1d872a64de11b3126ac208b27a1c60e349c83be
+size 776295111

model-00104-of-00206.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:5104ee429a67a03e0ea7988822a38139cfb2cd076cc9c3b8c720555a81785b96
+size 805306651

model-00105-of-00206.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:6f4b2ed0609b0f69a93afa4810117286e4e4ad93c1b04b761af96c58953d7475
+size 5234491678

model-00113-of-00206.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:723c128709f85a035ad7cb77ec92a71091632395323d32fbfe3bb5660dcfc0d4
+size 5234491679

model-00116-of-00206.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:2868f2cf2babc8c52ba6ee1300816e71530e01be85d7dcd9db138aaaff2b16f5
+size 776295109

model-00119-of-00206.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:9583fff09982742adc98c33e612cc776990d8f8c2441969b7171b51d8dd65025
+size 805306651

model-00121-of-00206.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:976383ba8bef3a438da76d4452659908167a9215acfb26cb5ed9e6fbf7c476f5
+size 776295117

model-00124-of-00206.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:731e5e0f609429469097651e8975376f23683d0dc0a38c3b564dfc0791b1c569
+size 805306651

model-00132-of-00206.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f9b74fd815282da59d6fbc199013eed38467ad8103742f855e93b80d8b976d59
+size 5234491679

model-00133-of-00206.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:6f8396aa5a38a2b0123e8e1bbc443163928832b365a6f8419f6bbb9fad5541f4
+size 5234491679

model-00136-of-00206.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:57194aadb8beb92a11f6f1d164a545a501dd5370f35c3db257f39894629f494e
+size 776295119