Instructions to use moonshotai/Kimi-K2.5 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use moonshotai/Kimi-K2.5 with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("image-text-to-text", model="moonshotai/Kimi-K2.5", trust_remote_code=True)
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
pipe(text=messages)

# Load model directly
from transformers import AutoProcessor, AutoModel

processor = AutoProcessor.from_pretrained("moonshotai/Kimi-K2.5", trust_remote_code=True)
model = AutoModel.from_pretrained("moonshotai/Kimi-K2.5", trust_remote_code=True)
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
inputs = processor.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Inference
HuggingChat
Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use moonshotai/Kimi-K2.5 with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "moonshotai/Kimi-K2.5"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "moonshotai/Kimi-K2.5",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker

docker model run hf.co/moonshotai/Kimi-K2.5

SGLang

How to use moonshotai/Kimi-K2.5 with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "moonshotai/Kimi-K2.5" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "moonshotai/Kimi-K2.5",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "moonshotai/Kimi-K2.5" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "moonshotai/Kimi-K2.5",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Docker Model Runner
How to use moonshotai/Kimi-K2.5 with Docker Model Runner:
```
docker model run hf.co/moonshotai/Kimi-K2.5
```

👩‍💻OpenClaw 🦞中文社区(非盈利) - 中国开发者集结！中文交流群 & 本地化支持来了 (Chinese Community & Nonprofit organization)

#75

by MackGgasdasd - opened Feb 11

Discussion

MackGgasdasd

Feb 11

👋 各位 OpenClaw 的中国玩家/开发者们，大家好！

OpenClaw (Moltbot) 最近非常火，作为一款隐私优先、自托管的 AI Agent，它有着巨大的潜力。但我们发现，对于国内开发者来说，存在几个小痛点：

语言障碍：官方文档和 Issues 全是英文，啃起来费劲。
网络限制：Discord 社区访问困难，很多好用的 Prompt 和配置技巧没法及时获取。
本地化适配：如何对接国内大模型（DeepSeek/Qwen）？如何解决 Docker 网络问题？

为了解决这些问题，我们建立了 **OpenClaw 中文交流群 (WeChat)**！🚀

🤝 加入我们，你将获得：

🛠️ 实战避坑：交流 Docker/Webtop 隔离部署经验，解决环境配置报错。
🤖 模型对接：分享如何让 OpenClaw 完美运行 DeepSeek、通义千问等国内/本地 LLM 的配置方案。
📚 [文档汉化：我们正准备在推进官方文档的中文翻译工作，群内第一时间同步进度。]
⚡️ 极客交流：探讨 Playwright 自动化、自定义工具开发等高阶玩法。

Other discussions: https://github.com/openclaw/openclaw/discussions/9731

📬 如何加入？

这是属于我们自己的技术圈子，拒绝广告，只聊技术！
请扫描下方二维码加入微信群：

[OpenClaw🦞] ·AI-IDE 自然语一键安装Skill：https://github.com/MackDing/openclaw-installer-skill
让我们一起把 OpenClaw 玩出花来！🔥

https://github.com/openclaw/openclaw/pull/11106
https://github.com/openclaw/openclaw/discussions/10227

bigeagle changed discussion status to closed Feb 12

bigeagle locked this discussion Feb 12

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment