Instructions to use MiniMaxAI/MiniMax-M2.5 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use MiniMaxAI/MiniMax-M2.5 with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="MiniMaxAI/MiniMax-M2.5", trust_remote_code=True)
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("MiniMaxAI/MiniMax-M2.5", trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained("MiniMaxAI/MiniMax-M2.5", trust_remote_code=True)
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Inference
HuggingChat
Notebooks
Google Colab
Kaggle
Local Apps

vLLM

How to use MiniMaxAI/MiniMax-M2.5 with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "MiniMaxAI/MiniMax-M2.5"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "MiniMaxAI/MiniMax-M2.5",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/MiniMaxAI/MiniMax-M2.5

SGLang

How to use MiniMaxAI/MiniMax-M2.5 with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "MiniMaxAI/MiniMax-M2.5" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "MiniMaxAI/MiniMax-M2.5",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "MiniMaxAI/MiniMax-M2.5" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "MiniMaxAI/MiniMax-M2.5",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use MiniMaxAI/MiniMax-M2.5 with Docker Model Runner:
```
docker model run hf.co/MiniMaxAI/MiniMax-M2.5
```

windniw commited on Feb 12

Commit

9ba43d5

verified ·

1 Parent(s): afa2694

Add files using upload-large-folder tool

Browse files

Files changed (31) hide show

model-00090-of-00126.safetensors +3 -0
model-00092-of-00126.safetensors +3 -0
model-00093-of-00126.safetensors +3 -0
model-00094-of-00126.safetensors +3 -0
model-00095-of-00126.safetensors +3 -0
model-00096-of-00126.safetensors +3 -0
model-00097-of-00126.safetensors +3 -0
model-00098-of-00126.safetensors +3 -0
model-00099-of-00126.safetensors +3 -0
model-00100-of-00126.safetensors +3 -0
model-00101-of-00126.safetensors +3 -0
model-00102-of-00126.safetensors +3 -0
model-00103-of-00126.safetensors +3 -0
model-00104-of-00126.safetensors +3 -0
model-00105-of-00126.safetensors +3 -0
model-00106-of-00126.safetensors +3 -0
model-00107-of-00126.safetensors +3 -0
model-00108-of-00126.safetensors +3 -0
model-00109-of-00126.safetensors +3 -0
model-00110-of-00126.safetensors +3 -0
model-00111-of-00126.safetensors +3 -0
model-00112-of-00126.safetensors +3 -0
model-00113-of-00126.safetensors +3 -0
model-00114-of-00126.safetensors +3 -0
model-00115-of-00126.safetensors +3 -0
model-00116-of-00126.safetensors +3 -0
model-00117-of-00126.safetensors +3 -0
model-00118-of-00126.safetensors +3 -0
model-00119-of-00126.safetensors +3 -0
model-00120-of-00126.safetensors +3 -0
model-00121-of-00126.safetensors +3 -0

model-00090-of-00126.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:9d32641816e5d8dbb3e8891e0a2b3bfd118a5365d63d2fc5c821b525283f7734
+size 2463870000

model-00092-of-00126.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f34412829a54c5a050b0ed1294b7f4ff5d871aaf7d298df9fadf98b89e97b938
+size 2463870000

model-00093-of-00126.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e52d2a9b5f6e92bb88c816ff4cb7821796e3b64e906f7382827972a549fbcc9b
+size 1208321720

model-00094-of-00126.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:cf9960836e89f7fd437674f8fac66e4e77c0dce861f745ca17eb292f03c32ef7
+size 2463870000

model-00095-of-00126.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:a84cc16b89314f1c023827450ece593d4af3b96eaeeecca8d7e3b2ab969f7a9f
+size 1208321720

model-00096-of-00126.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:30573a909490be0be43af97970fa83994c44a88a092060a49b34c8e8d0926cc9
+size 2463870000

model-00097-of-00126.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:078119bcab4891536ff4dfafadd8723a97ab97c394d6545a1a8870683c6c50f6
+size 1208321720

model-00098-of-00126.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:698200ed0f6d779c11ae52ea5b8107a3cc4a8b5b17bf51aeb7dec4eea498b39c
+size 2463870000

model-00099-of-00126.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1eab1042dcfe9cc0529db8e39cd5d0c8adc5f9246a34033caab93ce5ab4ddc68
+size 1208321720

model-00100-of-00126.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:21889ceb440807ac15d1d849a4ffedfac112aef46d6d688b18df027d53f2011c
+size 2463870000

model-00101-of-00126.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:5caa04c4f2d9bc940321caaae9bd9a61b332fe9e133687c1490b902231b7c1cb
+size 1208321720

model-00102-of-00126.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b774cf9603d510a9f8cf6ee2bd6e19f3c391c5b768c6e67ef5b90a09bb99d026
+size 2463870000

model-00103-of-00126.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:bf0175d241da56233db656b0f1c3b95d9034d4d29e8b15df7f46a81f13e52ec3
+size 1208321720

model-00104-of-00126.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:3aca43a9a6a2cae95f452c65f0bcf917d4fc1a48ef737441910ac6e54ab95206
+size 2463870000

model-00105-of-00126.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:4e2fa5541242d757c05554c15fd88d2c56f47f329aa93a21603ce19c58ef2e7a
+size 1208321720

model-00106-of-00126.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:9783bb745a26d818e51fb24a87a18b678a542f24b14162e60f7b3881226ea2d0
+size 2463870000

model-00107-of-00126.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:7b51cd8f911ca5f2b58a6ef43485c0203dcbc7873fb859794ded362c017b9c4f
+size 1208321720

model-00108-of-00126.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c29432f100fab7475e2b6d7b0be5b41bbad05d406ba3cf99bdbbb49e3ec43057
+size 2463870000

model-00109-of-00126.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:0094b95cc9554e13798126031cc53a42ae7595b00f2bcafbb5492632d8cb5f72
+size 1208321720

model-00110-of-00126.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b53f9d339d8fda379ba988f10c0ada74ea041cc47ad315d0df97a1b0e166852d
+size 2463870000

model-00111-of-00126.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:2c8fdcde1f909bb2fc37dc7e384c5791d6c4659cc38b878c6a50966c2de57369
+size 1208321720

model-00112-of-00126.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f6bc93d313b4a2fa17a45ca3e2a3d80aa41e58d4a001c9e5088eefd326cfa70c
+size 2463870000

model-00113-of-00126.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:bc0175e5bc082f95214c1ba9abe7fafb5493b791dd1bb79845a888f5b113143c
+size 1208321720

model-00114-of-00126.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:fd9b77f047f5b0f6f3fc2c09e292909252b86574950d281afaf27b5f40a434d4
+size 2463870000

model-00115-of-00126.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b36aa5e54842b947f316d5de27e7e525d0e988b2028fc4f4d9fd427e11460de4
+size 1208321720

model-00116-of-00126.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:607a727267084d34d5a85be14b45de092bbb1e2f5b329202fd8b8418b11bd78e
+size 2463870000

model-00117-of-00126.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:8f78613a20752964c42c1965c2132a7f3169fb5e3fe99798a60439fa150f5b6a
+size 1208321720

model-00118-of-00126.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:23a70919051f397f14ca3e0f84be4cf93e1c07caccd8ef424621af04d0bb3fd0
+size 2463870000

model-00119-of-00126.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:318743f13194252056ca93f1af5f899a456474ff52a3ad73a6215b0353e0defb
+size 1208321720

model-00120-of-00126.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:329dbf9b2344e2400b92e12aac1db15c25701e0ea7044c55b4ff19125cf27ba3
+size 2463870000

model-00121-of-00126.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:a9d73640ba0e6f44576c7e7e66c9a2cd740b83d793f4b5ffca0a1048e4b3bc4a
+size 1208321720