Instructions to use limloop/whiff-mamba2-20M with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use limloop/whiff-mamba2-20M with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="limloop/whiff-mamba2-20M")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("limloop/whiff-mamba2-20M", dtype="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use limloop/whiff-mamba2-20M with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "limloop/whiff-mamba2-20M"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "limloop/whiff-mamba2-20M",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/limloop/whiff-mamba2-20M

SGLang

How to use limloop/whiff-mamba2-20M with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "limloop/whiff-mamba2-20M" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "limloop/whiff-mamba2-20M",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "limloop/whiff-mamba2-20M" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "limloop/whiff-mamba2-20M",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use limloop/whiff-mamba2-20M with Docker Model Runner:
```
docker model run hf.co/limloop/whiff-mamba2-20M
```

whiff-mamba2-20M

Commit History

Update README.md

747a9f2
verified

limloop commited on Oct 20, 2025

Update README.md

d41c017
verified

Arsen Arutunan commited on Aug 21, 2025

Update README.md

e946191
verified

Arsen Arutunan commited on Jul 9, 2025

Update README.md

4544c86
verified

Arsen Arutunan commited on Jun 19, 2025

Update README.md

e8c4cc1
verified

Arsen Arutunan commited on May 28, 2025

самая адекватная версия

7f8e1c0

limloop commited on May 27, 2025

initial commit

81f1b1b
verified

Arsen Arutunan commited on May 23, 2025

Commit History

Update README.md 747a9f2 verified

Update README.md d41c017 verified

Update README.md e946191 verified

Update README.md 4544c86 verified

Update README.md e8c4cc1 verified

самая адекватная версия 7f8e1c0

initial commit 81f1b1b verified