Instructions to use tiny-random/longcat-flash-lite-sparse with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use tiny-random/longcat-flash-lite-sparse with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="tiny-random/longcat-flash-lite-sparse")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# pip install -U transformers accelerate
# Load model directly
from transformers import LongcatCausalLM
model = LongcatCausalLM.from_pretrained("tiny-random/longcat-flash-lite-sparse", device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use tiny-random/longcat-flash-lite-sparse with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "tiny-random/longcat-flash-lite-sparse"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "tiny-random/longcat-flash-lite-sparse",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/tiny-random/longcat-flash-lite-sparse

SGLang

How to use tiny-random/longcat-flash-lite-sparse with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "tiny-random/longcat-flash-lite-sparse" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "tiny-random/longcat-flash-lite-sparse",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "tiny-random/longcat-flash-lite-sparse" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "tiny-random/longcat-flash-lite-sparse",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use tiny-random/longcat-flash-lite-sparse with Docker Model Runner:
```
docker model run hf.co/tiny-random/longcat-flash-lite-sparse
```

longcat-flash-lite-sparse / README.md

yujiepan

Upload folder using huggingface_hub

462e5ce verified 1 day ago

preview code

Raw History Blame Contribute Delete

2.81 kB

---
library_name: transformers
pipeline_tag: text-generation
base_model:
- meituan-longcat/LongCat-Flash-Lite-Sparse
---
This is a randomly initialized tiny model based on [meituan-longcat/LongCat-Flash-Lite-Sparse](https://huggingface.co/meituan-longcat/LongCat-Flash-Lite-Sparse) for testing and debugging.

| Feature | Source | This repo |
|---|---|---|
| Checkpoint tensor elements | 69.11B BF16, 17.26M F32 | 11.72M BF16, 5.76K F32 |
| Safetensors weight files | 138.29 GB (26 files) | 23.53 MB (model.safetensors) |
| Logical layers (attention sublayers) | 14 (28) | 4 (8) |
| Hidden width / dense MLP / expert MLP | 3,072 / 6,144 / 1,024 | 8 / 64 / 32 |
| Q heads / MLA nope-rope-v head dims | 32 / 128-64-128 | 8 / 64-64-128 |
| MLA q-lora / kv-lora rank | 1,536 / 512 | 32 / 256 |
| Routed / identity zero experts, top-k | 256 / 128, 12 | 32 / 128, 12 |
| LSA index heads / head dim / top-k | 16 / 128 / 2,048 | Same |
| CLI factor / local + init tokens | 2 / 1,024 + 16 | Same |
| Over-embedding tables | 12 tables, ~10.22M rows each | 2 tables, ~524k rows |
| MTP/NextN draft layers | 1 (with LSA indexer) | Same |
| Attention / RoPE | LSA + deepseek-yarn, 1M context | Same |
| Vocabulary rows / tying | 131,072 / untied | Same |
| Routers / correction bias | FP32 | Same |
| Stored precision | BF16 | Same |

SGLang-only: the source ships no Transformers code and the tensors follow SGLang's `longcat_flash` schema. The n-gram hash modulus is internal embedding machinery, so it follows [tiny-random/longcat-flash-lite](https://huggingface.co/tiny-random/longcat-flash-lite).

| File path | Size |
|------|------|
| model.safetensors | 23.5MB |

### Example usage

#### SGLang serving (unverified)

LSA is implemented in SGLang (main branch; the LongCat Sparse adaptation landed via PR #32918). The checkpoint keeps the source's LongcatCausalLM architecture and serves text only, like the upstream deployment guide.

```bash
python3 -m sglang.launch_server \
  --trust-remote-code \
  --model scratch/longcat-flash-lite-sparse \
  --host 0.0.0.0 \
  --port 30000 \
  --tp-size 4 \
  --max-running-requests 64 \
  --mem-fraction-static 0.93 \
  --chunked-prefill-size 2048 \
  --dsa-prefill-backend fa3 \
  --kv-cache-dtype bfloat16
curl http://127.0.0.1:30000/v1/chat/completions \
  -H 'Content-Type: application/json' \
  -d '{"messages": [{"role": "user", "content": "Hello, world!"}], "max_tokens": 16}'
```

### Creating this repo

- Code: [.meta/create_model.py](.meta/create_model.py)
- Model structure: [.meta/model.log](.meta/model.log)
- Environment: [.meta/env.json](.meta/env.json)

### Change log

- 2026-11-03: Initial version: direct SGLang-schema LSA checkpoint (shortcut-MoE, CLI indexers, ngram over-embeddings and one NextN MTP draft).

*This repo is generated by GPT-6.1-Sol.*

	---
	library_name: transformers
	pipeline_tag: text-generation
	base_model:
	- meituan-longcat/LongCat-Flash-Lite-Sparse
	---

	This is a randomly initialized tiny model based on [meituan-longcat/LongCat-Flash-Lite-Sparse](https://huggingface.co/meituan-longcat/LongCat-Flash-Lite-Sparse) for testing and debugging.

	\| Feature \| Source \| This repo \|
	\|---\|---\|---\|
	\| Checkpoint tensor elements \| 69.11B BF16, 17.26M F32 \| 11.72M BF16, 5.76K F32 \|
	\| Safetensors weight files \| 138.29 GB (26 files) \| 23.53 MB (model.safetensors) \|
	\| Logical layers (attention sublayers) \| 14 (28) \| 4 (8) \|
	\| Hidden width / dense MLP / expert MLP \| 3,072 / 6,144 / 1,024 \| 8 / 64 / 32 \|
	\| Q heads / MLA nope-rope-v head dims \| 32 / 128-64-128 \| 8 / 64-64-128 \|
	\| MLA q-lora / kv-lora rank \| 1,536 / 512 \| 32 / 256 \|
	\| Routed / identity zero experts, top-k \| 256 / 128, 12 \| 32 / 128, 12 \|
	\| LSA index heads / head dim / top-k \| 16 / 128 / 2,048 \| Same \|
	\| CLI factor / local + init tokens \| 2 / 1,024 + 16 \| Same \|
	\| Over-embedding tables \| 12 tables, ~10.22M rows each \| 2 tables, ~524k rows \|
	\| MTP/NextN draft layers \| 1 (with LSA indexer) \| Same \|
	\| Attention / RoPE \| LSA + deepseek-yarn, 1M context \| Same \|
	\| Vocabulary rows / tying \| 131,072 / untied \| Same \|
	\| Routers / correction bias \| FP32 \| Same \|
	\| Stored precision \| BF16 \| Same \|

	SGLang-only: the source ships no Transformers code and the tensors follow SGLang's `longcat_flash` schema. The n-gram hash modulus is internal embedding machinery, so it follows [tiny-random/longcat-flash-lite](https://huggingface.co/tiny-random/longcat-flash-lite).

	\| File path \| Size \|
	\|------\|------\|
	\| model.safetensors \| 23.5MB \|

	### Example usage

	#### SGLang serving (unverified)

	LSA is implemented in SGLang (main branch; the LongCat Sparse adaptation landed via PR #32918). The checkpoint keeps the source's LongcatCausalLM architecture and serves text only, like the upstream deployment guide.

	```bash
	python3 -m sglang.launch_server \
	--trust-remote-code \
	--model scratch/longcat-flash-lite-sparse \
	--host 0.0.0.0 \
	--port 30000 \
	--tp-size 4 \
	--max-running-requests 64 \
	--mem-fraction-static 0.93 \
	--chunked-prefill-size 2048 \
	--dsa-prefill-backend fa3 \
	--kv-cache-dtype bfloat16

	curl http://127.0.0.1:30000/v1/chat/completions \
	-H 'Content-Type: application/json' \
	-d '{"messages": [{"role": "user", "content": "Hello, world!"}], "max_tokens": 16}'
	```

	### Creating this repo

	- Code: [.meta/create_model.py](.meta/create_model.py)
	- Model structure: [.meta/model.log](.meta/model.log)
	- Environment: [.meta/env.json](.meta/env.json)

	### Change log

	- 2026-11-03: Initial version: direct SGLang-schema LSA checkpoint (shortcut-MoE, CLI indexers, ngram over-embeddings and one NextN MTP draft).

	This repo is generated by GPT-6.1-Sol.