Instructions to use Proximile/LLaDA-8B-Tools with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use Proximile/LLaDA-8B-Tools with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="Proximile/LLaDA-8B-Tools", trust_remote_code=True)
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("Proximile/LLaDA-8B-Tools", trust_remote_code=True, dtype="auto")

PEFT
How to use Proximile/LLaDA-8B-Tools with PEFT:
```
Task type is invalid.
```
Notebooks
Google Colab
Kaggle
Local Apps

vLLM

How to use Proximile/LLaDA-8B-Tools with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "Proximile/LLaDA-8B-Tools"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Proximile/LLaDA-8B-Tools",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/Proximile/LLaDA-8B-Tools

SGLang

How to use Proximile/LLaDA-8B-Tools with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "Proximile/LLaDA-8B-Tools" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Proximile/LLaDA-8B-Tools",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "Proximile/LLaDA-8B-Tools" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Proximile/LLaDA-8B-Tools",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use Proximile/LLaDA-8B-Tools with Docker Model Runner:
```
docker model run hf.co/Proximile/LLaDA-8B-Tools
```

ProximileAdmin commited on May 17, 2025

Commit

930484d

verified ·

1 Parent(s): fd6269c

Upload merged model

Browse files

Files changed (7) hide show

model-00001-of-00007.safetensors +1 -1
model-00002-of-00007.safetensors +1 -1
model-00003-of-00007.safetensors +1 -1
model-00004-of-00007.safetensors +1 -1
model-00005-of-00007.safetensors +1 -1
model-00006-of-00007.safetensors +1 -1
model-00007-of-00007.safetensors +1 -1

model-00001-of-00007.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:6526a9217f2c1feaa1a4529c07fa0bba010984568924e9e082c4bbbbe634cda7
 size 4957818648

 version https://git-lfs.github.com/spec/v1
+oid sha256:76a12a2eda959261dcc278237ec3e8f4922c99d7c1587cc4d45dc93fcc5e454c
 size 4957818648

model-00002-of-00007.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:b18b0a26548ae7ab1bf22391219f714445bb262320e6fb5e2c36e20343069b92
 size 4966225704

 version https://git-lfs.github.com/spec/v1
+oid sha256:32500e146aba9e7d35bf879ced8e21a66b145a40bd7d5f3e8b20c6603854fe8e
 size 4966225704

model-00003-of-00007.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:3e5844af04e7eecf3aed87c8aec2314553c8e50cc1efa936e387b38d66d1186e
 size 4832040992

 version https://git-lfs.github.com/spec/v1
+oid sha256:aee38e2b8b1fd2ba0d5fc78cf4ac9baa2addb3a53b5f587181ecb91a8fb343de
 size 4832040992

model-00004-of-00007.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:0548dd6a1555825fe3387cc6329fccf8abf7b5e7441bd87b11daeb0b1175c010
 size 4832007792

 version https://git-lfs.github.com/spec/v1
+oid sha256:13826ecd7a3cc7b4943f5ab6fa946a69e654670c6eee32d36e2a6a9ec0b13933
 size 4832007792

model-00005-of-00007.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:6e12954cc46f0269c01308b22d3cef401a0fc88f15d65ff26aa57a152e88754a
 size 4966258728

 version https://git-lfs.github.com/spec/v1
+oid sha256:f00348c1f263c668067cb6ea07e59107064a2f253e82ea25f303c9ad911fbdc5
 size 4966258728

model-00006-of-00007.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:4546729e891d9c3600263fa6e8b0d061ee5061701ff289e16a1dbbd1d1a74bbe
 size 4966258752

 version https://git-lfs.github.com/spec/v1
+oid sha256:1aa1302ec4d18b2fa5e39835f4e4ae462189a018450c9de67042c1c1d3e09e6d
 size 4966258752

model-00007-of-00007.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:fa021cfd21e0959b17bd91cdcb46e253ef554520d68a6d0d415d00085ce05418
 size 2541748728

 version https://git-lfs.github.com/spec/v1
+oid sha256:be3a6b07296e35269bc4ee1fdfe629961300abba63bca9e2255a3c0e262b960f
 size 2541748728