Instructions to use trillionlabs/gWorld-8B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use trillionlabs/gWorld-8B with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("image-text-to-text", model="trillionlabs/gWorld-8B")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
pipe(text=messages)

# Load model directly
from transformers import AutoProcessor, AutoModelForImageTextToText

processor = AutoProcessor.from_pretrained("trillionlabs/gWorld-8B")
model = AutoModelForImageTextToText.from_pretrained("trillionlabs/gWorld-8B")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
inputs = processor.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use trillionlabs/gWorld-8B with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "trillionlabs/gWorld-8B"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "trillionlabs/gWorld-8B",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker

docker model run hf.co/trillionlabs/gWorld-8B

SGLang

How to use trillionlabs/gWorld-8B with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "trillionlabs/gWorld-8B" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "trillionlabs/gWorld-8B",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "trillionlabs/gWorld-8B" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "trillionlabs/gWorld-8B",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Docker Model Runner
How to use trillionlabs/gWorld-8B with Docker Model Runner:
```
docker model run hf.co/trillionlabs/gWorld-8B
```

gWorld-8B

Commit History

Update README.md

eeec39b
verified

sungjunhan-trl commited on 22 days ago

Update README.md

22cb24e
verified

sungjunhan-trl commited on 23 days ago

Update README.md

9fd9f9f
verified

sungjunhan-trl commited on 26 days ago

Improve model card: Add pipeline_tag, library_name, paper link, and sample usage (#1)

6a7aea5

sungjunhan-trl

nielsr HF Staff commited on Feb 4

Update README.md

f2f1e43
verified

sungjunhan-trl commited on Feb 4

Update README.md

f6929e5
verified

sungjunhan-trl commited on Feb 3

Update README.md

23301be
verified

sungjunhan-trl commited on Feb 3

Update README.md

cdb930a
verified

sungjunhan-trl commited on Jan 30

Update README.md

bab467c
verified

sungjunhan-trl commited on Jan 30

Update README.md

6f715ed
verified

sungjunhan-trl commited on Jan 30

Update README.md

dc079e9
verified

sungjunhan-trl commited on Jan 30

Update README.md

0530c1c
verified

sungjunhan-trl commited on Jan 30

Update README.md

ffc45a7
verified

sungjunhan-trl commited on Jan 30

Update README.md

2305905
verified

sungjunhan-trl commited on Jan 30

Update README.md

3bf5ae5
verified

sungjunhan-trl commited on Jan 30

Update README.md

896e24b
verified

sungjunhan-trl commited on Jan 30

Create README.md

1cb7f31
verified

sungjunhan-trl commited on Jan 30

Upload MWM-v12-8b model weights

f339a24
verified

sungjunhan-trl commited on Jan 28

initial commit

accdc22
verified

sungjunhan-trl commited on Jan 28

Commit History

Update README.md eeec39b verified

Update README.md 22cb24e verified

Update README.md 9fd9f9f verified

Improve model card: Add pipeline_tag, library_name, paper link, and sample usage (#1) 6a7aea5

Update README.md f2f1e43 verified

Update README.md f6929e5 verified

Update README.md 23301be verified

Update README.md cdb930a verified

Update README.md bab467c verified

Update README.md 6f715ed verified

Update README.md dc079e9 verified

Update README.md 0530c1c verified

Update README.md ffc45a7 verified

Update README.md 2305905 verified

Update README.md 3bf5ae5 verified

Update README.md 896e24b verified

Create README.md 1cb7f31 verified

Upload MWM-v12-8b model weights f339a24 verified

initial commit accdc22 verified

Update README.md

eeec39b
verified

Update README.md

22cb24e
verified

Update README.md

9fd9f9f
verified

Improve model card: Add pipeline_tag, library_name, paper link, and sample usage (#1)

6a7aea5

Update README.md

f2f1e43
verified

Update README.md

f6929e5
verified

Update README.md

23301be
verified

Update README.md

cdb930a
verified

Update README.md

bab467c
verified

Update README.md

6f715ed
verified

Update README.md

dc079e9
verified

Update README.md

0530c1c
verified

Update README.md

ffc45a7
verified

Update README.md

2305905
verified

Update README.md

3bf5ae5
verified

Update README.md

896e24b
verified

Create README.md

1cb7f31
verified

Upload MWM-v12-8b model weights

f339a24
verified

initial commit

accdc22
verified