Instructions to use internlm/Intern-S2-Preview with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use internlm/Intern-S2-Preview with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("image-text-to-text", model="internlm/Intern-S2-Preview", trust_remote_code=True)
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
pipe(text=messages)

# Load model directly
from transformers import AutoModelForImageTextToText
model = AutoModelForImageTextToText.from_pretrained("internlm/Intern-S2-Preview", trust_remote_code=True, dtype="auto")

Notebooks
Google Colab
Kaggle
Local Apps

vLLM

How to use internlm/Intern-S2-Preview with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "internlm/Intern-S2-Preview"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "internlm/Intern-S2-Preview",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker

docker model run hf.co/internlm/Intern-S2-Preview

SGLang

How to use internlm/Intern-S2-Preview with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "internlm/Intern-S2-Preview" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "internlm/Intern-S2-Preview",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "internlm/Intern-S2-Preview" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "internlm/Intern-S2-Preview",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Docker Model Runner
How to use internlm/Intern-S2-Preview with Docker Model Runner:
```
docker model run hf.co/internlm/Intern-S2-Preview
```

yehaochen commited on 4 days ago

Commit

be1dc7e

1 Parent(s): 87ce0b4

[Fix] Remove old weight

Browse files

Files changed (22) hide show

model-00001-of-00022.safetensors +0 -3
model-00002-of-00022.safetensors +0 -3
model-00003-of-00022.safetensors +0 -3
model-00004-of-00022.safetensors +0 -3
model-00005-of-00022.safetensors +0 -3
model-00006-of-00022.safetensors +0 -3
model-00007-of-00022.safetensors +0 -3
model-00008-of-00022.safetensors +0 -3
model-00009-of-00022.safetensors +0 -3
model-00010-of-00022.safetensors +0 -3
model-00011-of-00022.safetensors +0 -3
model-00012-of-00022.safetensors +0 -3
model-00013-of-00022.safetensors +0 -3
model-00014-of-00022.safetensors +0 -3
model-00015-of-00022.safetensors +0 -3
model-00016-of-00022.safetensors +0 -3
model-00017-of-00022.safetensors +0 -3
model-00018-of-00022.safetensors +0 -3
model-00019-of-00022.safetensors +0 -3
model-00020-of-00022.safetensors +0 -3
model-00021-of-00022.safetensors +0 -3
model-00022-of-00022.safetensors +0 -3

model-00001-of-00022.safetensors DELETED Viewed

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:995a45fa3692bd35364745a7b96acdaa631a6c3ffb8a4102edfcbf39229ac5af
-size 3920272400

model-00002-of-00022.safetensors DELETED Viewed

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:0c629deac2d23507b1b324096a42f61129f815f2e52621f82e5365fe585580fa
-size 3357898400

model-00003-of-00022.safetensors DELETED Viewed

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:063764d67002b7e6bb21c0937dbe4ed90a0355cab570c878a33411ded935bea6
-size 3370808760

model-00004-of-00022.safetensors DELETED Viewed

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:50dd6754c2c07aa914817ead2ec53699d8f8b9f1405665d814566281c1951043
-size 3357898400

model-00005-of-00022.safetensors DELETED Viewed

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:e7bcd4ca7a6eb1c349170c00858a52e526268b0b305590124e20543750ba1669
-size 3370808760

model-00006-of-00022.safetensors DELETED Viewed

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:a6b0c9c45273dac6f35d61ddf45f4b27a5e81203adda07d677f53680f46c89c3
-size 3357898360

model-00007-of-00022.safetensors DELETED Viewed

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:9aa57c51a4742dc646e060a9047b8daf12911f69dd4cc7ff98dfb1d32912a24f
-size 3370808792

model-00008-of-00022.safetensors DELETED Viewed

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:37c11f3eb529963a1a9c7511a4aeddb45d6182363a42f9dd6b144e0c3f9114b6
-size 3357898432

model-00009-of-00022.safetensors DELETED Viewed

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:78728fb1a8ca22a82f6f293cd3bda71e712cd17dd5b55ad8746d7e317aacafa4
-size 3370808792

model-00010-of-00022.safetensors DELETED Viewed

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:455404e35f8e0c488eb08196fe27568a13f9f4b36268039d8f37572149a500ef
-size 3357898432

model-00011-of-00022.safetensors DELETED Viewed

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:ef470a402662cf45b36d8b12e7dcea6192ff9de7612bd60829410e40e9a4084e
-size 3370808792

model-00012-of-00022.safetensors DELETED Viewed

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:9490b4f09f2420deeb254209fa68cdc9339860560d26037ef3b56bc1733b39eb
-size 3357898432

model-00013-of-00022.safetensors DELETED Viewed

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:ccb516812b38f42c775f7b6681496129d49f88f3d6874d7ff101580fe0073ab2
-size 3370808792

model-00014-of-00022.safetensors DELETED Viewed

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:779b5ee835558166adb60e1e187bf44c1a862b693f94a4a4fec2d59a463be0d9
-size 3357898432

model-00015-of-00022.safetensors DELETED Viewed

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:18575d53b0c3708ffbbb14a2e9008a1fa0ec426887ab547ba765e3325436dbdd
-size 3370808792

model-00016-of-00022.safetensors DELETED Viewed

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:0e24ce8453b89b8fb6a390358080250d6a6dd60b3190984d7ac9e920711ae33c
-size 3357898432

model-00017-of-00022.safetensors DELETED Viewed

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:e8020324419f3ad5f03812594d6ee152c5a869c71077230649321aaf5a76bd9b
-size 3370808792

model-00018-of-00022.safetensors DELETED Viewed

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:6f3f9808fd16522e225e30bf1654c366de9827dd9261cbf5bf2bdf6a5b944232
-size 3357898432

model-00019-of-00022.safetensors DELETED Viewed

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:64ca6cea07284e2d43ec4fb32e78941b9e505178d3e870891449bf0b73e2f281
-size 3370808792

model-00020-of-00022.safetensors DELETED Viewed

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:bd30d6f3db1c81b3ce74e994aa0604781218d8f307203130d768d967428f5b5b
-size 3357898432

model-00021-of-00022.safetensors DELETED Viewed

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:b725bd593e946e8242f9e8585f4f7b53c4f6ba1795244f45b9a0ca458714b232
-size 4288914488

model-00022-of-00022.safetensors DELETED Viewed

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:b609eeea1d0fcbdd1a5fd9d2979f5c4b331caa4fef49432c096795db90ae1ddd
-size 833287792