Instructions to use Jetlink/JetLLMPremium-3.5 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use Jetlink/JetLLMPremium-3.5 with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("image-text-to-text", model="Jetlink/JetLLMPremium-3.5")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
pipe(text=messages)

# Load model directly
from transformers import AutoProcessor, AutoModelForImageTextToText

processor = AutoProcessor.from_pretrained("Jetlink/JetLLMPremium-3.5")
model = AutoModelForImageTextToText.from_pretrained("Jetlink/JetLLMPremium-3.5")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
inputs = processor.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps

vLLM

How to use Jetlink/JetLLMPremium-3.5 with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "Jetlink/JetLLMPremium-3.5"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Jetlink/JetLLMPremium-3.5",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker

docker model run hf.co/Jetlink/JetLLMPremium-3.5

SGLang

How to use Jetlink/JetLLMPremium-3.5 with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "Jetlink/JetLLMPremium-3.5" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Jetlink/JetLLMPremium-3.5",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "Jetlink/JetLLMPremium-3.5" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Jetlink/JetLLMPremium-3.5",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Docker Model Runner
How to use Jetlink/JetLLMPremium-3.5 with Docker Model Runner:
```
docker model run hf.co/Jetlink/JetLLMPremium-3.5
```

rezanaltjetlink commited on Apr 14

Commit

8a4f664

verified ·

1 Parent(s): 3c6c43e

Add files using upload-large-folder tool

Browse files

Files changed (50) hide show

model.safetensors-00001-of-00094.safetensors +3 -0
model.safetensors-00003-of-00094.safetensors +3 -0
model.safetensors-00007-of-00094.safetensors +3 -0
model.safetensors-00009-of-00094.safetensors +3 -0
model.safetensors-00010-of-00094.safetensors +3 -0
model.safetensors-00011-of-00094.safetensors +3 -0
model.safetensors-00012-of-00094.safetensors +3 -0
model.safetensors-00013-of-00094.safetensors +3 -0
model.safetensors-00014-of-00094.safetensors +3 -0
model.safetensors-00016-of-00094.safetensors +3 -0
model.safetensors-00017-of-00094.safetensors +3 -0
model.safetensors-00018-of-00094.safetensors +3 -0
model.safetensors-00019-of-00094.safetensors +3 -0
model.safetensors-00021-of-00094.safetensors +3 -0
model.safetensors-00023-of-00094.safetensors +3 -0
model.safetensors-00025-of-00094.safetensors +3 -0
model.safetensors-00026-of-00094.safetensors +3 -0
model.safetensors-00027-of-00094.safetensors +3 -0
model.safetensors-00028-of-00094.safetensors +3 -0
model.safetensors-00029-of-00094.safetensors +3 -0
model.safetensors-00030-of-00094.safetensors +3 -0
model.safetensors-00034-of-00094.safetensors +3 -0
model.safetensors-00036-of-00094.safetensors +3 -0
model.safetensors-00040-of-00094.safetensors +3 -0
model.safetensors-00041-of-00094.safetensors +3 -0
model.safetensors-00043-of-00094.safetensors +3 -0
model.safetensors-00046-of-00094.safetensors +3 -0
model.safetensors-00047-of-00094.safetensors +3 -0
model.safetensors-00048-of-00094.safetensors +3 -0
model.safetensors-00049-of-00094.safetensors +3 -0
model.safetensors-00050-of-00094.safetensors +3 -0
model.safetensors-00052-of-00094.safetensors +3 -0
model.safetensors-00054-of-00094.safetensors +3 -0
model.safetensors-00059-of-00094.safetensors +3 -0
model.safetensors-00061-of-00094.safetensors +3 -0
model.safetensors-00063-of-00094.safetensors +3 -0
model.safetensors-00067-of-00094.safetensors +3 -0
model.safetensors-00068-of-00094.safetensors +3 -0
model.safetensors-00069-of-00094.safetensors +3 -0
model.safetensors-00070-of-00094.safetensors +3 -0
model.safetensors-00071-of-00094.safetensors +3 -0
model.safetensors-00074-of-00094.safetensors +3 -0
model.safetensors-00075-of-00094.safetensors +3 -0
model.safetensors-00079-of-00094.safetensors +3 -0
model.safetensors-00084-of-00094.safetensors +3 -0
model.safetensors-00087-of-00094.safetensors +3 -0
model.safetensors-00089-of-00094.safetensors +3 -0
model.safetensors-00091-of-00094.safetensors +3 -0
model.safetensors-00092-of-00094.safetensors +3 -0
model.safetensors-00093-of-00094.safetensors +3 -0

model.safetensors-00001-of-00094.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:ef3af31ff138d1b4a4bdba1207ae727a8cf04f45e63805bfe0023b81019753d2
+size 8589934736

model.safetensors-00003-of-00094.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:30d5b86b581bfbee831f8fb0bd559f7c51841540c16ccfcb33b2c6e034da9189
+size 8589934736

model.safetensors-00007-of-00094.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:5ea70f2e4f1dceb3ca110474d5e5c9c8358686ff9483766f2c44569c27988291
+size 8589934736

model.safetensors-00009-of-00094.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:99275054b8efa27b0edce1c558bf574fdf9710901a1f26ced05e3e66f6ee0bd7
+size 8589934736

model.safetensors-00010-of-00094.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:7901ad36e1a8df569acc5fcffb304bc052f36fa0922c77c991aa2562d0105c36
+size 8589934736

model.safetensors-00011-of-00094.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:6de37420e3d78c30df0cc3f3a5f8b1b7a6ce7dc387715c20f429d4e74a23da71
+size 8589934736

model.safetensors-00012-of-00094.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:df24d49b01c11c2c2b935bb0221ed5f0c31f1efbb5a3499e2f1d0d257c6bbc5a
+size 8589934736

model.safetensors-00013-of-00094.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:4050f0e009ce2555a586a62c89d45767cd1f248b51365ad5cdc28bc0c8c48324
+size 8589934736

model.safetensors-00014-of-00094.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:5fbb1559e1b960c908ee74df7d925c54a46f7f76d914b3b79eb43e5b68a17f47
+size 8589934736

model.safetensors-00016-of-00094.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:0106bb289e1a16e7aa1329376e866592c7d61af53b7c11a472b38fba50a7fb64
+size 8589934736

model.safetensors-00017-of-00094.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:5ddb14834a14278ec9d3edb6a769cabd67b0318cc92dd4daf6ffc9fa090522e3
+size 8589934736

model.safetensors-00018-of-00094.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e9d42bce8cf3a69b845e1298236482a59763813a5f37a345b01a66c94fb085e5
+size 8589934736

model.safetensors-00019-of-00094.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:aea6f596de60fc7bba9441da6c31b961f06edd3a23638e67c186683ee0627e94
+size 8589934736

model.safetensors-00021-of-00094.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:0b294edfa9256f16c84ea7b22aeab8e266d80ebced07341735b9cca4055c0a40
+size 8589934736

model.safetensors-00023-of-00094.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:aff917f1549ce6960c11f9486fa9c139c5bd95f96b106f89f7e08cbe3a9bfd63
+size 8589934736

model.safetensors-00025-of-00094.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:4495e64341b298bb5f04c36f0c4ce200a4d2f60d1c4cf8d5befaa60a89720d81
+size 8589934736

model.safetensors-00026-of-00094.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:0bfda686c8e4b38bb325e7d41fb1f51ef37382f87b18619bbea93d7d18f83eae
+size 8589934736

model.safetensors-00027-of-00094.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b2bbe774d86bf517e948d5350d984952403500a840791384f047058f811b77c7
+size 8589934736

model.safetensors-00028-of-00094.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:bc5224f3d310356962d13cdf0ab6bd4524aea1178b7f72295081b4e83fea89e4
+size 8589934736

model.safetensors-00029-of-00094.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:830a685a5ba653da5f456e7750987615b23310984f1dcbe80a9356954bfd0f93
+size 8589934736

model.safetensors-00030-of-00094.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:740234757240e6e1a50d3c842a929c4ba98d73ada9b10a5ab8409bd3caa92a69
+size 8589934736

model.safetensors-00034-of-00094.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:75e7d240200e82f9680968db70d85770422f87ff5632ad21e58aa9fa057f90cc
+size 8589934736

model.safetensors-00036-of-00094.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:4cbce89cb5824105c2b6c97b5e9d3ef8e30d5aa93278c05d497413891ca850f0
+size 8589934736

model.safetensors-00040-of-00094.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:53c2e8a4eb74e14c86396059b3f20f7560c48244dcab4c972a9074ceee76889c
+size 8589934736

model.safetensors-00041-of-00094.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b5bbcf8e2b785daee4557cb8d3b47349a921c0911f3364b69a089470b6309ba6
+size 8589934736

model.safetensors-00043-of-00094.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b418deab92a9d6c2198e2535b034913368b00b5e2846f14d0accca78ee20f585
+size 8589934736

model.safetensors-00046-of-00094.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:0e3cb804a0a09fb3d763cb350ca679d40b13f3231ba0c3fa8f219173635c910b
+size 8589934736

model.safetensors-00047-of-00094.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:429868b1c18e7e21704787d6a37f8d8c71ce50132825e00c35f7b9e7373b503d
+size 8589934736

model.safetensors-00048-of-00094.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:df0acbdd33e9d350eed432374ed1f384f680c68b6e4db4ccf19b7fb5ad9fa122
+size 8589934736

model.safetensors-00049-of-00094.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:030ba02db03d8c1dc5dfb21d1b62086b30b1c8241444a2f270a2d306fe911fc1
+size 8589934736

model.safetensors-00050-of-00094.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e0c41996f743b33c0b717b4a5c8aa8ce07c57916893d3595c664af6eacc68504
+size 8589934736

model.safetensors-00052-of-00094.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c35dbf843b99a5249aae368f48ce50c0836c88d514a3e6665368dac2a3cdf180
+size 8589934736

model.safetensors-00054-of-00094.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e11284072f54306cbee322523c21323344672c5d1450f6a0d5a95f99808b1daa
+size 8589934736

model.safetensors-00059-of-00094.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:283e2d6e77872d5b67c7467b6db3af21887052618921eefc64d75c8788695aff
+size 8589934736

model.safetensors-00061-of-00094.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:eb1041b26a18e9c24b4cffcacf60b9584116d90701014e13b1c9739c6e179645
+size 8589934864

model.safetensors-00063-of-00094.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:409a6b965d9e2f62f61cee738906f48deed75b37af5af35b845e06f1614808f8
+size 8589934864

model.safetensors-00067-of-00094.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:8bb5c75a94987fa332dbfc273821a9339fec33ebd278246e2420290ae018fa46
+size 8589934864

model.safetensors-00068-of-00094.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:972212bee152dbe05996767bb86bdf1a4f3e1f9043d168c92af1a4358f5e5c58
+size 8589934864

model.safetensors-00069-of-00094.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:4fbb6fe1a4164d5fb79d777bcd790275bf71a8937e556d25ab68698714250458
+size 8589934864

model.safetensors-00070-of-00094.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:02ca20a9a77547b10a4364465f9f00ca4eddac469581ad065af06e57cac2664a
+size 8589934864

model.safetensors-00071-of-00094.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:9cdc08857cbf1c24d7f74c19885fd974fd138ed70955b47565a0ce88d3620602
+size 8589934864

model.safetensors-00074-of-00094.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:db1b30fd47084b7f6a77021d0a3fce19733db53182b3cc73b9683af818dbbed8
+size 8589934864

model.safetensors-00075-of-00094.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:986a56272126a5a47cdb0ece2f559f234b0042293f6488fcdb54e97db8d13f76
+size 8589934864

model.safetensors-00079-of-00094.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:ae989a457d8cc302c8399bff0c059ffa17e9b25113e3f5e05a2ce340382632f3
+size 8589934864

model.safetensors-00084-of-00094.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f745ae873f4c16cc77d616acd6a29e054e29ff98e47db003d99ede785b5ff27f
+size 8589934864

model.safetensors-00087-of-00094.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:902e61210bc26018a0e7140d56cbdb47dceb0a108ca8cb37dfa4f64b88c88f97
+size 8589934864

model.safetensors-00089-of-00094.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:20e3cfca678d1e609ebd0b40b90df476b072da779011c1ac0771401c5cdb5791
+size 8589934864

model.safetensors-00091-of-00094.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:3633797c27c32b194da65eaff2c5c27eb184bd547577c4124498bb8ae51e670f
+size 9638517720

model.safetensors-00092-of-00094.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:66cd7e6aecdcd4c69bfc7e8c072cbc4ae3771897785279a0ff2da6a0eb4a8211
+size 9658656328

model.safetensors-00093-of-00094.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:15f424c1a22772238bb0efcf53291f29ec00f5c08d84b644ae54ee31486475e1
+size 9663818112