Instructions to use tzchen07/g2_X9e with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use tzchen07/g2_X9e with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="tzchen07/g2_X9e")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForMultimodalLM

tokenizer = AutoTokenizer.from_pretrained("tzchen07/g2_X9e")
model = AutoModelForMultimodalLM.from_pretrained("tzchen07/g2_X9e")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use tzchen07/g2_X9e with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "tzchen07/g2_X9e"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "tzchen07/g2_X9e",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/tzchen07/g2_X9e

SGLang

How to use tzchen07/g2_X9e with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "tzchen07/g2_X9e" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "tzchen07/g2_X9e",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "tzchen07/g2_X9e" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "tzchen07/g2_X9e",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use tzchen07/g2_X9e with Docker Model Runner:
```
docker model run hf.co/tzchen07/g2_X9e
```

g2_X9e

File size: 11,560 Bytes

ad70175

{"current_steps": 205, "total_steps": 498, "loss": 0.0977, "lr": 3.6784918420649952e-06, "epoch": 0.8239135895503642, "percentage": 41.16, "elapsed_time": "0:01:41", "remaining_time": "0:02:24"}
{"current_steps": 210, "total_steps": 498, "loss": 0.0731, "lr": 3.600477621728473e-06, "epoch": 0.8440090429540317, "percentage": 42.17, "elapsed_time": "0:03:21", "remaining_time": "0:04:36"}
{"current_steps": 215, "total_steps": 498, "loss": 0.0939, "lr": 3.521110642339991e-06, "epoch": 0.864104496357699, "percentage": 43.17, "elapsed_time": "0:05:03", "remaining_time": "0:06:39"}
{"current_steps": 220, "total_steps": 498, "loss": 0.0747, "lr": 3.4404884655379433e-06, "epoch": 0.8841999497613665, "percentage": 44.18, "elapsed_time": "0:06:43", "remaining_time": "0:08:30"}
{"current_steps": 225, "total_steps": 498, "loss": 0.0625, "lr": 3.358710195908653e-06, "epoch": 0.9042954031650339, "percentage": 45.18, "elapsed_time": "0:08:26", "remaining_time": "0:10:15"}
{"current_steps": 230, "total_steps": 498, "loss": 0.1004, "lr": 3.27587635916233e-06, "epoch": 0.9243908565687013, "percentage": 46.18, "elapsed_time": "0:10:07", "remaining_time": "0:11:48"}
{"current_steps": 235, "total_steps": 498, "loss": 0.1034, "lr": 3.1920887785621233e-06, "epoch": 0.9444863099723687, "percentage": 47.19, "elapsed_time": "0:11:51", "remaining_time": "0:13:16"}
{"current_steps": 240, "total_steps": 498, "loss": 0.0815, "lr": 3.10745044975816e-06, "epoch": 0.9645817633760362, "percentage": 48.19, "elapsed_time": "0:13:33", "remaining_time": "0:14:34"}
{"current_steps": 245, "total_steps": 498, "loss": 0.0887, "lr": 3.022065414180425e-06, "epoch": 0.9846772167797035, "percentage": 49.2, "elapsed_time": "0:15:13", "remaining_time": "0:15:42"}
{"current_steps": 250, "total_steps": 498, "loss": 0.0972, "lr": 2.9360386311461276e-06, "epoch": 1.0040190906807336, "percentage": 50.2, "elapsed_time": "0:16:52", "remaining_time": "0:16:43"}
{"current_steps": 255, "total_steps": 498, "loss": 0.0546, "lr": 2.849475848838749e-06, "epoch": 1.0241145440844008, "percentage": 51.2, "elapsed_time": "0:18:30", "remaining_time": "0:17:38"}
{"current_steps": 260, "total_steps": 498, "loss": 0.0601, "lr": 2.762483474317387e-06, "epoch": 1.0442099974880683, "percentage": 52.21, "elapsed_time": "0:20:09", "remaining_time": "0:18:27"}
{"current_steps": 265, "total_steps": 498, "loss": 0.0596, "lr": 2.6751684427161684e-06, "epoch": 1.0643054508917358, "percentage": 53.21, "elapsed_time": "0:21:51", "remaining_time": "0:19:12"}
{"current_steps": 270, "total_steps": 498, "loss": 0.0577, "lr": 2.587638085794541e-06, "epoch": 1.0844009042954033, "percentage": 54.22, "elapsed_time": "0:23:31", "remaining_time": "0:19:52"}
{"current_steps": 275, "total_steps": 498, "loss": 0.0527, "lr": 2.5e-06, "epoch": 1.1044963576990705, "percentage": 55.22, "elapsed_time": "0:25:11", "remaining_time": "0:20:25"}
{"current_steps": 280, "total_steps": 498, "loss": 0.0592, "lr": 2.41236191420546e-06, "epoch": 1.124591811102738, "percentage": 56.22, "elapsed_time": "0:26:52", "remaining_time": "0:20:55"}
{"current_steps": 285, "total_steps": 498, "loss": 0.0552, "lr": 2.3248315572838316e-06, "epoch": 1.1446872645064055, "percentage": 57.23, "elapsed_time": "0:28:33", "remaining_time": "0:21:20"}
{"current_steps": 290, "total_steps": 498, "loss": 0.0601, "lr": 2.237516525682614e-06, "epoch": 1.164782717910073, "percentage": 58.23, "elapsed_time": "0:30:13", "remaining_time": "0:21:40"}
{"current_steps": 295, "total_steps": 498, "loss": 0.0601, "lr": 2.1505241511612522e-06, "epoch": 1.1848781713137402, "percentage": 59.24, "elapsed_time": "0:31:57", "remaining_time": "0:21:59"}
{"current_steps": 300, "total_steps": 498, "loss": 0.0626, "lr": 2.0639613688538733e-06, "epoch": 1.2049736247174077, "percentage": 60.24, "elapsed_time": "0:33:42", "remaining_time": "0:22:14"}
{"current_steps": 305, "total_steps": 498, "loss": 0.049, "lr": 1.9779345858195757e-06, "epoch": 1.2250690781210751, "percentage": 61.24, "elapsed_time": "0:35:25", "remaining_time": "0:22:24"}
{"current_steps": 310, "total_steps": 498, "loss": 0.055, "lr": 1.8925495502418407e-06, "epoch": 1.2451645315247426, "percentage": 62.25, "elapsed_time": "0:37:07", "remaining_time": "0:22:30"}
{"current_steps": 315, "total_steps": 498, "loss": 0.0608, "lr": 1.8079112214378769e-06, "epoch": 1.2652599849284099, "percentage": 63.25, "elapsed_time": "0:38:48", "remaining_time": "0:22:32"}
{"current_steps": 320, "total_steps": 498, "loss": 0.0526, "lr": 1.7241236408376702e-06, "epoch": 1.2853554383320773, "percentage": 64.26, "elapsed_time": "0:40:27", "remaining_time": "0:22:30"}
{"current_steps": 325, "total_steps": 498, "loss": 0.0509, "lr": 1.6412898040913471e-06, "epoch": 1.3054508917357448, "percentage": 65.26, "elapsed_time": "0:42:09", "remaining_time": "0:22:26"}
{"current_steps": 330, "total_steps": 498, "loss": 0.0631, "lr": 1.5595115344620575e-06, "epoch": 1.3255463451394123, "percentage": 66.27, "elapsed_time": "0:43:54", "remaining_time": "0:22:21"}
{"current_steps": 335, "total_steps": 498, "loss": 0.0524, "lr": 1.47888935766001e-06, "epoch": 1.3456417985430797, "percentage": 67.27, "elapsed_time": "0:45:37", "remaining_time": "0:22:11"}
{"current_steps": 340, "total_steps": 498, "loss": 0.0507, "lr": 1.399522378271527e-06, "epoch": 1.365737251946747, "percentage": 68.27, "elapsed_time": "0:47:16", "remaining_time": "0:21:58"}
{"current_steps": 345, "total_steps": 498, "loss": 0.0487, "lr": 1.3215081579350058e-06, "epoch": 1.3858327053504145, "percentage": 69.28, "elapsed_time": "0:48:58", "remaining_time": "0:21:43"}
{"current_steps": 350, "total_steps": 498, "loss": 0.0544, "lr": 1.2449425954135452e-06, "epoch": 1.405928158754082, "percentage": 70.28, "elapsed_time": "0:50:38", "remaining_time": "0:21:25"}
{"current_steps": 355, "total_steps": 498, "loss": 0.0606, "lr": 1.169919808711659e-06, "epoch": 1.4260236121577492, "percentage": 71.29, "elapsed_time": "0:52:20", "remaining_time": "0:21:05"}
{"current_steps": 360, "total_steps": 498, "loss": 0.0547, "lr": 1.0965320193809808e-06, "epoch": 1.4461190655614167, "percentage": 72.29, "elapsed_time": "0:54:03", "remaining_time": "0:20:43"}
{"current_steps": 365, "total_steps": 498, "loss": 0.0534, "lr": 1.02486943915718e-06, "epoch": 1.4662145189650841, "percentage": 73.29, "elapsed_time": "0:55:45", "remaining_time": "0:20:18"}
{"current_steps": 370, "total_steps": 498, "loss": 0.0541, "lr": 9.550201590674343e-07, "epoch": 1.4863099723687516, "percentage": 74.3, "elapsed_time": "0:57:29", "remaining_time": "0:19:53"}
{"current_steps": 375, "total_steps": 498, "loss": 0.0501, "lr": 8.870700411447817e-07, "epoch": 1.506405425772419, "percentage": 75.3, "elapsed_time": "0:59:15", "remaining_time": "0:19:26"}
{"current_steps": 380, "total_steps": 498, "loss": 0.0611, "lr": 8.21102612882454e-07, "epoch": 1.5265008791760866, "percentage": 76.31, "elapsed_time": "1:01:00", "remaining_time": "0:18:56"}
{"current_steps": 385, "total_steps": 498, "loss": 0.0505, "lr": 7.57198964557942e-07, "epoch": 1.5465963325797538, "percentage": 77.31, "elapsed_time": "1:02:43", "remaining_time": "0:18:24"}
{"current_steps": 390, "total_steps": 498, "loss": 0.0473, "lr": 6.954376495529927e-07, "epoch": 1.5666917859834213, "percentage": 78.31, "elapsed_time": "1:04:23", "remaining_time": "0:17:49"}
{"current_steps": 395, "total_steps": 498, "loss": 0.0519, "lr": 6.358945877920861e-07, "epoch": 1.5867872393870885, "percentage": 79.32, "elapsed_time": "1:06:04", "remaining_time": "0:17:13"}
{"current_steps": 400, "total_steps": 498, "loss": 0.0491, "lr": 5.786429724180801e-07, "epoch": 1.606882692790756, "percentage": 80.32, "elapsed_time": "1:07:48", "remaining_time": "0:16:36"}
{"current_steps": 405, "total_steps": 498, "loss": 0.0441, "lr": 5.237531798197415e-07, "epoch": 1.6269781461944235, "percentage": 81.33, "elapsed_time": "1:10:07", "remaining_time": "0:16:06"}
{"current_steps": 410, "total_steps": 498, "loss": 0.054, "lr": 4.712926831217685e-07, "epoch": 1.647073599598091, "percentage": 82.33, "elapsed_time": "1:11:47", "remaining_time": "0:15:24"}
{"current_steps": 415, "total_steps": 498, "loss": 0.047, "lr": 4.2132596924363666e-07, "epoch": 1.6671690530017584, "percentage": 83.33, "elapsed_time": "1:13:30", "remaining_time": "0:14:42"}
{"current_steps": 420, "total_steps": 498, "loss": 0.0503, "lr": 3.7391445962923824e-07, "epoch": 1.687264506405426, "percentage": 84.34, "elapsed_time": "1:15:14", "remaining_time": "0:13:58"}
{"current_steps": 425, "total_steps": 498, "loss": 0.0456, "lr": 3.2911643474473647e-07, "epoch": 1.7073599598090932, "percentage": 85.34, "elapsed_time": "1:16:56", "remaining_time": "0:13:12"}
{"current_steps": 430, "total_steps": 498, "loss": 0.0535, "lr": 2.869869624374699e-07, "epoch": 1.7274554132127606, "percentage": 86.35, "elapsed_time": "1:18:36", "remaining_time": "0:12:25"}
{"current_steps": 435, "total_steps": 498, "loss": 0.0481, "lr": 2.4757783024395244e-07, "epoch": 1.747550866616428, "percentage": 87.35, "elapsed_time": "1:20:19", "remaining_time": "0:11:37"}
{"current_steps": 440, "total_steps": 498, "loss": 0.0519, "lr": 2.1093748173018846e-07, "epoch": 1.7676463200200954, "percentage": 88.35, "elapsed_time": "1:22:01", "remaining_time": "0:10:48"}
{"current_steps": 445, "total_steps": 498, "loss": 0.0523, "lr": 1.771109569425547e-07, "epoch": 1.7877417734237628, "percentage": 89.36, "elapsed_time": "1:23:43", "remaining_time": "0:09:58"}
{"current_steps": 450, "total_steps": 498, "loss": 0.0454, "lr": 1.4613983704244826e-07, "epoch": 1.8078372268274303, "percentage": 90.36, "elapsed_time": "1:25:25", "remaining_time": "0:09:06"}
{"current_steps": 455, "total_steps": 498, "loss": 0.046, "lr": 1.1806219319275918e-07, "epoch": 1.8279326802310978, "percentage": 91.37, "elapsed_time": "1:27:04", "remaining_time": "0:08:13"}
{"current_steps": 460, "total_steps": 498, "loss": 0.0529, "lr": 9.291253975900138e-08, "epoch": 1.8480281336347653, "percentage": 92.37, "elapsed_time": "1:28:51", "remaining_time": "0:07:20"}
{"current_steps": 465, "total_steps": 498, "loss": 0.0389, "lr": 7.072179188262252e-08, "epoch": 1.8681235870384325, "percentage": 93.37, "elapsed_time": "1:30:35", "remaining_time": "0:06:25"}
{"current_steps": 470, "total_steps": 498, "loss": 0.0489, "lr": 5.151722747865434e-08, "epoch": 1.8882190404421, "percentage": 94.38, "elapsed_time": "1:32:14", "remaining_time": "0:05:29"}
{"current_steps": 475, "total_steps": 498, "loss": 0.0438, "lr": 3.5322453704410286e-08, "epoch": 1.9083144938457672, "percentage": 95.38, "elapsed_time": "1:33:56", "remaining_time": "0:04:32"}
{"current_steps": 480, "total_steps": 498, "loss": 0.0448, "lr": 2.215737794045436e-08, "epoch": 1.9284099472494347, "percentage": 96.39, "elapsed_time": "1:35:43", "remaining_time": "0:03:35"}
{"current_steps": 485, "total_steps": 498, "loss": 0.0436, "lr": 1.2038183319507957e-08, "epoch": 1.9485054006531022, "percentage": 97.39, "elapsed_time": "1:37:25", "remaining_time": "0:02:36"}
{"current_steps": 490, "total_steps": 498, "loss": 0.0419, "lr": 4.977308833379324e-09, "epoch": 1.9686008540567697, "percentage": 98.39, "elapsed_time": "1:39:07", "remaining_time": "0:01:37"}
{"current_steps": 495, "total_steps": 498, "loss": 0.048, "lr": 9.834340423678368e-10, "epoch": 1.9886963074604371, "percentage": 99.4, "elapsed_time": "1:40:50", "remaining_time": "0:00:36"}
{"current_steps": 498, "total_steps": 498, "epoch": 2.0, "percentage": 100.0, "elapsed_time": "1:42:27", "remaining_time": "0:00:00"}