Text Generation
Transformers
Safetensors
gemma2
llama-factory
full
Generated from Trainer
conversational
text-generation-inference
Instructions to use tzchen07/SG_X9e with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use tzchen07/SG_X9e with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="tzchen07/SG_X9e") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoTokenizer, AutoModelForMultimodalLM tokenizer = AutoTokenizer.from_pretrained("tzchen07/SG_X9e") model = AutoModelForMultimodalLM.from_pretrained("tzchen07/SG_X9e") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use tzchen07/SG_X9e with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "tzchen07/SG_X9e" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "tzchen07/SG_X9e", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/tzchen07/SG_X9e
- SGLang
How to use tzchen07/SG_X9e with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "tzchen07/SG_X9e" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "tzchen07/SG_X9e", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "tzchen07/SG_X9e" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "tzchen07/SG_X9e", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use tzchen07/SG_X9e with Docker Model Runner:
docker model run hf.co/tzchen07/SG_X9e
| {"current_steps": 205, "total_steps": 498, "loss": 0.0956, "lr": 4.0000000000000003e-07, "epoch": 0.8239135895503642, "percentage": 41.16, "elapsed_time": "0:01:41", "remaining_time": "0:02:24"} | |
| {"current_steps": 210, "total_steps": 498, "loss": 0.0755, "lr": 9.000000000000001e-07, "epoch": 0.8440090429540317, "percentage": 42.17, "elapsed_time": "0:03:21", "remaining_time": "0:04:36"} | |
| {"current_steps": 215, "total_steps": 498, "loss": 0.0894, "lr": 1.4000000000000001e-06, "epoch": 0.864104496357699, "percentage": 43.17, "elapsed_time": "0:05:03", "remaining_time": "0:06:38"} | |
| {"current_steps": 220, "total_steps": 498, "loss": 0.074, "lr": 1.9000000000000002e-06, "epoch": 0.8841999497613665, "percentage": 44.18, "elapsed_time": "0:06:43", "remaining_time": "0:08:29"} | |
| {"current_steps": 225, "total_steps": 498, "loss": 0.0612, "lr": 2.4000000000000003e-06, "epoch": 0.9042954031650339, "percentage": 45.18, "elapsed_time": "0:08:26", "remaining_time": "0:10:14"} | |
| {"current_steps": 230, "total_steps": 498, "loss": 0.0967, "lr": 2.9e-06, "epoch": 0.9243908565687013, "percentage": 46.18, "elapsed_time": "0:10:07", "remaining_time": "0:11:47"} | |
| {"current_steps": 235, "total_steps": 498, "loss": 0.1008, "lr": 3.4000000000000005e-06, "epoch": 0.9444863099723687, "percentage": 47.19, "elapsed_time": "0:11:50", "remaining_time": "0:13:15"} | |
| {"current_steps": 240, "total_steps": 498, "loss": 0.0846, "lr": 3.900000000000001e-06, "epoch": 0.9645817633760362, "percentage": 48.19, "elapsed_time": "0:13:32", "remaining_time": "0:14:33"} | |
| {"current_steps": 245, "total_steps": 498, "loss": 0.0889, "lr": 4.4e-06, "epoch": 0.9846772167797035, "percentage": 49.2, "elapsed_time": "0:15:11", "remaining_time": "0:15:41"} | |
| {"current_steps": 250, "total_steps": 498, "loss": 0.1021, "lr": 4.9000000000000005e-06, "epoch": 1.0040190906807336, "percentage": 50.2, "elapsed_time": "0:16:50", "remaining_time": "0:16:42"} | |
| {"current_steps": 255, "total_steps": 498, "loss": 0.057, "lr": 4.999016565957633e-06, "epoch": 1.0241145440844008, "percentage": 51.2, "elapsed_time": "0:18:29", "remaining_time": "0:17:36"} | |
| {"current_steps": 260, "total_steps": 498, "loss": 0.0695, "lr": 4.995022691166621e-06, "epoch": 1.0442099974880683, "percentage": 52.21, "elapsed_time": "0:20:08", "remaining_time": "0:18:25"} | |
| {"current_steps": 265, "total_steps": 498, "loss": 0.0713, "lr": 4.987961816680493e-06, "epoch": 1.0643054508917358, "percentage": 53.21, "elapsed_time": "0:21:49", "remaining_time": "0:19:11"} | |
| {"current_steps": 270, "total_steps": 498, "loss": 0.0704, "lr": 4.977842622059546e-06, "epoch": 1.0844009042954033, "percentage": 54.22, "elapsed_time": "0:23:30", "remaining_time": "0:19:50"} | |
| {"current_steps": 275, "total_steps": 498, "loss": 0.0615, "lr": 4.96467754629559e-06, "epoch": 1.1044963576990705, "percentage": 55.22, "elapsed_time": "0:25:10", "remaining_time": "0:20:24"} | |
| {"current_steps": 280, "total_steps": 498, "loss": 0.0616, "lr": 4.948482772521346e-06, "epoch": 1.124591811102738, "percentage": 56.22, "elapsed_time": "0:26:50", "remaining_time": "0:20:54"} | |
| {"current_steps": 285, "total_steps": 498, "loss": 0.0627, "lr": 4.929278208117378e-06, "epoch": 1.1446872645064055, "percentage": 57.23, "elapsed_time": "0:28:31", "remaining_time": "0:21:19"} | |
| {"current_steps": 290, "total_steps": 498, "loss": 0.0707, "lr": 4.907087460240999e-06, "epoch": 1.164782717910073, "percentage": 58.23, "elapsed_time": "0:30:11", "remaining_time": "0:21:39"} | |
| {"current_steps": 295, "total_steps": 498, "loss": 0.0758, "lr": 4.881937806807241e-06, "epoch": 1.1848781713137402, "percentage": 59.24, "elapsed_time": "0:31:55", "remaining_time": "0:21:58"} | |
| {"current_steps": 300, "total_steps": 498, "loss": 0.0698, "lr": 4.8538601629575525e-06, "epoch": 1.2049736247174077, "percentage": 60.24, "elapsed_time": "0:33:39", "remaining_time": "0:22:13"} | |
| {"current_steps": 305, "total_steps": 498, "loss": 0.0593, "lr": 4.822889043057446e-06, "epoch": 1.2250690781210751, "percentage": 61.24, "elapsed_time": "0:35:22", "remaining_time": "0:22:23"} | |
| {"current_steps": 310, "total_steps": 498, "loss": 0.0635, "lr": 4.789062518269812e-06, "epoch": 1.2451645315247426, "percentage": 62.25, "elapsed_time": "0:37:04", "remaining_time": "0:22:29"} | |
| {"current_steps": 315, "total_steps": 498, "loss": 0.0737, "lr": 4.752422169756048e-06, "epoch": 1.2652599849284099, "percentage": 63.25, "elapsed_time": "0:38:46", "remaining_time": "0:22:31"} | |
| {"current_steps": 320, "total_steps": 498, "loss": 0.065, "lr": 4.713013037562531e-06, "epoch": 1.2853554383320773, "percentage": 64.26, "elapsed_time": "0:40:24", "remaining_time": "0:22:28"} | |
| {"current_steps": 325, "total_steps": 498, "loss": 0.0563, "lr": 4.670883565255264e-06, "epoch": 1.3054508917357448, "percentage": 65.26, "elapsed_time": "0:42:06", "remaining_time": "0:22:24"} | |
| {"current_steps": 330, "total_steps": 498, "loss": 0.0654, "lr": 4.6260855403707625e-06, "epoch": 1.3255463451394123, "percentage": 66.27, "elapsed_time": "0:43:52", "remaining_time": "0:22:19"} | |
| {"current_steps": 335, "total_steps": 498, "loss": 0.0616, "lr": 4.578674030756364e-06, "epoch": 1.3456417985430797, "percentage": 67.27, "elapsed_time": "0:45:34", "remaining_time": "0:22:10"} | |
| {"current_steps": 340, "total_steps": 498, "loss": 0.0608, "lr": 4.528707316878233e-06, "epoch": 1.365737251946747, "percentage": 68.27, "elapsed_time": "0:47:13", "remaining_time": "0:21:56"} | |
| {"current_steps": 345, "total_steps": 498, "loss": 0.0573, "lr": 4.476246820180259e-06, "epoch": 1.3858327053504145, "percentage": 69.28, "elapsed_time": "0:48:55", "remaining_time": "0:21:41"} | |
| {"current_steps": 350, "total_steps": 498, "loss": 0.0648, "lr": 4.421357027581921e-06, "epoch": 1.405928158754082, "percentage": 70.28, "elapsed_time": "0:50:35", "remaining_time": "0:21:23"} | |
| {"current_steps": 355, "total_steps": 498, "loss": 0.0679, "lr": 4.364105412207914e-06, "epoch": 1.4260236121577492, "percentage": 71.29, "elapsed_time": "0:52:17", "remaining_time": "0:21:03"} | |
| {"current_steps": 360, "total_steps": 498, "loss": 0.0655, "lr": 4.304562350447008e-06, "epoch": 1.4461190655614167, "percentage": 72.29, "elapsed_time": "0:53:59", "remaining_time": "0:20:41"} | |
| {"current_steps": 365, "total_steps": 498, "loss": 0.0662, "lr": 4.242801035442059e-06, "epoch": 1.4662145189650841, "percentage": 73.29, "elapsed_time": "0:55:41", "remaining_time": "0:20:17"} | |
| {"current_steps": 370, "total_steps": 498, "loss": 0.0659, "lr": 4.178897387117547e-06, "epoch": 1.4863099723687516, "percentage": 74.3, "elapsed_time": "0:57:25", "remaining_time": "0:19:51"} | |
| {"current_steps": 375, "total_steps": 498, "loss": 0.0605, "lr": 4.11292995885522e-06, "epoch": 1.506405425772419, "percentage": 75.3, "elapsed_time": "0:59:11", "remaining_time": "0:19:24"} | |
| {"current_steps": 380, "total_steps": 498, "loss": 0.0741, "lr": 4.044979840932567e-06, "epoch": 1.5265008791760866, "percentage": 76.31, "elapsed_time": "1:00:56", "remaining_time": "0:18:55"} | |
| {"current_steps": 385, "total_steps": 498, "loss": 0.058, "lr": 3.975130560842821e-06, "epoch": 1.5465963325797538, "percentage": 77.31, "elapsed_time": "1:02:38", "remaining_time": "0:18:23"} | |
| {"current_steps": 390, "total_steps": 498, "loss": 0.0584, "lr": 3.9034679806190204e-06, "epoch": 1.5666917859834213, "percentage": 78.31, "elapsed_time": "1:04:18", "remaining_time": "0:17:48"} | |
| {"current_steps": 395, "total_steps": 498, "loss": 0.0582, "lr": 3.830080191288342e-06, "epoch": 1.5867872393870885, "percentage": 79.32, "elapsed_time": "1:06:00", "remaining_time": "0:17:12"} | |
| {"current_steps": 400, "total_steps": 498, "loss": 0.0634, "lr": 3.755057404586455e-06, "epoch": 1.606882692790756, "percentage": 80.32, "elapsed_time": "1:07:43", "remaining_time": "0:16:35"} | |
| {"current_steps": 405, "total_steps": 498, "loss": 0.0525, "lr": 3.6784918420649952e-06, "epoch": 1.6269781461944235, "percentage": 81.33, "elapsed_time": "1:10:09", "remaining_time": "0:16:06"} | |
| {"current_steps": 410, "total_steps": 498, "loss": 0.0645, "lr": 3.600477621728473e-06, "epoch": 1.647073599598091, "percentage": 82.33, "elapsed_time": "1:11:49", "remaining_time": "0:15:24"} | |
| {"current_steps": 415, "total_steps": 498, "loss": 0.0526, "lr": 3.521110642339991e-06, "epoch": 1.6671690530017584, "percentage": 83.33, "elapsed_time": "1:13:32", "remaining_time": "0:14:42"} | |
| {"current_steps": 420, "total_steps": 498, "loss": 0.0616, "lr": 3.4404884655379433e-06, "epoch": 1.687264506405426, "percentage": 84.34, "elapsed_time": "1:15:15", "remaining_time": "0:13:58"} | |
| {"current_steps": 425, "total_steps": 498, "loss": 0.0537, "lr": 3.358710195908653e-06, "epoch": 1.7073599598090932, "percentage": 85.34, "elapsed_time": "1:16:58", "remaining_time": "0:13:13"} | |
| {"current_steps": 430, "total_steps": 498, "loss": 0.0619, "lr": 3.27587635916233e-06, "epoch": 1.7274554132127606, "percentage": 86.35, "elapsed_time": "1:18:38", "remaining_time": "0:12:26"} | |
| {"current_steps": 435, "total_steps": 498, "loss": 0.0603, "lr": 3.1920887785621233e-06, "epoch": 1.747550866616428, "percentage": 87.35, "elapsed_time": "1:20:20", "remaining_time": "0:11:38"} | |
| {"current_steps": 440, "total_steps": 498, "loss": 0.0594, "lr": 3.10745044975816e-06, "epoch": 1.7676463200200954, "percentage": 88.35, "elapsed_time": "1:22:02", "remaining_time": "0:10:48"} | |
| {"current_steps": 445, "total_steps": 498, "loss": 0.0608, "lr": 3.022065414180425e-06, "epoch": 1.7877417734237628, "percentage": 89.36, "elapsed_time": "1:23:44", "remaining_time": "0:09:58"} | |
| {"current_steps": 450, "total_steps": 498, "loss": 0.0505, "lr": 2.9360386311461276e-06, "epoch": 1.8078372268274303, "percentage": 90.36, "elapsed_time": "1:25:26", "remaining_time": "0:09:06"} | |
| {"current_steps": 455, "total_steps": 498, "loss": 0.0497, "lr": 2.849475848838749e-06, "epoch": 1.8279326802310978, "percentage": 91.37, "elapsed_time": "1:27:05", "remaining_time": "0:08:13"} | |
| {"current_steps": 460, "total_steps": 498, "loss": 0.0625, "lr": 2.762483474317387e-06, "epoch": 1.8480281336347653, "percentage": 92.37, "elapsed_time": "1:28:52", "remaining_time": "0:07:20"} | |
| {"current_steps": 465, "total_steps": 498, "loss": 0.0448, "lr": 2.6751684427161684e-06, "epoch": 1.8681235870384325, "percentage": 93.37, "elapsed_time": "1:30:36", "remaining_time": "0:06:25"} | |
| {"current_steps": 470, "total_steps": 498, "loss": 0.0588, "lr": 2.587638085794541e-06, "epoch": 1.8882190404421, "percentage": 94.38, "elapsed_time": "1:32:15", "remaining_time": "0:05:29"} | |
| {"current_steps": 475, "total_steps": 498, "loss": 0.0511, "lr": 2.5e-06, "epoch": 1.9083144938457672, "percentage": 95.38, "elapsed_time": "1:33:57", "remaining_time": "0:04:32"} | |
| {"current_steps": 480, "total_steps": 498, "loss": 0.0497, "lr": 2.41236191420546e-06, "epoch": 1.9284099472494347, "percentage": 96.39, "elapsed_time": "1:35:43", "remaining_time": "0:03:35"} | |
| {"current_steps": 485, "total_steps": 498, "loss": 0.0498, "lr": 2.3248315572838316e-06, "epoch": 1.9485054006531022, "percentage": 97.39, "elapsed_time": "1:37:25", "remaining_time": "0:02:36"} | |
| {"current_steps": 490, "total_steps": 498, "loss": 0.0459, "lr": 2.237516525682614e-06, "epoch": 1.9686008540567697, "percentage": 98.39, "elapsed_time": "1:39:07", "remaining_time": "0:01:37"} | |
| {"current_steps": 495, "total_steps": 498, "loss": 0.052, "lr": 2.1505241511612522e-06, "epoch": 1.9886963074604371, "percentage": 99.4, "elapsed_time": "1:40:50", "remaining_time": "0:00:36"} | |
| {"current_steps": 498, "total_steps": 498, "epoch": 2.0, "percentage": 100.0, "elapsed_time": "1:42:38", "remaining_time": "0:00:00"} | |