Text Generation
Transformers
TensorBoard
Safetensors
qwen3
llama-factory
full
Generated from Trainer
conversational
text-generation-inference
Instructions to use lldois/v02_all_lr3e5 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use lldois/v02_all_lr3e5 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="lldois/v02_all_lr3e5") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("lldois/v02_all_lr3e5") model = AutoModelForCausalLM.from_pretrained("lldois/v02_all_lr3e5", device_map="auto") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use lldois/v02_all_lr3e5 with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "lldois/v02_all_lr3e5" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "lldois/v02_all_lr3e5", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/lldois/v02_all_lr3e5
- SGLang
How to use lldois/v02_all_lr3e5 with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "lldois/v02_all_lr3e5" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "lldois/v02_all_lr3e5", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "lldois/v02_all_lr3e5" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "lldois/v02_all_lr3e5", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use lldois/v02_all_lr3e5 with Docker Model Runner:
docker model run hf.co/lldois/v02_all_lr3e5
| {"current_steps": 5, "total_steps": 398, "loss": 2.8925046920776367, "lr": 9.999999999999999e-06, "epoch": 0.01256281407035176, "percentage": 1.26, "elapsed_time": "0:00:40", "remaining_time": "0:53:17"} | |
| {"current_steps": 10, "total_steps": 398, "loss": 2.448771286010742, "lr": 2.25e-05, "epoch": 0.02512562814070352, "percentage": 2.51, "elapsed_time": "0:01:21", "remaining_time": "0:52:27"} | |
| {"current_steps": 15, "total_steps": 398, "loss": 2.0705329895019533, "lr": 2.9998012821858358e-05, "epoch": 0.03768844221105527, "percentage": 3.77, "elapsed_time": "0:02:02", "remaining_time": "0:52:04"} | |
| {"current_steps": 20, "total_steps": 398, "loss": 1.9264299392700195, "lr": 2.997566311404217e-05, "epoch": 0.05025125628140704, "percentage": 5.03, "elapsed_time": "0:02:42", "remaining_time": "0:51:15"} | |
| {"current_steps": 25, "total_steps": 398, "loss": 1.7724725723266601, "lr": 2.9928516855555942e-05, "epoch": 0.06281407035175879, "percentage": 6.28, "elapsed_time": "0:03:23", "remaining_time": "0:50:32"} | |
| {"current_steps": 30, "total_steps": 398, "loss": 1.7452875137329102, "lr": 2.985665211069496e-05, "epoch": 0.07537688442211055, "percentage": 7.54, "elapsed_time": "0:04:01", "remaining_time": "0:49:20"} | |
| {"current_steps": 35, "total_steps": 398, "loss": 1.6443361282348632, "lr": 2.9760187872372847e-05, "epoch": 0.08793969849246232, "percentage": 8.79, "elapsed_time": "0:04:41", "remaining_time": "0:48:39"} | |
| {"current_steps": 40, "total_steps": 398, "loss": 1.6196260452270508, "lr": 2.9639283865094298e-05, "epoch": 0.10050251256281408, "percentage": 10.05, "elapsed_time": "0:05:23", "remaining_time": "0:48:12"} | |
| {"current_steps": 45, "total_steps": 398, "loss": 1.6696979522705078, "lr": 2.9494140280484873e-05, "epoch": 0.11306532663316583, "percentage": 11.31, "elapsed_time": "0:06:02", "remaining_time": "0:47:22"} | |
| {"current_steps": 50, "total_steps": 398, "loss": 1.5513226509094238, "lr": 2.932499744581575e-05, "epoch": 0.12562814070351758, "percentage": 12.56, "elapsed_time": "0:06:43", "remaining_time": "0:46:48"} | |
| {"current_steps": 55, "total_steps": 398, "loss": 1.5566128730773925, "lr": 2.913213542607226e-05, "epoch": 0.13819095477386933, "percentage": 13.82, "elapsed_time": "0:07:23", "remaining_time": "0:46:05"} | |
| {"current_steps": 60, "total_steps": 398, "loss": 1.5669374465942383, "lr": 2.8915873560225136e-05, "epoch": 0.1507537688442211, "percentage": 15.08, "elapsed_time": "0:08:04", "remaining_time": "0:45:26"} | |
| {"current_steps": 65, "total_steps": 398, "loss": 1.5305331230163575, "lr": 2.8676569932472298e-05, "epoch": 0.16331658291457288, "percentage": 16.33, "elapsed_time": "0:08:44", "remaining_time": "0:44:47"} | |
| {"current_steps": 70, "total_steps": 398, "loss": 1.575944995880127, "lr": 2.841462077932666e-05, "epoch": 0.17587939698492464, "percentage": 17.59, "elapsed_time": "0:09:22", "remaining_time": "0:43:55"} | |
| {"current_steps": 75, "total_steps": 398, "loss": 1.5058233261108398, "lr": 2.8130459833531793e-05, "epoch": 0.1884422110552764, "percentage": 18.84, "elapsed_time": "0:10:02", "remaining_time": "0:43:14"} | |
| {"current_steps": 80, "total_steps": 398, "loss": 1.502994918823242, "lr": 2.7824557605891595e-05, "epoch": 0.20100502512562815, "percentage": 20.1, "elapsed_time": "0:10:42", "remaining_time": "0:42:32"} | |
| {"current_steps": 85, "total_steps": 398, "loss": 1.511138916015625, "lr": 2.749742060620333e-05, "epoch": 0.2135678391959799, "percentage": 21.36, "elapsed_time": "0:11:23", "remaining_time": "0:41:55"} | |
| {"current_steps": 90, "total_steps": 398, "loss": 1.5119872093200684, "lr": 2.714959050458384e-05, "epoch": 0.22613065326633167, "percentage": 22.61, "elapsed_time": "0:12:02", "remaining_time": "0:41:12"} | |
| {"current_steps": 95, "total_steps": 398, "loss": 1.5344759941101074, "lr": 2.6781643234577683e-05, "epoch": 0.23869346733668342, "percentage": 23.87, "elapsed_time": "0:12:42", "remaining_time": "0:40:31"} | |
| {"current_steps": 100, "total_steps": 398, "loss": 1.494624137878418, "lr": 2.639418803953223e-05, "epoch": 0.25125628140703515, "percentage": 25.13, "elapsed_time": "0:13:22", "remaining_time": "0:39:51"} | |
| {"current_steps": 105, "total_steps": 398, "loss": 1.4727994918823242, "lr": 2.598786646381871e-05, "epoch": 0.2638190954773869, "percentage": 26.38, "elapsed_time": "0:14:02", "remaining_time": "0:39:11"} | |
| {"current_steps": 110, "total_steps": 398, "loss": 1.4636452674865723, "lr": 2.5563351290569583e-05, "epoch": 0.27638190954773867, "percentage": 27.64, "elapsed_time": "0:14:43", "remaining_time": "0:38:32"} | |
| {"current_steps": 115, "total_steps": 398, "loss": 1.526972484588623, "lr": 2.5121345427691065e-05, "epoch": 0.2889447236180904, "percentage": 28.89, "elapsed_time": "0:15:24", "remaining_time": "0:37:55"} | |
| {"current_steps": 120, "total_steps": 398, "loss": 1.4123519897460937, "lr": 2.4662580743995365e-05, "epoch": 0.3015075376884422, "percentage": 30.15, "elapsed_time": "0:16:02", "remaining_time": "0:37:09"} | |
| {"current_steps": 125, "total_steps": 398, "loss": 1.440127468109131, "lr": 2.4187816857379752e-05, "epoch": 0.314070351758794, "percentage": 31.41, "elapsed_time": "0:16:42", "remaining_time": "0:36:28"} | |
| {"current_steps": 130, "total_steps": 398, "loss": 1.4384952545166017, "lr": 2.3697839877058963e-05, "epoch": 0.32663316582914576, "percentage": 32.66, "elapsed_time": "0:17:22", "remaining_time": "0:35:49"} | |
| {"current_steps": 135, "total_steps": 398, "loss": 1.4032865524291993, "lr": 2.319346110193356e-05, "epoch": 0.3391959798994975, "percentage": 33.92, "elapsed_time": "0:18:03", "remaining_time": "0:35:10"} | |
| {"current_steps": 140, "total_steps": 398, "loss": 1.4081149101257324, "lr": 2.267551567724948e-05, "epoch": 0.35175879396984927, "percentage": 35.18, "elapsed_time": "0:18:43", "remaining_time": "0:34:29"} | |
| {"current_steps": 145, "total_steps": 398, "loss": 1.4147528648376464, "lr": 2.2144861211772998e-05, "epoch": 0.36432160804020103, "percentage": 36.43, "elapsed_time": "0:19:21", "remaining_time": "0:33:46"} | |
| {"current_steps": 150, "total_steps": 398, "loss": 1.3809213638305664, "lr": 2.160237635777088e-05, "epoch": 0.3768844221105528, "percentage": 37.69, "elapsed_time": "0:20:02", "remaining_time": "0:33:08"} | |
| {"current_steps": 155, "total_steps": 398, "loss": 1.443575954437256, "lr": 2.104895935614689e-05, "epoch": 0.38944723618090454, "percentage": 38.94, "elapsed_time": "0:20:44", "remaining_time": "0:32:30"} | |
| {"current_steps": 160, "total_steps": 398, "loss": 1.4132374763488769, "lr": 2.0485526549143637e-05, "epoch": 0.4020100502512563, "percentage": 40.2, "elapsed_time": "0:21:25", "remaining_time": "0:31:51"} | |
| {"current_steps": 165, "total_steps": 398, "loss": 1.4260528564453125, "lr": 1.99130108630724e-05, "epoch": 0.41457286432160806, "percentage": 41.46, "elapsed_time": "0:22:05", "remaining_time": "0:31:11"} | |
| {"current_steps": 170, "total_steps": 398, "loss": 1.4127822875976563, "lr": 1.933236026358324e-05, "epoch": 0.4271356783919598, "percentage": 42.71, "elapsed_time": "0:22:43", "remaining_time": "0:30:29"} | |
| {"current_steps": 175, "total_steps": 398, "loss": 1.3749101638793946, "lr": 1.8744536186033133e-05, "epoch": 0.4396984924623116, "percentage": 43.97, "elapsed_time": "0:23:25", "remaining_time": "0:29:50"} | |
| {"current_steps": 180, "total_steps": 398, "loss": 1.3645042419433593, "lr": 1.8150511943551052e-05, "epoch": 0.45226130653266333, "percentage": 45.23, "elapsed_time": "0:24:06", "remaining_time": "0:29:11"} | |
| {"current_steps": 185, "total_steps": 398, "loss": 1.3747994422912597, "lr": 1.7551271115436e-05, "epoch": 0.4648241206030151, "percentage": 46.48, "elapsed_time": "0:24:47", "remaining_time": "0:28:33"} | |
| {"current_steps": 190, "total_steps": 398, "loss": 1.356684684753418, "lr": 1.694780591855643e-05, "epoch": 0.47738693467336685, "percentage": 47.74, "elapsed_time": "0:25:27", "remaining_time": "0:27:52"} | |
| {"current_steps": 195, "total_steps": 398, "loss": 1.3736384391784668, "lr": 1.6341115564447624e-05, "epoch": 0.4899497487437186, "percentage": 48.99, "elapsed_time": "0:26:08", "remaining_time": "0:27:12"} | |
| {"current_steps": 200, "total_steps": 398, "loss": 1.3433109283447267, "lr": 1.5732204604827395e-05, "epoch": 0.5025125628140703, "percentage": 50.25, "elapsed_time": "0:26:49", "remaining_time": "0:26:33"} | |
| {"current_steps": 205, "total_steps": 398, "loss": 1.4066362380981445, "lr": 1.5122081268269593e-05, "epoch": 0.5150753768844221, "percentage": 51.51, "elapsed_time": "0:27:30", "remaining_time": "0:25:53"} | |
| {"current_steps": 210, "total_steps": 398, "loss": 1.382357692718506, "lr": 1.4511755790789445e-05, "epoch": 0.5276381909547738, "percentage": 52.76, "elapsed_time": "0:28:12", "remaining_time": "0:25:14"} | |
| {"current_steps": 215, "total_steps": 398, "loss": 1.4047765731811523, "lr": 1.3902238743105087e-05, "epoch": 0.5402010050251256, "percentage": 54.02, "elapsed_time": "0:28:54", "remaining_time": "0:24:36"} | |
| {"current_steps": 220, "total_steps": 398, "loss": 1.3828323364257813, "lr": 1.32945393573448e-05, "epoch": 0.5527638190954773, "percentage": 55.28, "elapsed_time": "0:29:36", "remaining_time": "0:23:57"} | |
| {"current_steps": 225, "total_steps": 398, "loss": 1.4413321495056153, "lr": 1.2689663855970765e-05, "epoch": 0.5653266331658291, "percentage": 56.53, "elapsed_time": "0:30:16", "remaining_time": "0:23:16"} | |
| {"current_steps": 230, "total_steps": 398, "loss": 1.3303167343139648, "lr": 1.2088613785686083e-05, "epoch": 0.5778894472361809, "percentage": 57.79, "elapsed_time": "0:30:56", "remaining_time": "0:22:35"} | |
| {"current_steps": 235, "total_steps": 398, "loss": 1.3269375801086425, "lr": 1.1492384359083988e-05, "epoch": 0.5904522613065326, "percentage": 59.05, "elapsed_time": "0:31:36", "remaining_time": "0:21:55"} | |
| {"current_steps": 240, "total_steps": 398, "loss": 1.3969734191894532, "lr": 1.0901962806784941e-05, "epoch": 0.6030150753768844, "percentage": 60.3, "elapsed_time": "0:32:16", "remaining_time": "0:21:15"} | |
| {"current_steps": 245, "total_steps": 398, "loss": 1.3942330360412598, "lr": 1.0318326742790171e-05, "epoch": 0.6155778894472361, "percentage": 61.56, "elapsed_time": "0:32:56", "remaining_time": "0:20:34"} | |
| {"current_steps": 250, "total_steps": 398, "loss": 1.3573790550231934, "lr": 9.742442545758419e-06, "epoch": 0.628140703517588, "percentage": 62.81, "elapsed_time": "0:33:36", "remaining_time": "0:19:53"} | |
| {"current_steps": 255, "total_steps": 398, "loss": 1.3188179016113282, "lr": 9.175263758885932e-06, "epoch": 0.6407035175879398, "percentage": 64.07, "elapsed_time": "0:34:17", "remaining_time": "0:19:14"} | |
| {"current_steps": 260, "total_steps": 398, "loss": 1.3902714729309082, "lr": 8.617729511039368e-06, "epoch": 0.6532663316582915, "percentage": 65.33, "elapsed_time": "0:34:57", "remaining_time": "0:18:33"} | |
| {"current_steps": 265, "total_steps": 398, "loss": 1.3327635765075683, "lr": 8.070762961755747e-06, "epoch": 0.6658291457286433, "percentage": 66.58, "elapsed_time": "0:35:37", "remaining_time": "0:17:52"} | |
| {"current_steps": 270, "total_steps": 398, "loss": 1.4243352890014649, "lr": 7.535269772684295e-06, "epoch": 0.678391959798995, "percentage": 67.84, "elapsed_time": "0:36:20", "remaining_time": "0:17:13"} | |
| {"current_steps": 275, "total_steps": 398, "loss": 1.3524487495422364, "lr": 7.012136608001107e-06, "epoch": 0.6909547738693468, "percentage": 69.1, "elapsed_time": "0:37:02", "remaining_time": "0:16:34"} | |
| {"current_steps": 280, "total_steps": 398, "loss": 1.4379519462585448, "lr": 6.5022296662795675e-06, "epoch": 0.7035175879396985, "percentage": 70.35, "elapsed_time": "0:37:42", "remaining_time": "0:15:53"} | |
| {"current_steps": 285, "total_steps": 398, "loss": 1.3775064468383789, "lr": 6.006393246247647e-06, "epoch": 0.7160804020100503, "percentage": 71.61, "elapsed_time": "0:38:22", "remaining_time": "0:15:13"} | |
| {"current_steps": 290, "total_steps": 398, "loss": 1.3395397186279296, "lr": 5.525448348806584e-06, "epoch": 0.7286432160804021, "percentage": 72.86, "elapsed_time": "0:39:03", "remaining_time": "0:14:32"} | |
| {"current_steps": 295, "total_steps": 398, "loss": 1.3216740608215332, "lr": 5.060191317625973e-06, "epoch": 0.7412060301507538, "percentage": 74.12, "elapsed_time": "0:39:44", "remaining_time": "0:13:52"} | |
| {"current_steps": 300, "total_steps": 398, "loss": 1.367293930053711, "lr": 4.611392520566028e-06, "epoch": 0.7537688442211056, "percentage": 75.38, "elapsed_time": "0:40:25", "remaining_time": "0:13:12"} | |
| {"current_steps": 305, "total_steps": 398, "loss": 1.3515189170837403, "lr": 4.179795074110265e-06, "epoch": 0.7663316582914573, "percentage": 76.63, "elapsed_time": "0:41:05", "remaining_time": "0:12:31"} | |
| {"current_steps": 310, "total_steps": 398, "loss": 1.3384337425231934, "lr": 3.766113612920868e-06, "epoch": 0.7788944723618091, "percentage": 77.89, "elapsed_time": "0:41:44", "remaining_time": "0:11:51"} | |
| {"current_steps": 315, "total_steps": 398, "loss": 1.3583839416503907, "lr": 3.3710331065537868e-06, "epoch": 0.7914572864321608, "percentage": 79.15, "elapsed_time": "0:42:25", "remaining_time": "0:11:10"} | |
| {"current_steps": 320, "total_steps": 398, "loss": 1.3483553886413575, "lr": 2.9952077252932014e-06, "epoch": 0.8040201005025126, "percentage": 80.4, "elapsed_time": "0:43:03", "remaining_time": "0:10:29"} | |
| {"current_steps": 325, "total_steps": 398, "loss": 1.365108108520508, "lr": 2.6392597569829623e-06, "epoch": 0.8165829145728644, "percentage": 81.66, "elapsed_time": "0:43:44", "remaining_time": "0:09:49"} | |
| {"current_steps": 330, "total_steps": 398, "loss": 1.3631028175354003, "lr": 2.3037785766487252e-06, "epoch": 0.8291457286432161, "percentage": 82.91, "elapsed_time": "0:44:24", "remaining_time": "0:09:09"} | |
| {"current_steps": 335, "total_steps": 398, "loss": 1.3902606964111328, "lr": 1.98931967061679e-06, "epoch": 0.8417085427135679, "percentage": 84.17, "elapsed_time": "0:45:05", "remaining_time": "0:08:28"} | |
| {"current_steps": 340, "total_steps": 398, "loss": 1.405683994293213, "lr": 1.6964037167454605e-06, "epoch": 0.8542713567839196, "percentage": 85.43, "elapsed_time": "0:45:44", "remaining_time": "0:07:48"} | |
| {"current_steps": 345, "total_steps": 398, "loss": 1.4000654220581055, "lr": 1.4255157222919812e-06, "epoch": 0.8668341708542714, "percentage": 86.68, "elapsed_time": "0:46:25", "remaining_time": "0:07:07"} | |
| {"current_steps": 350, "total_steps": 398, "loss": 1.388939380645752, "lr": 1.1771042208424232e-06, "epoch": 0.8793969849246231, "percentage": 87.94, "elapsed_time": "0:47:05", "remaining_time": "0:06:27"} | |
| {"current_steps": 355, "total_steps": 398, "loss": 1.383950424194336, "lr": 9.515805296343461e-07, "epoch": 0.8919597989949749, "percentage": 89.2, "elapsed_time": "0:47:45", "remaining_time": "0:05:47"} | |
| {"current_steps": 360, "total_steps": 398, "loss": 1.3533215522766113, "lr": 7.493180685019057e-07, "epoch": 0.9045226130653267, "percentage": 90.45, "elapsed_time": "0:48:25", "remaining_time": "0:05:06"} | |
| {"current_steps": 365, "total_steps": 398, "loss": 1.3400803565979005, "lr": 5.706517415710688e-07, "epoch": 0.9170854271356784, "percentage": 91.71, "elapsed_time": "0:49:04", "remaining_time": "0:04:26"} | |
| {"current_steps": 370, "total_steps": 398, "loss": 1.40626220703125, "lr": 4.1587738272880093e-07, "epoch": 0.9296482412060302, "percentage": 92.96, "elapsed_time": "0:49:45", "remaining_time": "0:03:45"} | |
| {"current_steps": 375, "total_steps": 398, "loss": 1.3951802253723145, "lr": 2.8525126578428927e-07, "epoch": 0.9422110552763819, "percentage": 94.22, "elapsed_time": "0:50:23", "remaining_time": "0:03:05"} | |
| {"current_steps": 380, "total_steps": 398, "loss": 1.3679948806762696, "lr": 1.7898968013340567e-07, "epoch": 0.9547738693467337, "percentage": 95.48, "elapsed_time": "0:51:04", "remaining_time": "0:02:25"} | |
| {"current_steps": 385, "total_steps": 398, "loss": 1.378611946105957, "lr": 9.726857262890576e-08, "epoch": 0.9673366834170855, "percentage": 96.73, "elapsed_time": "0:51:43", "remaining_time": "0:01:44"} | |
| {"current_steps": 390, "total_steps": 398, "loss": 1.344498634338379, "lr": 4.0223256249426465e-08, "epoch": 0.9798994974874372, "percentage": 97.99, "elapsed_time": "0:52:24", "remaining_time": "0:01:04"} | |
| {"current_steps": 395, "total_steps": 398, "loss": 1.359067726135254, "lr": 7.948186049637207e-09, "epoch": 0.992462311557789, "percentage": 99.25, "elapsed_time": "0:53:04", "remaining_time": "0:00:24"} | |
| {"current_steps": 398, "total_steps": 398, "epoch": 1.0, "percentage": 100.0, "elapsed_time": "0:53:30", "remaining_time": "0:00:00"} | |