Instructions to use mingiJ/limo_pro-4b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use mingiJ/limo_pro-4b with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="mingiJ/limo_pro-4b")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("mingiJ/limo_pro-4b")
model = AutoModelForCausalLM.from_pretrained("mingiJ/limo_pro-4b", device_map="auto")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use mingiJ/limo_pro-4b with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "mingiJ/limo_pro-4b"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "mingiJ/limo_pro-4b",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/mingiJ/limo_pro-4b

SGLang

How to use mingiJ/limo_pro-4b with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "mingiJ/limo_pro-4b" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "mingiJ/limo_pro-4b",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "mingiJ/limo_pro-4b" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "mingiJ/limo_pro-4b",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use mingiJ/limo_pro-4b with Docker Model Runner:
```
docker model run hf.co/mingiJ/limo_pro-4b
```

limo_pro-4b / trainer_log.jsonl

mingiJ

Initial upload

2deabd7 verified 7 months ago

Raw

History Blame Contribute Delete

14.7 kB

	{"current_steps": 10, "total_steps": 753, "loss": 0.9405, "lr": 1.1842105263157895e-05, "epoch": 0.013270299411130464, "percentage": 1.33, "elapsed_time": "0:04:40", "remaining_time": "5:46:51"}
	{"current_steps": 20, "total_steps": 753, "loss": 0.4873, "lr": 2.5e-05, "epoch": 0.026540598822260928, "percentage": 2.66, "elapsed_time": "0:09:19", "remaining_time": "5:42:03"}
	{"current_steps": 30, "total_steps": 753, "loss": 0.4081, "lr": 3.815789473684211e-05, "epoch": 0.039810898233391394, "percentage": 3.98, "elapsed_time": "0:13:58", "remaining_time": "5:36:55"}
	{"current_steps": 40, "total_steps": 753, "loss": 0.3966, "lr": 5.131578947368422e-05, "epoch": 0.053081197644521856, "percentage": 5.31, "elapsed_time": "0:18:37", "remaining_time": "5:32:05"}
	{"current_steps": 50, "total_steps": 753, "loss": 0.4168, "lr": 6.447368421052632e-05, "epoch": 0.06635149705565231, "percentage": 6.64, "elapsed_time": "0:23:18", "remaining_time": "5:27:37"}
	{"current_steps": 60, "total_steps": 753, "loss": 0.4101, "lr": 7.763157894736843e-05, "epoch": 0.07962179646678279, "percentage": 7.97, "elapsed_time": "0:27:58", "remaining_time": "5:23:04"}
	{"current_steps": 70, "total_steps": 753, "loss": 0.4176, "lr": 9.078947368421054e-05, "epoch": 0.09289209587791325, "percentage": 9.3, "elapsed_time": "0:32:37", "remaining_time": "5:18:17"}
	{"current_steps": 80, "total_steps": 753, "loss": 0.4322, "lr": 9.999515495391765e-05, "epoch": 0.10616239528904371, "percentage": 10.62, "elapsed_time": "0:37:16", "remaining_time": "5:13:32"}
	{"current_steps": 90, "total_steps": 753, "loss": 0.4376, "lr": 9.990904692023604e-05, "epoch": 0.11943269470017417, "percentage": 11.95, "elapsed_time": "0:41:55", "remaining_time": "5:08:49"}
	{"current_steps": 100, "total_steps": 753, "loss": 0.4379, "lr": 9.971548459891113e-05, "epoch": 0.13270299411130462, "percentage": 13.28, "elapsed_time": "0:46:35", "remaining_time": "5:04:15"}
	{"current_steps": 110, "total_steps": 753, "loss": 0.4398, "lr": 9.941488473004595e-05, "epoch": 0.1459732935224351, "percentage": 14.61, "elapsed_time": "0:51:16", "remaining_time": "4:59:44"}
	{"current_steps": 120, "total_steps": 753, "loss": 0.4487, "lr": 9.900789450581836e-05, "epoch": 0.15924359293356558, "percentage": 15.94, "elapsed_time": "0:55:57", "remaining_time": "4:55:08"}
	{"current_steps": 130, "total_steps": 753, "loss": 0.4274, "lr": 9.849539017707508e-05, "epoch": 0.17251389234469602, "percentage": 17.26, "elapsed_time": "1:00:36", "remaining_time": "4:50:25"}
	{"current_steps": 140, "total_steps": 753, "loss": 0.4224, "lr": 9.787847516676162e-05, "epoch": 0.1857841917558265, "percentage": 18.59, "elapsed_time": "1:05:18", "remaining_time": "4:45:57"}
	{"current_steps": 150, "total_steps": 753, "loss": 0.4365, "lr": 9.715847769425021e-05, "epoch": 0.19905449116695695, "percentage": 19.92, "elapsed_time": "1:10:01", "remaining_time": "4:41:28"}
	{"current_steps": 160, "total_steps": 753, "loss": 0.4347, "lr": 9.633694791568062e-05, "epoch": 0.21232479057808742, "percentage": 21.25, "elapsed_time": "1:14:43", "remaining_time": "4:36:56"}
	{"current_steps": 170, "total_steps": 753, "loss": 0.4475, "lr": 9.541565458647059e-05, "epoch": 0.22559508998921787, "percentage": 22.58, "elapsed_time": "1:19:24", "remaining_time": "4:32:21"}
	{"current_steps": 180, "total_steps": 753, "loss": 0.4493, "lr": 9.439658125318151e-05, "epoch": 0.23886538940034835, "percentage": 23.9, "elapsed_time": "1:24:06", "remaining_time": "4:27:45"}
	{"current_steps": 190, "total_steps": 753, "loss": 0.4223, "lr": 9.328192198293831e-05, "epoch": 0.2521356888114788, "percentage": 25.23, "elapsed_time": "1:28:49", "remaining_time": "4:23:12"}
	{"current_steps": 200, "total_steps": 753, "loss": 0.4481, "lr": 9.207407663959816e-05, "epoch": 0.26540598822260925, "percentage": 26.56, "elapsed_time": "1:33:34", "remaining_time": "4:18:43"}
	{"current_steps": 210, "total_steps": 753, "loss": 0.443, "lr": 9.077564571683826e-05, "epoch": 0.27867628763373975, "percentage": 27.89, "elapsed_time": "1:40:19", "remaining_time": "4:19:24"}
	{"current_steps": 220, "total_steps": 753, "loss": 0.41, "lr": 8.938942473928729e-05, "epoch": 0.2919465870448702, "percentage": 29.22, "elapsed_time": "1:45:01", "remaining_time": "4:14:26"}
	{"current_steps": 230, "total_steps": 753, "loss": 0.4244, "lr": 8.791839824375471e-05, "epoch": 0.30521688645600065, "percentage": 30.54, "elapsed_time": "1:49:44", "remaining_time": "4:09:32"}
	{"current_steps": 240, "total_steps": 753, "loss": 0.4219, "lr": 8.636573335351648e-05, "epoch": 0.31848718586713115, "percentage": 31.87, "elapsed_time": "1:54:28", "remaining_time": "4:04:40"}
	{"current_steps": 250, "total_steps": 753, "loss": 0.4212, "lr": 8.473477295949169e-05, "epoch": 0.3317574852782616, "percentage": 33.2, "elapsed_time": "1:59:10", "remaining_time": "3:59:47"}
	{"current_steps": 260, "total_steps": 753, "loss": 0.4232, "lr": 8.302902852299104e-05, "epoch": 0.34502778468939205, "percentage": 34.53, "elapsed_time": "2:03:52", "remaining_time": "3:54:53"}
	{"current_steps": 270, "total_steps": 753, "loss": 0.4065, "lr": 8.125217251553289e-05, "epoch": 0.3582980841005225, "percentage": 35.86, "elapsed_time": "2:08:34", "remaining_time": "3:50:00"}
	{"current_steps": 280, "total_steps": 753, "loss": 0.4149, "lr": 7.940803051200419e-05, "epoch": 0.371568383511653, "percentage": 37.18, "elapsed_time": "2:13:17", "remaining_time": "3:45:09"}
	{"current_steps": 290, "total_steps": 753, "loss": 0.4174, "lr": 7.750057295418911e-05, "epoch": 0.38483868292278345, "percentage": 38.51, "elapsed_time": "2:17:59", "remaining_time": "3:40:18"}
	{"current_steps": 300, "total_steps": 753, "loss": 0.4009, "lr": 7.553390660239932e-05, "epoch": 0.3981089823339139, "percentage": 39.84, "elapsed_time": "2:22:43", "remaining_time": "3:35:31"}
	{"current_steps": 310, "total_steps": 753, "loss": 0.4013, "lr": 7.351226569360996e-05, "epoch": 0.41137928174504435, "percentage": 41.17, "elapsed_time": "2:27:26", "remaining_time": "3:30:41"}
	{"current_steps": 320, "total_steps": 753, "loss": 0.4209, "lr": 7.144000282513812e-05, "epoch": 0.42464958115617485, "percentage": 42.5, "elapsed_time": "2:32:09", "remaining_time": "3:25:52"}
	{"current_steps": 330, "total_steps": 753, "loss": 0.3839, "lr": 6.932157958349133e-05, "epoch": 0.4379198805673053, "percentage": 43.82, "elapsed_time": "2:36:50", "remaining_time": "3:21:03"}
	{"current_steps": 340, "total_steps": 753, "loss": 0.4107, "lr": 6.716155693856188e-05, "epoch": 0.45119017997843575, "percentage": 45.15, "elapsed_time": "2:41:34", "remaining_time": "3:16:16"}
	{"current_steps": 350, "total_steps": 753, "loss": 0.3981, "lr": 6.496458542384877e-05, "epoch": 0.46446047938956625, "percentage": 46.48, "elapsed_time": "2:46:17", "remaining_time": "3:11:28"}
	{"current_steps": 360, "total_steps": 753, "loss": 0.394, "lr": 6.273539512384879e-05, "epoch": 0.4777307788006967, "percentage": 47.81, "elapsed_time": "2:51:00", "remaining_time": "3:06:41"}
	{"current_steps": 370, "total_steps": 753, "loss": 0.3931, "lr": 6.047878549017415e-05, "epoch": 0.49100107821182715, "percentage": 49.14, "elapsed_time": "2:55:42", "remaining_time": "3:01:52"}
	{"current_steps": 380, "total_steps": 753, "loss": 0.3823, "lr": 5.819961500832278e-05, "epoch": 0.5042713776229576, "percentage": 50.46, "elapsed_time": "3:00:24", "remaining_time": "2:57:04"}
	{"current_steps": 390, "total_steps": 753, "loss": 0.3876, "lr": 5.590279073734822e-05, "epoch": 0.517541677034088, "percentage": 51.79, "elapsed_time": "3:05:05", "remaining_time": "2:52:16"}
	{"current_steps": 400, "total_steps": 753, "loss": 0.3842, "lr": 5.359325774495082e-05, "epoch": 0.5308119764452185, "percentage": 53.12, "elapsed_time": "3:09:48", "remaining_time": "2:47:29"}
	{"current_steps": 410, "total_steps": 753, "loss": 0.3906, "lr": 5.1275988460736045e-05, "epoch": 0.544082275856349, "percentage": 54.45, "elapsed_time": "3:16:33", "remaining_time": "2:44:26"}
	{"current_steps": 420, "total_steps": 753, "loss": 0.3982, "lr": 4.895597197056262e-05, "epoch": 0.5573525752674795, "percentage": 55.78, "elapsed_time": "3:21:20", "remaining_time": "2:39:37"}
	{"current_steps": 430, "total_steps": 753, "loss": 0.3804, "lr": 4.663820327502975e-05, "epoch": 0.57062287467861, "percentage": 57.1, "elapsed_time": "3:26:03", "remaining_time": "2:34:46"}
	{"current_steps": 440, "total_steps": 753, "loss": 0.3741, "lr": 4.432767253522987e-05, "epoch": 0.5838931740897404, "percentage": 58.43, "elapsed_time": "3:30:46", "remaining_time": "2:29:56"}
	{"current_steps": 450, "total_steps": 753, "loss": 0.3998, "lr": 4.202935432892075e-05, "epoch": 0.5971634735008708, "percentage": 59.76, "elapsed_time": "3:35:29", "remaining_time": "2:25:05"}
	{"current_steps": 460, "total_steps": 753, "loss": 0.3869, "lr": 3.97481969402488e-05, "epoch": 0.6104337729120013, "percentage": 61.09, "elapsed_time": "3:40:12", "remaining_time": "2:20:15"}
	{"current_steps": 470, "total_steps": 753, "loss": 0.3673, "lr": 3.7489111706082325e-05, "epoch": 0.6237040723231317, "percentage": 62.42, "elapsed_time": "3:44:54", "remaining_time": "2:15:25"}
	{"current_steps": 480, "total_steps": 753, "loss": 0.3666, "lr": 3.5256962441892515e-05, "epoch": 0.6369743717342623, "percentage": 63.75, "elapsed_time": "3:49:39", "remaining_time": "2:10:36"}
	{"current_steps": 490, "total_steps": 753, "loss": 0.3595, "lr": 3.305655496994804e-05, "epoch": 0.6502446711453927, "percentage": 65.07, "elapsed_time": "3:54:22", "remaining_time": "2:05:47"}
	{"current_steps": 500, "total_steps": 753, "loss": 0.3627, "lr": 3.089262677236915e-05, "epoch": 0.6635149705565232, "percentage": 66.4, "elapsed_time": "3:59:06", "remaining_time": "2:00:59"}
	{"current_steps": 510, "total_steps": 753, "loss": 0.3614, "lr": 2.8769836791318215e-05, "epoch": 0.6767852699676536, "percentage": 67.73, "elapsed_time": "4:03:50", "remaining_time": "1:56:10"}
	{"current_steps": 520, "total_steps": 753, "loss": 0.3787, "lr": 2.6692755398287096e-05, "epoch": 0.6900555693787841, "percentage": 69.06, "elapsed_time": "4:08:34", "remaining_time": "1:51:22"}
	{"current_steps": 530, "total_steps": 753, "loss": 0.355, "lr": 2.4665854554077283e-05, "epoch": 0.7033258687899145, "percentage": 70.39, "elapsed_time": "4:13:17", "remaining_time": "1:46:34"}
	{"current_steps": 540, "total_steps": 753, "loss": 0.3558, "lr": 2.269349818065838e-05, "epoch": 0.716596168201045, "percentage": 71.71, "elapsed_time": "4:17:59", "remaining_time": "1:41:45"}
	{"current_steps": 550, "total_steps": 753, "loss": 0.3653, "lr": 2.077993276563457e-05, "epoch": 0.7298664676121756, "percentage": 73.04, "elapsed_time": "4:22:42", "remaining_time": "1:36:57"}
	{"current_steps": 560, "total_steps": 753, "loss": 0.3552, "lr": 1.8929278219547537e-05, "epoch": 0.743136767023306, "percentage": 74.37, "elapsed_time": "4:27:28", "remaining_time": "1:32:10"}
	{"current_steps": 570, "total_steps": 753, "loss": 0.3492, "lr": 1.7145519005699907e-05, "epoch": 0.7564070664344364, "percentage": 75.7, "elapsed_time": "4:32:10", "remaining_time": "1:27:23"}
	{"current_steps": 580, "total_steps": 753, "loss": 0.347, "lr": 1.5432495561597072e-05, "epoch": 0.7696773658455669, "percentage": 77.03, "elapsed_time": "4:36:55", "remaining_time": "1:22:35"}
	{"current_steps": 590, "total_steps": 753, "loss": 0.3571, "lr": 1.3793896030476794e-05, "epoch": 0.7829476652566973, "percentage": 78.35, "elapsed_time": "4:41:37", "remaining_time": "1:17:48"}
	{"current_steps": 600, "total_steps": 753, "loss": 0.3502, "lr": 1.223324832072874e-05, "epoch": 0.7962179646678278, "percentage": 79.68, "elapsed_time": "4:46:21", "remaining_time": "1:13:01"}
	{"current_steps": 610, "total_steps": 753, "loss": 0.3553, "lr": 1.0753912510299914e-05, "epoch": 0.8094882640789582, "percentage": 81.01, "elapsed_time": "4:52:58", "remaining_time": "1:08:40"}
	{"current_steps": 620, "total_steps": 753, "loss": 0.3519, "lr": 9.359073612439479e-06, "epoch": 0.8227585634900887, "percentage": 82.34, "elapsed_time": "4:57:41", "remaining_time": "1:03:51"}
	{"current_steps": 630, "total_steps": 753, "loss": 0.3483, "lr": 8.051734718358294e-06, "epoch": 0.8360288629012192, "percentage": 83.67, "elapsed_time": "5:02:24", "remaining_time": "0:59:02"}
	{"current_steps": 640, "total_steps": 753, "loss": 0.3575, "lr": 6.834710531566813e-06, "epoch": 0.8492991623123497, "percentage": 84.99, "elapsed_time": "5:07:06", "remaining_time": "0:54:13"}
	{"current_steps": 650, "total_steps": 753, "loss": 0.3527, "lr": 5.710621307812386e-06, "epoch": 0.8625694617234801, "percentage": 86.32, "elapsed_time": "5:11:49", "remaining_time": "0:49:24"}
	{"current_steps": 660, "total_steps": 753, "loss": 0.3528, "lr": 4.681887213662789e-06, "epoch": 0.8758397611346106, "percentage": 87.65, "elapsed_time": "5:16:32", "remaining_time": "0:44:36"}
	{"current_steps": 670, "total_steps": 753, "loss": 0.349, "lr": 3.7507231158823043e-06, "epoch": 0.889110060545741, "percentage": 88.98, "elapsed_time": "5:21:16", "remaining_time": "0:39:47"}
	{"current_steps": 680, "total_steps": 753, "loss": 0.3364, "lr": 2.9191338128187475e-06, "epoch": 0.9023803599568715, "percentage": 90.31, "elapsed_time": "5:25:57", "remaining_time": "0:34:59"}
	{"current_steps": 690, "total_steps": 753, "loss": 0.3468, "lr": 2.188909718068166e-06, "epoch": 0.9156506593680019, "percentage": 91.63, "elapsed_time": "5:30:40", "remaining_time": "0:30:11"}
	{"current_steps": 700, "total_steps": 753, "loss": 0.357, "lr": 1.5616230057104996e-06, "epoch": 0.9289209587791325, "percentage": 92.96, "elapsed_time": "5:35:24", "remaining_time": "0:25:23"}
	{"current_steps": 710, "total_steps": 753, "loss": 0.342, "lr": 1.0386242254152467e-06, "epoch": 0.942191258190263, "percentage": 94.29, "elapsed_time": "5:40:06", "remaining_time": "0:20:35"}
	{"current_steps": 720, "total_steps": 753, "loss": 0.3562, "lr": 6.21039394705153e-07, "epoch": 0.9554615576013934, "percentage": 95.62, "elapsed_time": "5:44:51", "remaining_time": "0:15:48"}
	{"current_steps": 730, "total_steps": 753, "loss": 0.341, "lr": 3.0976757463795916e-07, "epoch": 0.9687318570125238, "percentage": 96.95, "elapsed_time": "5:49:35", "remaining_time": "0:11:00"}
	{"current_steps": 740, "total_steps": 753, "loss": 0.3285, "lr": 1.054789341259521e-07, "epoch": 0.9820021564236543, "percentage": 98.27, "elapsed_time": "5:54:18", "remaining_time": "0:06:13"}
	{"current_steps": 750, "total_steps": 753, "loss": 0.3452, "lr": 8.613307060878484e-09, "epoch": 0.9952724558347847, "percentage": 99.6, "elapsed_time": "5:59:00", "remaining_time": "0:01:26"}
	{"current_steps": 753, "total_steps": 753, "epoch": 0.999253545658124, "percentage": 100.0, "elapsed_time": "6:02:34", "remaining_time": "0:00:00"}