Instructions to use AiAF/rp-2b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use AiAF/rp-2b with PEFT:

from peft import PeftModel
from transformers import AutoModelForCausalLM

base_model = AutoModelForCausalLM.from_pretrained("google/gemma-2-2b-it")
model = PeftModel.from_pretrained(base_model, "AiAF/rp-2b")

Transformers

How to use AiAF/rp-2b with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="AiAF/rp-2b")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("AiAF/rp-2b")
model = AutoModelForCausalLM.from_pretrained("AiAF/rp-2b")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use AiAF/rp-2b with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "AiAF/rp-2b"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "AiAF/rp-2b",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/AiAF/rp-2b

SGLang

How to use AiAF/rp-2b with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "AiAF/rp-2b" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "AiAF/rp-2b",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "AiAF/rp-2b" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "AiAF/rp-2b",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use AiAF/rp-2b with Docker Model Runner:
```
docker model run hf.co/AiAF/rp-2b
```

AiAF commited on Mar 30

Commit

1f2e159

verified ·

1 Parent(s): 3928ed9

Training in progress, step 750

Browse files

Files changed (2) hide show

adapter_model.safetensors +1 -1
debug.log +104 -1

adapter_model.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:59badcbc1d668a371853f284e39f9ca33e2fe2af68b773148163044bb0f70bdd
 size 102264160

 version https://git-lfs.github.com/spec/v1
+oid sha256:f145aad3e393aacb1ea6687fe5c794bd1505c6b68c50e5038c6eac34efa7e4d6
 size 102264160

debug.log CHANGED Viewed

@@ -1805,4 +1805,107 @@ trainable params: 25,559,040 || all params: 2,639,900,928 || trainable%: 0.9682
 70%|▋| 701/1000 [12:13<16:05,  3.23s/it]
 70%|▋| 702/1000 [12:13<12:18,  2.48s/it]
 70%|▋| 702/1000 [12:13<12:18,  2.48s/it]
 70%|▋| 703/1000 [12:14<09:46,  1.97s/it]
 70%|▋| 703/1000 [12:14<09:46,  1.97s/it]
 70%|▋| 704/1000 [12:15<07:54,  1.60s/it]
 70%|▋| 704/1000 [12:15<07:54,  1.60s/it]
 70%|▋| 704/1000 [12:15<07:54,  1.60s/it]
 70%|▋| 705/1000 [12:16<06:40,  1.36s/it]
 70%|▋| 705/1000 [12:16<06:40,  1.36s/it]
 71%|▋| 706/1000 [12:17<05:45,  1.18s/it]
 71%|▋| 706/1000 [12:17<05:45,  1.18s/it]
 71%|▋| 707/1000 [12:17<05:04,  1.04s/it]
 71%|▋| 707/1000 [12:17<05:04,  1.04s/it]
 71%|▋| 708/1000 [12:18<04:37,  1.05it/s]
 71%|▋| 708/1000 [12:18<04:37,  1.05it/s]
 71%|▋| 709/1000 [12:19<04:20,  1.12it/s]
 71%|▋| 709/1000 [12:19<04:20,  1.12it/s]
 71%|▋| 710/1000 [12:19<04:03,  1.19it/s]
 71%|▋| 710/1000 [12:19<04:03,  1.19it/s]
 71%|▋| 711/1000 [12:20<03:53,  1.24it/s]
 71%|▋| 711/1000 [12:20<03:53,  1.24it/s]
 71%|▋| 712/1000 [12:21<03:46,  1.27it/s]
 71%|▋| 712/1000 [12:21<03:46,  1.27it/s]
 71%|▋| 713/1000 [12:22<03:45,  1.27it/s]
 71%|▋| 713/1000 [12:22<03:45,  1.27it/s]
 71%|▋| 714/1000 [12:23<03:43,  1.28it/s]
 71%|▋| 714/1000 [12:23<03:43,  1.28it/s]
 72%|▋| 715/1000 [12:23<03:40,  1.29it/s]
 72%|▋| 715/1000 [12:23<03:40,  1.29it/s]
 72%|▋| 716/1000 [12:24<03:38,  1.30it/s]
 72%|▋| 716/1000 [12:24<03:38,  1.30it/s]
 72%|▋| 717/1000 [12:25<03:35,  1.31it/s]
 72%|▋| 717/1000 [12:25<03:35,  1.31it/s]
 72%|▋| 718/1000 [12:25<03:30,  1.34it/s]
 72%|▋| 718/1000 [12:25<03:30,  1.34it/s]
 72%|▋| 719/1000 [12:26<03:29,  1.34it/s]
 72%|▋| 719/1000 [12:26<03:29,  1.34it/s]
 72%|▋| 720/1000 [12:27<03:26,  1.36it/s]
 72%|▋| 720/1000 [12:27<03:26,  1.36it/s]
 72%|▋| 721/1000 [12:28<03:27,  1.35it/s]
 72%|▋| 721/1000 [12:28<03:27,  1.35it/s]
 72%|▋| 722/1000 [12:28<03:25,  1.35it/s]
 72%|▋| 722/1000 [12:28<03:25,  1.35it/s]
 72%|▋| 723/1000 [12:29<03:26,  1.34it/s]
 72%|▋| 723/1000 [12:29<03:26,  1.34it/s]
 72%|▋| 724/1000 [12:30<03:28,  1.33it/s]
 72%|▋| 724/1000 [12:30<03:28,  1.33it/s]
 72%|▋| 725/1000 [12:31<03:24,  1.35it/s]
 72%|▋| 725/1000 [12:31<03:24,  1.35it/s]
 73%|▋| 726/1000 [12:31<03:16,  1.39it/s]
 73%|▋| 726/1000 [12:31<03:16,  1.39it/s]
 73%|▋| 727/1000 [12:32<03:15,  1.39it/s]
 73%|▋| 727/1000 [12:32<03:15,  1.39it/s]
 73%|▋| 728/1000 [12:33<03:17,  1.38it/s]
 73%|▋| 728/1000 [12:33<03:17,  1.38it/s]
 73%|▋| 729/1000 [12:34<03:18,  1.36it/s]
 73%|▋| 729/1000 [12:34<03:18,  1.36it/s]
 73%|▋| 730/1000 [12:34<03:23,  1.33it/s]
 73%|▋| 730/1000 [12:34<03:23,  1.33it/s]
 73%|▋| 731/1000 [12:35<03:21,  1.34it/s]
 73%|▋| 731/1000 [12:35<03:21,  1.34it/s]
 73%|▋| 732/1000 [12:36<03:23,  1.32it/s]
 73%|▋| 732/1000 [12:36<03:23,  1.32it/s]
 73%|▋| 733/1000 [12:37<03:19,  1.34it/s]
 73%|▋| 733/1000 [12:37<03:19,  1.34it/s]
 73%|▋| 734/1000 [12:37<03:17,  1.35it/s]
 73%|▋| 734/1000 [12:37<03:17,  1.35it/s]
 74%|▋| 735/1000 [12:38<03:17,  1.34it/s]
 74%|▋| 735/1000 [12:38<03:17,  1.34it/s]
 74%|▋| 736/1000 [12:39<03:16,  1.34it/s]
 74%|▋| 736/1000 [12:39<03:16,  1.34it/s]
 74%|▋| 737/1000 [12:40<03:16,  1.34it/s]
 74%|▋| 737/1000 [12:40<03:16,  1.34it/s]
 74%|▋| 738/1000 [12:40<03:15,  1.34it/s]
 74%|▋| 738/1000 [12:40<03:15,  1.34it/s]
 74%|▋| 739/1000 [12:41<03:17,  1.32it/s]
 74%|▋| 739/1000 [12:41<03:17,  1.32it/s]
 74%|▋| 740/1000 [12:42<03:18,  1.31it/s]
 74%|▋| 740/1000 [12:42<03:18,  1.31it/s]
 74%|▋| 741/1000 [12:43<03:18,  1.31it/s]
 74%|▋| 741/1000 [12:43<03:18,  1.31it/s]
 74%|▋| 742/1000 [12:43<03:12,  1.34it/s]
 74%|▋| 742/1000 [12:43<03:12,  1.34it/s]
 74%|▋| 743/1000 [12:44<03:11,  1.34it/s]
 74%|▋| 743/1000 [12:44<03:11,  1.34it/s]
 74%|▋| 744/1000 [12:45<03:09,  1.35it/s]
 74%|▋| 744/1000 [12:45<03:09,  1.35it/s]
 74%|▋| 745/1000 [12:46<03:09,  1.35it/s]
 74%|▋| 745/1000 [12:46<03:09,  1.35it/s]
 75%|▋| 746/1000 [12:46<03:08,  1.35it/s]
 75%|▋| 746/1000 [12:46<03:08,  1.35it/s]
 75%|▋| 747/1000 [12:47<03:07,  1.35it/s]
 75%|▋| 747/1000 [12:47<03:07,  1.35it/s]
 75%|▋| 748/1000 [12:48<03:07,  1.35it/s]
 75%|▋| 748/1000 [12:48<03:07,  1.35it/s]
 75%|▋| 749/1000 [12:49<03:10,  1.32it/s]
 75%|▋| 749/1000 [12:49<03:10,  1.32it/s]
 75%|▊| 750/1000 [12:49<03:08,  1.33it/s]
 75%|▊| 750/1000 [12:49<03:08,  1.33it/s][2026-03-30 14:48:03,796] [INFO] [axolotl.core.trainers.base.evaluate:401] [PID:37135] Running evaluation step...
  0%|            | 0/100 [00:00<?, ?it/s][A
  3%|    | 3/100 [00:00<00:03, 28.04it/s][A
  6%|▏   | 6/100 [00:00<00:05, 16.57it/s][A
  8%|▎   | 8/100 [00:00<00:05, 16.62it/s][A
 10%|▎  | 10/100 [00:00<00:05, 15.99it/s][A
 12%|▎  | 12/100 [00:00<00:05, 16.99it/s][A
 14%|▍  | 14/100 [00:00<00:05, 16.89it/s][A
 16%|▍  | 16/100 [00:00<00:04, 16.99it/s][A
 18%|▌  | 18/100 [00:01<00:04, 17.21it/s][A
 20%|▌  | 20/100 [00:01<00:04, 17.51it/s][A
 22%|▋  | 22/100 [00:01<00:04, 17.05it/s][A
 24%|▋  | 24/100 [00:01<00:04, 17.68it/s][A
 26%|▊  | 26/100 [00:01<00:04, 17.06it/s][A
 28%|▊  | 28/100 [00:01<00:04, 17.10it/s][A
 30%|▉  | 30/100 [00:01<00:04, 16.71it/s][A
 32%|▉  | 32/100 [00:01<00:04, 16.79it/s][A
 34%|█  | 34/100 [00:01<00:03, 16.91it/s][A
 37%|█  | 37/100 [00:02<00:03, 17.30it/s][A
 39%|█▏ | 39/100 [00:02<00:03, 17.32it/s][A
 41%|█▏ | 41/100 [00:02<00:03, 17.54it/s][A
 44%|█▎ | 44/100 [00:02<00:03, 18.21it/s][A
 46%|█▍ | 46/100 [00:02<00:03, 17.31it/s][A
 48%|█▍ | 48/100 [00:02<00:02, 17.71it/s][A
 50%|█▌ | 50/100 [00:02<00:02, 17.06it/s][A
 52%|█▌ | 52/100 [00:03<00:02, 17.04it/s][A
 54%|█▌ | 54/100 [00:03<00:02, 16.32it/s][A
 56%|█▋ | 56/100 [00:03<00:02, 16.65it/s][A
 58%|█▋ | 58/100 [00:03<00:02, 16.54it/s][A
 60%|█▊ | 60/100 [00:03<00:02, 17.01it/s][A
 62%|█▊ | 62/100 [00:03<00:02, 17.45it/s][A
 64%|█▉ | 64/100 [00:03<00:02, 17.67it/s][A
 66%|█▉ | 66/100 [00:03<00:02, 16.87it/s][A
 68%|██ | 68/100 [00:03<00:01, 17.43it/s][A
 70%|██ | 70/100 [00:04<00:01, 16.84it/s][A
 72%|██▏| 72/100 [00:04<00:01, 17.34it/s][A
 74%|██▏| 74/100 [00:04<00:01, 16.45it/s][A
 77%|██▎| 77/100 [00:04<00:01, 17.09it/s][A
 79%|██▎| 79/100 [00:04<00:01, 17.51it/s][A
 81%|██▍| 81/100 [00:04<00:01, 16.77it/s][A
 84%|██▌| 84/100 [00:04<00:00, 18.11it/s][A
 86%|██▌| 86/100 [00:04<00:00, 17.51it/s][A
 89%|██▋| 89/100 [00:05<00:00, 17.36it/s][A
 91%|██▋| 91/100 [00:05<00:00, 17.85it/s][A
 93%|██▊| 93/100 [00:05<00:00, 16.91it/s][A
 95%|██▊| 95/100 [00:05<00:00, 16.63it/s][A
 97%|██▉| 97/100 [00:05<00:00, 16.76it/s][A
 75%|▊| 750/1000 [12:55<03:08,  1.33it/s]
                                         [A[2026-03-30 14:48:09,865] [INFO] [axolotl.core.trainers.base._save:722] [PID:37135] Saving model checkpoint to /workspace/data/axolotl-outputs/sft/gemma-2-2b-it-rp-sft-qlora/checkpoint-750
 75%|▊| 751/1000 [12:59<13:40,  3.29s/it]
 75%|▊| 751/1000 [12:59<13:40,  3.29s/it]
 75%|▊| 752/1000 [12:59<10:27,  2.53s/it]
 75%|▊| 752/1000 [12:59<10:27,  2.53s/it]
 75%|▊| 753/1000 [13:00<08:14,  2.00s/it]
 75%|▊| 753/1000 [13:00<08:14,  2.00s/it]
 75%|▊| 754/1000 [13:01<06:34,  1.60s/it]
 75%|▊| 754/1000 [13:01<06:34,  1.60s/it]

 70%|▋| 701/1000 [12:13<16:05,  3.23s/it]
 70%|▋| 702/1000 [12:13<12:18,  2.48s/it]
 70%|▋| 702/1000 [12:13<12:18,  2.48s/it]
 70%|▋| 703/1000 [12:14<09:46,  1.97s/it]
 70%|▋| 703/1000 [12:14<09:46,  1.97s/it]
 70%|▋| 704/1000 [12:15<07:54,  1.60s/it]
 70%|▋| 704/1000 [12:15<07:54,  1.60s/it]
 70%|▋| 704/1000 [12:15<07:54,  1.60s/it]
 70%|▋| 705/1000 [12:16<06:40,  1.36s/it]
 70%|▋| 705/1000 [12:16<06:40,  1.36s/it]
 71%|▋| 706/1000 [12:17<05:45,  1.18s/it]
 71%|▋| 706/1000 [12:17<05:45,  1.18s/it]
 71%|▋| 707/1000 [12:17<05:04,  1.04s/it]
 71%|▋| 707/1000 [12:17<05:04,  1.04s/it]
 71%|▋| 708/1000 [12:18<04:37,  1.05it/s]
 71%|▋| 708/1000 [12:18<04:37,  1.05it/s]
 71%|▋| 709/1000 [12:19<04:20,  1.12it/s]
 71%|▋| 709/1000 [12:19<04:20,  1.12it/s]
 71%|▋| 710/1000 [12:19<04:03,  1.19it/s]
 71%|▋| 710/1000 [12:19<04:03,  1.19it/s]
 71%|▋| 711/1000 [12:20<03:53,  1.24it/s]
 71%|▋| 711/1000 [12:20<03:53,  1.24it/s]
 71%|▋| 712/1000 [12:21<03:46,  1.27it/s]
 71%|▋| 712/1000 [12:21<03:46,  1.27it/s]
 71%|▋| 713/1000 [12:22<03:45,  1.27it/s]
 71%|▋| 713/1000 [12:22<03:45,  1.27it/s]
 71%|▋| 714/1000 [12:23<03:43,  1.28it/s]
 71%|▋| 714/1000 [12:23<03:43,  1.28it/s]
 72%|▋| 715/1000 [12:23<03:40,  1.29it/s]
 72%|▋| 715/1000 [12:23<03:40,  1.29it/s]
 72%|▋| 716/1000 [12:24<03:38,  1.30it/s]
 72%|▋| 716/1000 [12:24<03:38,  1.30it/s]
 72%|▋| 717/1000 [12:25<03:35,  1.31it/s]
 72%|▋| 717/1000 [12:25<03:35,  1.31it/s]
 72%|▋| 718/1000 [12:25<03:30,  1.34it/s]
 72%|▋| 718/1000 [12:25<03:30,  1.34it/s]
 72%|▋| 719/1000 [12:26<03:29,  1.34it/s]
 72%|▋| 719/1000 [12:26<03:29,  1.34it/s]
 72%|▋| 720/1000 [12:27<03:26,  1.36it/s]
 72%|▋| 720/1000 [12:27<03:26,  1.36it/s]
 72%|▋| 721/1000 [12:28<03:27,  1.35it/s]
 72%|▋| 721/1000 [12:28<03:27,  1.35it/s]
 72%|▋| 722/1000 [12:28<03:25,  1.35it/s]
 72%|▋| 722/1000 [12:28<03:25,  1.35it/s]
 72%|▋| 723/1000 [12:29<03:26,  1.34it/s]
 72%|▋| 723/1000 [12:29<03:26,  1.34it/s]
 72%|▋| 724/1000 [12:30<03:28,  1.33it/s]
 72%|▋| 724/1000 [12:30<03:28,  1.33it/s]
 72%|▋| 725/1000 [12:31<03:24,  1.35it/s]
 72%|▋| 725/1000 [12:31<03:24,  1.35it/s]
 73%|▋| 726/1000 [12:31<03:16,  1.39it/s]
 73%|▋| 726/1000 [12:31<03:16,  1.39it/s]
 73%|▋| 727/1000 [12:32<03:15,  1.39it/s]
 73%|▋| 727/1000 [12:32<03:15,  1.39it/s]
 73%|▋| 728/1000 [12:33<03:17,  1.38it/s]
 73%|▋| 728/1000 [12:33<03:17,  1.38it/s]
 73%|▋| 729/1000 [12:34<03:18,  1.36it/s]
 73%|▋| 729/1000 [12:34<03:18,  1.36it/s]
 73%|▋| 730/1000 [12:34<03:23,  1.33it/s]
 73%|▋| 730/1000 [12:34<03:23,  1.33it/s]
 73%|▋| 731/1000 [12:35<03:21,  1.34it/s]
 73%|▋| 731/1000 [12:35<03:21,  1.34it/s]
 73%|▋| 732/1000 [12:36<03:23,  1.32it/s]
 73%|▋| 732/1000 [12:36<03:23,  1.32it/s]
 73%|▋| 733/1000 [12:37<03:19,  1.34it/s]
 73%|▋| 733/1000 [12:37<03:19,  1.34it/s]
 73%|▋| 734/1000 [12:37<03:17,  1.35it/s]
 73%|▋| 734/1000 [12:37<03:17,  1.35it/s]
 74%|▋| 735/1000 [12:38<03:17,  1.34it/s]
 74%|▋| 735/1000 [12:38<03:17,  1.34it/s]
 74%|▋| 736/1000 [12:39<03:16,  1.34it/s]
 74%|▋| 736/1000 [12:39<03:16,  1.34it/s]
 74%|▋| 737/1000 [12:40<03:16,  1.34it/s]
 74%|▋| 737/1000 [12:40<03:16,  1.34it/s]
 74%|▋| 738/1000 [12:40<03:15,  1.34it/s]
 74%|▋| 738/1000 [12:40<03:15,  1.34it/s]
 74%|▋| 739/1000 [12:41<03:17,  1.32it/s]
 74%|▋| 739/1000 [12:41<03:17,  1.32it/s]
 74%|▋| 740/1000 [12:42<03:18,  1.31it/s]
 74%|▋| 740/1000 [12:42<03:18,  1.31it/s]
 74%|▋| 741/1000 [12:43<03:18,  1.31it/s]
 74%|▋| 741/1000 [12:43<03:18,  1.31it/s]
 74%|▋| 742/1000 [12:43<03:12,  1.34it/s]
 74%|▋| 742/1000 [12:43<03:12,  1.34it/s]
 74%|▋| 743/1000 [12:44<03:11,  1.34it/s]
 74%|▋| 743/1000 [12:44<03:11,  1.34it/s]
 74%|▋| 744/1000 [12:45<03:09,  1.35it/s]
 74%|▋| 744/1000 [12:45<03:09,  1.35it/s]
 74%|▋| 745/1000 [12:46<03:09,  1.35it/s]
 74%|▋| 745/1000 [12:46<03:09,  1.35it/s]
 75%|▋| 746/1000 [12:46<03:08,  1.35it/s]
 75%|▋| 746/1000 [12:46<03:08,  1.35it/s]
 75%|▋| 747/1000 [12:47<03:07,  1.35it/s]
 75%|▋| 747/1000 [12:47<03:07,  1.35it/s]
 75%|▋| 748/1000 [12:48<03:07,  1.35it/s]
 75%|▋| 748/1000 [12:48<03:07,  1.35it/s]
 75%|▋| 749/1000 [12:49<03:10,  1.32it/s]
 75%|▋| 749/1000 [12:49<03:10,  1.32it/s]
 75%|▊| 750/1000 [12:49<03:08,  1.33it/s]
 75%|▊| 750/1000 [12:49<03:08,  1.33it/s][2026-03-30 14:48:03,796] [INFO] [axolotl.core.trainers.base.evaluate:401] [PID:37135] Running evaluation step...
  0%|            | 0/100 [00:00<?, ?it/s][A
  3%|    | 3/100 [00:00<00:03, 28.04it/s][A
  6%|▏   | 6/100 [00:00<00:05, 16.57it/s][A
  8%|▎   | 8/100 [00:00<00:05, 16.62it/s][A
 10%|▎  | 10/100 [00:00<00:05, 15.99it/s][A
 12%|▎  | 12/100 [00:00<00:05, 16.99it/s][A
 14%|▍  | 14/100 [00:00<00:05, 16.89it/s][A
 16%|▍  | 16/100 [00:00<00:04, 16.99it/s][A
 18%|▌  | 18/100 [00:01<00:04, 17.21it/s][A
 20%|▌  | 20/100 [00:01<00:04, 17.51it/s][A
 22%|▋  | 22/100 [00:01<00:04, 17.05it/s][A
 24%|▋  | 24/100 [00:01<00:04, 17.68it/s][A
 26%|▊  | 26/100 [00:01<00:04, 17.06it/s][A
 28%|▊  | 28/100 [00:01<00:04, 17.10it/s][A
 30%|▉  | 30/100 [00:01<00:04, 16.71it/s][A
 32%|▉  | 32/100 [00:01<00:04, 16.79it/s][A
 34%|█  | 34/100 [00:01<00:03, 16.91it/s][A
 37%|█  | 37/100 [00:02<00:03, 17.30it/s][A
 39%|█▏ | 39/100 [00:02<00:03, 17.32it/s][A
 41%|█▏ | 41/100 [00:02<00:03, 17.54it/s][A
 44%|█▎ | 44/100 [00:02<00:03, 18.21it/s][A
 46%|█▍ | 46/100 [00:02<00:03, 17.31it/s][A
 48%|█▍ | 48/100 [00:02<00:02, 17.71it/s][A
 50%|█▌ | 50/100 [00:02<00:02, 17.06it/s][A
 52%|█▌ | 52/100 [00:03<00:02, 17.04it/s][A
 54%|█▌ | 54/100 [00:03<00:02, 16.32it/s][A
 56%|█▋ | 56/100 [00:03<00:02, 16.65it/s][A
 58%|█▋ | 58/100 [00:03<00:02, 16.54it/s][A
 60%|█▊ | 60/100 [00:03<00:02, 17.01it/s][A
 62%|█▊ | 62/100 [00:03<00:02, 17.45it/s][A
 64%|█▉ | 64/100 [00:03<00:02, 17.67it/s][A
 66%|█▉ | 66/100 [00:03<00:02, 16.87it/s][A
 68%|██ | 68/100 [00:03<00:01, 17.43it/s][A
 70%|██ | 70/100 [00:04<00:01, 16.84it/s][A
 72%|██▏| 72/100 [00:04<00:01, 17.34it/s][A
 74%|██▏| 74/100 [00:04<00:01, 16.45it/s][A
 77%|██▎| 77/100 [00:04<00:01, 17.09it/s][A
 79%|██▎| 79/100 [00:04<00:01, 17.51it/s][A
 81%|██▍| 81/100 [00:04<00:01, 16.77it/s][A
 84%|██▌| 84/100 [00:04<00:00, 18.11it/s][A
 86%|██▌| 86/100 [00:04<00:00, 17.51it/s][A
 89%|██▋| 89/100 [00:05<00:00, 17.36it/s][A
 91%|██▋| 91/100 [00:05<00:00, 17.85it/s][A
 93%|██▊| 93/100 [00:05<00:00, 16.91it/s][A
 95%|██▊| 95/100 [00:05<00:00, 16.63it/s][A
 97%|██▉| 97/100 [00:05<00:00, 16.76it/s][A
 75%|▊| 750/1000 [12:55<03:08,  1.33it/s]
                                         [A[2026-03-30 14:48:09,865] [INFO] [axolotl.core.trainers.base._save:722] [PID:37135] Saving model checkpoint to /workspace/data/axolotl-outputs/sft/gemma-2-2b-it-rp-sft-qlora/checkpoint-750
 75%|▊| 751/1000 [12:59<13:40,  3.29s/it]
 75%|▊| 751/1000 [12:59<13:40,  3.29s/it]
 75%|▊| 752/1000 [12:59<10:27,  2.53s/it]
 75%|▊| 752/1000 [12:59<10:27,  2.53s/it]
 75%|▊| 753/1000 [13:00<08:14,  2.00s/it]
 75%|▊| 753/1000 [13:00<08:14,  2.00s/it]
 75%|▊| 754/1000 [13:01<06:34,  1.60s/it]
 75%|▊| 754/1000 [13:01<06:34,  1.60s/it]