Instructions to use finalform/rewrite_files_Qwen3-Coder-30B-A3B-Instruct with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use finalform/rewrite_files_Qwen3-Coder-30B-A3B-Instruct with PEFT:

from peft import PeftModel
from transformers import AutoModelForCausalLM

base_model = AutoModelForCausalLM.from_pretrained("Qwen/Qwen3-Coder-30B-A3B-Instruct")
model = PeftModel.from_pretrained(base_model, "finalform/rewrite_files_Qwen3-Coder-30B-A3B-Instruct")

Transformers

How to use finalform/rewrite_files_Qwen3-Coder-30B-A3B-Instruct with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="finalform/rewrite_files_Qwen3-Coder-30B-A3B-Instruct")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("finalform/rewrite_files_Qwen3-Coder-30B-A3B-Instruct", dtype="auto")

Notebooks
Google Colab
Kaggle
Local Apps

vLLM

How to use finalform/rewrite_files_Qwen3-Coder-30B-A3B-Instruct with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "finalform/rewrite_files_Qwen3-Coder-30B-A3B-Instruct"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "finalform/rewrite_files_Qwen3-Coder-30B-A3B-Instruct",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/finalform/rewrite_files_Qwen3-Coder-30B-A3B-Instruct

SGLang

How to use finalform/rewrite_files_Qwen3-Coder-30B-A3B-Instruct with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "finalform/rewrite_files_Qwen3-Coder-30B-A3B-Instruct" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "finalform/rewrite_files_Qwen3-Coder-30B-A3B-Instruct",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "finalform/rewrite_files_Qwen3-Coder-30B-A3B-Instruct" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "finalform/rewrite_files_Qwen3-Coder-30B-A3B-Instruct",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use finalform/rewrite_files_Qwen3-Coder-30B-A3B-Instruct with Docker Model Runner:
```
docker model run hf.co/finalform/rewrite_files_Qwen3-Coder-30B-A3B-Instruct
```

rewrite_files_Qwen3-Coder-30B-A3B-Instruct / trainer_log.jsonl

finalform

Upload folder using huggingface_hub

6eec7f6 verified about 1 month ago

raw

history blame contribute delete

8.55 kB

	{"current_steps": 2, "total_steps": 56, "eval_loss": 0.24771852791309357, "epoch": 0.14814814814814814, "percentage": 3.57, "elapsed_time": "0:11:28", "remaining_time": "5:09:47"}
	{"current_steps": 3, "total_steps": 56, "loss": 0.2441, "lr": 0.00027304247779439414, "epoch": 0.2222222222222222, "percentage": 5.36, "elapsed_time": "0:13:35", "remaining_time": "4:00:15"}
	{"current_steps": 4, "total_steps": 56, "eval_loss": 0.1996598243713379, "epoch": 0.2962962962962963, "percentage": 7.14, "elapsed_time": "0:21:10", "remaining_time": "4:35:21"}
	{"current_steps": 6, "total_steps": 56, "loss": 0.2367, "lr": 0.0004, "epoch": 0.4444444444444444, "percentage": 10.71, "elapsed_time": "0:25:28", "remaining_time": "3:32:15"}
	{"current_steps": 6, "total_steps": 56, "eval_loss": 0.15869076550006866, "epoch": 0.4444444444444444, "percentage": 10.71, "elapsed_time": "0:30:55", "remaining_time": "4:17:46"}
	{"current_steps": 8, "total_steps": 56, "eval_loss": 0.14757852256298065, "epoch": 0.5925925925925926, "percentage": 14.29, "elapsed_time": "0:42:18", "remaining_time": "4:13:50"}
	{"current_steps": 9, "total_steps": 56, "loss": 0.1895, "lr": 0.00037647058823529414, "epoch": 0.6666666666666666, "percentage": 16.07, "elapsed_time": "0:44:26", "remaining_time": "3:52:07"}
	{"current_steps": 10, "total_steps": 56, "eval_loss": 0.13183145225048065, "epoch": 0.7407407407407407, "percentage": 17.86, "elapsed_time": "0:52:01", "remaining_time": "3:59:19"}
	{"current_steps": 12, "total_steps": 56, "loss": 0.1361, "lr": 0.00035294117647058826, "epoch": 0.8888888888888888, "percentage": 21.43, "elapsed_time": "0:56:14", "remaining_time": "3:26:13"}
	{"current_steps": 12, "total_steps": 56, "eval_loss": 0.11719267070293427, "epoch": 0.8888888888888888, "percentage": 21.43, "elapsed_time": "1:01:39", "remaining_time": "3:46:04"}
	{"current_steps": 14, "total_steps": 56, "eval_loss": 0.1052589863538742, "epoch": 1.0, "percentage": 25.0, "elapsed_time": "1:11:19", "remaining_time": "3:33:57"}
	{"current_steps": 15, "total_steps": 56, "loss": 0.18, "lr": 0.0003294117647058824, "epoch": 1.074074074074074, "percentage": 26.79, "elapsed_time": "1:13:30", "remaining_time": "3:20:54"}
	{"current_steps": 16, "total_steps": 56, "eval_loss": 0.09851272404193878, "epoch": 1.1481481481481481, "percentage": 28.57, "elapsed_time": "1:21:06", "remaining_time": "3:22:47"}
	{"current_steps": 18, "total_steps": 56, "loss": 0.1193, "lr": 0.00030588235294117644, "epoch": 1.2962962962962963, "percentage": 32.14, "elapsed_time": "1:25:27", "remaining_time": "3:00:24"}
	{"current_steps": 18, "total_steps": 56, "eval_loss": 0.09319568425416946, "epoch": 1.2962962962962963, "percentage": 32.14, "elapsed_time": "1:30:55", "remaining_time": "3:11:56"}
	{"current_steps": 20, "total_steps": 56, "eval_loss": 0.08752243220806122, "epoch": 1.4444444444444444, "percentage": 35.71, "elapsed_time": "1:42:24", "remaining_time": "3:04:20"}
	{"current_steps": 21, "total_steps": 56, "loss": 0.0823, "lr": 0.0002823529411764706, "epoch": 1.5185185185185186, "percentage": 37.5, "elapsed_time": "1:44:31", "remaining_time": "2:54:11"}
	{"current_steps": 22, "total_steps": 56, "eval_loss": 0.08400166034698486, "epoch": 1.5925925925925926, "percentage": 39.29, "elapsed_time": "1:52:07", "remaining_time": "2:53:17"}
	{"current_steps": 24, "total_steps": 56, "loss": 0.1175, "lr": 0.00025882352941176474, "epoch": 1.7407407407407407, "percentage": 42.86, "elapsed_time": "1:56:17", "remaining_time": "2:35:03"}
	{"current_steps": 24, "total_steps": 56, "eval_loss": 0.07777883112430573, "epoch": 1.7407407407407407, "percentage": 42.86, "elapsed_time": "2:01:49", "remaining_time": "2:42:25"}
	{"current_steps": 26, "total_steps": 56, "eval_loss": 0.07366437464952469, "epoch": 1.8888888888888888, "percentage": 46.43, "elapsed_time": "2:13:14", "remaining_time": "2:33:44"}
	{"current_steps": 27, "total_steps": 56, "loss": 0.0898, "lr": 0.00023529411764705883, "epoch": 1.9629629629629628, "percentage": 48.21, "elapsed_time": "2:15:21", "remaining_time": "2:25:23"}
	{"current_steps": 28, "total_steps": 56, "eval_loss": 0.07038821280002594, "epoch": 2.0, "percentage": 50.0, "elapsed_time": "2:22:01", "remaining_time": "2:22:01"}
	{"current_steps": 30, "total_steps": 56, "loss": 0.0948, "lr": 0.00021176470588235295, "epoch": 2.148148148148148, "percentage": 53.57, "elapsed_time": "2:26:22", "remaining_time": "2:06:51"}
	{"current_steps": 30, "total_steps": 56, "eval_loss": 0.06887274235486984, "epoch": 2.148148148148148, "percentage": 53.57, "elapsed_time": "2:31:57", "remaining_time": "2:11:41"}
	{"current_steps": 32, "total_steps": 56, "eval_loss": 0.06697963178157806, "epoch": 2.2962962962962963, "percentage": 57.14, "elapsed_time": "2:43:39", "remaining_time": "2:02:44"}
	{"current_steps": 33, "total_steps": 56, "loss": 0.0739, "lr": 0.00018823529411764707, "epoch": 2.3703703703703702, "percentage": 58.93, "elapsed_time": "2:45:49", "remaining_time": "1:55:34"}
	{"current_steps": 34, "total_steps": 56, "eval_loss": 0.06529785692691803, "epoch": 2.4444444444444446, "percentage": 60.71, "elapsed_time": "2:53:25", "remaining_time": "1:52:12"}
	{"current_steps": 36, "total_steps": 56, "loss": 0.0526, "lr": 0.0001647058823529412, "epoch": 2.5925925925925926, "percentage": 64.29, "elapsed_time": "2:57:38", "remaining_time": "1:38:41"}
	{"current_steps": 36, "total_steps": 56, "eval_loss": 0.06430461257696152, "epoch": 2.5925925925925926, "percentage": 64.29, "elapsed_time": "3:03:06", "remaining_time": "1:41:43"}
	{"current_steps": 38, "total_steps": 56, "eval_loss": 0.06337571144104004, "epoch": 2.7407407407407405, "percentage": 67.86, "elapsed_time": "3:14:19", "remaining_time": "1:32:02"}
	{"current_steps": 39, "total_steps": 56, "loss": 0.0564, "lr": 0.0001411764705882353, "epoch": 2.814814814814815, "percentage": 69.64, "elapsed_time": "3:16:25", "remaining_time": "1:25:37"}
	{"current_steps": 40, "total_steps": 56, "eval_loss": 0.062485575675964355, "epoch": 2.888888888888889, "percentage": 71.43, "elapsed_time": "3:23:59", "remaining_time": "1:21:35"}
	{"current_steps": 42, "total_steps": 56, "loss": 0.0678, "lr": 0.00011764705882352942, "epoch": 3.0, "percentage": 75.0, "elapsed_time": "3:27:13", "remaining_time": "1:09:04"}
	{"current_steps": 42, "total_steps": 56, "eval_loss": 0.061602283269166946, "epoch": 3.0, "percentage": 75.0, "elapsed_time": "3:32:15", "remaining_time": "1:10:45"}
	{"current_steps": 44, "total_steps": 56, "eval_loss": 0.061493076384067535, "epoch": 3.148148148148148, "percentage": 78.57, "elapsed_time": "3:43:06", "remaining_time": "1:00:50"}
	{"current_steps": 45, "total_steps": 56, "loss": 0.0499, "lr": 9.411764705882353e-05, "epoch": 3.2222222222222223, "percentage": 80.36, "elapsed_time": "3:45:12", "remaining_time": "0:55:03"}
	{"current_steps": 46, "total_steps": 56, "eval_loss": 0.06156101077795029, "epoch": 3.2962962962962963, "percentage": 82.14, "elapsed_time": "3:52:47", "remaining_time": "0:50:36"}
	{"current_steps": 48, "total_steps": 56, "loss": 0.0437, "lr": 7.058823529411765e-05, "epoch": 3.4444444444444446, "percentage": 85.71, "elapsed_time": "3:56:54", "remaining_time": "0:39:29"}
	{"current_steps": 48, "total_steps": 56, "eval_loss": 0.06198165938258171, "epoch": 3.4444444444444446, "percentage": 85.71, "elapsed_time": "4:02:30", "remaining_time": "0:40:25"}
	{"current_steps": 50, "total_steps": 56, "eval_loss": 0.06207697466015816, "epoch": 3.5925925925925926, "percentage": 89.29, "elapsed_time": "4:13:58", "remaining_time": "0:30:28"}
	{"current_steps": 51, "total_steps": 56, "loss": 0.0421, "lr": 4.705882352941177e-05, "epoch": 3.6666666666666665, "percentage": 91.07, "elapsed_time": "4:16:05", "remaining_time": "0:25:06"}
	{"current_steps": 52, "total_steps": 56, "eval_loss": 0.06235222890973091, "epoch": 3.7407407407407405, "percentage": 92.86, "elapsed_time": "4:23:38", "remaining_time": "0:20:16"}
	{"current_steps": 54, "total_steps": 56, "loss": 0.0557, "lr": 2.3529411764705884e-05, "epoch": 3.888888888888889, "percentage": 96.43, "elapsed_time": "4:27:50", "remaining_time": "0:09:55"}
	{"current_steps": 54, "total_steps": 56, "eval_loss": 0.06244580075144768, "epoch": 3.888888888888889, "percentage": 96.43, "elapsed_time": "4:33:20", "remaining_time": "0:10:07"}
	{"current_steps": 56, "total_steps": 56, "eval_loss": 0.062325846403837204, "epoch": 4.0, "percentage": 100.0, "elapsed_time": "4:43:44", "remaining_time": "0:00:00"}
	{"current_steps": 56, "total_steps": 56, "epoch": 4.0, "percentage": 100.0, "elapsed_time": "4:45:35", "remaining_time": "0:00:00"}