Upload merged Qwen3-4B-Instruct-2507 model (auto-generated README)
Browse files- README.md +3 -3
- model-00001-of-00002.safetensors +1 -1
- model-00002-of-00002.safetensors +1 -1
README.md
CHANGED
|
@@ -45,7 +45,7 @@ Loss is applied to **all assistant turns** in the trajectory, enabling the model
|
|
| 45 |
|
| 46 |
- DBBench dataset: `u-10bei/dbbench_sft_dataset_react_v4`
|
| 47 |
- ALFWorld dataset: `u-10bei/sft_alfworld_trajectory_dataset_v5`
|
| 48 |
-
- Mixing ratio (pre-merge target): **DB:ALF =
|
| 49 |
|
| 50 |
### DB Oversampling (category-aware)
|
| 51 |
Enabled: **False**
|
|
@@ -66,8 +66,8 @@ DB category weights used during training-data preparation:
|
|
| 66 |
- Method: LoRA (full precision base)
|
| 67 |
- Max sequence length: 4096
|
| 68 |
- Epochs: 1
|
| 69 |
-
- Learning rate:
|
| 70 |
-
- LoRA: r=32, alpha=64, dropout=0.
|
| 71 |
- Per-device train batch size: 2
|
| 72 |
- Gradient accumulation: 4
|
| 73 |
|
|
|
|
| 45 |
|
| 46 |
- DBBench dataset: `u-10bei/dbbench_sft_dataset_react_v4`
|
| 47 |
- ALFWorld dataset: `u-10bei/sft_alfworld_trajectory_dataset_v5`
|
| 48 |
+
- Mixing ratio (pre-merge target): **DB:ALF = 3:1**
|
| 49 |
|
| 50 |
### DB Oversampling (category-aware)
|
| 51 |
Enabled: **False**
|
|
|
|
| 66 |
- Method: LoRA (full precision base)
|
| 67 |
- Max sequence length: 4096
|
| 68 |
- Epochs: 1
|
| 69 |
+
- Learning rate: 3e-05
|
| 70 |
+
- LoRA: r=32, alpha=64, dropout=0.05
|
| 71 |
- Per-device train batch size: 2
|
| 72 |
- Gradient accumulation: 4
|
| 73 |
|
model-00001-of-00002.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4967215360
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:fd754441f37fcaeabebf5f7d200d69d88198dafbf7ade0c78b6e1aafd3164871
|
| 3 |
size 4967215360
|
model-00002-of-00002.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 3077766632
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:49fb62246505ed17e61b85f1dc5de3f3e325b94da7aca2a1db3d2622a29fc9e1
|
| 3 |
size 3077766632
|