Upload merged Qwen3-4B-Instruct-2507 model (auto-generated README)
Browse files- README.md +2 -2
- model-00001-of-00002.safetensors +1 -1
- model-00002-of-00002.safetensors +1 -1
README.md
CHANGED
|
@@ -45,7 +45,7 @@ Loss is applied to **all assistant turns** in the trajectory, enabling the model
|
|
| 45 |
|
| 46 |
- DBBench dataset: `u-10bei/dbbench_sft_dataset_react_v4`
|
| 47 |
- ALFWorld dataset: `u-10bei/sft_alfworld_trajectory_dataset_v5`
|
| 48 |
-
- Mixing ratio (pre-merge target): **DB:ALF = 1:
|
| 49 |
|
| 50 |
### DB Oversampling (category-aware)
|
| 51 |
Enabled: **False**
|
|
@@ -66,7 +66,7 @@ DB category weights used during training-data preparation:
|
|
| 66 |
- Method: LoRA (full precision base)
|
| 67 |
- Max sequence length: 4096
|
| 68 |
- Epochs: 1
|
| 69 |
-
- Learning rate:
|
| 70 |
- LoRA: r=32, alpha=64, dropout=0.0
|
| 71 |
- Per-device train batch size: 2
|
| 72 |
- Gradient accumulation: 4
|
|
|
|
| 45 |
|
| 46 |
- DBBench dataset: `u-10bei/dbbench_sft_dataset_react_v4`
|
| 47 |
- ALFWorld dataset: `u-10bei/sft_alfworld_trajectory_dataset_v5`
|
| 48 |
+
- Mixing ratio (pre-merge target): **DB:ALF = 1:1**
|
| 49 |
|
| 50 |
### DB Oversampling (category-aware)
|
| 51 |
Enabled: **False**
|
|
|
|
| 66 |
- Method: LoRA (full precision base)
|
| 67 |
- Max sequence length: 4096
|
| 68 |
- Epochs: 1
|
| 69 |
+
- Learning rate: 1e-04
|
| 70 |
- LoRA: r=32, alpha=64, dropout=0.0
|
| 71 |
- Per-device train batch size: 2
|
| 72 |
- Gradient accumulation: 4
|
model-00001-of-00002.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4967215360
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:6f38f23744fab63f870fbd24fa346357a850fc47e35906f6df0977d07d2ac02f
|
| 3 |
size 4967215360
|
model-00002-of-00002.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 3077766632
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:65ff7631b6cad730447f3c7c65324f7102899864ae4b61f3d8b6fa24aec6b890
|
| 3 |
size 3077766632
|