bharathmuppa commited on
Commit
8a0f78a
·
verified ·
1 Parent(s): de5839f

Upload fused model

Browse files
Files changed (2) hide show
  1. README.md +6 -4
  2. model.safetensors +1 -1
README.md CHANGED
@@ -75,17 +75,19 @@ The model was trained with this system prompt. Use it for best results:
75
 
76
  | Setting | Value |
77
  | --- | --- |
78
- | Records (train / valid / test) | 1869 / 101 / 60 |
79
- | Iterations | 1400 |
80
  | Batch size | 4 |
81
  | Max sequence length | 2048 |
82
  | Loss | assistant tokens only |
83
- | Final validation loss | 1.386 (from 2.147) |
84
- | Test loss, assistant tokens (base → tuned) | 2.148 → 1.346 |
85
  | Learning rate | 3e-5, cosine decay, 50 warm-up steps |
86
 
87
  ## Limits
88
 
 
 
89
  - Use `repetition_penalty` 1.1 or similar; long import lists can repeat otherwise.
90
 
91
  - 1.5B parameters. It is good for Angular questions and small components. It is not a general assistant.
 
75
 
76
  | Setting | Value |
77
  | --- | --- |
78
+ | Records (train / valid / test) | 2427 / 131 / 79 |
79
+ | Iterations | 1700 |
80
  | Batch size | 4 |
81
  | Max sequence length | 2048 |
82
  | Loss | assistant tokens only |
83
+ | Final validation loss | 1.313 (from 2.175) |
84
+ | Test loss, assistant tokens (base → tuned) | 2.104 → 1.293 |
85
  | Learning rate | 3e-5, cosine decay, 50 warm-up steps |
86
 
87
  ## Limits
88
 
89
+ - Known-issue answers ("I'm on 19.2 and see X") give the right shape, release line and fix description, but the issue and PR numbers are often wrong. Verify them on GitHub. A 1.5B model does not memorize 250 issue numbers from a few exposures.
90
+
91
  - Use `repetition_penalty` 1.1 or similar; long import lists can repeat otherwise.
92
 
93
  - 1.5B parameters. It is good for Angular questions and small components. It is not a general assistant.
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8b211641d3a2fca7c9e89c2acf1276ac099a885adb9c82dc9f14c69d550243f7
3
  size 3087467005
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b1e421b6be24ac12cf7334f15c2478f8eb398fd25a6e81b53c95cab12fda83d3
3
  size 3087467005