Add provenance correction: not a surgical child of the declared base
Browse files
README.md
CHANGED
|
@@ -21,7 +21,31 @@ model_type: qwen3_5_text
|
|
| 21 |
|
| 22 |
**The first auto-tuned model from jBlaze.**
|
| 23 |
|
| 24 |
-
Seven stacked behavioral modifications. Automatically calibrated.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 25 |
|
| 26 |
This is a 27-billion parameter code security scanner built on [Qwen 3.5-27B](https://huggingface.co/Qwen/Qwen3.5-27B) with 7 stacked behavioral modifications, each automatically calibrated by **jTuner** -- a new capability in [jBlaze](https://jblaze.dev) that we are announcing with this release.
|
| 27 |
|
|
|
|
| 21 |
|
| 22 |
**The first auto-tuned model from jBlaze.**
|
| 23 |
|
| 24 |
+
Seven stacked behavioral modifications. Automatically calibrated.
|
| 25 |
+
|
| 26 |
+
> **Provenance correction.** An independent weight-level audit of this
|
| 27 |
+
> checkpoint against its declared base, `Qwen/Qwen3.5-27B`, found that it is
|
| 28 |
+
> NOT a surgical child of that base. Gradient training lies somewhere
|
| 29 |
+
> between the two:
|
| 30 |
+
>
|
| 31 |
+
> - 0 of 14 normalisation and bias tensors survive unchanged (weight surgery
|
| 32 |
+
> leaves these untouched); they moved 5.1e-3 to 1.6e-1.
|
| 33 |
+
> - Cosine to the base is 0.775-0.942 at essentially unchanged scale
|
| 34 |
+
> (norm ratio 1.014-1.031) -- related, same magnitude, substantially
|
| 35 |
+
> rotated. That rules out both rescaling and a wrong base.
|
| 36 |
+
> - `q_proj` (rel. Frobenius 0.46-0.52) and `embed_tokens` (0.47) are both
|
| 37 |
+
> modified. Neither is a weight-surgery target.
|
| 38 |
+
> - The deltas are spectrally dense throughout (leading singular direction
|
| 39 |
+
> carries 0.05-1.2% of the energy; 64 directions carry 3-10%), which is
|
| 40 |
+
> the signature of training rather than of a constructed low-rank edit.
|
| 41 |
+
>
|
| 42 |
+
> The audit CANNOT say which step is responsible. `Sharona_Q27B-R_CodeSecurity`
|
| 43 |
+
> (v1) predates this model and sits closer to it than the declared base does,
|
| 44 |
+
> so the real chain is likely base -> v1 -> v2, and an undisclosed
|
| 45 |
+
> intermediate is indistinguishable from training in the final step. What is
|
| 46 |
+
> established is that the path from `Qwen/Qwen3.5-27B` to these weights
|
| 47 |
+
> includes gradient training, so the `weight-surgery` tag does not describe
|
| 48 |
+
> this checkpoint on its own. The full chain should be documented here.
|
| 49 |
|
| 50 |
This is a 27-billion parameter code security scanner built on [Qwen 3.5-27B](https://huggingface.co/Qwen/Qwen3.5-27B) with 7 stacked behavioral modifications, each automatically calibrated by **jTuner** -- a new capability in [jBlaze](https://jblaze.dev) that we are announcing with this release.
|
| 51 |
|