File size: 3,224 Bytes
46144df | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 | # OxMini ablation samples
These are the unedited fixed-prompt generations from the three matched 120-step runs (seed 1337, top-k 40). They are preserved to make the qualitative comparison auditable rather than reducing it to a subjective summary.
## Plain GPT baseline
### `ROMEO:\n`, temperature 0.7
```text
ROMEO:
ABEVIUU o d He indRTIad ratomenwerein un mangcou ad rind
MESinee d
KOKL'ades th
```
### `ROMEO:\n`, temperature 1.0
```text
ROMEO:
Yerm:
-h
TAVooceoom t to ieund,
qA!
Whg reunth ad mIOCTiokin rSme is ate ule his
```
### `KING:\n`, temperature 0.7
```text
KING:
ABe nou o d He indRTcbd ratomenwerein un mangcou ad rind
MESinee d
KOKL:auso th
```
### `KING:\n`, temperature 1.0
```text
KING:
Y ym:
-h
TAVooceoom t to ieund,
qA!
Whg reunth ad mIOCTiokin rSme i?
:te ule his
```
### `First Citizen:\n`, temperature 0.7
```text
First Citizen:
Ane nouso d He indRTcbd ratomenwerein un mangcou ad rind
MjubCee d
KOes auso th
```
### `First Citizen:\n`, temperature 1.0
```text
First Citizen:
Yerm:
-h
Thaooceoomy, thoieund,
qAbe yg reunth ad mI asiokin rSme is ate ule his
```
## Hybrid KDA-lite/MLA-lite, one stream
### `ROMEO:\n`, temperature 0.7
```text
ROMEO:
And of so do me and cbd rathes with thaw maHJone ad rind
MourCHAjut thes ad a th
```
### `ROMEO:\n`, temperature 1.0
```text
ROMEO:
Yerm:
-hOuraooch's the to wund,
qAbe hghreunto ad mIOCTIZkinHKS'iti?
, stull his
```
### `KING:\n`, temperature 0.7
```text
KING:
And of so do me and cbd rathes with thaw maHN'se ad rind
MourCHAjut thes ad a th
```
### `KING:\n`, temperature 1.0
```text
KING:
Yerm:
-hOuraoA:
Fom tHMHoieund,
qAbe hghreunto ad mIOCTIZkinHKSjet ?
, stull his
```
### `First Citizen:\n`, temperature 0.7
```text
First Citizen:
And on so do me and cbd rathes with thaw maHN'se ad rind
MourCHAjut thes ad a th
```
### `First Citizen:\n`, temperature 1.0
```text
First Citizen:
Yerm:
-hOuraoA:
Fom tHMHoieund,
qAbe hghreunto ad mIOCTIZkinHKS'iti?
, stull his
```
## Full OxMini hybrid + mHC-lite
### `ROMEO:\n`, temperature 0.7
```text
ROMEO:
Her no st do me and cbd ratorst lonit and pelcou ad rind
Moubiee se thes ad a th
```
### `ROMEO:\n`, temperature 1.0
```text
ROMEO:
Yerm:
-zONA;oA:
Fom to to eund,
qube hghreumy tad mIOCTI?Ol or me i?
, stule his
```
### `KING:\n`, temperature 0.7
```text
KING:
And not ond hen and cbd ratorst lonit and pelcou ad rind
Moubiee se thes ad a th
```
### `KING:\n`, temperature 1.0
```text
KING:
Yerm:
-zONA;oA:
Fom to to eund,
qube hghreumy tad mIOCTI?Ol or me i?
, stule his
```
### `First Citizen:\n`, temperature 0.7
```text
First Citizen:
And not ond hen and cbd ratorst lonit and pelcou ad rind
Moubiee se thes ad a th
```
### `First Citizen:\n`, temperature 1.0
```text
First Citizen:
Yerm:
-hOuraoA:
Fom to to eunr:
qube hghreumy tad mI as okindrome i?
, stule his
```
## Qualitative reading
All three models are still mostly garbled after only 120 updates. Hybrid and full OxMini emit more word-like fragments and slightly more stable speaker formatting than baseline, consistent with their lower held-out loss, but the difference is not strong enough to claim useful language ability. The full mHC-lite arm is not visibly better than hybrid-only.
|