Upload opt/kld_stock_control.txt with huggingface_hub
Browse files- opt/kld_stock_control.txt +33 -0
opt/kld_stock_control.txt
ADDED
|
@@ -0,0 +1,33 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
== stock base
|
| 2 |
+
0.20.768.663 I Final estimate: PPL = 4.1389 +/- 0.22147
|
| 3 |
+
== stock vs stock (noise floor)
|
| 4 |
+
chunk PPL ln(PPL(Q)/PPL(base)) KL Divergence Δp RMS Same top p
|
| 5 |
+
Mean PPL(Q) : 4.138925 ± 0.221467
|
| 6 |
+
Mean PPL(base) : 4.134849 ± 0.220661
|
| 7 |
+
Mean ln(PPL(Q)/PPL(base)) : 0.000985 ± 0.000987
|
| 8 |
+
Mean PPL(Q)/PPL(base) : 1.000986 ± 0.000988
|
| 9 |
+
Mean PPL(Q)-PPL(base) : 0.004076 ± 0.004120
|
| 10 |
+
Mean KLD: -0.000001 ± 0.000000
|
| 11 |
+
Maximum KLD: 0.000055
|
| 12 |
+
Median KLD: 0.000000
|
| 13 |
+
Mean Δp: 0.000 ± 0.000 %
|
| 14 |
+
Maximum Δp: 0.004%
|
| 15 |
+
Median Δp: 0.000%
|
| 16 |
+
RMS Δp : 0.001 ± 0.000 %
|
| 17 |
+
Same top p: 100.000 ± 0.000 %
|
| 18 |
+
== opt vs stock
|
| 19 |
+
chunk PPL ln(PPL(Q)/PPL(base)) KL Divergence Δp RMS Same top p
|
| 20 |
+
Mean PPL(Q) : 4.138925 ± 0.221467
|
| 21 |
+
Mean PPL(base) : 4.134849 ± 0.220661
|
| 22 |
+
Mean ln(PPL(Q)/PPL(base)) : 0.000985 ± 0.000987
|
| 23 |
+
Mean PPL(Q)/PPL(base) : 1.000986 ± 0.000988
|
| 24 |
+
Mean PPL(Q)-PPL(base) : 0.004076 ± 0.004120
|
| 25 |
+
Mean KLD: -0.000001 ± 0.000000
|
| 26 |
+
Maximum KLD: 0.000055
|
| 27 |
+
Median KLD: 0.000000
|
| 28 |
+
Mean Δp: 0.000 ± 0.000 %
|
| 29 |
+
Maximum Δp: 0.004%
|
| 30 |
+
Median Δp: 0.000%
|
| 31 |
+
RMS Δp : 0.001 ± 0.000 %
|
| 32 |
+
Same top p: 100.000 ± 0.000 %
|
| 33 |
+
KLD_DONE
|