Upload opt/kld_opt_vs_stock.txt with huggingface_hub
Browse files- opt/kld_opt_vs_stock.txt +13 -0
opt/kld_opt_vs_stock.txt
ADDED
|
@@ -0,0 +1,13 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
BENCH2_DONE
|
| 2 |
+
chunk PPL ln(PPL(Q)/PPL(base)) KL Divergence Δp RMS Same top p
|
| 3 |
+
Mean PPL(Q) : 4.138925 ± 0.221467
|
| 4 |
+
Mean PPL(base) : 4.134849 ± 0.220661
|
| 5 |
+
Mean PPL(Q)/PPL(base) : 1.000986 ± 0.000988
|
| 6 |
+
Mean PPL(Q)-PPL(base) : 0.004076 ± 0.004120
|
| 7 |
+
Mean KLD: -0.000001 ± 0.000000
|
| 8 |
+
Maximum KLD: 0.000055
|
| 9 |
+
Median KLD: 0.000000
|
| 10 |
+
Maximum Δp: 0.004%
|
| 11 |
+
RMS Δp : 0.001 ± 0.000 %
|
| 12 |
+
Same top p: 100.000 ± 0.000 %
|
| 13 |
+
KLD2_DONE
|