Heretic trials
How many trials ran for this model? Default 200? Or more?
194/200
I ran
--n-startup-trials 100 --n-trials 400
And still ended up with 36 refusals :/
I would say, I got lucky!
Which trial do you want to use?
[1] [Trial 551] Refusals: 42/100, KL divergence: 0.1108
[2] [Trial 562] Refusals: 43/100, KL divergence: 0.0616
[3] [Trial 169] Refusals: 58/100, KL divergence: 0.0333
[4] [Trial 202] Refusals: 61/100, KL divergence: 0.0285
[5] [Trial 132] Refusals: 64/100, KL divergence: 0.0214
[6] [Trial 130] Refusals: 70/100, KL divergence: 0.0213
[7] [Trial 104] Refusals: 71/100, KL divergence: 0.0180
[8] [Trial 364] Refusals: 72/100, KL divergence: 0.0099
[9] [Trial 649] Refusals: 75/100, KL divergence: 0.0042
Damn bro, start playing the lottery.
I was a lot worried because till 180/200 trials the best was 33/100 refusal and then this happened. π
