May 31, 2025 03:37 Update README.md 03:36 Upload lora.sft half-baked lora (might as well share it) May 22, 2025 18:26 Upload fp32.sft Reverted to prior revision Apr 19, 2025 19:03 Upload fp32.sft I hope this isn't the copy that managed to botch itself because I didn't export it the right way 01:42 Upload fp32.sft Apr 6, 2025 03:36 Upload fp32.sft Still not good enough... Apr 1, 2025 01:29 Upload fp32.sft Compared to the nemo models this is well more than adequate...... Mar 30, 2025 14:52 Upload fp32.sft 14:43 Upload fp32.sft 05:00 Upload fp32.sft Mar 29, 2025 00:18 m mrq
00:08 Upload 3 files Mar 20, 2025 01:46 Upload 2 files Mar 15, 2025 02:03 update readme mrq
01:31 Upload 2 files Mar 11, 2025 20:49 Upload 2 files Experimental weights Jan 6, 2025 06:09 Upload fp32.sft experimental weights Dec 28, 2024 00:14 Upload fp32.sft More post-training on NS/SR that wasn't necessary but might as well push these weights......... Dec 20, 2024 15:03 Upload fp32.sft Dec 17, 2024 01:22 Upload fp32.sft Dec 16, 2024 14:36 Upload fp32.sft Dec 15, 2024 23:18 cleanup mrq
22:59 Upload fp32.sft Separating from the confusing ar+nar-llama-8 name since this is now the nar-len too. Nov 23, 2024 19:56 Update models/config.llama.yaml 19:56 Update models/config.llama.yaml 19:55 Upload lora.sft 01:44 Upload fp32.sft Decent weights Nov 21, 2024 00:06 Update README.md 00:02 Upload lora.sft 00:06 marked old loras as old mrq
Nov 20, 2024 00:59 Update README.md 00:52 Upload 2 files Updated models (ar+nar has nar-len compatibility, nar-len model is finalized as the reference model will receive training) Nov 19, 2024 18:21 Update README.md 03:23 Update README.md RIP Nov 18, 2024 03:46 Update README.md 03:42 Upload fp32.sft ugh Nov 17, 2024 16:18 Update README.md 16:13 Upload 2 files Updated reference AR+NAR model to a "better" trained one (need to do actual regression tests, but it sounds really nice), backed up current one as `ar+nar-old-llama-8` 14:53 Upload fp32.sft Slightly better but requires more training. Nov 16, 2024 21:59 Update README.md 21:49 Upload 2 files Very, very early NAR-len model (that works enough but not good enough so far) Nov 5, 2024 16:36 Update README.md R.I.P. LayerSkip 04:48 Upload fp32.sft Again, LayerSkip is very sensitive to de-facto batch size. Nov 3, 2024 23:56 Upload fp32.sft Unironically I think this is fixing the model even without layerskipping the more it trains. 17:21 Update README.md 17:13 Upload fp32.sft More promising layerskip-aware weights (it actually seems to perform better than the base model, atlhough with just one voice I'm comparing so far) 03:25 Update README.md 02:37 Upload fp32.sft Updated layerskip weights (not looking good...) Nov 2, 2024 16:40 Upload fp32.sft Better-ish layerskip-aware weights (apparently the model didn't train as much as I would have liked overnight but it seems fine-er-ish)