- no-warmup-no-decay-4k-no-optim-no-tie-streamingLLM-4-1020-entropy-loss-normdsv3-0.5b-q16-kv2-ep-16-sep-0-top2-cf-2-bias-1e-3-bf16-ep4-mp2-pp1-lr-2e-5-minlr-2e-5-bs-1024-gpus-8-seqlen-4096
- no-warmup-no-decay-4k-no-optim-no-tie-streamingLLM-4-1020-entropydsv3-0.5b-q16-kv2-ep-16-sep-0-top2-cf-2-bias-1e-3-bf16-ep4-mp2-pp1-lr-2e-5-minlr-2e-5-bs-1024-gpus-8-seqlen-4096
- 1.52 kB