view article Article Sort your prompts: a free speed-up for MoE batch inference badaoui • 15 days ago • 10
view article Article Sort your prompts: a free speed-up for MoE batch inference badaoui • 15 days ago • 10
view article Article Transformers now runs llama.cpp quants +1 marcsun13, ArthurZ, lysandre • Sep 22 • 122
view article Article Async GRPO with LoRA across HF Jobs: a bucket, a proxy, and no NCCL +2 aminediroHF, qgallouedec, kashif, sergiopaniego • Sep 10 • 54
Muse Glimmer Collection Muse Glimmer 30B: multimodal agentic model for local deployment. BF16 weights, GGUF k-quants, ExecuTorch builds, DFlash drafter. • 4 items • Updated Aug 10 • 129