Article
Introducing AutoRound: Intel’s Advanced Quantization for LLMs and VLMs
- +7
wenhuach, Haihao, weiweiz1, n1ck-guo, isaacmac, kding1, IlyasMoutawwakil, marcsun13, medmekk
• • 45
Mohamed Mekkouri
medmekk
AI & ML interests
None yet
Recent Activity
posted an update 1 day ago
🚀 Introducing Halo 1.0
Today, we are open-sourcing Halo, the training framework we use to train every model at White Circle.
It comes with:
🧠 Full post-training stack: SFT, DPO/KTO/SMPO, reward modeling, GRPO, distillation
🤖 Async multi-turn RL with vLLM/SGLang rollouts and sandboxed tool use
⚡ ~2.8× TRL throughput on 8× B300 (EP+FSDPv2, FA4, fp8/fp4)
🤗 Dense HF models + 15 MoE families (Qwen, GLM, Mistral, DeepSeek-V4…)
🛠️ One halo command, prebuilt Docker images, and docs for humans and agents
💻 https://github.com/whitecircle/halo
Try it and tell us what you're training liked a model 6 days ago
whitecircle/GLM-4.7-Flash-Coder updated a dataset 2 months ago
whitecircle/math-reasoning-sftOrganizations
published an article over 1 year ago
published an article over 1 year ago
Article
LLM Inference on Edge: A Fun and Easy Guide to run LLMs via React Native on your Phone!
medmekk, marcsun13
• • 101 published an article about 2 years ago
Article
Fine-tuning LLMs to 1.58bit: extreme quantization made easy
- +4
medmekk, marcsun13, lvwerra, pcuenq, osanseviero, thomwolf
• • 282 published an article about 2 years ago
Article
Fine-tuning LLMs to 1.58bit: extreme quantization made easy
- +4
medmekk, marcsun13, lvwerra, pcuenq, osanseviero, thomwolf
• • 282