halley-ai/Qwen3-Next-80B-A3B-Instruct-MLX-5bit-gs32
Text Generation • 80B • Updated • 27 • 1
Halley AI
company
Verified
AI & ML interests
Text Generation & Chat Assistants; Model Compression & Quantization (Q4/Q6/Q8, gs32); Inference & Serving (on-prem, low-latency); RAG / Retrieval; Agents & Tool Use; Distillation / LoRA / Fine-tuning
halley-ai/Qwen3-Next-80B-A3B-Instruct-MLX-6bit-gs64
Text Generation • 80B • Updated • 25 • 1
halley-ai/Qwen3-Next-80B-A3B-Instruct-MLX-4bit-gs64
Text Generation • 80B • Updated • 59 • 1
halley-ai/gpt-oss-120b-MLX-bf16
Text Generation • 117B • Updated • 206 • 3
halley-ai/gpt-oss-120b-MLX-8bit-gs32
Text Generation • 117B • Updated • 66 • 1
halley-ai/gpt-oss-120b-MLX-6bit-gs64
Text Generation • 117B • Updated • 60 • 1
halley-ai/gpt-oss-20b-MLX-5bit-gs32
Text Generation • 21B • Updated • 75 • 1
halley-ai/gpt-oss-20b-MLX-6bit-gs32
Text Generation • 21B • Updated • 2.25k • 1
halley-ai/gpt-oss-20b-MLX-4bit-gs32
Text Generation • 21B • Updated • 222 • 3