udgamlabs/Gargi
Text Generation • 0.4B • Updated • 286 • 1
384M English model trained from scratch on ~17B tokens. Thinks step by step, holds a conversation, reads ~16K tokens. Apache-2.0.
Note Start here. The chat model: thinking on or off, follow-up questions, documents up to ~16K tokens. Base model within 2 points of Qwen2.5-0.5B on ARC and WinoGrande with ~1,000x less training data.
Note Q8_0 (410 MB, recommended), Q4_K_M and f16 for Ollama and llama.cpp: ollama run hf.co/udgamlabs/Gargi-GGUF:Q8_0
Note bf16 build for Apple silicon (mlx-lm).
Note 4-bit build for Apple silicon (mlx-lm).
Note The pretrained base model (32K context), for research and fine-tuning.