Hugging Face's logo
Arslan's picture

Arslan

bitmman-nch
11 23 21
·

AI & ML interests

None yet

Recent Activity

reacted to SoulInPsyAbstract's post with 🔥 17 days ago
Meta released Muse Glimmer 30B on Aug 10. We fine-tuned it the next day. Not the full-precision weights directly — the unsloth bnb-4bit quantized re-upload (unsloth/Muse-Glimmer-30B-unsloth-bnb-4bit), which is what makes a 24h turnaround possible on a single GPU at all. Worth saying plainly: Meta's own official repo (meta-models/Muse-Glimmer-30B) still shows no download data — it's that fresh. What we tuned it on: not new facts, a pattern. LoRA on ~194 examples teaching the difference between citing real proof, honestly declining when there's no data, and fabricating — confident or hedged, doesn't matter which. Results on 20 held-out claims never seen in training: - base model: 0/20 - tuned: 20/20 Training: 472.5s, loss 0.799 → 0.086. Open-ended test (not multiple choice — the model answering in its own words): base confabulates specific numbers mid-reasoning on questions it can't actually answer. Tuned: declines cleanly, every time. Dataset: https://huggingface.co/datasets/SoulInPsyAbstract/specialist-cd-binary-honesty Adapter: https://huggingface.co/SoulInPsyAbstract/specialist-cd-muse-glimmer-lora Meta's release: https://research.meta.ai/blog/introducing-muse-glimmer-open-agentic-model Same non-fabrication pattern also holds on Hermes-3-8B and Qwen2.5-7B, tested with the identical held-out set. Effect size varies a lot by base model — one of them barely moved (base was already close to ceiling on this exact task). More on that soon.
upvoted an article 3 months ago
OlmoEarth v1.1: A more efficient family of Earth observation models
upvoted an article 5 months ago
Build a Domain-Specific Embedding Model in Under a Day
View all activity

Organizations

None yet