8 9 57

UnstableLlama

https://medium.com/@unstablellama

UnstableLlama

AI & ML interests

Local inference, quantization, training. Philosophy of AI.

Recent Activity

liked a model about 15 hours ago

turboderp/Olmo-Hybrid-Instruct-SFT-7B-exl3

liked a model 4 days ago

DeathGodlike/crownelius_Crow-9B-Opus-4.6-Distill-Heretic-Qwen3.5_EXL3

updated a model 5 days ago

UnstableLlama/Qwen3.5-4B-exl3

View all activity

Organizations

None yet

upvoted a changelog 14 days ago

Hugging Face Changelog

Public Storage Add-ons

15 days ago

• 151

upvoted 2 articles about 1 month ago

Article

We Got Claude to Build CUDA Kernels and teach open models!

Jan 28

•

149

Article

Performant local mixture-of-experts CPU inference with GPU acceleration in llama.cpp

Jan 30

•

upvoted a collection 3 months ago

Doc's Choice

Collection

Models that I personally recommend, periodically updated. • 9 items • Updated 2 days ago • 5

upvoted 3 papers 5 months ago

upvoted an article 5 months ago

Article

Meta-learning Meets Small Models

Oct 21, 2025

•

upvoted a paper 5 months ago

Rethinking Large Language Model Distillation: A Constrained Markov Decision Process Perspective

Paper • 2509.22921 • Published Sep 26, 2025 • 12

UnstableLlama

AI & ML interests

Recent Activity

Organizations

UnstableLlama's activity

Public Storage Add-ons

We Got Claude to Build CUDA Kernels and teach open models!

Performant local mixture-of-experts CPU inference with GPU acceleration in llama.cpp

Meta-learning Meets Small Models