Inference Optimized Checkpoints (with Model Optimizer)
Collection
A collection of generative models quantized and optimized for inference with Model Optimizer. • 77 items • Updated • 173
Ed Addario PRO
eaddario
AI & ML interests
Finding ways to optimize LLMs' inference performance in resource-constrained environments (e.g. commodity hardware, desktops, laptops, mobiles, edge devices, etc.)
Recent Activity
upvoted a collection 29 days ago
Inference Optimized Checkpoints (with Model Optimizer) new activity about 1 month ago
eaddario/gemma-4-26B-A4B-it-GGUF:Methodology of using F16 as intermediate conversion and baseline? new activity about 1 month ago
eaddario/Qwen3.5-9B-GGUF:Amazing quantsOrganizations
upvoted a collection 29 days ago
upvoted an article 7 months ago
Article
Norm-Preserving Biprojected Abliteration
grimjim
• • 86 upvoted an article about 1 year ago
Article
Cohere on Hugging Face Inference Providers 🔥
- +5
reach-vb, burtenshaw, merve, celinah, alexrs, julien-c, sbrandeis
• • 129 upvoted an article over 1 year ago
Article
Making LLMs Smaller Without Breaking Them: A GLU-Aware Pruning Approach
oopere
• • 20 upvoted 2
collections over 1 year ago