eaddario/Llama-Guard-3-8B-GGUF
Text Generation • 8B • Updated • 201
Ed Addario PRO
eaddario
AI & ML interests
Finding ways to optimize LLMs' inference performance in resource-constrained environments (e.g. commodity hardware, desktops, laptops, mobiles, edge devices, etc.)
Recent Activity
upvoted a collection about 1 month ago
Inference Optimized Checkpoints (with Model Optimizer) new activity about 1 month ago
eaddario/gemma-4-26B-A4B-it-GGUF:Methodology of using F16 as intermediate conversion and baseline? new activity about 2 months ago
eaddario/Qwen3.5-9B-GGUF:Amazing quantsOrganizations
eaddario/Watt-Tool-8B-GGUF
Text Generation • 8B • Updated • 337 • 5
eaddario/DeepSeek-R1-Distill-Qwen-7B-GGUF
Text Generation • 8B • Updated • 403 • 3
eaddario/Hammer2.1-7b-GGUF
Text Generation • 8B • Updated • 379 • 2
eaddario/DeepSeek-R1-Distill-Llama-8B-GGUF
Text Generation • 8B • Updated • 224 • 1