Running open LLMs locally: GGUF quants sized for consumer GPUs. VRAM requirements and GPU compatibility for every model at https://llmrun.dev
Open-weight LLMs ranked with 90% ranges and skill scores