Inference Optimized Checkpoints (with Model Optimizer) Collection A collection of generative models quantized and optimized for inference with Model Optimizer. • 54 items • Updated 1 day ago • 113
nolynn/Oni_Mitsubishi_12B-Q5_K_M-GGUF Image-Text-to-Text • 12B • Updated Mar 14, 2025 • 6 • 2
nolynn/Oni_Mitsubishi_12B-Q5_K_M-GGUF Image-Text-to-Text • 12B • Updated Mar 14, 2025 • 6 • 2
Running on A10G 1.87k GGUF My Repo 🦙 1.87k Quantize a Hugging Face model to GGUF and create a repo