README.md

metadata

title: GGUF Converter
emoji: 🔄
colorFrom: blue
colorTo: purple
sdk: gradio
sdk_version: 4.44.0
app_file: app.py
pinned: false
license: apache-2.0
tags:
  - gguf
  - quantization
  - converter
  - mobile
  - dispatchai

🔄 dispatchAI GGUF Converter

Convert any HuggingFace model to GGUF format with multiple quantization levels. Free, on ZeroGPU.

Features

• Multiple quant levels: Q2_K, Q3_K_M, Q4_K_M, Q5_K_M, Q6_K, Q8_0, F16
• One-click conversion: Enter model ID, select quants, click convert
• Auto-upload: GGUF files are uploaded directly to the model repo
• ZeroGPU: Runs on HuggingFace's free GPU infrastructure

Use Cases

• Add GGUF quants to your existing safetensors models
• Create mobile-optimized versions with Q4_K_M (the sweet spot)
• Provide multiple RAM-budget options for your users

🚀 dispatchAI — Small. Mobile. Free. UAE-built.