InfiGUI-R1-3B-GGUF / README.md
cnjn's picture
Upload folder using huggingface_hub
cb1c892 verified
---
base_model: InfiX-ai/InfiGUI-R1-3B
library_name: gguf
pipeline_tag: image-text-to-text
tags:
- llama-cpp
- gguf
- vision
- multimodal
- gui
- agent
quantized_by: cnjn
---
# About
static quants of https://huggingface.co/InfiX-ai/InfiGUI-R1-3B
THIS REPO CONTAINS mmproj-* FILE, CAN BE DEPLOYED WITH ONE SHOT.
# Usage
```bash
llama-server -m InfiGUI-R1-3B-IQ4_K_M.gguf --mmproj mmproj-InfiGUI-R1-3B-F16.gguf --jinja -c 8196
```