InfiGUI-R1-3B-GGUF / README.md
cnjn's picture
Upload folder using huggingface_hub
cb1c892 verified
metadata
base_model: InfiX-ai/InfiGUI-R1-3B
library_name: gguf
pipeline_tag: image-text-to-text
tags:
  - llama-cpp
  - gguf
  - vision
  - multimodal
  - gui
  - agent
quantized_by: cnjn

About

static quants of https://huggingface.co/InfiX-ai/InfiGUI-R1-3B

THIS REPO CONTAINS mmproj-* FILE, CAN BE DEPLOYED WITH ONE SHOT.

Usage

llama-server -m InfiGUI-R1-3B-IQ4_K_M.gguf --mmproj mmproj-InfiGUI-R1-3B-F16.gguf --jinja -c 8196