Hugging Face's logo

Zoont
/
InternVL3-2B-4-Bit-GGUF-with-mmproj

Image-Text-to-Text
GGUF
internvl
4-bit precision
llama.cpp
mmproj
imatrix
conversational
Model card Files
xet
 Community

GGUF Conversion & Quantization of OpenGVLab/InternVL3-2B (4-Bit Quantization)

This model is converted & quantized from OpenGVLab/InternVL3-2B using llama.cpp version 6217 (7a6e91ad)

All quants made using imatrix option with Bartowski's dataset

Model Details

For more details about the model, see its original model card

Downloads last month
267
GGUF
Model size
2B params
Architecture
qwen2
Hardware compatibility
Log In to add your hardware

4-bit

View +1 variant
Inference Providers NEW
Image-Text-to-Text
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Zoont/InternVL3-2B-4-Bit-GGUF-with-mmproj

Base model

OpenGVLab/InternVL3-2B-Pretrained
Finetuned
OpenGVLab/InternVL3-2B-Instruct
Finetuned
OpenGVLab/InternVL3-2B
Quantized
(4)
this model