openbmb
/

MiniCPM3-4B-GGUF

Model card Files Files and versions

This repo includes the GGUF versions of MiniCPM3-4B:

minicpm3-4b-fp16.gguf
minicpm3-4b-q4_k_m.gguf

For usage and more information, please check our GitHub repo.

Downloads last month: 1,591

GGUF

Model size

4B params

Architecture

minicpm3

Hardware compatibility

Log In to add your hardware

4-bit

View +1 variant

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for openbmb/MiniCPM3-4B-GGUF

Base model

openbmb/MiniCPM3-4B

Quantized

(11)

this model

Quantizations

Collection including openbmb/MiniCPM3-4B-GGUF

MiniCPM

The MiniCPM family of LLMs and VLLMs. • 33 items • Updated Feb 9 • 75