DevQuasar
/

nvidia.Nemotron-Mini-4B-Instruct-GGUF

Text Generation

Model card Files Files and versions

nvidia.Nemotron-Mini-4B-Instruct-GGUF

36.4 GB

1 contributor

History: 13 commits

csabakecskemeti's picture

csabakecskemeti

Upload nvidia.Nemotron-Mini-4B-Instruct.Q5_K_S.gguf with huggingface_hub

74fc48f verified 12 months ago

.gitattributes
2.4 kB

Upload nvidia.Nemotron-Mini-4B-Instruct.Q5_K_S.gguf with huggingface_hub 12 months ago
README.md
853 Bytes

Upload README.md with huggingface_hub 12 months ago
nvidia.Nemotron-Mini-4B-Instruct.Q2_K.gguf
1.9 GB
xet

Upload nvidia.Nemotron-Mini-4B-Instruct.Q2_K.gguf with huggingface_hub 12 months ago
nvidia.Nemotron-Mini-4B-Instruct.Q3_K_L.gguf
2.45 GB
xet

Upload nvidia.Nemotron-Mini-4B-Instruct.Q3_K_L.gguf with huggingface_hub 12 months ago
nvidia.Nemotron-Mini-4B-Instruct.Q3_K_M.gguf
2.3 GB
xet

Upload nvidia.Nemotron-Mini-4B-Instruct.Q3_K_M.gguf with huggingface_hub 12 months ago
nvidia.Nemotron-Mini-4B-Instruct.Q3_K_S.gguf
2.12 GB
xet

Upload nvidia.Nemotron-Mini-4B-Instruct.Q3_K_S.gguf with huggingface_hub 12 months ago
nvidia.Nemotron-Mini-4B-Instruct.Q4_K_M.gguf
2.7 GB
xet

Upload nvidia.Nemotron-Mini-4B-Instruct.Q4_K_M.gguf with huggingface_hub 12 months ago
nvidia.Nemotron-Mini-4B-Instruct.Q4_K_S.gguf
2.58 GB
xet

Upload nvidia.Nemotron-Mini-4B-Instruct.Q4_K_S.gguf with huggingface_hub 12 months ago
nvidia.Nemotron-Mini-4B-Instruct.Q5_K_M.gguf
3.06 GB
xet

Upload nvidia.Nemotron-Mini-4B-Instruct.Q5_K_M.gguf with huggingface_hub 12 months ago
nvidia.Nemotron-Mini-4B-Instruct.Q5_K_S.gguf
2.99 GB
xet

Upload nvidia.Nemotron-Mini-4B-Instruct.Q5_K_S.gguf with huggingface_hub 12 months ago
nvidia.Nemotron-Mini-4B-Instruct.Q6_K.gguf
3.45 GB
xet

Upload nvidia.Nemotron-Mini-4B-Instruct.Q6_K.gguf with huggingface_hub 12 months ago
nvidia.Nemotron-Mini-4B-Instruct.Q8_0.gguf
4.46 GB
xet

Upload nvidia.Nemotron-Mini-4B-Instruct.Q8_0.gguf with huggingface_hub 12 months ago
nvidia.Nemotron-Mini-4B-Instruct.f16.gguf
8.39 GB
xet

Upload nvidia.Nemotron-Mini-4B-Instruct.f16.gguf with huggingface_hub 12 months ago