Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

mradermacher
/
Nemotron-Mini-4B-Instruct-GGUF

Transformers
GGUF
PyTorch
English
nvidia
llama-3
conversational
Model card Files Files and versions
xet
Community
Nemotron-Mini-4B-Instruct-GGUF
41.4 GB
Ctrl+K
Ctrl+K
  • 1 contributor
History: 18 commits
mradermacher's picture
mradermacher
auto-patch README.md
3879731 verified about 1 year ago
  • .gitattributes
    2.47 kB
    uploaded from kaos over 1 year ago
  • Nemotron-Mini-4B-Instruct.IQ4_XS.gguf
    2.48 GB
    xet
    uploaded from kaos over 1 year ago
  • Nemotron-Mini-4B-Instruct.Q2_K.gguf
    1.9 GB
    xet
    uploaded from kaos over 1 year ago
  • Nemotron-Mini-4B-Instruct.Q3_K_L.gguf
    2.45 GB
    xet
    uploaded from kaos over 1 year ago
  • Nemotron-Mini-4B-Instruct.Q3_K_M.gguf
    2.3 GB
    xet
    uploaded from kaos over 1 year ago
  • Nemotron-Mini-4B-Instruct.Q3_K_S.gguf
    2.12 GB
    xet
    uploaded from kaos over 1 year ago
  • Nemotron-Mini-4B-Instruct.Q4_0_4_4.gguf
    2.57 GB
    xet
    uploaded from kaos over 1 year ago
  • Nemotron-Mini-4B-Instruct.Q4_K_M.gguf
    2.7 GB
    xet
    uploaded from kaos over 1 year ago
  • Nemotron-Mini-4B-Instruct.Q4_K_S.gguf
    2.58 GB
    xet
    uploaded from kaos over 1 year ago
  • Nemotron-Mini-4B-Instruct.Q5_K_M.gguf
    3.06 GB
    xet
    uploaded from kaos over 1 year ago
  • Nemotron-Mini-4B-Instruct.Q5_K_S.gguf
    2.99 GB
    xet
    uploaded from kaos over 1 year ago
  • Nemotron-Mini-4B-Instruct.Q6_K.gguf
    3.45 GB
    xet
    uploaded from kaos over 1 year ago
  • Nemotron-Mini-4B-Instruct.Q8_0.gguf
    4.46 GB
    xet
    uploaded from kaos over 1 year ago
  • Nemotron-Mini-4B-Instruct.f16.gguf
    8.39 GB
    xet
    uploaded from kaos over 1 year ago
  • README.md
    3.79 kB
    auto-patch README.md about 1 year ago