Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

bartowski
/
K2-Chat-GGUF

Text Generation
GGUF
Model card Files Files and versions
xet
Community
K2-Chat-GGUF
514 GB
  • 1 contributor
History: 2 commits
bartowski's picture
bartowski
Llamacpp quants
28c5e76 verified almost 2 years ago
  • K2-Chat-Q8_0.gguf
    Llamacpp quants almost 2 years ago
  • K2-Chat-f16.gguf
    Llamacpp quants almost 2 years ago
  • .gitattributes
    2.7 kB
    Llamacpp quants almost 2 years ago
  • K2-Chat-IQ1_M.gguf
    15.4 GB
    xet
    Llamacpp quants almost 2 years ago
  • K2-Chat-IQ2_M.gguf
    22.4 GB
    xet
    Llamacpp quants almost 2 years ago
  • K2-Chat-IQ2_XXS.gguf
    17.5 GB
    xet
    Llamacpp quants almost 2 years ago
  • K2-Chat-IQ3_M.gguf
    29.8 GB
    xet
    Llamacpp quants almost 2 years ago
  • K2-Chat-IQ3_XXS.gguf
    24.7 GB
    xet
    Llamacpp quants almost 2 years ago
  • K2-Chat-IQ4_XS.gguf
    34.8 GB
    xet
    Llamacpp quants almost 2 years ago
  • K2-Chat-Q2_K.gguf
    24.1 GB
    xet
    Llamacpp quants almost 2 years ago
  • K2-Chat-Q3_K_M.gguf
    31.6 GB
    xet
    Llamacpp quants almost 2 years ago
  • K2-Chat-Q3_K_S.gguf
    28.2 GB
    xet
    Llamacpp quants almost 2 years ago
  • K2-Chat-Q4_K_M.gguf
    39.3 GB
    xet
    Llamacpp quants almost 2 years ago
  • K2-Chat-Q5_K_M.gguf
    46.2 GB
    xet
    Llamacpp quants almost 2 years ago
  • K2-Chat.imatrix
    22.8 MB
    xet
    Llamacpp quants almost 2 years ago
  • README.md
    5.35 kB
    Llamacpp quants almost 2 years ago