Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

QuantFactory
/
TinyAgent-7B-GGUF

Transformers
GGUF
English
function calling
on-device language model
conversational
Model card Files Files and versions
xet
Community
TinyAgent-7B-GGUF
Ctrl+K
Ctrl+K
  • 1 contributor
History: 12 commits
aashish1904's picture
aashish1904
Upload TinyAgent-7B.Q2_K.gguf with huggingface_hub
2fffc06 verified over 1 year ago
  • .gitattributes
    2.12 kB
    Upload TinyAgent-7B.Q2_K.gguf with huggingface_hub over 1 year ago
  • README.md
    5.61 kB
    Upload README.md with huggingface_hub over 1 year ago
  • TinyAgent-7B.Q2_K.gguf
    3.18 GB
    xet
    Upload TinyAgent-7B.Q2_K.gguf with huggingface_hub over 1 year ago
  • TinyAgent-7B.Q4_0.gguf
    4.66 GB
    xet
    Upload TinyAgent-7B.Q4_0.gguf with huggingface_hub over 1 year ago
  • TinyAgent-7B.Q4_1.gguf
    5.13 GB
    xet
    Upload TinyAgent-7B.Q4_1.gguf with huggingface_hub over 1 year ago
  • TinyAgent-7B.Q4_K_M.gguf
    4.92 GB
    xet
    Upload TinyAgent-7B.Q4_K_M.gguf with huggingface_hub over 1 year ago
  • TinyAgent-7B.Q5_0.gguf
    5.6 GB
    xet
    Upload TinyAgent-7B.Q5_0.gguf with huggingface_hub over 1 year ago
  • TinyAgent-7B.Q5_1.gguf
    6.07 GB
    xet
    Upload TinyAgent-7B.Q5_1.gguf with huggingface_hub over 1 year ago
  • TinyAgent-7B.Q5_K_M.gguf
    5.73 GB
    xet
    Upload TinyAgent-7B.Q5_K_M.gguf with huggingface_hub over 1 year ago
  • TinyAgent-7B.Q5_K_S.gguf
    5.6 GB
    xet
    Upload TinyAgent-7B.Q5_K_S.gguf with huggingface_hub over 1 year ago
  • TinyAgent-7B.Q6_K.gguf
    6.6 GB
    xet
    Upload TinyAgent-7B.Q6_K.gguf with huggingface_hub over 1 year ago
  • TinyAgent-7B.Q8_0.gguf
    8.54 GB
    xet
    Upload TinyAgent-7B.Q8_0.gguf with huggingface_hub over 1 year ago