Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

TheFireHacker
/
Qwen3-0.6b-TensorSlayerPatch

Safetensors
GGUF
qwen3
conversational
Model card Files Files and versions
xet
Community
1
Qwen3-0.6b-TensorSlayerPatch / gguf
2.66 GB
  • 1 contributor
History: 2 commits
TheFireHacker's picture
TheFireHacker
Add GGUF quantized versions for Ollama/llama.cpp compatibility with API instructions
bec0b3f verified 5 months ago
  • README.md
    2.75 kB
    Add GGUF quantized versions for Ollama/llama.cpp compatibility with API instructions 5 months ago
  • qwen3-0.6b-tensorslayer-f16.gguf
    1.2 GB
    xet
    Add GGUF quantized versions for Ollama/llama.cpp compatibility with API instructions 5 months ago
  • qwen3-0.6b-tensorslayer-q4_0.gguf
    382 MB
    xet
    Add GGUF quantized versions for Ollama/llama.cpp compatibility with API instructions 5 months ago
  • qwen3-0.6b-tensorslayer-q5_k_m.gguf
    444 MB
    xet
    Add GGUF quantized versions for Ollama/llama.cpp compatibility with API instructions 5 months ago
  • qwen3-0.6b-tensorslayer-q8_0.gguf
    639 MB
    xet
    Add GGUF quantized versions for Ollama/llama.cpp compatibility with API instructions 5 months ago