Improvements comapred to v2:

  • BF16 instead of F16 for native precision
  • Includes full tokenization for speech tokens, theoretical support for text based instead of token based inference.
Downloads last month
800
GGUF
Model size
0.6B params
Architecture
qwen2
Hardware compatibility
Log In to view the estimation

16-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for Tinysoft/Cosyvoice3-0.5B-GGUF

Quantized
(3)
this model