https://huggingface.co/Akicou/Deepseek-V-3.2-Reduced_GS6

#1643
by Akicou - opened

https://huggingface.co/Akicou/Deepseek-V-3.2-Reduced_GS6

If possible. could be that the architecture is not supported or im js not pulling the corrected llama.cpp repo

The DeepseekV32ForCausalLM architecture is unfortunately not currently supported by llama.cpp
Please follow https://github.com/ggml-org/llama.cpp/issues/16331 and let me know once support for it got merged.

Akicou changed discussion status to closed

Sign up or log in to comment