When GGUF?

#2
by ChuckMcSneed - opened

Please help adding support for your model in llama.cpp.

实在是买不起8张H100,只能用EPYC9654推理,十分期待能有gguf格式的版本

Sign up or log in to comment