NOTE: This is an experimental GGUF repo based on a preliminary PR: https://github.com/ggml-org/llama.cpp/pull/24162

IF YOU'RE LOOKING FOR STABLE GGUFs OF THE MODEL, PLEASE WAIT FOR THE PR TO GET MERGED

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support