README.md

metadata

title: README
emoji: 📉
colorFrom: purple
colorTo: red
sdk: streamlit
pinned: true
sdk_version: 1.45.1

Space to share Nexesenex's quants.

IQx_K quants and Q6_0 quants (or those having E60 in the name) require IK_Llama.cpp or Croco.cpp to be used.

NXS Quants are IK_Llama quants made with my NXS Llama.cpp mainline fork, so benefiniting from the last commits of Llama.cpp at the date of the quant publication.

---

Mradermarcher's quants of my models can mostly be found here : https://huggingface.co/mradermacher?search_models=Llama_3.