--- title: README emoji: 📉 colorFrom: purple colorTo: red sdk: streamlit pinned: true sdk_version: 1.45.1 --- Space to share Nexesenex's quants. IQx_K quants and Q6_0 quants (or those having E60 in the name) require IK_Llama.cpp or Croco.cpp to be used. NXS Quants are IK_Llama quants made with my NXS Llama.cpp mainline fork, so benefiniting from the last commits of Llama.cpp at the date of the quant publication. --- Mradermarcher's quants of my models can mostly be found here : https://huggingface.co/mradermacher?search_models=Llama_3.