README / README.md
Nexesenex's picture
Update README.md
fe72a3e verified
---
title: README
emoji: ๐Ÿ“‰
colorFrom: purple
colorTo: red
sdk: streamlit
pinned: true
sdk_version: 1.45.1
---
Space to share Nexesenex's quants.
IQx_K quants and Q6_0 quants (or those having E60 in the name) require IK_Llama.cpp or Croco.cpp to be used.
NXS Quants are IK_Llama quants made with my NXS Llama.cpp mainline fork, so benefiniting from the last commits of Llama.cpp at the date of the quant publication.
---
Mradermarcher's quants of my models can mostly be found here : https://huggingface.co/mradermacher?search_models=Llama_3.