Quantizations of https://huggingface.co/CalderaAI/Hexoteric-7B

Inference Clients/UIs


From original readme

Spherical Hexa-Merge of hand-picked Mistrel-7B models.
This is the successor to Naberius-7B, building on its findings.

[11 Dec 2023 UPDATE] Original compute resource for experiment are inaccessible. Long story;

https://huggingface.co/CalderaAI/Hexoteric-7B/discussions/2#6576d3e5412ee701851fd567

Stanford Alpaca format works best for instruct test driving this engima.

Downloads last month
65
GGUF
Model size
7B params
Architecture
llama
Hardware compatibility
Log In to view the estimation

1-bit

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support