Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

11,728

Base only

Active filters: quantized

MaziyarPanahi/34b-beta-GGUF

Text Generation • 34B • Updated Mar 4, 2024 • 152 • 4

Lewdiculous/Eris_Remix_7B-GGUF-IQ-Imatrix

Text Generation • 7B • Updated Mar 5, 2024 • 249 • 11

Lewdiculous/Copium-Cola-9B-GGUF-IQ-Imatrix

Text Generation • 9B • Updated Mar 5, 2024 • 145 • 7

solidrust/Magic-Dolphin-7b-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 4

solidrust/DPOpenHermes-7B-v2-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 5

solidrust/dolphin-2.8-experiment26-7b-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 1 • 1

MaziyarPanahi/Calme-7B-Instruct-v0.1.1-GGUF

Text Generation • 7B • Updated Mar 5, 2024 • 278 • 6

solidrust/MonarchLake-7B-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 1

solidrust/Mistral-7B-Instruct-v0.2-Neural-Story-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 1

solidrust/OmniCorso-7B-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 5

solidrust/MBX-7B-v3-DPO-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 2

alokabhishek/Llama-2-7b-chat-hf-bnb-4bit

Text Generation • 7B • Updated Mar 16, 2024 • 3 • 2

solidrust/merlinite-7b-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 3

alokabhishek/falcon-7b-instruct-bnb-4bit

Text Generation • 7B • Updated Mar 16, 2024 • 1 • 1

Lewdiculous/Layris_9B-GGUF-IQ-Imatrix

Text Generation • 9B • Updated May 4, 2024 • 238 • 20

solidrust/Flora-7B-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 4

solidrust/Luna-7B-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 2

MaziyarPanahi/MixTAO-7Bx2-MoE-v8.1-GGUF

Text Generation • 13B • Updated Mar 11, 2024 • 705 • 10

alokabhishek/Mistral-7B-Instruct-v0.2-GGUF

Text Generation • 7B • Updated Mar 24, 2024 • 11 • 2

alokabhishek/Llama-2-7b-chat-hf-GGUF

Text Generation • 7B • Updated Mar 16, 2024 • 85 • 1

solidrust/Mewthree-7B-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 4 • 1

solidrust/Flora-7B-DPO-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 1

solidrust/NeuralHermes-2.5-Mistral-7B-laser-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 1

solidrust/Monarch-7B-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 3

solidrust/NeuralMonarch-7B-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 3

solidrust/AlphaMonarch-7B-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 2

solidrust/Darewin-7B-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 1

solidrust/Eris-Remix-7B-DPO-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 2

MaziyarPanahi/merlinite-7b-GGUF

Text Generation • 7B • Updated Mar 7, 2024 • 163 • 5

MaziyarPanahi/Yi-9B-GGUF

Text Generation • 9B • Updated Mar 14, 2024 • 365 • 15