Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

45,693

Base only

Active filters: 4-bit

TheBloke/PiVoT-0.1-Starling-LM-RP-GPTQ

Text Generation • 7B • Updated Nov 28, 2023 • 7 • 4

TheBloke/evolvedSeeker_1_3-GPTQ

Text Generation • 1B • Updated Nov 28, 2023 • 4

TheBloke/saiga_mistral_7b-GPTQ

Text Generation • 7B • Updated Nov 28, 2023 • 9 • 8

TheBloke/Astrid-Mistral-7B-GPTQ

Text Generation • 7B • Updated Nov 28, 2023 • 8 • 2

TheBloke/Aetheria-L2-70B-GPTQ

Text Generation • 69B • Updated Nov 29, 2023 • 7 • 1

TheBloke/Open-Hermes-2.5-neural-chat-3.1-frankenmerge-11b-AWQ

Text Generation • 11B • Updated Nov 30, 2023 • 3 • 2

TheBloke/SauerkrautLM-7B-HerO-AWQ

Text Generation • 7B • Updated Nov 29, 2023 • 6 • 4

TheBloke/Venus-120b-v1.0-AWQ

Text Generation • 120B • Updated Nov 29, 2023 • 5 • 2

unsloth/llama-2-7b-bnb-4bit

Text Generation • 7B • Updated Sep 3, 2024 • 2.38k • 15

Sujan42024/dlite-v2-355m-bi4tQuantization

Text Generation • 0.4B • Updated Nov 29, 2023

TheBloke/psyonic-cetacean-20B-AWQ

Text Generation • 20B • Updated Nov 29, 2023 • 4

Ferrxni/finetuned_gw_mistral_GPTQ

Updated Nov 29, 2023 • 3

TheBloke/Open-Hermes-2.5-neural-chat-3.1-frankenmerge-11b-GPTQ

Text Generation • 11B • Updated Nov 30, 2023 • 6 • 1

TheBloke/psyonic-cetacean-20B-GPTQ

Text Generation • 20B • Updated Nov 29, 2023 • 4

TheBloke/SauerkrautLM-7B-HerO-GPTQ

Text Generation • 7B • Updated Nov 29, 2023 • 10 • 1

TheBloke/tigerbot-70B-chat-v2-AWQ

Text Generation • 69B • Updated Nov 30, 2023 • 7 • 2

TheBloke/deepseek-llm-67b-chat-AWQ

Text Generation • 67B • Updated Nov 29, 2023 • 16 • 5

TheBloke/deepseek-llm-67b-chat-GPTQ

Text Generation • 67B • Updated Nov 29, 2023 • 4 • 8

NobodyExistsOnTheInternet/mistral-7b-airoboros-chatml

Updated Dec 1, 2023 • 5

TheBloke/Iambe-20B-DARE-AWQ

Text Generation • 20B • Updated Nov 29, 2023 • 8 • 1

TheBloke/open-llama-3b-v2-wizard-evol-instuct-v2-196k-AWQ

Text Generation • 3B • Updated Nov 30, 2023 • 11 • 1

vachonni/falcon-1b-tech-level-fr

Text Generation • Updated Nov 29, 2023 • 1

TheBloke/deepseek-llm-7B-base-AWQ

Text Generation • 7B • Updated Nov 29, 2023 • 161 • 2

TheBloke/deepseek-llm-67b-base-AWQ

Text Generation • 67B • Updated Nov 29, 2023 • 56 • 2

TheBloke/deepseek-llm-67b-base-GPTQ

Text Generation • 67B • Updated Nov 29, 2023 • 7 • 1

TheBloke/deepseek-llm-7B-chat-AWQ

Text Generation • 7B • Updated Nov 29, 2023 • 167 • 3

TheBloke/LLaMA2-13B-Psyfighter2-AWQ

Text Generation • 13B • Updated Nov 30, 2023 • 7 • 4

TheBloke/Iambe-20B-DARE-GPTQ

Text Generation • 20B • Updated Nov 29, 2023 • 7 • 1

TheBloke/NeuralHermes-2.5-Mistral-7B-AWQ

Text Generation • 7B • Updated Nov 30, 2023 • 4 • 7

TheBloke/deepseek-llm-7B-base-GPTQ

Text Generation • 7B • Updated Nov 29, 2023 • 30 • 2