Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,742

Full-text search

Active filters: 4-bit

Sujan42024/dlite-v2-355m-bi4tQuantization

Text Generation • 0.4B • Updated Nov 29, 2023 • 1

TheBloke/psyonic-cetacean-20B-AWQ

Text Generation • 20B • Updated Nov 29, 2023 • 5

Ferrxni/finetuned_gw_mistral_GPTQ

Updated Nov 29, 2023

TheBloke/Open-Hermes-2.5-neural-chat-3.1-frankenmerge-11b-GPTQ

Text Generation • 11B • Updated Nov 30, 2023 • 2 • 1

TheBloke/psyonic-cetacean-20B-GPTQ

Text Generation • 20B • Updated Nov 29, 2023

TheBloke/SauerkrautLM-7B-HerO-GPTQ

Text Generation • 7B • Updated Nov 29, 2023 • 8 • 1

TheBloke/tigerbot-70B-chat-v2-AWQ

Text Generation • 69B • Updated Nov 30, 2023 • 2

TheBloke/deepseek-llm-67b-chat-AWQ

Text Generation • 67B • Updated Nov 29, 2023 • 251 • 5

TheBloke/deepseek-llm-67b-chat-GPTQ

Text Generation • 67B • Updated Nov 29, 2023 • 9 • 8

NobodyExistsOnTheInternet/mistral-7b-airoboros-chatml

Updated Dec 1, 2023 • 3

TheBloke/Iambe-20B-DARE-AWQ

Text Generation • 20B • Updated Nov 29, 2023 • 3 • 1

TheBloke/open-llama-3b-v2-wizard-evol-instuct-v2-196k-AWQ

Text Generation • 3B • Updated Nov 30, 2023 • 161 • 1

vachonni/falcon-1b-tech-level-fr

Text Generation • Updated Nov 29, 2023

TheBloke/deepseek-llm-7B-base-AWQ

Text Generation • 7B • Updated Nov 29, 2023 • 9 • 2

TheBloke/deepseek-llm-67b-base-AWQ

Text Generation • 67B • Updated Nov 29, 2023 • 14 • 2

TheBloke/deepseek-llm-67b-base-GPTQ

Text Generation • 67B • Updated Nov 29, 2023 • 12 • 1

TheBloke/deepseek-llm-7B-chat-AWQ

Text Generation • 7B • Updated Nov 29, 2023 • 223 • 3

TheBloke/LLaMA2-13B-Psyfighter2-AWQ

Text Generation • 13B • Updated Nov 30, 2023 • 20 • 4

TheBloke/Iambe-20B-DARE-GPTQ

Text Generation • 20B • Updated Nov 29, 2023 • 5 • 1

TheBloke/NeuralHermes-2.5-Mistral-7B-AWQ

Text Generation • 7B • Updated Nov 30, 2023 • 11 • 7

TheBloke/deepseek-llm-7B-base-GPTQ

Text Generation • 7B • Updated Nov 29, 2023 • 8 • 2

TheBloke/deepseek-llm-7B-chat-GPTQ

Text Generation • 7B • Updated Nov 30, 2023 • 21 • 1

TheBloke/open-llama-3b-v2-wizard-evol-instuct-v2-196k-GPTQ

Text Generation • 3B • Updated Nov 30, 2023 • 8 • 2

TheBloke/LLaMA2-13B-Psyfighter2-GPTQ

Text Generation • 13B • Updated Nov 30, 2023 • 7 • 16

TheBloke/NeuralHermes-2.5-Mistral-7B-GPTQ

Text Generation • 7B • Updated Nov 30, 2023 • 11 • 8

TheBloke/SG-Raccoon-Yi-55B-GPTQ

Text Generation • 56B • Updated Nov 30, 2023 • 1

TheBloke/SG-Raccoon-Yi-55B-AWQ

Text Generation • 56B • Updated Nov 30, 2023 • 2

Qwen/Qwen-1_8B-Chat-Int4

Text Generation • Updated Dec 13, 2023 • 451 • 36

Qwen/Qwen-72B-Chat-Int4

Text Generation • 72B • Updated Jan 4, 2024 • 335 • 47

TheBloke/tigerbot-70B-chat-v2-GPTQ

Text Generation • 69B • Updated Nov 30, 2023 • 1 • 5