Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

48,287

Base only

Active filters: 4-bit

TheBloke/xDAN-L1-Chat-RL-v1-AWQ

Text Generation • 7B • Updated Dec 26, 2023 • 6 • 1

TheBloke/xDAN-L1-Chat-RL-v1-GPTQ

Text Generation • 7B • Updated Dec 26, 2023 • 15 • 3

TheBloke/Yi-34B-200K-AEZAKMI-v2-GPTQ

Text Generation • 34B • Updated Dec 26, 2023 • 6 • 2

TheBloke/Yi-34B-200K-AEZAKMI-v2-AWQ

Text Generation • 34B • Updated Dec 26, 2023 • 4 • 2

TheBloke/openthaigpt-1.0.0-beta-13B-chat-GPTQ

Text Generation • 13B • Updated Dec 26, 2023 • 10 • 3

TheBloke/openthaigpt-1.0.0-beta-13B-chat-AWQ

Text Generation • 13B • Updated Dec 26, 2023 • 6 • 1

TheBloke/neural-chat-7B-v3-3-wizardmath-dare-me-AWQ

Text Generation • 7B • Updated Dec 26, 2023 • 4 • 1

TheBloke/openchat-3.5-1210-starling-slerp-AWQ

Text Generation • 7B • Updated Dec 26, 2023 • 5 • 1

VictorNanka/phi-2-sft-lora

Text Generation • Updated Dec 26, 2023 • 4

TheBloke/neural-chat-7B-v3-3-wizardmath-dare-me-GPTQ

Text Generation • 7B • Updated Dec 26, 2023 • 3 • 1

TheBloke/openchat-3.5-1210-starling-slerp-GPTQ

Text Generation • 7B • Updated Dec 26, 2023 • 8 • 4

unsloth/codellama-34b-bnb-4bit

Text Generation • 35B • Updated Sep 3, 2024 • 127 • 3

danniel2023/lora_model

7B • Updated Dec 26, 2023 • 7

CambioMoney/mixtral-instruct-MLFlowV4

Text Generation • 47B • Updated Dec 26, 2023 • 6 • 1

TheBloke/MixtralOrochi8x7B-AWQ

Text Generation • 47B • Updated Dec 26, 2023 • 7 • 2

TheBloke/MixtralOrochi8x7B-GPTQ

Text Generation • 47B • Updated Dec 26, 2023 • 10 • 7

ace2105/mistral-indian-rights

Text Generation • 7B • Updated Dec 27, 2023 • 5

unsloth/llama-2-13b-bnb-4bit

Text Generation • 13B • Updated Sep 3, 2024 • 175 • 7

TheBloke/Silicon-Maid-7B-AWQ

Text Generation • 7B • Updated Dec 27, 2023 • 7 • 9

TheBloke/Silicon-Maid-7B-GPTQ

Text Generation • 7B • Updated Dec 27, 2023 • 56 • 25

msamon/AdaptLLM-finance-chat-AWQ

Text Generation • 7B • Updated Dec 27, 2023 • 2 • 1

hamel/tokenfight

Updated Dec 28, 2023 • 7

jakemannix/zephyr-7b-beta_assistant_v0.2_gptq

Text Generation • 7B • Updated Dec 28, 2023 • 5

TheBloke/dolphin-2.6-mistral-7B-AWQ

Text Generation • 7B • Updated Dec 28, 2023 • 2.25k • 8

TheBloke/dolphin-2.6-mistral-7B-GPTQ

Text Generation • 7B • Updated Dec 28, 2023 • 18 • 9

Crystalcareai/WeakAuraGenerator

Updated Jan 7, 2024 • 2

TheBloke/Aurora-Nights-70B-v1.0-GPTQ

Text Generation • 69B • Updated Dec 28, 2023 • 9 • 1

TheBloke/Aurora-Nights-70B-v1.0-AWQ

Text Generation • 69B • Updated Dec 28, 2023 • 6 • 4

brody1/mixtral-lora-8X7b

Text Generation • 48B • Updated Dec 28, 2023 • 2

TheBloke/Aurora-Nights-103B-v1.0-AWQ

Text Generation • 103B • Updated Dec 28, 2023 • 4 • 1