Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,565

Base only

Active filters: 2-bit

MaziyarPanahi/Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation • 71B • Updated Jul 29, 2024 • 167k • 40

MaziyarPanahi/Meta-Llama-3.1-405B-Instruct-GGUF

Text Generation • 410B • Updated Jul 29, 2024 • 154k • 16

MaziyarPanahi/Mistral-Large-Instruct-2407-GGUF

Text Generation • 123B • Updated Jul 26, 2024 • 2.39k • 21

Maximofn/Llama-3-8B-Instruct-GPTQ-2bits

Text Generation • 8B • Updated Jul 26, 2024 • 6

MaziyarPanahi/calme-2.1-llama3.1-70b-GGUF

Text Generation • 71B • Updated Jul 31, 2024 • 126 • 2

MaziyarPanahi/gemma-2-2b-it-GGUF

Text Generation • 3B • Updated Aug 1, 2024 • 163k • 14

MaziyarPanahi/calme-2.2-qwen2-72b-GGUF

Text Generation • 73B • Updated Aug 6, 2024 • 513 • 2

ChenMnZ/Mistral-Large-Instruct-2407-EfficientQAT-w2g64-GPTQ

123B • Updated Aug 6, 2024 • 7 • 25

MaziyarPanahi/RYS-XLarge-GGUF

Text Generation • 78B • Updated Aug 6, 2024 • 111 • 7

MaziyarPanahi/calme-2.3-legalkit-8b-GGUF

Text Generation • 8B • Updated Aug 7, 2024 • 487 • 8

MaziyarPanahi/Qwen2-Math-1.5B-Instruct-GGUF

Text Generation • 2B • Updated Aug 8, 2024 • 200 • 2

MaziyarPanahi/Qwen2-Math-7B-Instruct-GGUF

Text Generation • 8B • Updated Aug 8, 2024 • 60 • 1

MaziyarPanahi/Qwen2-Math-72B-Instruct-GGUF

Text Generation • 73B • Updated Aug 20, 2024 • 1.03k • 2

Alignment-Lab-AI/w2g64-mistral-large-intruct-gptq

123B • Updated Aug 12, 2024 • 5

HHD-QiXuan/RYS-XLarge-GGUF

Text Generation • 78B • Updated Aug 18, 2024 • 34 • 1

Orion-zhen/TinyLlama-1.1B-Chat-v1.0-2.0bpw-exl2

Updated Aug 18, 2024 • 2

MaziyarPanahi/SmolLM-1.7B-Instruct-v0.2-GGUF

Text Generation • 2B • Updated Aug 18, 2024 • 152 • 7

MaziyarPanahi/Phi-3.5-mini-instruct-GGUF

Text Generation • 4B • Updated Aug 20, 2024 • 266k • 29

AminBH/Llama-3-8B-GPTQ-wiki-2bit

Text Generation • 8B • Updated Aug 21, 2024 • 4

jburmeister/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Aug 22, 2024 • 36

jburmeister/Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation • 71B • Updated Aug 22, 2024 • 50

jburmeister/Meta-Llama-3.1-405B-Instruct-GGUF

Text Generation • 410B • Updated Aug 22, 2024 • 7

jburmeister/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • 8B • Updated Aug 22, 2024 • 706

MaziyarPanahi/calme-2.1-phi3.5-4b-GGUF

Text Generation • 4B • Updated Aug 23, 2024 • 176 • 1

MaziyarPanahi/xLAM-8x22b-r-GGUF

Text Generation • 141B • Updated Sep 6, 2024 • 167 • 1

zewenwu/phi-3.5-w2g64-gptq

4B • Updated Aug 30, 2024

MaziyarPanahi/Yi-Coder-1.5B-Chat-GGUF

Text Generation • 1B • Updated Sep 4, 2024 • 168k • 18

MaziyarPanahi/Yi-Coder-9B-Chat-GGUF

Text Generation • 9B • Updated Sep 4, 2024 • 162k • 9

BigHuggyD/FluffyKaeloky_Luminum-v0.1-123B_exl2_2.0bpw_h6

Text Generation • Updated Sep 7, 2024 • 5

MaziyarPanahi/DeepSeek-V2.5-GGUF

Text Generation • 236B • Updated Sep 11, 2024 • 244 • 3