Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,798

Base only

Active filters: 2-bit

MaziyarPanahi/mergekit-ties-aspkrwz-GGUF

Text Generation • 7B • Updated Jun 18, 2024 • 239

MaziyarPanahi/mergekit-slerp-xqswkgn-GGUF

Text Generation • 7B • Updated Jun 18, 2024 • 411

MaziyarPanahi/mergekit-slerp-zonivkr-GGUF

Text Generation • 7B • Updated Jun 18, 2024 • 538

MaziyarPanahi/mergekit-slerp-ueqsixf-GGUF

Text Generation • 7B • Updated Jun 18, 2024 • 263

MaziyarPanahi/mergekit-slerp-xlkdlta-GGUF

Text Generation • 7B • Updated Jun 18, 2024 • 46 • 1

MaziyarPanahi/mergekit-slerp-ksadkxl-GGUF

Text Generation • 7B • Updated Jun 18, 2024 • 663 • 1

MaziyarPanahi/mergekit-slerp-qcerglv-GGUF

Text Generation • 7B • Updated Jun 18, 2024 • 19 • 1

MaziyarPanahi/llama-world-GGUF

Text Generation • 7B • Updated Jun 18, 2024 • 254 • 1

MaziyarPanahi/gemma-gemma-GGUF

Text Generation • 7B • Updated Jun 18, 2024 • 195

MaziyarPanahi/LWM-14b-Text-Chat-1M-GGUF

Text Generation • 7B • Updated Jun 18, 2024 • 498

MaziyarPanahi/mergekit-slerp-ozbsicw-GGUF

Text Generation • 7B • Updated Jun 18, 2024 • 398

MaziyarPanahi/mergekit-slerp-jeyctse-GGUF

Text Generation • 7B • Updated Jun 18, 2024 • 199

MaziyarPanahi/mergekit-ties-kkhkcqw-GGUF

Text Generation • 7B • Updated Jun 18, 2024 • 296

MaziyarPanahi/mergekit-slerp-kxzcrwh-GGUF

Text Generation • 7B • Updated Jun 18, 2024 • 120 • 1

MaziyarPanahi/mergekit-slerp-zzizhry-GGUF

Text Generation • 7B • Updated Jun 18, 2024 • 393 • 1

MaziyarPanahi/mergekit-slerp-fcxoywi-GGUF

Text Generation • 7B • Updated Jun 18, 2024 • 24 • 1

MaziyarPanahi/mergekit-slerp-gpprpds-GGUF

Text Generation • 7B • Updated Jun 18, 2024 • 316 • 1

MaziyarPanahi/firefunction-v2-GGUF

Text Generation • 71B • Updated Jun 20, 2024 • 80.4k • 18

acl-srw-2024/mistral-7b-unsloth-gptq-2bit

Text Generation • Updated Jun 25, 2024 • 4

pigas/opt-125m-gptqg-2-bit-interpol-HQQ

Text Generation • 0.2B • Updated Jun 25, 2024 • 6

MaziyarPanahi/calme-2.1-qwen2-72b-GGUF

Text Generation • 73B • Updated Aug 2, 2024 • 1.07k • 13

MaziyarPanahi/calme-2.1-qwen2-7b-GGUF

Text Generation • 8B • Updated Jul 21, 2024 • 300

MaziyarPanahi/calme-2.2-qwen2-7b-GGUF

Text Generation • 8B • Updated Jul 21, 2024 • 391 • 1

MaziyarPanahi/calme-2.3-qwen2-7b-GGUF

Text Generation • 8B • Updated Jul 21, 2024 • 178 • 2

MaziyarPanahi/calme-2.4-qwen2-7b-GGUF

Text Generation • 8B • Updated Jul 21, 2024 • 210 • 1

MaziyarPanahi/calme-2.5-qwen2-7b-GGUF

Text Generation • 8B • Updated Jul 21, 2024 • 178 • 1

MaziyarPanahi/calme-2.6-qwen2-7b-GGUF

Text Generation • 8B • Updated Jul 21, 2024 • 121 • 1

MaziyarPanahi/calme-2.7-qwen2-7b-GGUF

Text Generation • 8B • Updated Jul 21, 2024 • 522 • 1

MaziyarPanahi/calme-2.8-qwen2-7b-GGUF

Text Generation • 8B • Updated Jul 21, 2024 • 429 • 3

acl-srw-2024/llama-3-typhoon-v1.5-8b-instruct-unsloth-sft-epoch-3-gptq-2bit

Text Generation • Updated Jun 29, 2024 • 3