Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,799

Base only

Active filters: 2-bit

MaziyarPanahi/Calme-7B-Instruct-v0.5-GGUF

Text Generation • 7B • Updated Mar 15, 2024 • 756 • 2

MaziyarPanahi/yi-super-9B-GGUF

Text Generation • 9B • Updated Mar 15, 2024 • 457 • 3

MaziyarPanahi/BioMedGPT-LM-7B-GGUF

Text Generation • 7B • Updated Mar 17, 2024 • 337 • 4

MaziyarPanahi/Calme-4x7B-MoE-v0.1-GGUF

Text Generation • 24B • Updated Mar 18, 2024 • 518

MaziyarPanahi/Calme-4x7B-MoE-v0.2-GGUF

Text Generation • 24B • Updated Mar 18, 2024 • 504 • 4

MaziyarPanahi/Yi-9B-200K-GGUF

Text Generation • 9B • Updated Mar 18, 2024 • 475 • 5

MaziyarPanahi/Yi-6B-200K-GGUF

Text Generation • 6B • Updated Mar 18, 2024 • 154

pigas/TinyLlama-1.1B-Chat-v0.3-GPTQ-2bits

Text Generation • 1B • Updated Mar 25, 2024 • 3

MaziyarPanahi/Hermes-2-Pro-11B-GGUF

Text Generation • 11B • Updated Mar 26, 2024 • 79 • 4

MaziyarPanahi/Mistral-7B-v0.2-GGUF

Text Generation • 7B • Updated Mar 28, 2024 • 179 • 3

DisOOM/Faro-Yi-9B-200k-GGUF

Text Generation • 9B • Updated Mar 30, 2024 • 123 • 1

MaziyarPanahi/OgnoExperiment27-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 184

MaziyarPanahi/ShadowYam-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 123

MaziyarPanahi/Experiment27Neuralsirkrishna-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 98

MaziyarPanahi/YamShadow-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 476 • 1

MaziyarPanahi/NeuralsirkrishnaExperiment26-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 197

MaziyarPanahi/Strangemerges_32Yamshadow-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 25

MaziyarPanahi/Experiment26Experiment26-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 30

MaziyarPanahi/YamStrangemerges_32-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 29

MaziyarPanahi/Experiment28Experiment29-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 158

MaziyarPanahi/Experiment26Experiment28-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 18

MaziyarPanahi/NeuralsirkrishnaExperiment28-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 184

MaziyarPanahi/AlloyingotneoyExperiment28-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 82

MaziyarPanahi/Experiment26M7-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 89

MaziyarPanahi/Strangemerges_32Experiment26-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 39

MaziyarPanahi/Inex12Strangemerges_32-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 430

MaziyarPanahi/Experiment26T3q-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 34

MaziyarPanahi/Strangemerges_32M7-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 56

MaziyarPanahi/Experiment26Inex12-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 102

MaziyarPanahi/YamExperiment24-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 51