Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,565

Base only

Active filters: 2-bit

MaziyarPanahi/Saul-Instruct-v1-GGUF

Text Generation • 7B • Updated Mar 10, 2024 • 516 • 10

MaziyarPanahi/luxia-21.4b-alignment-v1.0-GGUF

Text Generation • 21B • Updated Mar 17, 2024 • 473 • 9

MaziyarPanahi/Calme-7B-Instruct-v0.2-GGUF

Text Generation • 7B • Updated Mar 15, 2024 • 145 • 2

MaziyarPanahi/Calme-7B-Instruct-v0.3-GGUF

Text Generation • 7B • Updated Mar 15, 2024 • 163 • 1

MaziyarPanahi/Calme-7B-Instruct-v0.4-GGUF

Text Generation • 7B • Updated Mar 15, 2024 • 158 • 1

MaziyarPanahi/Calme-7B-Instruct-v0.5-GGUF

Text Generation • 7B • Updated Mar 15, 2024 • 200 • 2

MaziyarPanahi/yi-super-9B-GGUF

Text Generation • 9B • Updated Mar 15, 2024 • 726 • 3

MaziyarPanahi/BioMedGPT-LM-7B-GGUF

Text Generation • 7B • Updated Mar 17, 2024 • 963 • 4

MaziyarPanahi/Calme-4x7B-MoE-v0.1-GGUF

Text Generation • 24B • Updated Mar 18, 2024 • 260

MaziyarPanahi/Calme-4x7B-MoE-v0.2-GGUF

Text Generation • 24B • Updated Mar 18, 2024 • 356 • 4

MaziyarPanahi/Yi-9B-200K-GGUF

Text Generation • 9B • Updated Mar 18, 2024 • 135 • 5

MaziyarPanahi/Yi-6B-200K-GGUF

Text Generation • 6B • Updated Mar 18, 2024 • 689

pigas/TinyLlama-1.1B-Chat-v0.3-GPTQ-2bits

Text Generation • 1B • Updated Mar 25, 2024 • 1

MaziyarPanahi/Hermes-2-Pro-11B-GGUF

Text Generation • 11B • Updated Mar 26, 2024 • 115 • 4

MaziyarPanahi/Mistral-7B-v0.2-GGUF

Text Generation • 7B • Updated Mar 28, 2024 • 305 • 3

DisOOM/Faro-Yi-9B-200k-GGUF

Text Generation • 9B • Updated Mar 30, 2024 • 77 • 1

MaziyarPanahi/OgnoExperiment27-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 176

MaziyarPanahi/ShadowYam-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 59

MaziyarPanahi/Experiment27Neuralsirkrishna-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 114

MaziyarPanahi/YamShadow-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 81 • 1

MaziyarPanahi/NeuralsirkrishnaExperiment26-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 102

MaziyarPanahi/Strangemerges_32Yamshadow-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 70

MaziyarPanahi/Experiment26Experiment26-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 124

MaziyarPanahi/YamStrangemerges_32-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 190

MaziyarPanahi/Experiment28Experiment29-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 129

MaziyarPanahi/Experiment26Experiment28-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 89

MaziyarPanahi/NeuralsirkrishnaExperiment28-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 154

MaziyarPanahi/AlloyingotneoyExperiment28-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 73

MaziyarPanahi/Experiment26M7-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 94

MaziyarPanahi/Strangemerges_32Experiment26-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 39