Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,883

Base only

Active filters: 5-bit

denru/Midnight-Miqu-70B-v1.5x2-5_0bpw-h8-exl2-pippa

Text Generation • Updated Apr 1, 2024 • 6

MaziyarPanahi/Experiment28Strangemerges_32-7B-GGUF

Text Generation • 7B • Updated Apr 1, 2024 • 45

MaziyarPanahi/YamNeuralsirkrishna-7B-GGUF

Text Generation • 7B • Updated Apr 1, 2024 • 104

MaziyarPanahi/Inex12Neural-7B-GGUF

Text Generation • 7B • Updated Apr 1, 2024 • 204

MaziyarPanahi/ShadowExperiment24-7B-GGUF

Text Generation • 7B • Updated Apr 1, 2024 • 142

MaziyarPanahi/Strangemerges_32Strangemerges_30-7B-GGUF

Text Generation • 7B • Updated Apr 1, 2024 • 46

MaziyarPanahi/Experiment27Shadow-7B-GGUF

Text Generation • 7B • Updated Apr 1, 2024 • 56

MaziyarPanahi/Inex12Experiment28-7B-GGUF

Text Generation • 7B • Updated Apr 1, 2024 • 291

MaziyarPanahi/Experiment26Strangemerges_30-7B-GGUF

Text Generation • 7B • Updated Apr 1, 2024 • 93

MaziyarPanahi/Strangemerges_32Experiment28-7B-GGUF

Text Generation • 7B • Updated Apr 1, 2024 • 122

MaziyarPanahi/Experiment24Experiment26-7B-GGUF

Text Generation • 7B • Updated Apr 1, 2024 • 95

MaziyarPanahi/T3qM7-7B-GGUF

Text Generation • 7B • Updated Apr 1, 2024 • 190

MaziyarPanahi/Strangemerges_32T3qm7xp-7B-GGUF

Text Generation • 7B • Updated Apr 1, 2024 • 71

blockblockblock/Tess-2.0-Yi-34B-200K-bpw5

Text Generation • Updated Apr 2, 2024 • 5

MaziyarPanahi/TowerInstruct-7B-v0.2-EN2ES-GGUF

Text Generation • 7B • Updated Apr 2, 2024 • 1.21k • 1

MaziyarPanahi/Calme-7B-Instruct-v0.9-GGUF

Text Generation • 7B • Updated Apr 2, 2024 • 1.23k • 4

LoneStriker/M7-7b-5.0bpw-h6-exl2

Text Generation • Updated Apr 2, 2024 • 8

blockblockblock/Mistral-12.25B-Instruct-v0.2-bpw5

Text Generation • Updated Apr 3, 2024 • 3

kisimoff/NeuralExperiment-7b-MagicCoder-v7.5_exl2_5bpw

Text Generation • 7B • Updated Apr 3, 2024 • 7

kisimoff/The-Trinity-Coder-7B_exl2_5bpw

Text Generation • Updated Apr 3, 2024 • 6 • 2

lucyknada/Undi95-Miqu-MS-70B-EXL2-5.0bpw

Text Generation • Updated Apr 4, 2024 • 12

blockblockblock/Starling-LM-10.7B-beta-bpw5

Text Generation • Updated Apr 4, 2024 • 4

MaziyarPanahi/medicine-chat-GGUF

Text Generation • 7B • Updated Apr 4, 2024 • 333 • 4

MaziyarPanahi/M7Yamshadowexperiment28-7B-GGUF

Text Generation • 7B • Updated Apr 4, 2024 • 580

MaziyarPanahi/MeliodasT3qm7-7B-GGUF

Text Generation • 7B • Updated Apr 4, 2024 • 72

MaziyarPanahi/YamshadowExperiment27pastiche-7B-GGUF

Text Generation • 7B • Updated Apr 4, 2024 • 119

blockblockblock/TableLLM-13b-bpw5

Text Generation • Updated Apr 4, 2024 • 8

MaziyarPanahi/MeliodasPercival_01-7B-GGUF

Text Generation • 7B • Updated Apr 4, 2024 • 1.85k

blockblockblock/Young-Children-Storyteller-Mistral-7B-bpw5

Text Generation • Updated Apr 5, 2024 • 10

Dracones/Merged-RP-Stew-V2-34B_exl2_5.0bpw

Text Generation • Updated Apr 11, 2024 • 4