Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

32,746

Base only

Active filters: 8-bit

Guilherme34/Samanthavision-modelnotlora

Text Generation • 7B • Updated Apr 9, 2024 • 5

MaziyarPanahi/samantha-1.1-westlake-7b-GGUF

Text Generation • 7B • Updated Feb 13, 2024 • 303 • 3

MaziyarPanahi/natural-sql-7b-GGUF

Text Generation • 7B • Updated Feb 13, 2024 • 105 • 2

MaziyarPanahi/sqlcoder-7b-GGUF

Text Generation • 7B • Updated Feb 13, 2024 • 59

MaziyarPanahi/sqlcoder-7b-2-GGUF

Text Generation • 7B • Updated Feb 13, 2024 • 385 • 12

MaziyarPanahi/deepseek-math-7b-instruct-GGUF

Text Generation • 7B • Updated Feb 13, 2024 • 619 • 1

MaziyarPanahi/WhiteRabbitNeo-13B-v1-GGUF

Text Generation • 13B • Updated Feb 13, 2024 • 795 • 2

Deadwalker0/axolotl-ex

Updated Feb 14, 2024 • 1

MaziyarPanahi/LWM-Text-256K-GGUF

Text Generation • 7B • Updated Feb 14, 2024 • 92 • 6

MaziyarPanahi/WestSeverus-7B-DPO-v2-GGUF

Text Generation • 7B • Updated Feb 14, 2024 • 96 • 1

MaziyarPanahi/OGNO-7B-GGUF

Text Generation • 7B • Updated Feb 14, 2024 • 58 • 2

Phanh2532/GAMA-Tiny-Code-Generator

2B • Updated Feb 21, 2024 • 6 • 1

SuYee189/myanmar-gpt-health-faq

Text Generation • 82M • Updated Feb 15, 2024 • 5

SuYee189/myanmar-gpt-health-faq1

Text Generation • 0.1B • Updated Feb 15, 2024 • 4

oliverbob/biblegpt

0.6B • Updated Feb 19, 2024 • 168 • 3

wndiros/diva_em_leo_mistral_v06

Text Generation • 4B • Updated Feb 17, 2024 • 4

TeeZee/llama-2-7B-pirate-speech-QLORA-60-steps

Text Generation • 4B • Updated Feb 16, 2024 • 3

Epiculous/Fett-uccine-7B-GPTQ

Text Generation • Updated Feb 17, 2024 • 4 • 1

Harmj0y/nemesis-bge-small

Text Generation • 33.5M • Updated Feb 17, 2024 • 6

PhilSad/Claire-7b-0.1-instruct

Text Generation • 7B • Updated Jun 3, 2025 • 14 • 1

MaziyarPanahi/DARE_TIES_13B-GGUF

Text Generation • 13B • Updated Feb 17, 2024 • 58 • 4

MaziyarPanahi/Llama-2-7b-chat-hf-function-calling-v3-GGUF

Text Generation • 7B • Updated Feb 17, 2024 • 188 • 2

inventbot/Mixtral-8x7B-Instruct-v0.1-offloading-demo

Text Generation • 18B • Updated May 26, 2024 • 5

MaziyarPanahi/Llama-2-7b-chat-hf-function-calling-v2-GGUF

Text Generation • 7B • Updated Feb 17, 2024 • 128 • 4

benschlagman/llama-2-7b-chat-esconv

Text Generation • 4B • Updated Mar 25, 2024 • 7

MaziyarPanahi/Valor-7B-v0.1-GGUF

Text Generation • 7B • Updated Feb 18, 2024 • 97 • 4

MaziyarPanahi/NeuralOmniBeagle-7B-GGUF

Text Generation • 7B • Updated Feb 19, 2024 • 89 • 1

AbdulrehmanKryon/llmware-bling-stable-lm-3b-4e1t-v0-quantized-8bit

Text Generation • 3B • Updated Feb 19, 2024 • 3

BioMistral/BioMistral-7B-BnB.8

Text Generation • 7B • Updated Feb 19, 2024 • 8

MaziyarPanahi/BioMistral-7B-GGUF

Text Generation • 7B • Updated Feb 19, 2024 • 2.68k • 58