Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

8,997

Base only

Active filters: chat

byroneverson/Yi-1.5-34B-Chat-abliterated

Text Generation • 34B • Updated Dec 17, 2024 • 24 • 3

mradermacher/Yi-1.5-9B-Chat-abliterated-GGUF

9B • Updated Sep 5, 2024 • 88

mradermacher/Yi-1.5-9B-Chat-abliterated-i1-GGUF

9B • Updated Sep 6, 2024 • 187 • 1

wmilesboltz/Qwen2-7B-Instruct-Q2_K-GGUF

Text Generation • 8B • Updated Sep 6, 2024 • 1

koesn/Hermes-3-Llama-3.1-8B-GGUF

8B • Updated Sep 8, 2024 • 39

QuantFactory/leniachat-qwen2-1.5B-v0-GGUF

2B • Updated Sep 7, 2024 • 197 • 4

QuantFactory/leniachat-gemma-2b-v0-GGUF

3B • Updated Sep 7, 2024 • 81 • 2

Quant-Cartel/SorcererLM-8x22b-iMat-GGUF

Text Generation • 141B • Updated Nov 1, 2024 • 404 • 2

MaziyarPanahi/calme-2.2-llama3.1-70b

Text Generation • 71B • Updated Sep 29, 2024 • 21 • • 2

sequelbox/gemma-2-9B-MOTH

Text Generation • 9B • Updated Sep 13, 2024 • 7

koesn/Llama3.1-8B-Cobalt-GGUF

Text Generation • 8B • Updated Sep 10, 2024 • 24

antoste/Qwen2-1.5B-Instruct-IQ3_M-GGUF

Text Generation • 2B • Updated Sep 11, 2024 • 16

antoste/Qwen2-1.5B-Instruct-Q4_K_M-GGUF

Text Generation • 2B • Updated Sep 10, 2024 • 8

antoste/Qwen2-1.5B-Instruct-Q4_K_S-GGUF

Text Generation • 2B • Updated Sep 10, 2024 • 3

antoste/Qwen2-1.5B-Instruct-IQ4_XS-GGUF

Text Generation • 2B • Updated Sep 10, 2024 • 5

antoste/Qwen2-1.5B-Instruct-Q5_K_M-GGUF

Text Generation • 2B • Updated Sep 11, 2024 • 6

MaziyarPanahi/calme-2.3-llama3.1-70b

Text Generation • 71B • Updated Sep 29, 2024 • 15 • • 3

TitanML/Qwen2-1.5B-Instruct

Text Generation • 2B • Updated Sep 10, 2024 • 3

TitanML/Qwen2-0.5B-Instruct

Text Generation • 0.5B • Updated Sep 10, 2024 • 17 •

mradermacher/calme-2.2-llama3.1-70b-GGUF

71B • Updated Sep 11, 2024 • 61

koesn/Llama3.1-8B-Enigma-GGUF

Text Generation • 8B • Updated Sep 11, 2024 • 4

Kondara/Sailor-7B-Chat-Q4_K_M-GGUF

8B • Updated Sep 11, 2024 • 12

TitanML/Qwen2-1.5B-Instruct-AWQ

Text Generation • 2B • Updated Sep 11, 2024 • 3

mradermacher/calme-2.2-llama3.1-70b-i1-GGUF

71B • Updated Sep 12, 2024 • 113

TitanML/Qwen2-0.5B-Instruct-AWQ

Text Generation • 0.6B • Updated Sep 11, 2024 • 3

TitanML/Qwen2-Math-1.5B

Text Generation • 2B • Updated Sep 11, 2024 • 2

antoste/Qwen2-7B-Instruct-Q2_K-GGUF

Text Generation • 8B • Updated Sep 11, 2024 • 1

TitanML/Qwen2-Math-1.5B-Instruct

Text Generation • 2B • Updated Sep 11, 2024 • 5

TitanML/Qwen2-Math-72B

Text Generation • 73B • Updated Sep 11, 2024 • 6

antoste/Qwen2-1.5B-Instruct-Q5_K_S-GGUF

Text Generation • 2B • Updated Sep 11, 2024 • 7