Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,823

Base only

Active filters: quantization

RyanLucas3/ptq-facebook_opt-1.3b-W4A4-lf5-seed1-final

Text Generation • 1B • Updated Jan 15 • 3

RyanLucas3/ptq-facebook_opt-1.3b-W4A4-lf50-seed1-final

Text Generation • 1B • Updated Jan 15 • 2

RyanLucas3/ptq-facebook_opt-1.3b-W6A6-lf0.5-seed1-final

Text Generation • 1B • Updated Jan 15 • 2

RyanLucas3/ptq-facebook_opt-1.3b-W6A6-lf1-seed1-final

Text Generation • 1B • Updated Jan 15 • 3

RyanLucas3/ptq-facebook_opt-1.3b-W6A6-lf10-seed1-final

Text Generation • 1B • Updated Jan 15 • 3

RyanLucas3/ptq-facebook_opt-1.3b-W6A6-lf2-seed1-final

Text Generation • 1B • Updated Jan 15 • 2

RyanLucas3/ptq-facebook_opt-1.3b-W6A6-lf25-seed1-final

Text Generation • 1B • Updated Jan 15 • 3

RyanLucas3/ptq-facebook_opt-1.3b-W6A6-lf5-seed1-final

Text Generation • 1B • Updated Jan 15 • 3

RyanLucas3/ptq-facebook_opt-1.3b-W6A6-lf50-seed1-final

Text Generation • 1B • Updated Jan 15 • 3

deepsky-ia/TinyLlama-1.1B-Chat-v1.0-GGUF-MacQuantized

Text Generation • 1B • Updated Jan 15 • 16

Luigi/Falcon-H1-Tiny-Multilingual-100M-Instruct-GGUF

0.1B • Updated Jan 16 • 63

Amlogic-NN/Qwen2.5-0.5B-Instruct_quant_i8

vipertsniper/DeepSeek-R1-Distill-Qwen-14B-NVFP4

Text Generation • 8B • Updated Jan 16 • 137

DexopT/gemma-3-1b-it-heretic-extreme-uncensored-abliterated-MNN

Text Generation • Updated Jan 16 • 13 • 1

DexopT/L3-Dark-Planet-8B-HERETIC-Uncensored-Abliterated-MNN

Text Generation • Updated Jan 16 • 5

DexopT/DS-R1-Qwen3-8B-ArliAI-RpR-v4-Small-MNN

Text Generation • Updated Jan 16 • 5

DexopT/DarkSapling-7B-v2.0-MNN

Text Generation • Updated Jan 16 • 3

Akicou/Qwen3-30B-A3B-Instruct-2507-REAM-GGUF

23B • Updated Feb 12 • 125 • 1

ryukin164/LFM2.5-1.2B-Q4-JP

Text Generation • 1B • Updated Jan 17 • 211 • 1

Akicou/INTELLECT-3-REAP-50-FP8-Dynamic

Text Generation • 57B • Updated Jan 17 • 3 • 1

crimsonmythos/translategemma-4b-it_w8a8_RK3588

Text Generation • Updated Jan 23 • 1 • 2

Akicou/INTELLECT-3-REAP-50-heretic-GGUF

57B • Updated Jan 25 • 55 • 2

uaebn/leesplank-municipal-GGUF

Text Generation • 2B • Updated Jan 22 • 12

Echo9Zulu/Shadows-Gemma-3-1B-F16-GGUF

1.0B • Updated Jan 22 • 8

JEILDLWLRMA/Qwen3VL-8B-Instruct-FP8

Image-to-Text • 9B • Updated Jan 20 • 10 • 1

jiminaa/Qwen3-1.7B-Q5KM-language-LoRA

2B • Updated Jan 20 • 2

dtometzki/Qwen3-VL-30B-A3B-Instruct-FP8-DYNAMIC

Image-Text-to-Text • 31B • Updated Jan 20 • 4

krisaujla/BitLinear

Other • Updated Jan 20 • 2

Shifusen/Qwen3-Next-80B-A3B-Instruct-Decensored-NVFP4

Text Generation • Updated Jan 21 • 2

tonera/zavychromaxl_v100

Text-to-Image • Updated Jan 23 • 5