Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

9,468

Base only

Active filters: multilingual

OpenGVLab/InternVL2_5-38B-AWQ

Image-Text-to-Text • Updated Sep 11, 2025 • 489 • 9

jayakody2000lk/flan-t5-small-Q4_K_M-GGUF

77M • Updated Nov 21, 2024 • 7

jayakody2000lk/flan-t5-large-Q5_K_M-GGUF

0.8B • Updated Nov 21, 2024 • 15

ftshijt/espnet_codec_dac_large_v1.4_360epoch

Updated Nov 21, 2024 • 13

ftshijt/espnet_codec_dac_large_v1.6_240epoch

Updated Nov 21, 2024 • 1

NbAiLab/nb-llama-3.2-1B

Text Generation • 1B • Updated Dec 11, 2024 • 13 • • 3

NbAiLab/nb-llama-3.2-1B-Q4_K_M-GGUF

Text Generation • 1B • Updated Dec 11, 2024 • 26 • 1

NbAiLab/nb-llama-3.2-3B-Q4_K_M-GGUF

Text Generation • 3B • Updated Dec 11, 2024 • 13

typhoon-ai/typhoon2-safety-preview

Text Classification • 0.3B • Updated Mar 31, 2025 • 118 • 5

entai2965/small100-ctranslate2

Translation • Updated Nov 21, 2024 • 16

NbAiLab/nb-llama-3.1-8B-Q4_K_M-GGUF

Text Generation • 8B • Updated Dec 11, 2024 • 25 • 1

agkavin/t5-small-Q4_K_M-GGUF

Translation • 60.5M • Updated Nov 21, 2024 • 20

agkavin/t5-small-Q8_0-GGUF

Translation • 60.5M • Updated Nov 21, 2024 • 22 • 2

bartowski/NuExtract-1.5-smol-GGUF

Text Generation • 2B • Updated Nov 21, 2024 • 518 • 3

prithivMLmods/Marco-o1-GGUF

Text Generation • 8B • Updated Dec 5, 2024 • 143 • 6

andrewqian123/MiniCPM-V-2_6

Image-Text-to-Text • 8B • Updated Nov 29, 2024 • 12

stepfun-ai/GOT-OCR-2.0-hf

Image-Text-to-Text • 0.6B • Updated Jan 31, 2025 • 258k • 232

mnsoylemez/flan_t5_finetuned_further_projectmanagement

0.2B • Updated Nov 26, 2024

NbAiLab/nb-llama-3.1-8B-sft

Text Generation • 8B • Updated Dec 11, 2024 • 9

sail/Sailor2-1B-Pre

Text Generation • 1.0B • Updated Feb 20, 2025 • 8

sail/Sailor2-20B-Pre

Text Generation • 19B • Updated Apr 29, 2025 • 3

sail/Sailor2-8B-Pre

Text Generation • 9B • Updated Feb 20, 2025 • 7

tensorblock/NuExtract-1.5-tiny-GGUF

Text Generation • 0.5B • Updated Jan 27 • 28

jonyee/flan-t5-large-Q4_K_M-GGUF

0.8B • Updated Nov 26, 2024 • 11

quveex/flan2

77M • Updated Nov 26, 2024 • 2

tensorblock/NuExtract-tiny-v1.5-GGUF

Text Generation • 0.5B • Updated Jan 27 • 18

OpenGVLab/InternVL2-Pretrain-Models

Image-Text-to-Text • Updated Mar 25, 2025 • 12

NbAiLab/nb-notram-llama-3.3-70b-instruct

Text Generation • 71B • Updated Jan 9 • 40

mlx-community/numind-NuExtract-1.5-MLX-8bit

Text Generation • Updated Nov 27, 2024 • 52 • 2

tensorblock/NuExtract-1.5-smol-GGUF

Text Generation • 2B • Updated Jan 27 • 40