Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,922

Base only

Active filters: nvidia

roleplaiapp/AceInstruct-1.5B-Q3_K_L-GGUF

Text Generation • 2B • Updated Jan 19, 2025 • 2

roleplaiapp/AceInstruct-7B-Q3_K_L-GGUF

Text Generation • 8B • Updated Jan 19, 2025 • 5

roleplaiapp/AceInstruct-1.5B-Q4_0-GGUF

Text Generation • 2B • Updated Jan 19, 2025 • 13

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q5_K_S-GGUF

Text Generation • 71B • Updated Jan 19, 2025 • 26

roleplaiapp/AceInstruct-1.5B-Q4_K_S-GGUF

Text Generation • 2B • Updated Jan 19, 2025 • 4

roleplaiapp/AceInstruct-1.5B-Q4_K_M-GGUF

Text Generation • 2B • Updated Jan 19, 2025 • 10 • 1

roleplaiapp/AceInstruct-1.5B-Q5_0-GGUF

Text Generation • 2B • Updated Jan 19, 2025 • 2

roleplaiapp/AceInstruct-7B-Q4_0-GGUF

Text Generation • 8B • Updated Jan 19, 2025 • 5

roleplaiapp/AceInstruct-1.5B-Q5_K_S-GGUF

Text Generation • 2B • Updated Jan 19, 2025 • 2

roleplaiapp/AceInstruct-1.5B-Q5_K_M-GGUF

Text Generation • 2B • Updated Jan 19, 2025 • 5

roleplaiapp/AceInstruct-7B-Q4_K_S-GGUF

Text Generation • 8B • Updated Jan 19, 2025 • 4

roleplaiapp/AceInstruct-1.5B-Q6_K-GGUF

Text Generation • 2B • Updated Jan 19, 2025 • 4

roleplaiapp/AceInstruct-7B-Q4_K_M-GGUF

Text Generation • 8B • Updated Jan 19, 2025 • 1 • 1

roleplaiapp/AceInstruct-7B-Q5_0-GGUF

Text Generation • 8B • Updated Jan 19, 2025 • 3

roleplaiapp/AceInstruct-7B-Q5_K_S-GGUF

Text Generation • 8B • Updated Jan 19, 2025 • 2

roleplaiapp/AceInstruct-7B-Q5_K_M-GGUF

Text Generation • 8B • Updated Jan 19, 2025 • 4

roleplaiapp/AceInstruct-7B-Q6_K-GGUF

Text Generation • 8B • Updated Jan 19, 2025 • 5

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q5_K_M-GGUF

Text Generation • 71B • Updated Jan 19, 2025 • 11

roleplaiapp/AceInstruct-7B-Q8_0-GGUF

Text Generation • 8B • Updated Jan 19, 2025 • 3

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q6_K-GGUF

Text Generation • 71B • Updated Jan 19, 2025 • 30

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q8_0-GGUF

Text Generation • 71B • Updated Jan 19, 2025 • 19

inarikami/AceMath-72B-Instruct-GGUF

Text Generation • 73B • Updated Jan 22, 2025 • 35

nvidia/X-Mobility

Updated Feb 23, 2025 • 15

tensorblock/OpenMath2-Llama3.1-8B-GGUF

8B • Updated Jan 27 • 10

tensorblock/OpenMath2-Llama3.1-70B-GGUF

71B • Updated Jan 27 • 18

Nvidia-CMU25/DiffusionVideo2WorldGeneration

Feature Extraction • Updated Feb 12, 2025 • 7

mradermacher/OpenMath-CodeLlama-7b-Python-hf-GGUF

7B • Updated Feb 3, 2025 • 105

mradermacher/OpenMath-CodeLlama-13b-Python-hf-GGUF

13B • Updated Feb 3, 2025 • 128

mradermacher/OpenMath-CodeLlama-34b-Python-hf-GGUF

34B • Updated Jul 31, 2025 • 71

mradermacher/OpenMath-CodeLlama-13b-Python-hf-i1-GGUF

13B • Updated Feb 4, 2025 • 208