Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

189

Full-text search

Active filters: 8b

Triangle104/Llama3.1-8B-ShiningValiant2-Q5_K_M-GGUF

Text Generation • 8B • Updated Nov 24, 2024 • 17 • 1

Triangle104/Llama3.1-8B-ShiningValiant2-Q6_K-GGUF

Text Generation • 8B • Updated Nov 24, 2024 • 9 • 1

Triangle104/Llama3.1-8B-ShiningValiant2-Q8_0-GGUF

Text Generation • 8B • Updated Nov 24, 2024 • 5 • 1

itlwas/Kosmos-8B-v1-Q4_K_M-GGUF

8B • Updated Dec 18, 2024 • 8 • 1

itlwas/CursedMatrix-8B-v9-Q4_K_M-GGUF

8B • Updated Dec 18, 2024 • 5 • 1

QuantFactory/Multilingual-SaigaSuzume-8B-GGUF

8B • Updated Dec 21, 2024 • 111 • 2

Triangle104/Llama3.1-8B-PlumMath-Q4_K_S-GGUF

Text Generation • 8B • Updated Dec 26, 2024 • 11

Triangle104/Llama3.1-8B-PlumMath-Q4_K_M-GGUF

Text Generation • 8B • Updated Dec 26, 2024 • 10

Triangle104/Llama3.1-8B-PlumMath-Q5_K_S-GGUF

Text Generation • 8B • Updated Dec 26, 2024 • 10

Triangle104/Llama3.1-8B-PlumMath-Q6_K-GGUF

Text Generation • 8B • Updated Dec 26, 2024 • 14

Triangle104/Llama3.1-8B-PlumMath-Q5_K_M-GGUF

Text Generation • 8B • Updated Dec 26, 2024 • 9

Triangle104/Llama3.1-8B-PlumMath-Q8_0-GGUF

Text Generation • 8B • Updated Dec 26, 2024 • 12

matrixportalx/Kosmos-8B-v1-Q4_K_S-GGUF

8B • Updated Jan 3 • 9 • 2

matrixportalx/Multilingual-SaigaSuzume-8B-Q4_K_S-GGUF

8B • Updated Jan 3 • 26

matrixportalx/Kosmos-8B-v1-Q4_K_M-GGUF

8B • Updated Jan 9 • 17 • 2

matrixportalx/Kosmos-8B-v1-GGUF

8B • Updated Jan 13 • 10 • 1

matrixportalx/CursedMatrix-8B-v9-GGUF

8B • Updated Jan 14 • 33 • 1

Triangle104/Llama3.1-8B-PlumCode-Q4_K_S-GGUF

8B • Updated Jan 18 • 26

Triangle104/Llama3.1-8B-PlumCode-Q4_K_M-GGUF

8B • Updated Jan 18 • 28

Triangle104/Llama3.1-8B-PlumCode-Q5_K_S-GGUF

8B • Updated Jan 18 • 29

Triangle104/Llama3.1-8B-PlumCode-Q5_K_M-GGUF

8B • Updated Jan 18 • 25

Triangle104/Llama3.1-8B-PlumCode-Q6_K-GGUF

8B • Updated Jan 18 • 23

Triangle104/Llama3.1-8B-PlumCode-Q8_0-GGUF

8B • Updated Jan 18 • 15

roleplaiapp/internlm3-8b-instruct-Q2_K-GGUF

Text Generation • 9B • Updated Jan 19 • 13

roleplaiapp/internlm3-8b-instruct-Q3_K_S-GGUF

Text Generation • 9B • Updated Jan 19 • 18

roleplaiapp/internlm3-8b-instruct-Q3_K_M-GGUF

Text Generation • 9B • Updated Jan 19 • 12

roleplaiapp/internlm3-8b-instruct-Q3_K_L-GGUF

Text Generation • 9B • Updated Jan 19 • 19

roleplaiapp/internlm3-8b-instruct-Q4_0-GGUF

Text Generation • 9B • Updated Jan 19 • 11

roleplaiapp/internlm3-8b-instruct-Q4_K_S-GGUF

Text Generation • 9B • Updated Jan 19 • 11

roleplaiapp/internlm3-8b-instruct-Q4_K_M-GGUF

Text Generation • 9B • Updated Jan 19 • 11 • 1