Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

7,827

Base only

Active filters: th

Sumail/Meta-Llama-3.1-8B-Instruct-Q6_K-GGUF

Text Generation • 8B • Updated Sep 4, 2024 • 14

pruizpar/multilingual-e5-large-Q4_K_M-GGUF

Feature Extraction • 0.6B • Updated Sep 4, 2024 • 25

steveleancommerce/Meta-Llama-3.1-8B-Q4_K_M-GGUF

Text Generation • 8B • Updated Sep 4, 2024 • 8

Solshine/Llama-3.1-Storm-8B-Q2_K-GGUF

Text Generation • 8B • Updated Sep 5, 2024 • 25 • 1

Sumail/Meta-Llama-3.1-8B-Instruct-Q2_K-GGUF

Text Generation • 8B • Updated Sep 5, 2024 • 20

Sumail/Meta-Llama-3.1-8B-Instruct-Q3_K_S-GGUF

Text Generation • 8B • Updated Sep 5, 2024 • 3

Sumail/Meta-Llama-3.1-8B-Instruct-Q3_K_M-GGUF

Text Generation • 8B • Updated Sep 5, 2024 • 8

dungnasa/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Sep 5, 2024 • 2

b-r-ve/Meta-Llama-3.1-8B-Instruct-torchtune-fare-rule-all-airline-name-5-sep-2024

Text Generation • 8B • Updated Sep 5, 2024 • 5

Sumail/Meta-Llama-3.1-8B-Instruct-Q5_0-GGUF

Text Generation • 8B • Updated Sep 5, 2024 • 16

leafspark/Reflection-Llama-3.1-70B-GGUF

Text Generation • 71B • Updated Sep 10, 2024 • 656 • 26

tanliboy/Meta-Llama-3.1-8B-Instruct

Text Generation • 8B • Updated Sep 7, 2024 • 11 • • 1

phoner45/finetune-Question-Answer-thaiqa

Question Answering • 0.1B • Updated Sep 9, 2024 • 7 • 1

Sumail/Meta-Llama-3.1-8B-Instruct-Q5_K_M-GGUF

Text Generation • 8B • Updated Sep 6, 2024 • 10

PisutDeekub/CHATBOT-PJ-8B-LLAMA3-FINAL

Text Generation • 8B • Updated Sep 6, 2024 • 5

nnch/SambaLingo-Thai-Base-Q4_K_M-GGUF

7B • Updated Sep 6, 2024 • 4

nnch/SambaLingo-Thai-Base-Q8_0-GGUF

7B • Updated Sep 6, 2024 • 7

amgadhasan/sera-llama-3.1-8b-0.1

Text Generation • Updated Oct 24, 2024 • 4

leeloolee/intention

Sentence Similarity • 0.3B • Updated Sep 7, 2024 • 39 • 4

awilliamson/Meta-Llama-3.1-70B-Instruct-AWQ

Text Generation • 71B • Updated Sep 7, 2024 • 5

atsuki-yamaguchi/Llama-2-7b-hf-th-30K-focus

Text Generation • 7B • Updated Dec 5, 2025 • 2

atsuki-yamaguchi/Llama-2-7b-hf-th-30K-merge

Text Generation • 7B • Updated Dec 5, 2025 • 2

EchoMeow/Meta-Llama-3.1-8B-Q4_K_M-GGUF

Text Generation • 8B • Updated Sep 8, 2024 • 8

atsuki-yamaguchi/Llama-2-7b-hf-th-30K-mean

Text Generation • 7B • Updated Dec 5, 2025 • 3

north/llama3.1-8b-instruct-reference

Text Generation • 8B • Updated Mar 5, 2025 • 5

atsuki-yamaguchi/Llama-2-7b-hf-th-30K-rand

Text Generation • 7B • Updated Dec 5, 2025 • 2

atsuki-yamaguchi/Llama-2-7b-hf-th-30K-align

Text Generation • 7B • Updated Dec 5, 2025 • 3

async0x42/Meta-Llama-3.1-8B-exl2_5bpw

Text Generation • Updated Sep 8, 2024 • 5

FriendliAI/Meta-Llama-3.1-8B-Instruct-int8

Text Generation • 8B • Updated Sep 9, 2024 • 18.5k • 1

FriendliAI/Meta-Llama-3.1-70B-Instruct-int8

Text Generation • 71B • Updated Sep 9, 2024 • 10