Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,735

Base only

Active filters: meta

fbaldassarri/meta-llama_Llama-3.2-1B-Instruct-auto_round-int8-gs128-sym

Text Generation • 0.5B • Updated Jan 10, 2025 • 5

context-labs/Meta-Llama-3.1-8B-Instruct-FP16

Text Generation • 8B • Updated Jan 9, 2025 • 57 • • 1

Jaymon/Llama-3-MAAL-8B-Instruct-v0.1-Q8_0-GGUF

8B • Updated Jan 9, 2025 • 7

usman-khawar00/llama_model_testing1

Text Generation • Updated Jan 9, 2025

Liuzzyy/Llama-2-7b-chat-hf-Q4_K_M-GGUF

Text Generation • 7B • Updated Jan 9, 2025 • 13

Liuzzyy/Llama-2-13b-chat-hf-Q4_K_M-GGUF

Text Generation • 13B • Updated Jan 9, 2025 • 7

rdziubek/Llama-3.2-1B-Instruct-Q8_0-GGUF

Text Generation • 1B • Updated Jan 9, 2025 • 7

Yasar-02/LLAMA-3.1-8b-Instruct

Text Generation • 8B • Updated Jan 9, 2025 • 4

fbaldassarri/meta-llama_Llama-3.2-1B-Instruct-auto_gptq-int8-gs128-asym

Text Generation • 1B • Updated Jan 9, 2025 • 2

polyverse/Llama-3.2-3B-Q8_0-GGUF

Text Generation • 3B • Updated Jan 9, 2025 • 9

fbaldassarri/meta-llama_Llama-3.2-1B-Instruct-auto_gptq-int8-gs128-sym

Text Generation • 1B • Updated Jan 9, 2025 • 3

fbaldassarri/meta-llama_Llama-3.2-3B-auto_round-int8-gs128-sym

Text Generation • 1B • Updated Jan 9, 2025 • 3 • 1

BlackHillsInformationSecurity/Prompt-Guard-86M

Text Classification • 0.3B • Updated Jan 9, 2025 • 14

fbaldassarri/meta-llama_Llama-3.2-3B-auto_round-int8-gs128-asym

Text Generation • 1B • Updated Jan 9, 2025 • 3

kabriel/Llama-3.2-1B-Q4_K_M-GGUF

Text Generation • 1B • Updated Jan 10, 2025 • 7

kabriel/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Jan 10, 2025 • 4

mrcuddle/Lummimaid-v0.2-8B-Llama3.2Vision

Image-Text-to-Text • 11B • Updated Jan 12, 2025 • 4

mosuhy/Llama-3.1-8B-magpie-instruct-Nam-F-01

Text Generation • 8B • Updated Jan 10, 2025 • 3

fbaldassarri/meta-llama_Llama-3.2-3B-auto_gptq-int8-gs128-asym

Text Generation • 3B • Updated Jan 10, 2025 • 3

fbaldassarri/meta-llama_Llama-3.2-3B-auto_gptq-int8-gs128-sym

Text Generation • 3B • Updated Jan 10, 2025 • 2

fbaldassarri/meta-llama_Llama-3.2-3B-Instruct-auto_round-int8-gs128-asym

Text Generation • 1B • Updated Jan 10, 2025 • 3

triplee/torchtune_8B_full_ft_llama31_millfield_test_loss_250110_2e-6_15epoch_meta_before_user_epoch0

Text Generation • 8B • Updated Jan 10, 2025 • 2

triplee/torchtune_8B_full_ft_llama31_millfield_test_loss_250110_2e-6_15epoch_meta_before_user_epoch1

Text Generation • 8B • Updated Jan 10, 2025 • 5

triplee/torchtune_8B_full_ft_llama31_millfield_test_loss_250110_2e-6_15epoch_meta_before_user_epoch2

Text Generation • 8B • Updated Jan 10, 2025 • 5

mradermacher/Llama-3-70B-Instruct-Gradient-524k-GGUF

71B • Updated Jan 11, 2025 • 16

matrixportalx/Meta-Llama-3-8B-Instruct-Q5_K_M-GGUF

Text Generation • 8B • Updated Jan 10, 2025 • 11

matrixportalx/Meta-Llama-3-8B-Instruct-Q5_K_S-GGUF

Text Generation • 8B • Updated Jan 10, 2025 • 7

fbaldassarri/meta-llama_Llama-3.2-3B-Instruct-auto_round-int8-gs128-sym

Text Generation • 1B • Updated Jan 10, 2025 • 3

mradermacher/Llama-3-70B-Instruct-Gradient-1048k-GGUF

71B • Updated Jan 11, 2025 • 24

fbaldassarri/meta-llama_Llama-3.2-3B-Instruct-auto_gptq-int8-gs128-asym

Text Generation • 3B • Updated Jan 10, 2025 • 2