Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

32,576

Base only

Active filters: 8-bit

Zoyd/mlabonne_Meta-Llama-3-12B-Instruct-8_0bpw_exl2

Text Generation • Updated May 25, 2024 • 6

Zoyd/xxx777xxxASD_L3_SnowStorm_4x8B-8_0bpw_exl2

Text Generation • Updated May 25, 2024 • 3

kamrr/tinyllama-1.1B_alpaca_2k_lora

Updated May 25, 2024 • 7

kamrr/tinyllama-1.1B_dolly-3k_lora

Updated May 25, 2024 • 6

zahidpichen/Fine-Tuned-LLM-model

Updated May 25, 2024 • 1

FuturisticVibes/aya-23-35B-8.0bpw-h8-exl2

Text Generation • Updated May 25, 2024 • 4

altomek/YiSM-34B-0rn-8bpw-EXL2

Text Generation • Updated Aug 30, 2024 • 4

FuturisticVibes/Llama-3-70B-Instruct-abliterated-v3-8.0bpw-h8-exl2

Text Generation • Updated Jan 7 • 10

Zoyd/failspy_Smaug-Llama-3-70B-Instruct-abliterated-v3-8_0bpw_exl2

Text Generation • Updated May 26, 2024 • 3

shubham24/CodeLlama-7b-hf-manim-fine-tuned

Updated May 26, 2024 • 5

Zoyd/openchat_openchat-3.6-8b-20240522-8_0bpw_exl2

Text Generation • Updated May 26, 2024 • 9 • 2

Zoyd/NousResearch_Hermes-2-Theta-Llama-3-8B-8_0bpw_exl2

Text Generation • Updated May 26, 2024 • 5

cortecs/Smaug-Llama-3-70B-Instruct-GPTQ-8b

Text Generation • Updated Jun 10, 2024 • 4 • 1

Zoyd/flammenai_Mahou-1.2-phi-14B-8_0bpw_exl2

Text Generation • Updated May 26, 2024 • 8

rhysjones/Phi-3-mini-mango-1-GGUF

Text Generation • 4B • Updated May 26, 2024 • 89 • 1

Zoyd/cypienai_cymist-2-v03-SFT-8_0bpw_exl2

Text Generation • Updated May 26, 2024 • 3

Zoyd/Delcos_Velara-11B-v3-8_0bpw_exl2

Text Generation • Updated May 26, 2024 • 4

RemVdH/test-model-ft-tinylama

Updated May 26, 2024 • 4

koshnick/tinyllama-1.1B_alpaca_2k_lora

Updated May 27, 2024 • 4

nassersala/lora-color-tiny

Updated May 27, 2024 • 2

Zoyd/TheSkullery_Aura-Llama-Abliterated-8_0bpw_exl2

Text Generation • Updated May 27, 2024 • 4

Zoyd/prince-canuma_Llama-3-6B-v0.1-8_0bpw_exl2

Text Generation • Updated May 27, 2024 • 6

Zoyd/mlabonne_Daredevil-8B-8_0bpw_exl2

Text Generation • Updated May 27, 2024 • 5

Zoyd/giannisan_Mistral-10.7B-Instruct-v0.3-depth-upscaling-8_0bpw_exl2

Text Generation • Updated May 27, 2024 • 6

Zoyd/JetBrains_CodeLlama-7B-KStack-clean-8_0bpw_exl2

Text Generation • Updated May 27, 2024 • 4

Aditya1947/Kannada_Finetuned_LLama

Text Generation • Updated May 31, 2024 • 4

Klevin/Decyphers-2b-v0

Text Generation • 2B • Updated May 27, 2024 • 4

Zoyd/flammenai_Mahou-1.2a-llama3-8B-8_0bpw_exl2

Text Generation • Updated May 27, 2024 • 4

Zoyd/RESMPDEV_Qwen1.5-Wukong-4B-8_0bpw_exl2

Text Generation • Updated May 27, 2024 • 5

Abdulhanan2006/LogicLumina

Text Generation • 22B • Updated May 28, 2024 • 5