Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

27,423

Full-text search

Active filters: 8-bit

BigHuggyD/sophosympatheia_New-Dawn-Llama-3-70B-32K-v1.0_exl2_8.0bpw_h8

Text Generation • Updated Jun 25, 2024 • 1

nm-testing/Meta-Llama-3-8B-Instruct-W8-Channel-A8-Dynamic-Per-Token-Test

Text Generation • 8B • Updated Oct 9, 2024 • 66

BornSaint/open_cabra-pt-br-3B_v2_base_model

Text Generation • 3B • Updated Jun 25, 2024

BigHuggyD/alpindale_magnum-72b-v1_exl2_8.0bpw_h8

Text Generation • Updated Jun 26, 2024 • 1

Truepeak/ORPO-PM01-0.4-full

Feature Extraction • 8B • Updated Jun 26, 2024

Peaky8linders/isafpr-tiny-llama-lora

Updated Jun 27, 2024

unclecode/folrence-2-8bit

Image-Text-to-Text • 0.8B • Updated Jun 26, 2024 • 4

unclecode/folrence-2-large-8bit

Image-Text-to-Text • 0.8B • Updated Jun 26, 2024 • 1

bullerwins/Llama-3-Instruct-8B-SPPO-Iter3-exl2_8.0bpw

Text Generation • Updated Jun 26, 2024 • 1

bjaidi/Phi-3-medium-128k-instruct-GPTQ-8-bit-c4

Text Generation • 14B • Updated Jun 26, 2024 • 4

bjaidi/Phi-3-medium-128k-instruct-c4-32

Text Generation • 14B • Updated Jun 26, 2024 • 5

kurcontko/flan-t5-xxl-lora-samsum

11B • Updated Jun 27, 2024 • 1

MaziyarPanahi/calme-2.1-qwen2-72b-GGUF

Text Generation • 73B • Updated Aug 2, 2024 • 93 • 13

John6666/gokaygokay-Florence-2-SD3-Captioner-8bit

Image-Text-to-Text • 0.3B • Updated Jun 27, 2024 • 2 • 2

Persival123/appleHelper-mistral-7b-finetuned

Text Generation • 7B • Updated Jun 27, 2024 • 5

zero-one-01/llama3-8b-config

Text Generation • 5B • Updated Jun 27, 2024

vessl/gemma-2b-gptq-8bit

Text Generation • 3B • Updated Jun 27, 2024 • 5

bullerwins/L3-Aethora-15B-V2-exl2_8.0bpw

Text Generation • Updated Jun 27, 2024 • 3 • 1

Peaky8linders/isafpr-mistral-lora

Updated Jun 27, 2024

MaziyarPanahi/calme-2.1-qwen2-7b-GGUF

Text Generation • 8B • Updated Jul 21, 2024 • 38

iaincambeul/mistral-7b-instruct-v0.2-imp-fm

Updated Jun 27, 2024

MaziyarPanahi/calme-2.2-qwen2-7b-GGUF

Text Generation • 8B • Updated Jul 21, 2024 • 31 • 1

Sourabh2/Alphace_email

Text Generation • Updated Jun 27, 2024 • 2

MaziyarPanahi/calme-2.3-qwen2-7b-GGUF

Text Generation • 8B • Updated Jul 21, 2024 • 76 • 2

MaziyarPanahi/calme-2.4-qwen2-7b-GGUF

Text Generation • 8B • Updated Jul 21, 2024 • 58 • 1

bullerwins/Hermes-2-Theta-Llama-3-70B-32k-exl2_8.0bpw

Text Generation • Updated Jun 27, 2024 • 3 • 1

MaziyarPanahi/calme-2.5-qwen2-7b-GGUF

Text Generation • 8B • Updated Jul 21, 2024 • 57 • 1

MaziyarPanahi/calme-2.6-qwen2-7b-GGUF

Text Generation • 8B • Updated Jul 21, 2024 • 47 • 1

MaziyarPanahi/calme-2.7-qwen2-7b-GGUF

Text Generation • 8B • Updated Jul 21, 2024 • 48 • 1

MaziyarPanahi/calme-2.8-qwen2-7b-GGUF

Text Generation • 8B • Updated Jul 21, 2024 • 86 • 3