Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

27,443

Full-text search

Active filters: 8-bit

anil1002/unsloth_phi3-4bit_model

Text Generation • 2B • Updated May 30, 2024 • 4

Cheeezy/phi2-lora-summarization

2B • Updated May 30, 2024

Zoyd/xxx777xxxASD_L3-SnowStorm-v1.15-4x8B-A-8_0bpw_exl2

Text Generation • Updated May 30, 2024 • 1

Erinda/Chess_Mistral7b

7B • Updated Jun 5, 2024

MaziyarPanahi/Llama-3-8B-Instruct-v0.9-GGUF

Text Generation • 8B • Updated May 30, 2024 • 181 • 2

OhhTuRnz/train-KSPDG-Alpaca-LLaMA-Chat-8B-DoRA-16-8-adam_8bit_batch_2_gradient_2_LR_cosine_1e-4_8bit

Text Generation • 8B • Updated May 30, 2024 • 1

bavihao/whisper-AHao

Automatic Speech Recognition • Updated May 31, 2024

Zoyd/SenseLLM_ReflectionCoder-DS-6.7B-8_0bpw_exl2

Text Generation • Updated May 30, 2024 • 1

jburmeister/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • 71B • Updated May 30, 2024 • 57

Zoyd/CreitinGameplays_ConvAI-9b-v2-8_0bpw_exl2

Text Generation • Updated May 30, 2024 • 4

nm-testing/llama3-8b-w8_channel-a8_tensor-compressed

Text Generation • 8B • Updated Oct 9, 2024 • 4

Zoyd/OEvortex_HelpingAI-9B-8_0bpw_exl2

Text Generation • Updated May 31, 2024

Zoyd/failspy_Phi-3-medium-4k-instruct-abliterated-v3-8_0bpw_exl2

Text Generation • Updated May 31, 2024

phuongnv/retrosynthesis_8bit_16X

Feature Extraction • 8B • Updated Jul 9, 2024 • 1

Ali7538/EPFLLaMA_MCQA_Quantized

Text Generation • 1B • Updated May 31, 2024

Zoyd/Ppoyaa_LuminRP-13B-128k-v0.5-8_0bpw_exl2

Text Generation • Updated May 31, 2024 • 2

acl-srw-2024/llama3-8b-unsloth-sft-awq-8bit-v4

Text Generation • 8B • Updated May 31, 2024 • 6

Zoyd/xxx777xxxASD_L3-SnowStorm-v1.15-4x8B-B-8_0bpw_exl2

Text Generation • Updated May 31, 2024

hyunnnnnnnn/42dot_quantized

Text Generation • 1B • Updated Jun 3, 2024 • 3

acl-srw-2024/phi3-14b-unsloth-sft-gptq-8bit

Text Generation • Updated Jun 1, 2024

shrenikb/structuredSparseGPT

Text Generation • 7B • Updated Jun 1, 2024

bluuwhale/Llama-3-Lumimaid-8B-v0.1-OAS-8bpw-h8-exl2-rpcal

Text Generation • Updated Jun 1, 2024

cortecs/Mistral-7B-Instruct-v0.3-GPTQ-8b

Text Generation • Updated Jun 18, 2024 • 4 • 1

cortecs/Meta-Llama-3-8B-Instruct-GPTQ-8b

Text Generation • Updated Jun 18, 2024 • 4

anashr/Phi-3-mini-128k-instruct-8-bit

Text Generation • 4B • Updated Jun 1, 2024 • 6

Zoyd/LLM360_K2-Chat-8_0bpw_exl2

Text Generation • Updated Jun 1, 2024 • 1

Zoyd/jayasuryajsk_Llama-3-Ultron-8_0bpw_exl2

Text Generation • Updated Jun 1, 2024

Sinensis/Psyonic-Cetacean-Ultra-Quality-20b-8.0bpw-h8-exl2

Text Generation • Updated Jun 26, 2025 • 1

kim512/L3-70B-daybreak-storywriter-v0.4-8.0bpw-h8-exl2

Text Generation • Updated Jun 2, 2024

rubenamtz0/llama-3-8b-lora-law2entity

Updated Jun 4, 2024 • 3 • 1