Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

32,580

Base only

Active filters: 8-bit

SylvainShan/Qwen2SFT_GPTQ_8bits

Text Generation • 0.6B • Updated Jun 13, 2024 • 7

Douxe/quantizeTest

0.8B • Updated Jun 13, 2024 • 4

apry/best_8b

Text Generation • 4B • Updated Jun 14, 2024 • 5

kannn044/llama-3-8b-chat-doctor

Text Generation • 8B • Updated Jun 21, 2024 • 3

syrinenoamen/bnb_dpo_8bit

Text Generation • 3B • Updated Jun 14, 2024 • 5

pkalbhor/Meta-Llama-3-8B-Instruct-8bit

Text Generation • 8B • Updated Jun 14, 2024 • 7

marcosciala/pastanoodles_dpo_quant

Text Generation • 3B • Updated Jun 14, 2024 • 7

aerdna/phi2-q

Text Generation • 3B • Updated Jun 14, 2024 • 5

LouayN/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

Text Generation • 4B • Updated Jun 14, 2024 • 8

linxsxs/opt-125m-8bit

Text Generation • 0.1B • Updated Jun 14, 2024 • 5

bullerwins/Meta-Llama-3-8B-Instruct_exl2_8.0bpw

Text Generation • Updated Jun 14, 2024 • 4

broken-pipeline/MCQA-specialized-t5-base-int8

0.2B • Updated Jun 14, 2024 • 4

Douxe/quantizeTestThr1

Text Generation • 0.8B • Updated Jun 14, 2024 • 5

broken-pipeline/MCQA-specialized-aligned-t5-base-int8

0.2B • Updated Jun 14, 2024 • 6

nali24mai/base_quantized_model

Text Generation • 0.1B • Updated Jun 14, 2024 • 7

Douxe/Quantize_MCQA-SciQ

0.8B • Updated Jun 14, 2024 • 3

chrisswillss98/dpo_mcqa_BBQ_v1.02

Text Generation • 1B • Updated Jun 14, 2024 • 6

rombirli/q8

0.8B • Updated Jun 14, 2024 • 4

Peaky8linders/football_lora_axolotl

Updated Jun 17, 2024 • 2

TeeZee/BigMaid-20B-v2.0-bpw8.0-h8-exl2

Text Generation • Updated Jun 15, 2024 • 4

robertgshaw2/llama-3-w8a8-static-per-tensor-test

Text Generation • 8B • Updated Jun 15, 2024 • 7

robertgshaw2/llama-3-w8a8-dynamic-per-token-test

Text Generation • 8B • Updated Jun 15, 2024 • 7

grimjim/Llama-3-Oasis-v1-OAS-8B-8bpw_h8_exl2

Text Generation • Updated Aug 27, 2024 • 7

MaziyarPanahi/mergekit-slerp-oztfijl-GGUF

Text Generation • 7B • Updated Jun 15, 2024 • 503

MaziyarPanahi/EvoluzioneRed-GGUF

Text Generation • 7B • Updated Jun 15, 2024 • 11

MaziyarPanahi/mergekit-slerp-zwbosgo-GGUF

Text Generation • 8B • Updated Jun 15, 2024 • 10

MaziyarPanahi/Fimburs11V3-GGUF

Text Generation • 11B • Updated Jun 15, 2024 • 21

MaziyarPanahi/mergekit-passthrough-zpfenfn-GGUF

Text Generation • 23B • Updated Jun 15, 2024 • 115

TeeZee/DarkForest-20B-v3.0-bpw8.0-h8-exl2

Text Generation • Updated Jun 15, 2024 • 4

MaziyarPanahi/TopEvolution7RAG-GGUF

Text Generation • 7B • Updated Jun 15, 2024 • 42