Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

32,583

Base only

Active filters: 8-bit

RichardErkhov/guardrail_-_llama-2-7b-guanaco-instruct-sharded-8bits

Text Generation • 7B • Updated May 18, 2024 • 4

RichardErkhov/dhmeltzer_-_llama-7b-SFT_eli5_wiki65k_1024_r_64_alpha_16_merged-8bits

Text Generation • 7B • Updated May 18, 2024 • 3

RichardErkhov/RubielLabarta_-_LogoS-7Bx2-MoE-13B-v0.2-8bits

Text Generation • 13B • Updated May 18, 2024 • 6

RichardErkhov/alnrg2arg_-_blockchainlabs_7B_merged_test2_4_prune-8bits

Text Generation • 7B • Updated May 18, 2024 • 6

LoneStriker/Master-Yi-9B-8.0bpw-h8-exl2

Text Generation • Updated May 18, 2024 • 3 • 2

bdambrosio/dolphin-2.9.1-yi-1.5-34b-8.0bit-exl2

Text Generation • Updated May 18, 2024 • 13

RichardErkhov/aari1995_-_germeo-7b-laser-8bits

Text Generation • 7B • Updated May 18, 2024 • 4

MaziyarPanahi/Llama-3-70B-Instruct-v0.1-GGUF

Text Generation • 71B • Updated May 19, 2024 • 71 • 1

RichardErkhov/mlabonne_-_NeuralMarcoro14-7B-8bits

Text Generation • 7B • Updated May 18, 2024 • 4

madgrizzle/starsnatched-MemGPT-DPO-MoE-test-exl2

Text Generation • Updated May 19, 2024 • 4

RichardErkhov/malhajar_-_Mistral-7B-v0.2-meditron-turkish-8bits

Text Generation • 7B • Updated May 19, 2024 • 4

RichardErkhov/PracticeLLM_-_SOLAR-tail-10.7B-Merge-v1.0-8bits

Text Generation • 11B • Updated May 19, 2024 • 4

RichardErkhov/leveldevai_-_TurdusBeagle-7B-8bits

Text Generation • 7B • Updated May 19, 2024 • 4

RichardErkhov/core-3_-_kuno-royale-7B-8bits

Text Generation • 7B • Updated May 19, 2024 • 5

Zoyd/TIGER-Lab_MAmmoTH2-8x7B-Plus-8_0bpw_exl2

Text Generation • Updated May 19, 2024 • 4

RichardErkhov/ghost-x_-_ghost-7b-alpha-8bits

Text Generation • 7B • Updated May 19, 2024 • 4

RichardErkhov/lemon-mint_-_gemma-7b-openhermes-v0.80-8bits

Text Generation • 9B • Updated May 19, 2024 • 4

RichardErkhov/alexsherstinsky_-_Mistral-7B-v0.1-sharded-8bits

Text Generation • 7B • Updated May 19, 2024 • 4

RichardErkhov/maywell_-_PiVoT-10.7B-Mistral-v0.2-8bits

Text Generation • 11B • Updated May 19, 2024 • 4

RichardErkhov/beomi_-_gemma-ko-7b-8bits

Text Generation • 9B • Updated May 19, 2024 • 4

RichardErkhov/jambroz_-_sixtyoneeighty-7b-8bits

Text Generation • 7B • Updated May 19, 2024 • 5

RichardErkhov/garage-bAInd_-_Platypus2-13B-8bits

Text Generation • 13B • Updated May 19, 2024 • 6

MehdiHosseiniMoghadam/AVA-Qwen1.5-7B-Chat-gptq-8bit

Text Generation • 8B • Updated May 19, 2024 • 6

RichardErkhov/Rijgersberg_-_GEITje-7B-8bits

Text Generation • 7B • Updated May 19, 2024 • 5

RichardErkhov/maywell_-_Synatra-RP-Orca-2-7b-v0.1-8bits

Text Generation • 7B • Updated May 20, 2024 • 4

RichardErkhov/dreamgen_-_WizardLM-2-7B-8bits

Text Generation • 7B • Updated May 20, 2024 • 5

altomek/Yi-1.5-34B-8bpw-EXL2

Text Generation • Updated Aug 30, 2024 • 4

Zoyd/01-ai_Yi-1.5-9B-Chat-16K-8_0bpw_exl2

Text Generation • Updated May 20, 2024 • 4

chrisx01/tsetse-42

Text Generation • 7B • Updated May 20, 2024 • 5

Zoyd/01-ai_Yi-1.5-9B-32K-8_0bpw_exl2

Text Generation • Updated May 20, 2024 • 4