Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,383

Base only

Active filters: bitsandbytes

Ti-ger/Qwen1.5-4B-CQIA

Text Generation • 4B • Updated Apr 23, 2024 • 11

RichardErkhov/meta-llama_-_CodeLlama-7b-Instruct-hf-4bits

Text Generation • 7B • Updated Apr 21, 2024 • 5

RichardErkhov/meta-llama_-_CodeLlama-7b-Instruct-hf-8bits

Text Generation • 7B • Updated Apr 21, 2024 • 3

yyx123/Yi-6B-ruozhiba4

Updated Apr 21, 2024 • 6

RichardErkhov/meta-llama_-_CodeLlama-13b-Instruct-hf-4bits

Text Generation • 13B • Updated Apr 21, 2024 • 1

yyx123/Yi-6B-zhihu5

Updated Apr 24, 2024 • 20

AmanBankoti/outputs_merged1

Text Generation • 7B • Updated Apr 21, 2024 • 4

RichardErkhov/meta-llama_-_CodeLlama-70b-hf-4bits

Text Generation • 70B • Updated Apr 21, 2024 • 4

RichardErkhov/meta-llama_-_CodeLlama-34b-hf-4bits

Text Generation • 34B • Updated Apr 21, 2024 • 1

palgraciel/Meta-Llama-3-8B-Instruct-leo-kor

Text Generation • 8B • Updated Apr 26, 2024 • 4

RichardErkhov/meta-llama_-_CodeLlama-34b-hf-8bits

Text Generation • 34B • Updated Apr 21, 2024 • 3

RichardErkhov/meta-llama_-_CodeLlama-34b-Instruct-hf-4bits

Text Generation • 34B • Updated Apr 21, 2024 • 3

RichardErkhov/meta-llama_-_CodeLlama-34b-Instruct-hf-8bits

Text Generation • 34B • Updated Apr 21, 2024 • 2

MatthieuO/Mistroll-v0.1

Updated Apr 21, 2024

chansung/coding_llamaduo_result3

Updated Apr 22, 2024 • 1

KvrParaskevi/Llama-2-7b-Hotel-Booking-Model-8Bit

Text Generation • 7B • Updated May 16, 2024 • 2

Rorical/0-roleplay

Text Generation • 15B • Updated Jun 11, 2024 • 34 • 5

failspy/InternVL-Chat-V1-5-8bit

Visual Question Answering • 26B • Updated Apr 22, 2024 • 41 • 2

failspy/InternVL-Chat-V1-5-4bit

Feature Extraction • 26B • Updated Apr 22, 2024 • 11 • 6

jeongmi/solar_insta_chai_80_final

Text Generation • Updated May 6, 2024 • 4

RichardErkhov/meta-llama_-_Meta-Llama-3-8B-4bits

Text Generation • 8B • Updated May 2, 2024 • 3

RichardErkhov/meta-llama_-_Meta-Llama-3-8B-Instruct-4bits

Text Generation • 8B • Updated May 2, 2024 • 18 • 1

RichardErkhov/meta-llama_-_Meta-Llama-3-8B-8bits

Text Generation • 8B • Updated May 2, 2024 • 3

RichardErkhov/meta-llama_-_Meta-Llama-3-8B-Instruct-8bits

Text Generation • 8B • Updated May 2, 2024 • 7

RichardErkhov/meta-llama_-_Meta-Llama-Guard-2-8B-4bits

Text Generation • 8B • Updated Apr 22, 2024 • 2

RichardErkhov/meta-llama_-_Meta-Llama-Guard-2-8B-8bits

Text Generation • 8B • Updated Apr 22, 2024 • 2

hellomyoh/ll3-8b-mtft-en-ko-en.v0.1

Text Generation • 8B • Updated Apr 22, 2024 • 4

manishiitg/open-aditi-chat-hi-1.28-llama3

Updated Apr 22, 2024 • 3

dattaraj/Gemma-2b-it-mental-health

Text Generation • 3B • Updated Apr 22, 2024 • 8 • 3

GCMcM2024/blip2-opt-2.7b-spanish-without-lora

Visual Question Answering • 4B • Updated Apr 22, 2024 • 3