Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,959

Base only

Active filters: bitsandbytes

RichardErkhov/meta-llama_-_CodeLlama-34b-hf-8bits

Text Generation • 34B • Updated Apr 21, 2024 • 14

RichardErkhov/meta-llama_-_CodeLlama-34b-Instruct-hf-4bits

Text Generation • 34B • Updated Apr 21, 2024 • 9

RichardErkhov/meta-llama_-_CodeLlama-34b-Instruct-hf-8bits

Text Generation • 34B • Updated Apr 21, 2024 • 11

MatthieuO/Mistroll-v0.1

Updated Apr 21, 2024 • 3

chansung/coding_llamaduo_result3

Updated Apr 22, 2024 • 11

KvrParaskevi/Llama-2-7b-Hotel-Booking-Model-8Bit

Text Generation • 7B • Updated May 16, 2024 • 9

Rorical/0-roleplay

Text Generation • 15B • Updated Jun 11, 2024 • 24 • 5

failspy/InternVL-Chat-V1-5-8bit

Visual Question Answering • 26B • Updated Apr 22, 2024 • 12 • 2

failspy/InternVL-Chat-V1-5-4bit

Feature Extraction • 26B • Updated Apr 22, 2024 • 9 • 6

jeongmi/solar_insta_chai_80_final

Text Generation • Updated May 6, 2024 • 10

RichardErkhov/meta-llama_-_Meta-Llama-3-8B-4bits

Text Generation • 8B • Updated May 2, 2024 • 9

RichardErkhov/meta-llama_-_Meta-Llama-3-8B-Instruct-4bits

Text Generation • 8B • Updated May 2, 2024 • 16 • 1

RichardErkhov/meta-llama_-_Meta-Llama-3-8B-8bits

Text Generation • 8B • Updated May 2, 2024 • 8

RichardErkhov/meta-llama_-_Meta-Llama-3-8B-Instruct-8bits

Text Generation • 8B • Updated May 2, 2024 • 39

RichardErkhov/meta-llama_-_Meta-Llama-Guard-2-8B-4bits

Text Generation • 8B • Updated Apr 22, 2024 • 10

RichardErkhov/meta-llama_-_Meta-Llama-Guard-2-8B-8bits

Text Generation • 8B • Updated Apr 22, 2024 • 15

hellomyoh/ll3-8b-mtft-en-ko-en.v0.1

Text Generation • 8B • Updated Apr 22, 2024 • 11

manishiitg/open-aditi-chat-hi-1.28-llama3

Updated Apr 22, 2024 • 4

dattaraj/Gemma-2b-it-mental-health

Text Generation • 3B • Updated Apr 22, 2024 • 10 • 3

GCMcM2024/blip2-opt-2.7b-spanish-without-lora

Visual Question Answering • 4B • Updated Apr 22, 2024 • 10

srirambhavadish/Mixtral_arxt_v1

Text Generation • 7B • Updated Apr 22, 2024

Rhma/mistral_7b_fine-tuned-kaggle

Text Generation • 8B • Updated Apr 22, 2024 • 9

jeongmi/solar_musinsa_user111_100

Text Generation • 11B • Updated Apr 22, 2024 • 7

JeromeMore/Meta-Llama-3-8B-Instruct-bnb_4bit

Text Generation • 8B • Updated Apr 22, 2024 • 9

JeromeMore/Meta-Llama-3-8B-Instruct-bnb_8bit

Text Generation • 8B • Updated Apr 22, 2024 • 7

TachyHealthResearch/Llama3-Medical-Finetune_QA_MCQ

8B • Updated Apr 25, 2024 • 3 • 1

Rhma/llama2_7b-hf_finetuned-kaggle

Text Generation • 7B • Updated May 2, 2024 • 8

RichardErkhov/sophosympatheia_-_Midnight-Miqu-70B-v1.5-4bits

Text Generation • 70B • Updated Apr 22, 2024 • 7

IAVYang/modified_model

Text Generation • 8B • Updated Apr 22, 2024

gechim/vinallama-Q_4-ft-QAhealth

Text Generation • 3B • Updated Apr 22, 2024 • 8