Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,960

Base only

Active filters: bitsandbytes

RichardErkhov/NousResearch_-_Genstruct-7B-8bits

Text Generation • 7B • Updated Apr 28, 2024 • 6

RichardErkhov/NousResearch_-_Nous-Hermes-2-Mixtral-8x7B-DPO-4bits

Text Generation • 47B • Updated Apr 28, 2024 • 14

jasdeep06/llama-7b-samsum

Text Generation • 7B • Updated Apr 28, 2024 • 7

RichardErkhov/NousResearch_-_Meta-Llama-3-8B-4bits

Text Generation • 8B • Updated Apr 28, 2024 • 9

RichardErkhov/NousResearch_-_Meta-Llama-3-8B-8bits

Text Generation • 8B • Updated Apr 28, 2024 • 7

dimakosttt/dziekanat2.0

Text Generation • Updated May 1, 2024 • 7

RichardErkhov/NousResearch_-_Meta-Llama-3-8B-Instruct-4bits

Text Generation • 8B • Updated Apr 28, 2024 • 8

RichardErkhov/NousResearch_-_Meta-Llama-3-8B-Instruct-8bits

Text Generation • 8B • Updated Apr 28, 2024 • 10

1093212290a/idefics-9b-doodles

Image-Text-to-Text • 9B • Updated Apr 28, 2024 • 9

RichardErkhov/NousResearch_-_Meta-Llama-3-70B-4bits

Text Generation • 72B • Updated Apr 28, 2024 • 8

sid-th26/gemma-mcq-question-all-data

Text Generation • 9B • Updated Apr 28, 2024 • 7

basakerdogan/cyber-jarvis-llama3-4bit

Text Generation • 7B • Updated Apr 28, 2024 • 13

zementalist/llama-3-8B-chat-psychotherapist

Text Generation • 8B • Updated Apr 29, 2024 • 5 • 30

bongodongo/phi-3-mini-4k-instruct-q4

Text Generation • 4B • Updated Apr 28, 2024 • 12 • 1

Alaa18/Assistant_chatbot_Mistral

Text Generation • 7B • Updated May 8, 2024 • 11 • 1

RichardErkhov/facebook_-_galactica-125m-4bits

Text Generation • 0.1B • Updated Apr 30, 2024 • 17

RichardErkhov/facebook_-_galactica-125m-8bits

Text Generation • 0.1B • Updated Apr 30, 2024 • 13

RichardErkhov/facebook_-_xglm-4.5B-4bits

Text Generation • 5B • Updated Apr 30, 2024 • 11

RichardErkhov/facebook_-_xglm-4.5B-8bits

Text Generation • 5B • Updated Apr 30, 2024 • 13

neotran/sdprompt_tiny_4bit

Text Generation • 1B • Updated Apr 28, 2024 • 10

dwb2023/mistral-7b-instruct-quantized

Text Generation • 7B • Updated Apr 29, 2024 • 7

dwb2023/Meta-Llama-3-8B-Instruct-quantized

Text Generation • 8B • Updated Apr 29, 2024 • 12 • 2

moetezsa/test

Text Generation • 8B • Updated Apr 29, 2024 • 9

Ramikan-BR/tinyllama_PY-CODER-bnb-4bit-lora_4k-v2_q4_k_m

Text Generation • Updated May 1, 2024 • 8

chansung/llamaduo_synth_ds_v0.1

Updated Apr 30, 2024 • 5 • 1

Aharneish/Llama-Chat-final_merged

Text Generation • 7B • Updated Apr 29, 2024 • 8

RichardErkhov/NousResearch_-_Hermes-2-Pro-Mistral-7B-4bits

Text Generation • 7B • Updated Apr 29, 2024 • 10

nayan8625/llama3-8b-ymhafinetuned

Text Generation • 8B • Updated Apr 29, 2024 • 8

RyotaKadoya1993/PEFT-MoE2

Text Generation • 6B • Updated Apr 29, 2024 • 10

rainjay/Meta-Llama-3-8B-Instruct-4bit

Text Generation • 8B • Updated May 8, 2024 • 11