Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,084

Base only

Active filters: bitsandbytes

Dogge/llama-3-translate-enko-4bit

Text Generation • 8B • Updated Apr 27, 2024 • 3 • 1

fxmeng/PiSSA-Llama-2-7B-r128-4bit-5iter

Text Generation • 7B • Updated Apr 27, 2024 • 4

clarkchan/llama3-8b-alpaca-gpt4-chinese

Text Generation • 8B • Updated Apr 29, 2024 • 4

amarard/FinetunedOrpoLlama-3-8B

Text Generation • 8B • Updated Apr 27, 2024 • 6

omertafveez/Gemma-TherapyChatBot

Text Generation • 3B • Updated Apr 27, 2024 • 3 • 1

RichardErkhov/NousResearch_-_Nous-Hermes-2-Mixtral-8x7B-SFT-4bits

Text Generation • 47B • Updated Apr 28, 2024 • 3

fergos80/mistral-sigoIAspirantes-Orca-oass-500-gpu

7B • Updated Apr 28, 2024 • 6

RichardErkhov/NousResearch_-_Genstruct-7B-4bits

Text Generation • 7B • Updated Apr 28, 2024 • 4

RichardErkhov/NousResearch_-_Genstruct-7B-8bits

Text Generation • 7B • Updated Apr 28, 2024 • 6

RichardErkhov/NousResearch_-_Nous-Hermes-2-Mixtral-8x7B-DPO-4bits

Text Generation • 47B • Updated Apr 28, 2024 • 2

jasdeep06/llama-7b-samsum

Text Generation • 7B • Updated Apr 28, 2024 • 1

RichardErkhov/NousResearch_-_Meta-Llama-3-8B-4bits

Text Generation • 8B • Updated Apr 28, 2024 • 1

RichardErkhov/NousResearch_-_Meta-Llama-3-8B-8bits

Text Generation • 8B • Updated Apr 28, 2024 • 4

dimakosttt/dziekanat2.0

Text Generation • Updated May 1, 2024 • 3

RichardErkhov/NousResearch_-_Meta-Llama-3-8B-Instruct-4bits

Text Generation • 8B • Updated Apr 28, 2024 • 4

RichardErkhov/NousResearch_-_Meta-Llama-3-8B-Instruct-8bits

Text Generation • 8B • Updated Apr 28, 2024 • 2

1093212290a/idefics-9b-doodles

Image-Text-to-Text • 9B • Updated Apr 28, 2024 • 6

RichardErkhov/NousResearch_-_Meta-Llama-3-70B-4bits

Text Generation • 72B • Updated Apr 28, 2024 • 1

sid-th26/gemma-mcq-question-all-data

Text Generation • 9B • Updated Apr 28, 2024 • 1

basakerdogan/cyber-jarvis-llama3-4bit

Text Generation • 7B • Updated Apr 28, 2024 • 1

zementalist/llama-3-8B-chat-psychotherapist

Text Generation • 8B • Updated Apr 29, 2024 • 11 • 30

bongodongo/phi-3-mini-4k-instruct-q4

Text Generation • 4B • Updated Apr 28, 2024 • 3 • 1

Alaa18/Assistant_chatbot_Mistral

Text Generation • 7B • Updated May 8, 2024 • 4 • 1

RichardErkhov/facebook_-_galactica-125m-4bits

Text Generation • 0.1B • Updated Apr 30, 2024 • 1

RichardErkhov/facebook_-_galactica-125m-8bits

Text Generation • 0.1B • Updated Apr 30, 2024 • 4

RichardErkhov/facebook_-_xglm-4.5B-4bits

Text Generation • 5B • Updated Apr 30, 2024 • 3

RichardErkhov/facebook_-_xglm-4.5B-8bits

Text Generation • 5B • Updated Apr 30, 2024 • 3

neotran/sdprompt_tiny_4bit

Text Generation • 1B • Updated Apr 28, 2024 • 2

dwb2023/mistral-7b-instruct-quantized

Text Generation • 7B • Updated Apr 29, 2024 • 3

dwb2023/Meta-Llama-3-8B-Instruct-quantized

Text Generation • 8B • Updated Apr 29, 2024 • 7 • 2