Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,963

Base only

Active filters: bitsandbytes

Manju7/mistral-fmla_qa-Finetuned_with_quantv1

Text Generation • 7B • Updated Apr 15, 2024 • 11

axlesubash/phi2-email-qlora

Text Generation • 3B • Updated Apr 15, 2024 • 10

Jooonhan/mistral_7b_instruct_summarization_v2_merged_peft

Text Generation • 7B • Updated Apr 15, 2024 • 7

jaryong/llama-2-ko-7b-chat-itaz-v0.2

Text Generation • 7B • Updated Apr 15, 2024 • 8

RichardErkhov/HuggingFaceH4_-_starchat-alpha-4bits

Text Generation • 16B • Updated May 1, 2024 • 15

RichardErkhov/HuggingFaceH4_-_starchat-alpha-8bits

Text Generation • 16B • Updated May 1, 2024 • 13

daanjiri/Biomistral_7b_bhc_5

Text Generation • Updated Apr 15, 2024 • 8

sosoai/hansoldeco-mixtral-8x22b-4bit-v0.1

Text Generation • 145B • Updated Apr 15, 2024 • 9

dbaek111/Llama-2-7b-chat-hf-Elon_Interview_407-merged

Text Generation • 7B • Updated Apr 16, 2024

anupam413/phi2_qlora_emailGen_bitsandbytes

Text Generation • 3B • Updated Apr 17, 2024 • 11

bluedoumi/llama-2-7b-chat-hkcode-kor

Text Generation • 7B • Updated Apr 16, 2024 • 8

samyukthacodes/mental-health-mistral-7b-instructv0.2-finetuned-V2_merged

Text Generation • 7B • Updated Apr 16, 2024 • 8

dbaek111/Llama-2-7b-chat-hf-Elon_Interview_70-merged

Text Generation • 7B • Updated Apr 16, 2024

deepakdevfocaloid/the_comapny

Text Generation • Updated Apr 17, 2024

deepakdevfocaloid/outputs

Updated Apr 16, 2024 • 3

hananrh/gemma-2b-quotes

Text Generation • 3B • Updated Apr 16, 2024 • 9

udit-k/MentalHealth-Mistral7B

Text Generation • 7B • Updated Apr 16, 2024 • 8

BiswajitPadhi99/mistral-7b-finetuned-medical-summarizer-old

Text Generation • 7B • Updated Apr 16, 2024 • 9

sam2ai/gemma_odia_2b_v1

Updated Apr 17, 2024 • 5

Harsh1729/gemma2b-hotpotqa_uncertain-v1

Updated Apr 18, 2024 • 5

sosoai/hansoldeco-mixtral-8x22b-4bit-v0.2

Text Generation • 145B • Updated Apr 16, 2024 • 9

yiruiz/llama-2-13b-code-4bit-old

Text Generation • 13B • Updated Apr 16, 2024 • 8

alosmetria/llama-test-model

Text Generation • 7B • Updated Apr 17, 2024 • 7

daanjiri/Biomistral_7b_bhc_full

Text Generation • Updated Apr 19, 2024 • 7

YernazarBis/falcon-test-merged

Text Generation • 7B • Updated Apr 17, 2024 • 12

RichardErkhov/FredZhang7_-_anime-anything-promptgen-v2-4bits

Text Generation • 82.6M • Updated Apr 17, 2024 • 13

RichardErkhov/FredZhang7_-_distilgpt2-stable-diffusion-v2-4bits

Text Generation • 82.6M • Updated Apr 17, 2024 • 12

RichardErkhov/Norod78_-_hebrew-gpt_neo-small-4bits

Text Generation • 0.1B • Updated Apr 17, 2024 • 11

RichardErkhov/FredZhang7_-_distilgpt2-stable-diffusion-v2-8bits

Text Generation • 82M • Updated Apr 17, 2024 • 20

RichardErkhov/FredZhang7_-_anime-anything-promptgen-v2-8bits

Text Generation • 82M • Updated Apr 17, 2024 • 10