Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

43,054

Base only

Active filters: bitsandbytes

RichardErkhov/akahana_-_gpt2-indonesia-4bits

Text Generation • 0.1B • Updated Apr 17, 2024 • 12 • 1

RichardErkhov/akahana_-_gpt2-indonesia-8bits

Text Generation • 0.1B • Updated Apr 17, 2024 • 15 • 1

RichardErkhov/akhooli_-_gpt2-small-arabic-4bits

Text Generation • 0.1B • Updated Apr 17, 2024 • 18

RichardErkhov/akhooli_-_gpt2-small-arabic-8bits

Text Generation • 0.1B • Updated Apr 17, 2024 • 19 • 1

RichardErkhov/antoinelouis_-_belgpt2-4bits

Text Generation • 0.1B • Updated Apr 17, 2024 • 9

RichardErkhov/antoinelouis_-_belgpt2-8bits

Text Generation • 0.1B • Updated Apr 17, 2024 • 12

RichardErkhov/aubmindlab_-_aragpt2-base-4bits

Text Generation • 0.1B • Updated Apr 17, 2024 • 11

RichardErkhov/aubmindlab_-_aragpt2-base-8bits

Text Generation • 0.1B • Updated Apr 17, 2024 • 16

RichardErkhov/aubmindlab_-_aragpt2-large-4bits

Text Generation • 0.8B • Updated Apr 17, 2024 • 16

RichardErkhov/aubmindlab_-_aragpt2-large-8bits

Text Generation • 0.8B • Updated Apr 17, 2024 • 11

Trubnik1967/zephyr-7b-beta-Agent-Instruct_v3

Text Generation • Updated May 7, 2024 • 17 • 1

adediu25/implicit-llama2-all

Text Generation • 7B • Updated Apr 17, 2024 • 9

samehfarouk/quantized_Mistral7B_v2_int8

Text Generation • 7B • Updated Apr 17, 2024 • 8

yyx123/Yi-6B-ruozhiba2

Updated May 6, 2024 • 8 • 1

yyx123/Yi-6B-zhihu2

Updated Apr 18, 2024 • 6

adediu25/subtle-llama2-all

Text Generation • 7B • Updated Apr 17, 2024 • 10

samehfarouk/Mistral-7B-Instruct-v0.2_int8

Text Generation • 7B • Updated Apr 17, 2024 • 7

prince-canuma/Mixtral-8x22B-Instruct-v0.1-4bit

Text Generation • 143B • Updated Apr 17, 2024 • 12

bogdanfloris/Mistral-7B-v0.1-4bit

Text Generation • 7B • Updated Apr 17, 2024 • 10

batprem/typhoon-med

Text Generation • Updated Apr 20, 2024 • 10

mistral-community/Mixtral-8x22B-Instruct-v0.1-4bit

Text Generation • 141B • Updated Jul 1, 2024 • 87 • 11

wintercoming6/Mixtral-7B-AIPI-finetune

Text Generation • 7B • Updated Apr 17, 2024 • 13

wintercoming6/Mixtral-7B-AIPI-finetune-with-8bit-quantization

Text Generation • 7B • Updated Apr 17, 2024 • 13

thanhnew2001/bank

Text Generation • 0.6B • Updated Apr 18, 2024 • 17

thanhnew2001/merged

Text Generation • 0.6B • Updated Apr 17, 2024 • 18

perceptorLLM/idefics2-8b-4bit-fp16

Image-Text-to-Text • 9B • Updated Apr 17, 2024 • 22

perceptorLLM/idefics2-8b-4bit-bf16

Image-Text-to-Text • 9B • Updated Apr 17, 2024 • 10

prince-canuma/mixtral-8x22b-instruct-oh-4bit

Text Generation • 143B • Updated Apr 18, 2024 • 13

thanhnew2001/bank2

Text Generation • 0.6B • Updated Apr 18, 2024 • 22

thanhnew2001/bank3

Text Generation • 3B • Updated Apr 18, 2024 • 18