Models

Abzu/mpt-7b-instruct-q8

Text Generation • 7B • Updated Jul 7, 2023 • 6 • 2

Abzu/mpt-7b-chat-q8

Text Generation • 7B • Updated Jul 7, 2023 • 7 • 1

Abzu/mpt-7b-storywriter-q8

Text Generation • 7B • Updated Jul 7, 2023 • 9 • 2

Abzu/mpt-30b-q8

Text Generation • 30B • Updated Jul 7, 2023 • 7 • 3

Abzu/mpt-30b-chat-q8

Text Generation • 30B • Updated Jul 7, 2023 • 5 • 1

Mediocreatmybest/blip2-opt-2.7b_8bit

Image-to-Text • 4B • Updated Aug 27, 2023 • 19 • 2

Mediocreatmybest/blip2-opt-6.7b_8bit

Image-to-Text • 8B • Updated Aug 27, 2023 • 5 • 1

Mediocreatmybest/blip2-flan-t5-xxl_8bit

Visual Question Answering • Updated Jul 9, 2023 • 23 • 2

gretelai/falcon-7b

Text Generation • Updated Jul 10, 2023 • 2

sgowdaks/falcon-40b-instruct-8bit

Updated Jul 11, 2023 • 4

rosyvs/whisat

Automatic Speech Recognition • Updated Apr 29, 2025 • 2 • 3

FabbriSimo01/GPT_Large_Quantized

Text Generation • Updated Jul 15, 2023 • 639

FabbriSimo01/Bloom_1b_Quantized

Text Generation • Updated Jul 15, 2023 • 628

FabbriSimo01/Facebook_opt_1.3b_Quantized

Text Generation • Updated Jul 15, 2023 • 645

FabbriSimo01/Cerebras_1.3b_Quantized

Text Generation • Updated Jul 15, 2023 • 641

vivekraina/Falcon-8bit-test

Text Generation • Updated Jul 19, 2023 • 1

trillionmonster/Baichuan-13B-Chat-8bit

Text Generation • Updated Jul 25, 2023 • 9 • 9

vivekraina/Llama-2-7b-hf-8bit

Text Generation • Updated Jul 20, 2023 • 1 • 3

guardrail/llama-2-7b-guanaco-8bit-sharded

Text Generation • Updated Jul 20, 2023 • 3 • 4

richardr1126/spider-skeleton-wizard-coder-8bit

Text Generation • Updated Jul 26, 2023 • 3 • 1

pligor/gr7.5b-dolly

Text Generation • Updated Jul 24, 2023 • 1 • 1

Mediocreatmybest/instructblip-vicuna-7b_8bit

Image-to-Text • 8B • Updated Nov 19, 2023 • 2 • 3

osiria/primo

Text Generation • Updated Aug 12, 2023 • 12 • 2

vivym/chatglm2-6b-int4

Text Generation • 3B • Updated Jul 27, 2023 • 2

0prodigy/axolotl

Text Generation • Updated Oct 17, 2023 • 4

Matsakitkat/Mobility_Future_expectation

Text Generation • Updated Aug 1, 2023 • 2

anhtunguyen98/flan-t5-xxl-8bit

Updated Jul 28, 2023 • 1

vivekraina/Llama-2-13b-chat-hf-8bit

Text Generation • Updated Jul 28, 2023 • 1

Mediocreatmybest/instructblip-vicuna-13b_8bit

Image-Text-to-Text • 14B • Updated Nov 19, 2023 • 2

TransformerTales/llama-2-7b-8bit-nested

Text Generation • Updated Aug 5, 2023 • 2 • 2