Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

33,153

Base only

Active filters: 8-bit

pminha/roberta-base-squad-i8-f16-p60

Question Answering • 0.1B • Updated Dec 15, 2023 • 3

pminha/roberta-base-squad-i8-f16-p65

Question Answering • 0.1B • Updated Dec 15, 2023 • 4

pminha/roberta-base-squad-i8-f16-p70

Question Answering • 0.1B • Updated Dec 15, 2023 • 4

pminha/roberta-base-squad-i8-f16-p75

Question Answering • 0.1B • Updated Dec 15, 2023 • 4

pminha/roberta-base-squad-i8-f16-p80

Question Answering • 0.1B • Updated Dec 15, 2023 • 4

pminha/roberta-base-squad-i8-f16-p85

Question Answering • 0.1B • Updated Dec 15, 2023 • 3

pminha/roberta-base-squad-i8-f16-p90

Question Answering • 0.1B • Updated Dec 15, 2023 • 4

pminha/roberta-base-squad-i8-f16-p95

Question Answering • 0.1B • Updated Dec 15, 2023 • 4

raowaqas123/hblv3

Text Generation • Updated Dec 15, 2023 • 6

allstax/CodeExplainer-7b-v0.1

Text Generation • 7B • Updated Dec 16, 2023 • 6

marcchew/LaMini-Flan-T5-248M-Orca-12.5K-4bit

0.2B • Updated Dec 15, 2023 • 9

marcchew/LaMini-T5-223M-8bit

0.2B • Updated Dec 15, 2023 • 4

marcchew/LaMini-T5-61M-8bit

60.6M • Updated Dec 15, 2023 • 5

igorktech/rugpt3-joker-150k-8bit

Text Generation • 0.1B • Updated Dec 16, 2023 • 7

lavawolfiee/Mixtral-8x7B-Instruct-v0.1-offloading-demo

Text Generation • 18B • Updated Dec 30, 2023 • 42 • 27

raowaqas123/hbl_v4

Text Generation • 1B • Updated Jan 8, 2024 • 5

mojuss/llama-2-7b-chat-faq

Text Generation • 7B • Updated Dec 19, 2023 • 3

mojuss/llama-2-7b-chat-guanaco

Text Generation • 7B • Updated Dec 19, 2023 • 6

atgctg/overfit-humaneval

Text Generation • Updated Dec 19, 2023 • 8 • 1

Chung-Hsiung/Llama2-7b-finetuned

Text Generation • 7B • Updated Dec 20, 2023 • 6

xavierbarbier/mistral-7b-instruct-v0.1-hf-quant

Text Generation • 7B • Updated Dec 20, 2023 • 5

jak414/liedetect4_chat8bit_33mln

Updated Feb 2, 2024 • 2

monology/Mistral-7B-Instruct-v0.2-8bit

Text Generation • 7B • Updated Dec 20, 2023 • 6

ramy21/tinyllama2

Text Generation • 1B • Updated Dec 22, 2023 • 10 • 1

Bobblack225/intstep

Text Generation • 2B • Updated Dec 23, 2023 • 7

Yihsiu/hw-01

Text Generation • 67M • Updated Feb 25, 2024 • 9

LarryTW/LLM_HW2

Text Generation • 7B • Updated Dec 23, 2023 • 6

jkloip/cm124057-02

Text Generation • 7B • Updated Dec 23, 2023 • 6

LiamLi1991/HW02

7B • Updated Dec 28, 2023 • 5

wsyar/llmhw02

Text Generation • 7B • Updated Dec 28, 2023 • 5