Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,382

Base only

Active filters: bitsandbytes

JeukHwang/roberta-base-squad2-i8-f16

Question Answering • 0.1B • Updated Dec 13, 2023

perevalov/AntModel-7B-XLLM-test-lcquad-1-Demo

Text Generation • 7B • Updated Dec 14, 2023 • 4

raowaqas123/hbl-test

Text Generation • 3B • Updated Dec 14, 2023 • 4

raowaqas123/hbl_v2

Text Generation • 3B • Updated Dec 14, 2023 • 5

LsTam/Mistral-7B-Instruct-v0.1-8bit

Text Generation • 7B • Updated Dec 14, 2023 • 32

pminha/roberta-base-squad-i8-f32-p5

Question Answering • 0.1B • Updated Dec 14, 2023 • 2

pminha/roberta-base-squad-i8-f32-p15

Question Answering • 0.1B • Updated Dec 14, 2023 • 3

pminha/roberta-base-squad-i8-f32-p20

Question Answering • 0.1B • Updated Dec 14, 2023 • 1

pminha/roberta-base-squad-i8-f32-p25

Question Answering • 0.1B • Updated Dec 14, 2023 • 1

pminha/roberta-base-squad-i8-f32-p30

Question Answering • 0.1B • Updated Dec 14, 2023 • 1

pminha/roberta-base-squad-i8-f32-p35

Question Answering • 0.1B • Updated Dec 14, 2023 • 1

LsTam/Mistral-7B-Instruct-v0.2-8bit

Text Generation • 7B • Updated Dec 14, 2023 • 1

pminha/roberta-base-squad-i8-f32-p10

Question Answering • 0.1B • Updated Dec 14, 2023 • 1

pminha/roberta-base-squad-i8-f32-p40

Question Answering • 0.1B • Updated Dec 14, 2023 • 2

pminha/roberta-base-squad-i8-f32-p45

Question Answering • 0.1B • Updated Dec 14, 2023 • 1

pminha/roberta-base-squad-i8-f32-p50

Question Answering • 0.1B • Updated Dec 14, 2023 • 1

pminha/roberta-base-squad-i8-f16-p5

Question Answering • 0.1B • Updated Dec 14, 2023 • 1

pminha/roberta-base-squad-i8-f16-p10

Question Answering • 0.1B • Updated Dec 14, 2023 • 2

pminha/roberta-base-squad-i8-f16-p15

Question Answering • 0.1B • Updated Dec 14, 2023 • 2

pminha/roberta-base-squad-i8-f16-p20

Question Answering • 0.1B • Updated Dec 14, 2023 • 2

pminha/roberta-base-squad-i8-f16-p25

Question Answering • 0.1B • Updated Dec 14, 2023 • 2

pminha/roberta-base-squad-i8-f16-p30

Question Answering • 0.1B • Updated Dec 14, 2023 • 2

pminha/roberta-base-squad-i8-f16-p35

Question Answering • 0.1B • Updated Dec 14, 2023 • 2

pminha/roberta-base-squad-i8-f16-p40

Question Answering • 0.1B • Updated Dec 14, 2023 • 2

pminha/roberta-base-squad-i8-f16-p45

Question Answering • 0.1B • Updated Dec 14, 2023 • 2

pminha/roberta-base-squad-i8-f16-p50

Question Answering • 0.1B • Updated Dec 14, 2023 • 2

humbertonc/mistral_test1

Text Generation • 7B • Updated Dec 14, 2023 • 3

adamo1139/small-test-run-Yi-34B-200K-AEZAKMI-TEST-0.15epoch

Text Generation • Updated Dec 23, 2023 • 2

pminha/roberta-base-squad-i8-f32-p55

Question Answering • 0.1B • Updated Dec 15, 2023 • 1

pminha/roberta-base-squad-i8-f32-p60

Question Answering • 0.1B • Updated Dec 15, 2023 • 1