Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

33,301

Base only

Active filters: 8-bit

udemex10/Vojo_AI_LLMforCAD_v1.0

7B • Updated Dec 8, 2023 • 4

stakuma/dummy-model

Automatic Speech Recognition • Updated Dec 8, 2023 • 4

alexkarpekov/llama-2-7b-alexkarpekov-alpaca-lora-v2

Text Generation • Updated Dec 8, 2023 • 5

kurtn718/letter-scramble-1

7B • Updated Dec 9, 2023 • 3

one-man-army/una-xaberius-34b-v1beta-8bit-16k

Text Generation • 34B • Updated Dec 9, 2023 • 7 • 1

TachyHealth/Thealth-Thealth-notus-7b_v1

Text Generation • 7B • Updated Dec 10, 2023 • 7

TachyHealthResearch/mixtral-7b-8expert

7B • Updated Dec 10, 2023

TachyHealthResearch/DiscoLM-mixtral-8x7b-v2

7B • Updated Dec 10, 2023

kurtn718/scrambled_multiple_choice

Updated Dec 10, 2023 • 3

daptheHuman/merak-7b-candi-borobudur-v1-8bit-merged

Text Generation • 7B • Updated Dec 12, 2023 • 9

alessio21/Mistral-7B-v0.1-8bit

Text Generation • 7B • Updated Dec 11, 2023 • 7

alessio21/Mistral-7B-chat-v0.1-8bit

Text Generation • 7B • Updated Dec 11, 2023 • 6

daptheHuman/merak-7b-candi-borobudur-v2-8bit

Text Generation • 7B • Updated Dec 12, 2023 • 6

perevalov/AntModel-7B-XLLM-test-1-Demo

Text Generation • 7B • Updated Dec 12, 2023 • 7

LALAJI/receep-parser

Text Generation • 7B • Updated Dec 12, 2023

Gsnlp/ner

Updated Dec 13, 2023 • 3

miweru/ochat3-5_schwurpus_merged

Text Generation • 7B • Updated Dec 13, 2023

JeukHwang/roberta-base-squad2-i8-f32

Question Answering • 0.1B • Updated Dec 13, 2023 • 5

JeukHwang/roberta-base-squad2-i8-f16

Question Answering • 0.1B • Updated Dec 13, 2023 • 5

perevalov/AntModel-7B-XLLM-test-lcquad-1-Demo

Text Generation • 7B • Updated Dec 14, 2023 • 5

raowaqas123/hbl-test

Text Generation • 3B • Updated Dec 14, 2023 • 6

raowaqas123/hbl_v2

Text Generation • 3B • Updated Dec 14, 2023 • 8

LsTam/Mistral-7B-Instruct-v0.1-8bit

Text Generation • 7B • Updated Dec 14, 2023 • 6

pminha/roberta-base-squad-i8-f32-p5

Question Answering • 0.1B • Updated Dec 14, 2023 • 5

pminha/roberta-base-squad-i8-f32-p15

Question Answering • 0.1B • Updated Dec 14, 2023 • 4

pminha/roberta-base-squad-i8-f32-p20

Question Answering • 0.1B • Updated Dec 14, 2023 • 5

pminha/roberta-base-squad-i8-f32-p25

Question Answering • 0.1B • Updated Dec 14, 2023 • 5

pminha/roberta-base-squad-i8-f32-p30

Question Answering • 0.1B • Updated Dec 14, 2023 • 5

pminha/roberta-base-squad-i8-f32-p35

Question Answering • 0.1B • Updated Dec 14, 2023 • 5

LsTam/Mistral-7B-Instruct-v0.2-8bit

Text Generation • 7B • Updated Dec 14, 2023 • 8 • 1