Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

32,666

Base only

Active filters: 8-bit

RichardErkhov/kalytm_-_nous-1-8bits

Text Generation • 2B • Updated May 1, 2024 • 6

RichardErkhov/kalytm_-_nous-2-8bits

Text Generation • 2B • Updated May 1, 2024 • 6

RichardErkhov/kalytm_-_nous-3-8bits

Text Generation • 2B • Updated May 1, 2024 • 5

RichardErkhov/kalytm_-_nous-0-8bits

Text Generation • 2B • Updated May 1, 2024 • 5

RichardErkhov/Vikhrmodels_-_Vikhr-7B-instruct_0.4-8bits

Text Generation • 8B • Updated May 1, 2024 • 4

RichardErkhov/ryota39_-_llm-jp-1b-sft-100k-LoRA-8bits

Text Generation • 1B • Updated May 1, 2024 • 5

RichardErkhov/Aspik101_-_llama10-8bits

Text Generation • 8B • Updated May 1, 2024 • 5

ikeno-ada/madlad400-3b-mt-Quanto-2bit

1B • Updated May 1, 2024 • 3

ikeno-ada/madlad400-3b-mt-Quanto-4bit

2B • Updated May 1, 2024 • 4

RichardErkhov/Aspik101_-_llamaft6v2-8bits

Text Generation • 8B • Updated May 1, 2024 • 6

RichardErkhov/Aspik101_-_llamaft5-8bits

Text Generation • 8B • Updated May 1, 2024 • 11

RichardErkhov/Yuma42_-_KangalKhan-Ruby-7B-Fixed-8bits

Text Generation • 7B • Updated May 1, 2024 • 5

RichardErkhov/Yuma42_-_KangalKhan-RawEmerald-7B-8bits

Text Generation • 7B • Updated May 1, 2024 • 5

RichardErkhov/Yuma42_-_KangalKhan-RawRuby-7B-8bits

Text Generation • 7B • Updated May 1, 2024 • 4 • 1

RichardErkhov/aaditya_-_Llama3-OpenBioLLM-8B-8bits

Text Generation • 8B • Updated May 1, 2024 • 6

RichardErkhov/google_-_gemma-2b-8bits

Text Generation • 3B • Updated May 1, 2024 • 7

RichardErkhov/TinyLlama_-_TinyLlama-1.1B-Chat-v1.0-8bits

Text Generation • 1B • Updated May 2, 2024 • 4

RichardErkhov/bigscience_-_bloomz-560m-8bits

Text Generation • 0.6B • Updated May 2, 2024 • 7

RichardErkhov/google_-_gemma-2b-it-8bits

Text Generation • 3B • Updated May 2, 2024 • 5

vkrishnan569/tinyllama_4Q

0.6B • Updated May 2, 2024 • 90

RichardErkhov/deepset_-_roberta-base-squad2-8bits

Text Generation • 0.1B • Updated May 2, 2024 • 4

RichardErkhov/consciousAI_-_question-answering-roberta-base-s-v2-8bits

Text Generation • 0.1B • Updated May 2, 2024 • 5

RichardErkhov/deepset_-_tinyroberta-squad2-8bits

Text Generation • 82.2M • Updated May 2, 2024 • 4

RichardErkhov/deepset_-_roberta-base-squad2-distilled-8bits

Text Generation • 0.1B • Updated May 2, 2024 • 4

RichardErkhov/deepset_-_roberta-large-squad2-8bits

Text Generation • 0.4B • Updated May 2, 2024 • 3

RichardErkhov/trl-internal-testing_-_tiny-random-LlamaForCausalLM-8bits

Text Generation • 1.03M • Updated May 2, 2024 • 8

RichardErkhov/lgodwangl_-_new_01m-8bits

Text Generation • 7B • Updated May 2, 2024 • 4

henry-skywalker/mistral_7b_search_4bit

Text Generation • 4B • Updated May 2, 2024 • 5

RichardErkhov/yanolja_-_EEVE-Korean-10.8B-v1.0-8bits

Text Generation • 11B • Updated May 2, 2024 • 4

RichardErkhov/deepset_-_xlm-roberta-large-squad2-8bits

Text Generation • 0.6B • Updated May 2, 2024 • 4