Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,955

Base only

Active filters: bitsandbytes

RichardErkhov/fxmarty_-_tiny-random-GemmaForCausalLM-4bits

Text Generation • 8.2M • Updated May 3, 2024 • 9

RichardErkhov/fxmarty_-_tiny-random-GemmaForCausalLM-8bits

Text Generation • 8.19M • Updated May 3, 2024 • 15

RichardErkhov/mlabonne_-_NeuralDaredevil-7B-8bits

Text Generation • 7B • Updated May 3, 2024 • 6

RichardErkhov/FlagAlpha_-_Atom-7B-4bits

Text Generation • 7B • Updated May 3, 2024 • 9

RichardErkhov/FlagAlpha_-_Atom-7B-8bits

Text Generation • 7B • Updated May 3, 2024 • 8

NishantPar/phi2-email-priority-qlora

Text Generation • Updated May 3, 2024 • 7

1r0nm4g3/Doug

Text Generation • 9B • Updated May 3, 2024 • 12

RichardErkhov/fxmarty_-_tiny-dummy-qwen2-4bits

Text Generation • 1.22M • Updated May 3, 2024 • 9

RichardErkhov/fxmarty_-_tiny-dummy-qwen2-8bits

Text Generation • 1.22M • Updated May 3, 2024 • 9

RichardErkhov/yujiepan_-_llama-2-tiny-random-4bits

Text Generation • 514k • Updated May 3, 2024 • 10

RichardErkhov/yujiepan_-_llama-2-tiny-random-8bits

Text Generation • 513k • Updated May 3, 2024 • 10

cungnlp/Vistral-DATN

Text Generation • 8B • Updated May 3, 2024 • 10

hoangphu7122002ai/merge_model_test

Text Generation • 7B • Updated May 3, 2024 • 8

RichardErkhov/VAGOsolutions_-_SauerkrautLM-Mixtral-8x7B-Instruct-4bits

Text Generation • 47B • Updated May 3, 2024 • 12

RichardErkhov/Locutusque_-_gpt2-xl-conversational-4bits

Text Generation • 2B • Updated May 3, 2024 • 12

RichardErkhov/Locutusque_-_gpt2-xl-conversational-8bits

Text Generation • 2B • Updated May 3, 2024 • 11

AIAT/The_Scamper-opt70bqt

Table Question Answering • 71B • Updated May 3, 2024 • 7

Kameshr/LLAMA-3-Quantized

Text Generation • 8B • Updated May 3, 2024 • 16 • 9

supriyaupadhyaya/llama-3-8b-bnb-4bit-text-to-sql-old

Text Generation • 8B • Updated May 3, 2024 • 7

RichardErkhov/JackFram_-_llama-160m-4bits

Text Generation • 0.2B • Updated May 3, 2024 • 8

RichardErkhov/JackFram_-_llama-160m-8bits

Text Generation • 0.2B • Updated May 3, 2024 • 8

RichardErkhov/Locutusque_-_OpenCerebrum-1.0-7b-DPO-4bits

Text Generation • 7B • Updated May 3, 2024 • 6

RichardErkhov/Locutusque_-_OpenCerebrum-1.0-7b-DPO-8bits

Text Generation • 7B • Updated May 3, 2024 • 7

RichardErkhov/Nondzu_-_zephyr-speakleash-010-pl-3072-32-16-0.01-4bits

Text Generation • 7B • Updated May 3, 2024 • 8

RichardErkhov/Azurro_-_APT3-1B-Base-4bits

Text Generation • 1B • Updated May 3, 2024 • 10

RichardErkhov/Azurro_-_APT3-1B-Base-8bits

Text Generation • 1B • Updated May 3, 2024 • 8

RichardErkhov/Nondzu_-_zephyr-speakleash-010-pl-3072-32-16-0.01-8bits

Text Generation • 7B • Updated May 3, 2024 • 6

RichardErkhov/state-spaces_-_mamba-130m-hf-4bits

Text Generation • 0.1B • Updated May 3, 2024 • 10

RichardErkhov/state-spaces_-_mamba-130m-hf-8bits

Text Generation • 0.1B • Updated May 3, 2024 • 13

hackint0sh/phi-3-clinical-finetuned

Text Generation • 4B • Updated May 3, 2024 • 11