Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

41,094

Full-text search

Active filters: bitsandbytes

saadliaquat19/Llama-3-Patient-Doctor-2

Feature Extraction • 8B • Updated Apr 30, 2024

TheRightHomeCareTeam/Sulis-Dr-Llama-8b-Medical-Chat

Text Generation • 8B • Updated May 1, 2024 • 13

sylviali/eracond_llama_2_grammar

Text Generation • 7B • Updated Apr 30, 2024 • 1

RichardErkhov/Qwen_-_Qwen1.5-0.5B-4bits

Text Generation • 0.5B • Updated Apr 30, 2024 • 1

RichardErkhov/Qwen_-_Qwen1.5-0.5B-8bits

Text Generation • 0.5B • Updated Apr 30, 2024

RichardErkhov/Qwen_-_Qwen1.5-1.8B-4bits

Text Generation • 2B • Updated Apr 30, 2024

RichardErkhov/Qwen_-_Qwen1.5-7B-4bits

Text Generation • 8B • Updated Apr 30, 2024

RichardErkhov/Qwen_-_Qwen1.5-4B-4bits

Text Generation • 4B • Updated Apr 30, 2024

RichardErkhov/Qwen_-_Qwen1.5-1.8B-8bits

Text Generation • 2B • Updated Apr 30, 2024

LoftQ/Meta-Llama-3-70B-Instruct-4bit-64rank

Text Generation • 72B • Updated May 3, 2024 • 4 • 1

kyuhyun/final_4bit_DST_DPO_free

Text Generation • 11B • Updated Apr 30, 2024

RichardErkhov/Qwen_-_Qwen1.5-14B-4bits

Text Generation • 14B • Updated Apr 30, 2024

RichardErkhov/Qwen_-_Qwen1.5-4B-8bits

Text Generation • 4B • Updated about 1 month ago • 1

RichardErkhov/Qwen_-_Qwen1.5-7B-8bits

Text Generation • 8B • Updated Apr 30, 2024

Burhan02/Mistral-7B-Instruct-v0.2-ft

Updated May 2, 2024

RichardErkhov/Qwen_-_Qwen1.5-14B-8bits

Text Generation • 14B • Updated Apr 30, 2024 • 1

RichardErkhov/Qwen_-_Qwen1.5-1.8B-Chat-4bits

Text Generation • 2B • Updated Apr 30, 2024

RichardErkhov/Qwen_-_Qwen1.5-1.8B-Chat-8bits

Text Generation • 2B • Updated Apr 30, 2024

RichardErkhov/Qwen_-_Qwen1.5-4B-Chat-4bits

Text Generation • 4B • Updated Apr 30, 2024

RichardErkhov/Qwen_-_Qwen1.5-4B-Chat-8bits

Text Generation • 4B • Updated Apr 30, 2024

RichardErkhov/Qwen_-_Qwen1.5-7B-Chat-4bits

Text Generation • 8B • Updated Apr 30, 2024

samiyousef/Command-R-4-bit

Text Generation • 35B • Updated Apr 30, 2024 • 2

RichardErkhov/Qwen_-_Qwen1.5-14B-Chat-4bits

Text Generation • 14B • Updated Apr 30, 2024

code-endurer/lora_model_1

Text Generation • 7B • Updated Apr 30, 2024 • 2

RichardErkhov/Qwen_-_Qwen1.5-7B-Chat-8bits

Text Generation • 8B • Updated Apr 30, 2024

RichardErkhov/Qwen_-_Qwen1.5-0.5B-Chat-4bits

Text Generation • 0.5B • Updated Apr 30, 2024

RichardErkhov/Qwen_-_Qwen1.5-0.5B-Chat-8bits

Text Generation • 0.5B • Updated Apr 30, 2024

RichardErkhov/Qwen_-_Qwen1.5-14B-Chat-8bits

Text Generation • 14B • Updated Apr 30, 2024

AbdWalidAI/Llama-3-8B-Instruct-dialogsum

Text Generation • 8B • Updated May 1, 2024 • 1 • 1

RichardErkhov/Qwen_-_Qwen1.5-32B-4bits

Text Generation • 33B • Updated Apr 30, 2024