Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,959

Base only

Active filters: bitsandbytes

kakinola23/Meta-Llama-3-8B-bnb-4bit-new

Text Generation • 8B • Updated Apr 20, 2024 • 8

DehydratedWater42/SeELLama

Text Generation • 7B • Updated Apr 27, 2024 • 1

chansung/coding_llamaduo_result2

Updated Apr 21, 2024 • 15

yyx123/Yi-6B-zhihu4

Updated Apr 21, 2024 • 3

taozi555/llama3-8b-pippa

Updated Apr 21, 2024 • 4

jeongmi/solar_musinsa_user0

Text Generation • 11B • Updated Apr 21, 2024 • 10

sam2ai/llama3_8b_odia_v1

Text Generation • Updated Apr 24, 2024 • 8

RichardErkhov/meta-llama_-_LlamaGuard-7b-4bits

Text Generation • 7B • Updated Apr 21, 2024 • 10

LoftQ/Meta-Llama-3-70B-4bit-64rank

Text Generation • 72B • Updated May 3, 2024 • 10 • 1

OmarSamehSaid/LLM-CXR-v1

Text Generation • 3B • Updated Apr 21, 2024 • 10

yyx123/Yi-6B-ruozhiba3

Updated May 5, 2024 • 17

nuebaek/komt_mistral_mss_user_0_max_steps_80

Text Generation • 7B • Updated Apr 22, 2024 • 8

RichardErkhov/meta-llama_-_Llama-2-70b-chat-hf-4bits

Text Generation • 70B • Updated Apr 21, 2024 • 9

RichardErkhov/meta-llama_-_LlamaGuard-7b-8bits

Text Generation • 7B • Updated Apr 21, 2024 • 9

Omartificial-Intelligence-Space/al-baka-4bit-llama3-8b

Text Generation • 8B • Updated Apr 21, 2024 • 11 • 1

RichardErkhov/meta-llama_-_CodeLlama-7b-hf-4bits

Text Generation • 7B • Updated Apr 21, 2024 • 7

RichardErkhov/meta-llama_-_CodeLlama-7b-hf-8bits

Text Generation • 7B • Updated Apr 21, 2024 • 7

guptasaurabh78/ph2-sau-samsum-ft-1

Text Generation • 3B • Updated Apr 21, 2024 • 7

RichardErkhov/meta-llama_-_CodeLlama-7b-Python-hf-4bits

Text Generation • 7B • Updated Apr 21, 2024 • 8

RichardErkhov/meta-llama_-_CodeLlama-7b-Python-hf-8bits

Text Generation • 7B • Updated Apr 21, 2024 • 8

Ti-ger/Qwen1.5-4B-CQIA

Text Generation • 4B • Updated Apr 23, 2024 • 12

RichardErkhov/meta-llama_-_CodeLlama-7b-Instruct-hf-4bits

Text Generation • 7B • Updated Apr 21, 2024 • 11

RichardErkhov/meta-llama_-_CodeLlama-7b-Instruct-hf-8bits

Text Generation • 7B • Updated Apr 21, 2024 • 7

yyx123/Yi-6B-ruozhiba4

Updated Apr 21, 2024 • 7

RichardErkhov/meta-llama_-_CodeLlama-13b-Instruct-hf-4bits

Text Generation • 13B • Updated Apr 21, 2024 • 9

yyx123/Yi-6B-zhihu5

Updated Apr 24, 2024 • 12

AmanBankoti/outputs_merged1

Text Generation • 7B • Updated Apr 21, 2024 • 7

RichardErkhov/meta-llama_-_CodeLlama-70b-hf-4bits

Text Generation • 70B • Updated Apr 21, 2024 • 8

RichardErkhov/meta-llama_-_CodeLlama-34b-hf-4bits

Text Generation • 34B • Updated Apr 21, 2024 • 8

palgraciel/Meta-Llama-3-8B-Instruct-leo-kor

Text Generation • 8B • Updated Apr 26, 2024 • 8