Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,962

Base only

Active filters: bitsandbytes

OdiaGenAI-LLM/odia-gemma-7b-base-checkpoints

Updated Apr 13, 2024 • 5

dbaek111/llama2-lora-finetunined-merged_test

Text Generation • 7B • Updated Apr 13, 2024 • 7

prince-canuma/Damysus-Coder-v0.1-4bit

Text Generation • 7B • Updated Apr 13, 2024 • 9

andreidima/Llama-2-7b-Romanian-qlora

Text Generation • 7B • Updated Jan 5, 2025 • 17

hiraltalsaniya/01_medical-llama2-7b-fine-tune

Text Generation • 7B • Updated Apr 13, 2024 • 9

Weyaxi/Einstein-v4-Qwen-1.5-32B-adapter-checkpoints

Text Generation • Updated Jun 18, 2024 • 17 • 1

SinclairSchneider/zephyr-orpo-141b-A35b-v0.1-bnb-4bit

Text Generation • 143B • Updated Apr 14, 2024 • 20

anilbhatt1/mistral_2000_kp_0413

Text Generation • 7B • Updated Apr 14, 2024 • 7

IbrahimTarek/Boiler_gemma7b

Text Generation • 9B • Updated Apr 14, 2024 • 10

RichardErkhov/mistralai_-_Mistral-7B-v0.1-4bits

Text Generation • 7B • Updated Apr 14, 2024 • 17

RichardErkhov/mistralai_-_Mistral-7B-Instruct-v0.1-4bits

Text Generation • 7B • Updated Apr 14, 2024 • 8

RichardErkhov/mistralai_-_Mistral-7B-v0.1-8bits

Text Generation • 7B • Updated Apr 14, 2024 • 7

RichardErkhov/mistralai_-_Mistral-7B-Instruct-v0.1-8bits

Text Generation • 7B • Updated Apr 14, 2024 • 8

dbaek111/Llama-2-7b-chat-hf-Elon_Interview_70

Text Generation • 7B • Updated Apr 14, 2024

RichardErkhov/mistralai_-_Mixtral-8x7B-v0.1-4bits

Text Generation • 47B • Updated Apr 14, 2024 • 16

yyx123/Yi-6B-ruozhiba

Updated May 7, 2024 • 16

RichardErkhov/mistralai_-_Mixtral-8x7B-Instruct-v0.1-4bits

Text Generation • 47B • Updated Apr 14, 2024 • 14

RichardErkhov/mistralai_-_Mistral-7B-Instruct-v0.2-4bits

Text Generation • 7B • Updated Apr 14, 2024 • 7

GladiusTn/mistral7b_ocr_to_xml_A1_4bits

Text Generation • 7B • Updated Apr 14, 2024 • 9

RichardErkhov/mistralai_-_Mistral-7B-Instruct-v0.2-8bits

Text Generation • 7B • Updated Apr 14, 2024 • 11

RichardErkhov/google_-_codegemma-7b-it-4bits

Text Generation • 9B • Updated Apr 14, 2024 • 27

RichardErkhov/google_-_codegemma-7b-it-8bits

Text Generation • 9B • Updated Apr 14, 2024 • 37

RichardErkhov/google_-_codegemma-7b-4bits

Text Generation • 9B • Updated Apr 14, 2024 • 35

RichardErkhov/google_-_codegemma-7b-8bits

Text Generation • 9B • Updated Apr 14, 2024 • 33

mkeohane01/mistral-instruct-590

7B • Updated Apr 18, 2024

kaidens/WHaK_AIv1

Updated Apr 15, 2024 • 4

Ekhlass/phi2-flutter-q-docs

Text Generation • 3B • Updated Apr 14, 2024 • 8

RichardErkhov/google_-_codegemma-2b-4bits

Text Generation • 3B • Updated Apr 14, 2024 • 33

RichardErkhov/google_-_codegemma-2b-8bits

Text Generation • 3B • Updated Apr 14, 2024 • 29

daanjiri/Biomistral_7b_bhc_10

Text Generation • Updated Apr 14, 2024 • 6