Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,083

Base only

Active filters: bitsandbytes

RichardErkhov/cognitivecomputations_-_dolphin-2.6-mistral-7b-dpo-4bits

Text Generation • 7B • Updated Apr 26, 2024 • 1

RichardErkhov/cognitivecomputations_-_dolphin-2.6-mistral-7b-8bits

Text Generation • 7B • Updated Apr 26, 2024 • 2

RichardErkhov/cognitivecomputations_-_dolphin-2.6-mistral-7b-dpo-8bits

Text Generation • 7B • Updated Apr 26, 2024 • 1

1024m/GEMMA7B-01-EXALT1A-4bit

Text Generation • 9B • Updated Apr 26, 2024 • 3

RichardErkhov/cognitivecomputations_-_dolphin-2.6-mistral-7b-dpo-laser-4bits

Text Generation • 7B • Updated Apr 26, 2024 • 4

RichardErkhov/cognitivecomputations_-_dolphin-2.6-mistral-7b-dpo-laser-8bits

Text Generation • 7B • Updated Apr 26, 2024 • 2

dbands/llama-3-8b-instruct_4bit

Text Generation • 8B • Updated Apr 26, 2024 • 4

dbands/llama-3-8b-instruct_databricks-dolly-15k_4bit

Text Generation • 8B • Updated Apr 26, 2024 • 2

xinping/Mixtral-instruction-v0.1_zh-nf4

Text Generation • 48B • Updated May 7, 2024 • 4

dbands/llama-3-8b-instruct_code_instructions_122k_alpaca_style_4bit

Text Generation • 8B • Updated Apr 28, 2024 • 3

berquetR/phi15_second_run

Text Generation • 4B • Updated Apr 26, 2024 • 3

Kaizu07/llama2-bn-v0_4-4bit

Text Generation • 7B • Updated Apr 26, 2024 • 1

omertafveez/Llama-3-TherapyChatBot

Text Generation • 8B • Updated Apr 27, 2024 • 3

tt1225/aic24-track2-multiview-videollava-7b-lora

Updated Apr 26, 2024 • 4

vaatsav06/Llama3_medqa

Text Generation • 8B • Updated Apr 26, 2024 • 2

Shure-Dev/llava-vima

Image-Text-to-Text • 8B • Updated Apr 29, 2024 • 9

richie-ghost/llama-3b-unsloth-quantized_lora

Text Generation • 8B • Updated Apr 26, 2024 • 1

Entreprenerdly/blip2-opt-2.7b-fp16-sharded

Visual Question Answering • 4B • Updated Apr 26, 2024 • 6 • 1

richie-ghost/llama-3b-unsloth-quantized_merged_8bit

Text Generation • 8B • Updated Apr 26, 2024 • 2

richie-ghost/llama-3b-unsloth-quantized_merged_4bit_GPTQ

Text Generation • 8B • Updated Apr 26, 2024 • 3

thjeon/llama-2-7b-chat-thjeon-kor

Text Generation • 7B • Updated Apr 26, 2024 • 1

vaatsav06/Llama3_medqa_final

Text Generation • 8B • Updated Apr 28, 2024 • 2

fxmeng/PiSSA-Llama-2-7B-r16-4bit-5iter

Text Generation • 7B • Updated Apr 26, 2024 • 1

fxmeng/PiSSA-Llama-2-7B-r32-4bit-5iter

Text Generation • 7B • Updated Apr 26, 2024 • 2

devesh-2002/mistral-7b-v0.3-summarizer

Summarization • 7B • Updated Sep 4, 2024 • 6

kchopra04/lora_model_inst

Text Generation • 8B • Updated Apr 26, 2024 • 1

RichardErkhov/IlyaGusev_-_saiga_llama3_8b-4bits

Text Generation • 8B • Updated Apr 26, 2024 • 5

RichardErkhov/IlyaGusev_-_saiga_gemma_9b-4bits

Text Generation • 9B • Updated Apr 26, 2024 • 2

RichardErkhov/Nexusflow_-_Starling-LM-7B-beta-4bits

Text Generation • 7B • Updated Apr 26, 2024 • 2

RichardErkhov/IlyaGusev_-_saiga_llama3_8b-8bits

Text Generation • 8B • Updated Apr 26, 2024 • 4