Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

32,739

Base only

Active filters: 8-bit

sanjayadhikesaven/opt-125m-8bit

Text Generation • 0.1B • Updated Feb 21, 2024 • 7

MaziyarPanahi/Nous-Hermes-2-Mixtral-8x7B-SFT-Alpaca-GGUF

Text Generation • 47B • Updated Feb 21, 2024 • 195 • 3

sanjayadhikesaven/Llama-2-7b-hf8bit

Text Generation • 7B • Updated Feb 21, 2024 • 4

MaziyarPanahi/Nous-Hermes-2-Mixtral-8x7B-SFT-Wikihow-GGUF

Text Generation • 47B • Updated Feb 22, 2024 • 601 • 4

MaziyarPanahi/GritLM-8x7B-GGUF

Text Generation • 47B • Updated Feb 22, 2024 • 109 • 4

merve/gemma-7b-8bit

Text Generation • Updated Feb 22, 2024 • 4 • 1

merve/gemma-7b-it-8bit

Text Generation • Updated Feb 22, 2024 • 4

MaziyarPanahi/tulu-2-dpo-13b-GGUF

Text Generation • 13B • Updated Apr 17, 2024 • 667 • 3

benferns/instructblip-flan-t5-xl_8bit_nf4

Image-to-Text • 4B • Updated Feb 23, 2024 • 5

GVNzLp/TT

Text Generation • 7B • Updated Feb 23, 2024 • 6

weijie210/neuralchat_self-entropy

Text Generation • 7B • Updated Feb 25, 2024 • 5

tybritten/lora-for-starcoder

Updated Feb 23, 2024 • 4

panoyo9829/llava-1.6-gptq-8bit

Text Generation • Updated Feb 24, 2024 • 4

abdibrokhim/gemma-fine-tuned-brainmri-2402

Feature Extraction • 3B • Updated Mar 18, 2024 • 6

kronedays/gemma-7b-it-bnb8

Text Generation • 9B • Updated Feb 24, 2024 • 4

kevinz23/Qwen-7B-light8

Text Generation • 8B • Updated Feb 25, 2024 • 2

MaziyarPanahi/Qwen1.5-8x7b-v0.1-GGUF

Text Generation • 38B • Updated Mar 2, 2024 • 369 • 5

allstax/AI-G-Expander-v6-8bit

Text Generation • 4B • Updated Feb 25, 2024 • 6

MaziyarPanahi/OpenHermes-2.5-Mistral-7B-mt-bench-DPO-original-v3-GGUF

Text Generation • 7B • Updated Feb 25, 2024 • 42 • 2

MaziyarPanahi/Yarn-Solar-10b-64k-GGUF

Text Generation • 11B • Updated Feb 25, 2024 • 171 • 1

jwjeong/gpt2-xl-8bit-100g

Text Generation • Updated Feb 25, 2024 • 7

adarsh12x/mistral_7b_samantha_

7B • Updated Feb 26, 2024 • 2

MaziyarPanahi/Yarn-Solar-10b-32k-GGUF

Text Generation • 11B • Updated Feb 26, 2024 • 76 • 1

BenjaminLHR/llama-2-70b-chat-guanaco

Text Generation • 69B • Updated Mar 2, 2024 • 4

adarsh12x/mistral_7b_samantha__

7B • Updated Feb 26, 2024 • 2

MaziyarPanahi/LongAlpaca-13B-16k-GGUF

Text Generation • 13B • Updated Feb 26, 2024 • 52 • 4

adarsh12x/mistral_7b_samantha___

Text Generation • 7B • Updated Feb 27, 2024 • 4

MaziyarPanahi/LongAlpaca-13B-GGUF

Text Generation • 13B • Updated Feb 26, 2024 • 181 • 3

rKn7/Mixtral_7b_FineTuningA100

Text Generation • 4B • Updated Feb 26, 2024 • 5

Lienid/nous-eight

Text Generation • 7B • Updated Feb 27, 2024 • 5