Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

32,752

Base only

Active filters: 8-bit

Qwen/Qwen1.5-14B-Chat-GPTQ-Int8

Text Generation • 15B • Updated Apr 30, 2024 • 103 • 11

Qwen/Qwen1.5-7B-Chat-GPTQ-Int8

Text Generation • 8B • Updated Apr 30, 2024 • 92 • 26

Qwen/Qwen1.5-4B-Chat-GPTQ-Int8

Text Generation • 4B • Updated Apr 30, 2024 • 76 • 6

Qwen/Qwen1.5-1.8B-Chat-GPTQ-Int8

Text Generation • 2B • Updated Apr 30, 2024 • 83 • 2

Qwen/Qwen1.5-0.5B-Chat-GPTQ-Int8

Text Generation • 0.5B • Updated Apr 30, 2024 • 109 • 4

MaziyarPanahi/distilabeled-Marcoro14-7B-slerp-GGUF

Text Generation • 7B • Updated Feb 4, 2024 • 34

MaziyarPanahi/distilabeled-OpenHermes-2.5-Mistral-7B-GGUF

Text Generation • 7B • Updated Feb 4, 2024 • 214 • 1

MaziyarPanahi/notux-8x7b-v1-GGUF

Text Generation • 47B • Updated Feb 4, 2024 • 47

aassegai/mistral-legaleval-merged

Text Generation • 3B • Updated Feb 5, 2024 • 5

MaziyarPanahi/MetaMath-Bagel-DPO-34B-GGUF

Text Generation • 34B • Updated Feb 5, 2024 • 49 • 3

niranjan-agi/nl2_sql_model

Text Generation • 7B • Updated Feb 5, 2024 • 6

viai957/CodeLlama_7B-Fientuned

Text Generation • 7B • Updated Feb 7, 2024 • 4

andysalerno/rainbowfish-v7-lora-adapter

Updated Feb 8, 2024 • 1

areegtarek/patientcommunication-8bit

Text Generation • 7B • Updated Feb 7, 2024 • 6

sajaw/AntModel-7B-XLLM-Demo

Text Generation • 7B • Updated Feb 7, 2024 • 3

sajaw/Llama-2-7B-XLLM-Demo

Text Generation • 7B • Updated Feb 7, 2024 • 5

sajaw/Llama-2-7B-XLLM-GQA10K

7B • Updated Feb 7, 2024 • 6

ISTA-DASLab/Llama-2-70b-AQLM-2Bit-2x8-hf

Text Generation • 18B • Updated Mar 11, 2024 • 4 • 1

anik115/custom-llama-7b

Text Generation • Updated Feb 7, 2024 • 4

alielfilali01/heliosbrahma-falcon-7b-finetuned-mental-health-conversational

Text Generation • 7B • Updated Feb 7, 2024 • 7

alielfilali01/curiousily-falcon-7b-qlora-chat-support-bot-faq

Text Generation • 7B • Updated Feb 7, 2024 • 4

cti-ttp-18/custom-llama-7b

Text Generation • Updated Feb 8, 2024 • 4

madhiarasan/HR-finetuned

Updated Feb 8, 2024 • 2

2A2I-R/AG7B-CIDAR

Text Generation • 7B • Updated Apr 14, 2024 • 9 • 1

dmitrybright/Mistral-7B-Instruct-v0.1-8bit

Text Generation • 7B • Updated Feb 9, 2024 • 4

laurencer/VimGPT-CodeLlama-PythonCode-1.7m-Unsloth-1epoch-merged

Text Generation • 4B • Updated Feb 10, 2024 • 6 • 1

devlocalhost/blip2-opt-2.7b-xray-captions

Visual Question Answering • 4B • Updated Feb 11, 2024 • 15 • 1

MaziyarPanahi/LongAlign-13B-64k-GGUF

Text Generation • 13B • Updated Feb 11, 2024 • 51 • 3

vicgalle/solarized-18B-truthy

Text Generation • 18B • Updated Feb 11, 2024 • 71 • 1

Professor/davlan-small-8bit

77M • Updated Feb 12, 2024 • 5