Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

671

Base only

Active filters: AWQ

solidrust/OpenHyperion-2.5-Mistral-7B-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 8

solidrust/Dolphin-2.8-slerp-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 5

solidrust/AlphaHitchhiker-7B-v2-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 7

solidrust/Narrative-Nexus-DPO-7B-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 11

solidrust/Hermes-2-Pro-Mistral-7B-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 124 • 2

twhoool02/Llama-2-7b-chat-hf-AWQ

Text Generation • 7B • Updated Apr 3, 2024 • 6

alokabhishek/Llama-2-7b-chat-hf-4bit-AWQ

Text Generation • 7B • Updated Mar 24, 2024 • 5 • 1

solidrust/Starling-LM-7B-beta-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 58 • 3

solidrust/Hyperion-3.0-Mistral-7B-DPO-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 6

alokabhishek/Mistral-7B-Instruct-v0.2-4bit-AWQ

Text Generation • 7B • Updated Mar 24, 2024 • 8 • 1

solidrust/Mistral-7B-v0.2-OpenHermes-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 3

solidrust/Tess-7B-v2.0-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 4 • 1

solidrust/LewdMistral-7B-0.2-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 8

solidrust/WhiteRabbitNeo-7B-v1.5a-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 7

solidrust/mistral-7b-v0.2-layla-v4-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 5

MaziyarPanahi/Truthful_DPO_TomGrc_FusionNet_7Bx2_MoE_13B-AWQ

Text Generation • 13B • Updated Mar 26, 2024 • 9 • 3

solidrust/Hercules-4.0-Mistral-v0.2-7B-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 4 • 1

solidrust/OpenCerebrum-1.0-7b-DPO-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 11

solidrust/Kunoichi-DPO-v2-7B-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 7 • 2

solidrust/Einstein-v5-v0.2-7B-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 11

solidrust/CerebrumHyperion-7B-DPO-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 3

solidrust/dolphin-2.8-mistral-7b-v02-AWQ

Text Generation • 7B • Updated Sep 4, 2024 • 165 • 2

solidrust/EulerMath-Mistral-7B-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 5

solidrust/UltraMerge-v2-7B-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 5

mistral-community/Mixtral-8x22B-v0.1-AWQ

Text Generation • 141B • Updated Jul 5, 2024 • 66 • 36

solidrust/Einstein-v6-7B-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 7

solidrust/dolphin-2.8-mistral-7b-v02-AWQ-gemv-64gs

Text Generation • 7B • Updated Sep 3, 2024 • 5

solidrust/Mistral-22B-v0.1-AWQ

Text Generation • 22B • Updated Sep 3, 2024 • 7 • 1

solidrust/SlimHercules-4.0-Mistral-7B-v0.2-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 4

MaziyarPanahi/zephyr-orpo-141b-A35b-v0.1-AWQ

Text Generation • 141B • Updated Apr 12, 2024 • 7 • 3