Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

652

Base only

Active filters: AWQ

solidrust/NeuralBeagle14-7B-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 1

solidrust/OpenHyperion-2.5-Mistral-7B-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 1

solidrust/Dolphin-2.8-slerp-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 1

solidrust/AlphaHitchhiker-7B-v2-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 1

solidrust/Narrative-Nexus-DPO-7B-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 1

solidrust/Hermes-2-Pro-Mistral-7B-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 415 • 2

twhoool02/Llama-2-7b-chat-hf-AWQ

Text Generation • 7B • Updated Apr 3, 2024 • 1

alokabhishek/Llama-2-7b-chat-hf-4bit-AWQ

Text Generation • 7B • Updated Mar 24, 2024 • 1 • 1

solidrust/Starling-LM-7B-beta-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 7 • 3

solidrust/Hyperion-3.0-Mistral-7B-DPO-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 1

alokabhishek/Mistral-7B-Instruct-v0.2-4bit-AWQ

Text Generation • 7B • Updated Mar 24, 2024 • 3 • 1

solidrust/Mistral-7B-v0.2-OpenHermes-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 1

solidrust/Tess-7B-v2.0-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 2 • 1

solidrust/LewdMistral-7B-0.2-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 1

solidrust/WhiteRabbitNeo-7B-v1.5a-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 60

solidrust/mistral-7b-v0.2-layla-v4-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 2

MaziyarPanahi/Truthful_DPO_TomGrc_FusionNet_7Bx2_MoE_13B-AWQ

Text Generation • 13B • Updated Mar 26, 2024 • 10 • 3

solidrust/Hercules-4.0-Mistral-v0.2-7B-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 1 • 1

solidrust/OpenCerebrum-1.0-7b-DPO-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 3

solidrust/Kunoichi-DPO-v2-7B-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 6 • 2

solidrust/Einstein-v5-v0.2-7B-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 3

solidrust/CerebrumHyperion-7B-DPO-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 2

solidrust/dolphin-2.8-mistral-7b-v02-AWQ

Text Generation • 7B • Updated Sep 4, 2024 • 536 • 2

solidrust/EulerMath-Mistral-7B-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 2

solidrust/UltraMerge-v2-7B-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 2

mistral-community/Mixtral-8x22B-v0.1-AWQ

Text Generation • 141B • Updated Jul 5, 2024 • 148 • 36

solidrust/Einstein-v6-7B-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 1

solidrust/dolphin-2.8-mistral-7b-v02-AWQ-gemv-64gs

Text Generation • 7B • Updated Sep 3, 2024 • 3

solidrust/Mistral-22B-v0.1-AWQ

Text Generation • 22B • Updated Sep 3, 2024 • 2 • 1

solidrust/SlimHercules-4.0-Mistral-7B-v0.2-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 1