Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

671

Base only

Active filters: AWQ

solidrust/RainyMotip-2x7B-AWQ

Text Generation • 13B • Updated Sep 3, 2024 • 6

solidrust/NarumashiRTS-7B-V2-1-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 8

solidrust/NaruMOE-3x7B-v2-AWQ

Text Generation • 19B • Updated Sep 3, 2024 • 5

solidrust/Solutus-3x7B-AWQ

Text Generation • 19B • Updated Sep 3, 2024 • 12 • 1

solidrust/MELT-Mistral-3x7B-Instruct-v0.1-AWQ

Text Generation • 19B • Updated Sep 3, 2024 • 6

solidrust/EndlessRP-v3-7B-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 5

solidrust/InfinityRP-v1-7B-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 7

solidrust/Memgpt-3x7b-MOE-AWQ

Text Generation • 19B • Updated Sep 3, 2024 • 7 • 1

MaziyarPanahi/Mixtral-8x22B-Instruct-v0.1-AWQ

Text Generation • 141B • Updated Apr 18, 2024 • 513 • 13

solidrust/Silicon-Masha-7B-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 6

solidrust/LemonadeRP-4.5.3-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 6

solidrust/SlushySlerp-7B-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 5

solidrust/Mixtral-3x7B-Instruct-v0.1-AWQ

Text Generation • 19B • Updated Sep 3, 2024 • 11

solidrust/Silicon-Alice-7B-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 6

solidrust/Meta-Llama-3-8B-Instruct-hf-AWQ

Text Generation • 8B • Updated Sep 3, 2024 • 956 • 9

solidrust/Meta-Llama-3-8B-hf-AWQ

Text Generation • 8B • Updated Sep 3, 2024 • 12

solidrust/Llama-3-SLERP-8B-AWQ

Text Generation • 8B • Updated Sep 3, 2024 • 22

solidrust/Mistral-7B-v0.2-ORPO-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 4

solidrust/OrpoLlama-3-8B-AWQ

Text Generation • 8B • Updated Sep 3, 2024 • 12 • 3

solidrust/Neural-Llama-3-AWQ

Text Generation • 8B • Updated Apr 18, 2024 • 10

solidrust/Llama-3-DARE-8B-AWQ

Text Generation • 8B • Updated Sep 3, 2024 • 12

solidrust/FrankenLlama-3-12B-AWQ

Text Generation • 8B • Updated Sep 3, 2024 • 22

solidrust/DolphinHermesPro-ModelStock-7B-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 8

solidrust/Llama-3-NeuralPaca-8b-AWQ

Text Generation • 8B • Updated Sep 3, 2024 • 11

solidrust/Trillama-8B-AWQ

Text Generation • 8B • Updated Sep 3, 2024 • 6 • 1

solidrust/Llama-3-linear-8B-AWQ

Text Generation • 8B • Updated Apr 18, 2024 • 6

solidrust/Llama-3-8B-Instruct-Base-Slerp-AWQ

Text Generation • 8B • Updated Sep 3, 2024 • 7

solidrust/Mixtral_AI_MiniTron_Chat-AWQ

Text Generation • 4B • Updated Sep 3, 2024 • 7

solidrust/Meta-Llama-Guard-2-8B-AWQ

Text Generation • 8B • Updated Sep 3, 2024 • 18

solidrust/Mixtral_AI_MiniTron_1b-AWQ

Text Generation • 1B • Updated Sep 3, 2024 • 6