Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,785

Base only

Active filters: instruct

solidrust/bagel-7b-v0.4-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 7

sugatoray/mlx-neuralhermes-2.5-mistral-7b-q4bits

1B • Updated Feb 25, 2024 • 13

solidrust/Senzu-7B-v0.1-DPO-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 11 • 1

solidrust/Senzu-7B-v0.1-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 8 • 1

solidrust/Neural-Story-7B-instruct-v0.2-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 10

solidrust/Ignis-7B-DPO-Laser-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 13

solidrust/Ignis-7B-DPO-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 7

bartowski/AlphaMonarch-laser-exl2

Text Generation • Updated Feb 27, 2024 • 1

solidrust/Tiger-7B-v0.1-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 9

solidrust/Aeryth-7B-v0.1-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 8

solidrust/Panda-7B-v0.1-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 6

solidrust/Gecko-7B-v0.1-DPO-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 8

solidrust/Tanuki-7B-v0.1-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 5

solidrust/Gecko-7B-v0.1-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 13

illuni/illuni-llama-2-ko-7b

Question Answering • 7B • Updated Mar 7, 2024 • 13 • 2

solidrust/samantha-1.1-westlake-7b-AWQ

Text Generation • 7B • Updated Feb 29, 2024 • 11

heatball/Einstein-v4-7B-GGUF

7B • Updated Mar 1, 2024 • 18 • 2

nold/Einstein-v4-7B-GGUF

7B • Updated Mar 1, 2024 • 227

solidrust/WestLake-7B-v2-laser-truthy-dpo-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 9

mradermacher/Rose-20B-GGUF

20B • Updated Nov 18, 2024 • 11 • 1

LoneStriker/Einstein-v4-7B-GGUF

7B • Updated Mar 2, 2024 • 116 • 6

LoneStriker/Einstein-v4-7B-3.0bpw-h6-exl2

Text Generation • Updated Mar 2, 2024 • 9

LoneStriker/Einstein-v4-7B-4.0bpw-h6-exl2

Text Generation • Updated Mar 2, 2024 • 9

LoneStriker/Einstein-v4-7B-5.0bpw-h6-exl2

Text Generation • Updated Mar 2, 2024 • 12

LoneStriker/Einstein-v4-7B-6.0bpw-h6-exl2

Text Generation • Updated Mar 2, 2024 • 12

LoneStriker/Einstein-v4-7B-8.0bpw-h8-exl2

Text Generation • Updated Mar 2, 2024 • 12

abideen/AlphaMonarch-dora

Text Generation • 7B • Updated Mar 5, 2024 • 23 • 4

mradermacher/Rose-20B-i1-GGUF

20B • Updated Mar 27, 2025 • 164

solidrust/Einstein-v4-7B-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 16 • 1

Vikhrmodels/Vikhr-7B-instruct_0.2-AQLM

Text Generation • 1B • Updated Mar 3, 2024 • 15 • 1