Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

391

Base only

Active filters: quark

magiccodingman/Qwen3.8-Flash-Next-Quark-MXFP4-fp8

Image-Text-to-Text • 119B • Updated 22 days ago • 138 • 4

amd/Qwen3.8-Flash-Next-Quark-MXFP4-PLEFP8

Image-Text-to-Text • 119B • Updated 4 days ago • 1.71k • 2

amd/Qwen3.8-27B-Quark-Qronos-INT4-W4A16

Image-Text-to-Text • 6B • Updated Aug 28 • 1.08k • 3

amd/Qwen3.8-27B-Quark-AWQ-INT4-W4A16

Image-Text-to-Text • 6B • Updated Aug 28 • 45.2k • 22

amd/Qwen3.8-27B-Quark-AWQ-MXFP4

Image-Text-to-Text • 16B • Updated Aug 26 • 45.2k • 31

amd/Qwen3.8-Flash-Next-Quark-MXFP4

Image-Text-to-Text • 119B • Updated Sep 3 • 10.2k • 4

magiccodingman/Qwen3.8-27B-MXFP4-MagicQuant-GGUF

Image-Text-to-Text • 27B • Updated Aug 26 • 5.76k • 6

Capicua25x/Ornith-1.5-35B-A3B-MXFP4-Quark-RDNA4

19B • Updated Aug 29 • 73 • 1

amd/GLM-5.3-Quark-MXFP4-AttnFP8

Text Generation • 384B • Updated Sep 2 • 18.8k • 3

Capicua25x/Muse-Glimmer-30B-MXFP4-Quark-RDNA4

19B • Updated Sep 2 • 26 • 1

ukisai/Swift-Qwen3.8-27b-int4-AMD

Image-Text-to-Text • 6B • Updated 11 days ago • 1.16k • 8

ukisai/Swift-1.5-Qwen3.8-27b-Quark-FP8-dynamic-AMD

Image-Text-to-Text • 28B • Updated 11 days ago • 409 • 2

legion666/Huihui-Qwen3.8-27B-abliterated-Quark-AWQ-MXFP4

Image-Text-to-Text • 16B • Updated 9 days ago • 112 • 1

ethanwtodd/Swift-1.5-Qwen3.8-27b-Quark-RTN-MXFP4

Image-Text-to-Text • 16B • Updated 1 day ago • 66 • 1

AEON-7/Qwen3.8-27B-AEON-ULTIMATE-UNCENSORED-MXFP4-MXFP6-ROCm

Text Generation • 18B • Updated about 1 hour ago • 4 • 1

fxmarty/llama-tiny-testing-quark-indev

1.03M • Updated Oct 3, 2024 • 2

fxmarty/llama-tiny-int4-per-group-sym

1.03M • Updated Oct 25, 2024 • 17

fxmarty/llama-tiny-w-fp8-a-fp8

1.03M • Updated Oct 22, 2024 • 9

fxmarty/llama-tiny-w-fp8-a-fp8-o-fp8

1.03M • Updated Oct 22, 2024 • 11

fxmarty/llama-tiny-w-int8-per-tensor

1.03M • Updated Oct 22, 2024 • 15

fxmarty/llama-small-int4-per-group-sym-awq

16.7M • Updated Oct 29, 2024 • 3

fxmarty/quark-legacy-int8

1.03M • Updated Oct 10, 2024 • 2

fxmarty/llama-tiny-w-int8-b-int8-per-tensor

1.03M • Updated Oct 22, 2024 • 5

fxmarty/llama-small-int4-per-group-sym-awq-old

16.7M • Updated Oct 25, 2024 • 1

amd-quark/llama-tiny-w-int8-per-tensor

1.03M • Updated Dec 18, 2024 • 15

amd-quark/llama-tiny-w-int8-b-int8-per-tensor

1.03M • Updated Dec 18, 2024 • 14

amd-quark/llama-tiny-w-fp8-a-fp8

1.03M • Updated Dec 18, 2024 • 15

amd-quark/llama-tiny-w-fp8-a-fp8-o-fp8

1.03M • Updated Dec 18, 2024 • 16

amd-quark/llama-tiny-int4-per-group-sym

1.03M • Updated Dec 18, 2024 • 13

amd-quark/llama-small-int4-per-group-sym-awq

16.7M • Updated Dec 18, 2024 • 21