Models

Firworks/FAPO-32B-nvfp4

19B • Updated Oct 26 • 6

CPU-Hybrid-MoE/DeepSeek-R1-0528-GPU-FP8-GPTQ4

Text Generation • 106B • Updated about 1 month ago • 22

Firworks/Dolphin-Mistral-24B-Venice-Edition-nvfp4

14B • Updated Oct 26 • 5

Benasd/Qwen3-30B-A3B-Instruct-2507-NVFP4-BF16-MIXED-2

18B • Updated Oct 26 • 6

mratsim/Nova-70B-NVFP4A16

Text Generation • 41B • Updated Oct 26 • 9

mratsim/Anubis-70B-v1.1-NVFP4A16

Text Generation • 41B • Updated Oct 26 • 10

mratsim/GoldDiamondGold-L33-70B-NVFP4A16

Text Generation • 41B • Updated Nov 8 • 13

mratsim/L3.3-Ignition-v0.1-70B-NVFP4A16

Text Generation • 41B • Updated Nov 8 • 12

mratsim/Strawberrylemonade-L3-70B-v1.1-NVFP4A16

Text Generation • 41B • Updated Oct 26 • 670

RedHatAI/granite-4.0-h-small-FP8-dynamic

Text Generation • 32B • Updated 9 days ago • 20

Firworks/Hermes-4-70B-nvfp4

41B • Updated Oct 26 • 25 • 2

cerebras/GLM-4.5-Air-REAP-82B-A12B-FP8

Text Generation • 82B • Updated Oct 27 • 481 • 5

RedHatAI/Llama-4-Maverick-17B-128E-Instruct-FP8-block

Text Generation • 402B • Updated Oct 27 • 19 • 1

BaoLocTown/thanh-hug-lora-awq

0.3B • Updated Oct 27 • 4

Benasd/Qwen3-30B-A3B-Instruct-2507-NVFP4-FP8-MIXED

18B • Updated Oct 27 • 8

ig1/Qwen3-Coder-30B-A3B-Instruct-NVFP4

Text Generation • 17B • Updated Oct 27 • 570 • 1

BaoLocTown/thanh-GN-gemma-lora

1B • Updated Oct 27 • 2

nm-testing/TinyLlama-1.1B-Chat-v1.0-NVFP4-e2e

0.7B • Updated 9 days ago • 31

nm-testing/TinyLlama-1.1B-Chat-v1.0-NVFP4A16-e2e

0.7B • Updated 10 days ago • 165

nm-testing/TinyLlama-1.1B-Chat-v1.0-FP8_BLOCK-e2e

1B • Updated 10 days ago • 22

nm-testing/TinyLlama-1.1B-Chat-v1.0-FP8_DYNAMIC-e2e

1B • Updated 10 days ago • 27

nm-testing/TinyLlama-1.1B-Chat-v1.0-FP8-e2e

1B • Updated 9 days ago • 582

nm-testing/TinyLlama-1.1B-Chat-v1.0-FP8A16_channel-e2e

1B • Updated 10 days ago • 15

nm-testing/TinyLlama-1.1B-Chat-v1.0-FP8A16_tensor-e2e

1B • Updated 10 days ago • 15

nm-testing/TinyLlama-1.1B-Chat-v1.0-W8A8_channel_weight_static_per_tensor-e2e

1B • Updated 10 days ago • 25

nm-testing/TinyLlama-1.1B-Chat-v1.0-W8A8-e2e

1B • Updated 10 days ago • 11

nm-testing/TinyLlama-1.1B-Chat-v1.0-W8A8_tensor_weight_static_per_tensor_act-e2e

1B • Updated 10 days ago • 21

nm-testing/TinyLlama-1.1B-Chat-v1.0-kv_cache_default_gptq_tinyllama-e2e

0.3B • Updated 9 days ago • 21

nm-testing/Phi-3-mini-4k-instruct-kv_cache_default_phi3-e2e

4B • Updated 10 days ago • 19

nm-testing/TinyLlama-1.1B-Chat-v1.0-kv_cache_default_tinyllama-e2e

1B • Updated 10 days ago • 24