Inference Optimization

community

AI & ML interests

None defined yet.

Recent Activity

kylesayrs updated a model 2 days ago

inference-optimization/Kimi-K3-0.40B-MXFP4

nm-research updated a model 3 days ago

inference-optimization/qwe3-8B-selfdistill-v3-fresh3ep_ckpt2

nm-research published a model 3 days ago

inference-optimization/qwe3-8B-selfdistill-v3-fresh3ep_ckpt2

View all activity

inference-optimization 's models 446

inference-optimization/Laguna-XS.2-speculator.dflash-Qwen235B-500k-ckpt0

0.6B • Updated Jun 5 • 9

inference-optimization/gpt-oss-2.5B-A1.3B

3B • Updated Jun 4 • 270

inference-optimization/Llama-4-Scout-1.7B-0.4B-Instruct

Image-Text-to-Text • 2B • Updated Jun 4 • 280

inference-optimization/ctest-Qwen3.5-9B-sliding-window-all-speculator.dflash

2B • Updated Jun 4 • 16

inference-optimization/Llama-3.2-0.5B-Instruct

Text Generation • 0.5B • Updated Jun 3 • 24.7k • 1

inference-optimization/ctest-Qwen3.6-27B-speculator-regen.dflash

3B • Updated Jun 3 • 18 • 1

inference-optimization/ctest-Qwen3.5-9B-sliding-window-speculator.dflash

2B • Updated Jun 3 • 13

inference-optimization/Laguna-XS.2-speculator.dflash-Qwen235B-ckpt6

0.6B • Updated Jun 2 • 12

inference-optimization/Laguna-XS.2-speculator.dflash-Qwen235B-ckpt4

0.6B • Updated Jun 1 • 14

inference-optimization/Laguna-XS.2-speculator.dflash-Qwen235B-ckpt3

0.6B • Updated Jun 1 • 12

inference-optimization/Laguna-XS.2-speculator.dflash-Qwen235B-ckpt2

0.6B • Updated May 29 • 11

inference-optimization/dflash-DeepSeek-V4-Flash-speculators-50k

2B • Updated May 29 • 33

inference-optimization/Laguna-XS.2-speculator.dflash-Qwen235B-ckpt1

0.6B • Updated May 29 • 13

inference-optimization/Gemma4-DFlash-SWA-Causal-Nemo-Cascade

4B • Updated May 26 • 10

inference-optimization/Qwen3-1.6B-A0.9B

Text Generation • 2B • Updated May 24 • 15.5k • 3

inference-optimization/ctest-Qwen3.5-9B-subset-397-speculator.dflash

2B • Updated May 20 • 10

inference-optimization/Qwen3-235B-A22B-Thinking-2507-quantized.w4a16

Text Generation • 32B • Updated May 20 • 47

inference-optimization/Qwen3-235B-A22B-Thinking-2507-quantized.w8a8

Text Generation • 235B • Updated May 20 • 28

inference-optimization/Qwen3-235B-A22B-Instruct-2507-quantized.w4a16

Text Generation • 32B • Updated May 20 • 20

inference-optimization/Qwen3.6-35B-A3B-6.0-bits-mode-hybrid

Image-Text-to-Text • 28B • Updated May 20 • 13

inference-optimization/Gemma4_SWA_DFLASH

4B • Updated May 19 • 11

inference-optimization/final-ctest-Qwen3-8B-speculator.dflash

2B • Updated May 13 • 11

inference-optimization/qwen3-8b-peagle-speculators

inference-optimization/peagle-gemma4

2B • Updated May 6 • 8

inference-optimization/ctest-Qwen3.5-9B-speculator.dflash

2B • Updated May 5 • 16

inference-optimization/MiniMax-M2.5-BF16

Text Generation • 229B • Updated May 5 • 21

inference-optimization/ctest-Qwen3-8B-speculator.dflash

2B • Updated May 5 • 12

inference-optimization/DeepSeek-V4-Flash-bf16-NVFP4-FP8-BLOCK

inference-optimization/DeepSeek-V4-Flash-bf16

inference-optimization/DeepSeek-V4-Flash-5layers-nvfp4moe

20B • Updated Apr 28 • 13