Inference Optimization

community

AI & ML interests

None defined yet.

Recent Activity

nm-research updated a model about 4 hours ago

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.2048anc.combdatav2-q235b-instr-v6-ckpt3

nm-research published a model about 4 hours ago

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.2048anc.combdatav2-q235b-instr-v6-ckpt3

weifanjiang updated a model about 6 hours ago

inference-optimization/gemma-4-31B-it-speculator.dflash.swa.causal.fullvocab.muon

View all activity

inference-optimization 's models 306

inference-optimization/Llama-3.1-8B-Instruct-Mixed-NVFP4-FP8_DYNAMIC-qkv_proj-all

5B • Updated Dec 4, 2025 • 4

inference-optimization/Llama-3.1-8B-Instruct-Mixed-NVFP4-FP8_DYNAMIC-out_proj-all

5B • Updated Dec 4, 2025 • 5

inference-optimization/Llama-3.1-8B-Instruct-Mixed-NVFP4-FP8_BLOCK-gate_up_proj-all

7B • Updated Dec 4, 2025 • 3

inference-optimization/Llama-3.1-8B-Instruct-Mixed-NVFP4-FP8_BLOCK-down_proj-all

6B • Updated Dec 4, 2025 • 4

inference-optimization/Llama-3.1-8B-Instruct-Mixed-NVFP4-FP8_BLOCK-qkv_proj-all

5B • Updated Dec 4, 2025 • 3

inference-optimization/Llama-3.1-8B-Instruct-Mixed-NVFP4-FP8_BLOCK-out_proj-all

5B • Updated Dec 4, 2025 • 4