inference-optimization/Qwen3-30B-A3B-6.5-bits-mode-heuristic-per-tensor
25B • Updated • 49
Inference Optimization
community
AI & ML interests
None defined yet.
Recent Activity
View all activity
inference-optimization/Qwen3-30B-A3B-6-bits-mode-noise-per-tensor
23B • Updated • 45
inference-optimization/Qwen3-30B-A3B-6-bits-mode-hybrid-per-tensor
23B • Updated • 52
inference-optimization/Qwen3-30B-A3B-6-bits-mode-heuristic-per-tensor
23B • Updated • 66
inference-optimization/Qwen3-30B-A3B-5.5-bits-mode-noise-per-tensor
21B • Updated • 48
inference-optimization/Qwen3-30B-A3B-5.5-bits-mode-hybrid-per-tensor
21B • Updated • 46
inference-optimization/Qwen3-30B-A3B-5.5-bits-mode-heuristic-per-tensor
21B • Updated • 42
inference-optimization/Qwen3-30B-A3B-5-bits-mode-noise-per-tensor
19B • Updated • 46
inference-optimization/Qwen3-30B-A3B-5-bits-mode-hybrid-per-tensor
19B • Updated • 48
inference-optimization/Qwen3-30B-A3B-5-bits-mode-heuristic-per-tensor
19B • Updated • 61
inference-optimization/Qwen3-8B-7-bits-mode-noise-per-tensor
6B • Updated • 64
inference-optimization/Qwen3-8B-7-bits-mode-hybrid-per-tensor
7B • Updated • 76
inference-optimization/Qwen3-8B-7-bits-mode-heuristic-per-tensor
7B • Updated • 78
inference-optimization/Qwen3-8B-6.5-bits-mode-noise-per-tensor
6B • Updated • 54
inference-optimization/Qwen3-8B-6.5-bits-mode-hybrid-per-tensor
7B • Updated • 51
inference-optimization/Qwen3-8B-6.5-bits-mode-heuristic-per-tensor
7B • Updated • 61
inference-optimization/Qwen3-8B-6-bits-mode-noise-per-tensor
6B • Updated • 51
inference-optimization/Qwen3-8B-6-bits-mode-hybrid-per-tensor
6B • Updated • 50
inference-optimization/Qwen3-8B-6-bits-mode-heuristic-per-tensor
6B • Updated • 54
inference-optimization/Qwen3-8B-5.5-bits-mode-noise-per-tensor
6B • Updated • 53
inference-optimization/Qwen3-8B-5.5-bits-mode-hybrid-per-tensor
6B • Updated • 53
inference-optimization/Qwen3-8B-5.5-bits-mode-heuristic-per-tensor
6B • Updated • 54
inference-optimization/Qwen3-8B-5-bits-mode-noise-per-tensor
6B • Updated • 51
inference-optimization/Qwen3-8B-5-bits-mode-hybrid-per-tensor
6B • Updated • 59
inference-optimization/Qwen3-8B-5-bits-mode-heuristic-per-tensor
6B • Updated • 54
inference-optimization/Llama-3.1-8B-Instruct-7-bits-mode-noise-per-tensor
7B • Updated • 41
inference-optimization/Llama-3.1-8B-Instruct-7-bits-mode-hybrid-per-tensor
7B • Updated • 38
inference-optimization/Llama-3.1-8B-Instruct-7-bits-mode-heuristic-per-tensor
7B • Updated • 44
inference-optimization/Llama-3.1-8B-Instruct-6.5-bits-mode-noise-per-tensor
7B • Updated • 37
inference-optimization/Llama-3.1-8B-Instruct-6.5-bits-mode-hybrid-per-tensor
7B • Updated • 52