inference-optimization/Llama-3.2-3B-Instruct_5.5_bits_mode_heuristic
3B • Updated • 8
Inference Optimization
community
AI & ML interests
None defined yet.
Recent Activity
View all activity
inference-optimization/Llama-3.2-3B-Instruct_5.5_bits_mode_noise
3B • Updated • 8
inference-optimization/Llama-3.2-3B-Instruct_5.5_bits_mode_hybrid
3B • Updated • 7
inference-optimization/Llama-3.2-3B-Instruct_5_bits_mode_heuristic
3B • Updated • 12
inference-optimization/Llama-3.2-3B-Instruct_5_bits_mode_noise
3B • Updated • 7
inference-optimization/Llama-3.2-3B-Instruct_5_bits_mode_hybrid
3B • Updated • 6
inference-optimization/Llama-3.2-1B-Instruct_7_bits_mode_noise
1B • Updated • 10
inference-optimization/Llama-3.2-1B-Instruct_6.5_bits_mode_noise
1B • Updated • 6
inference-optimization/Llama-3.2-1B-Instruct_6.5_bits_mode_hybrid
1B • Updated • 11
inference-optimization/Llama-3.2-1B-Instruct_6_bits_mode_noise
1B • Updated • 7
inference-optimization/Llama-3.2-1B-Instruct_6_bits_mode_hybrid
1B • Updated • 8
inference-optimization/Llama-3.2-1B-Instruct_5.5_bits_mode_heuristic
1B • Updated • 7
inference-optimization/Llama-3.2-1B-Instruct_5.5_bits_mode_noise
1B • Updated • 10
inference-optimization/Llama-3.2-1B-Instruct_5.5_bits_mode_hybrid
1B • Updated • 7
inference-optimization/Llama-3.2-1B-Instruct_5_bits_mode_heuristic
1B • Updated • 9
inference-optimization/Llama-3.2-1B-Instruct_5_bits_mode_noise
1B • Updated • 6
inference-optimization/Llama-3.2-1B-Instruct_5_bits_mode_hybrid
1B • Updated • 7
inference-optimization/Llama-3.2-1B-Instruct_7_bits_mode_heuristic
1B • Updated • 8
inference-optimization/Llama-3.2-1B-Instruct_7_bits_mode_hybrid
1B • Updated • 9
inference-optimization/Llama-3.2-1B-Instruct_6.5_bits_mode_heuristic
1B • Updated • 15
inference-optimization/Llama-3.2-1B-Instruct_6_bits_mode_heuristic
1B • Updated • 9
inference-optimization/Qwen3-8B_7_bits_mode_heuristic
7B • Updated • 7
inference-optimization/Qwen3-8B_7_bits_mode_noise
7B • Updated • 7
inference-optimization/Qwen3-8B_7_bits_mode_hybrid
7B • Updated • 7
inference-optimization/Qwen3-8B_6.5_bits_mode_heuristic
7B • Updated • 8
inference-optimization/Qwen3-8B_6.5_bits_mode_noise
7B • Updated • 7
inference-optimization/Qwen3-8B_6.5_bits_mode_hybrid
7B • Updated • 9
inference-optimization/Qwen3-8B_6_bits_mode_heuristic
7B • Updated • 8
inference-optimization/Qwen3-8B_6_bits_mode_noise
7B • Updated • 13
inference-optimization/Qwen3-8B_6_bits_mode_hybrid
7B • Updated • 8