HRuiii/awq-omni-layer-4bit_by_similarity
7B • Updated • 4
Huarui Liu
HRuiii
AI & ML interests
None yet
Organizations
None yet
models 29
HRuiii/awq-omni-layer-4bit_by_similarity_compare_outputs
7B • Updated • 4
HRuiii/Llama-2-7b-hybrid-awq-omni-4bit-128g
Updated • 4
HRuiii/Llama-2-7b-w4a16g128-omniquant
7B • Updated • 5
HRuiii/Meta-Llama-3-8B-Instruct-awq-4bit
8B • Updated • 3
HRuiii/Meta-Llama-3-8B-Instruct-awq-8bit
8B • Updated • 5
HRuiii/Llama-2-7b-hf-awq-4bit
7B • Updated • 7 • 1
HRuiii/Llama-2-7b-hf-awq-8bit
7B • Updated • 5
HRuiii/LLaMA-3-8B-awq-8bit
8B • Updated • 3
HRuiii/LLaMA-3-8B-awq-4bit
8B • Updated • 3
datasets 0
None public yet