Spaces:

AsadIsmail
/

ternary-quant-demo

Running

App Files Files Community

ternary-quant-demo / ternary_quant

893 kB

Ctrl+K

Ctrl+K

1 contributor

History: 5 commits

AsadIsmail's picture

Update Qwen2-VL: now text+vision backbone quantized (fixed qkv + NaN bug)

0b1047e verified 9 days ago

ternary_quant
Fix: add HF Hub download support to load_ternary_model 10 days ago
__init__.py

1.73 kB
Bundle ternary_quant package directly (private repo fix) 10 days ago
cli.py

71 kB
Bundle ternary_quant package directly (private repo fix) 10 days ago
conditional_experts.py

43.6 kB
Bundle ternary_quant package directly (private repo fix) 10 days ago
cuda_kernels.py

14.5 kB
Bundle ternary_quant package directly (private repo fix) 10 days ago
data.py

2.47 kB
Bundle ternary_quant package directly (private repo fix) 10 days ago
eval.py

15.8 kB
Bundle ternary_quant package directly (private repo fix) 10 days ago
generative_adapters.py

40.3 kB
Update Qwen2-VL: now text+vision backbone quantized (fixed qkv + NaN bug) 9 days ago
inference.py

42.7 kB
Fix: apply chat template in generate_text (fixes Qwen3 garbage output) 10 days ago
mac_kernels.py

28.3 kB
Bundle ternary_quant package directly (private repo fix) 10 days ago
pipeline.py

16 kB
Bundle ternary_quant package directly (private repo fix) 10 days ago
ptq_families.py

20 kB
Bundle ternary_quant package directly (private repo fix) 10 days ago
quantizer.py

13.3 kB
Bundle ternary_quant package directly (private repo fix) 10 days ago
quantizer_small.py

82.7 kB
Update Qwen2-VL: now text+vision backbone quantized (fixed qkv + NaN bug) 9 days ago
quantizer_v2.py

13.6 kB
Bundle ternary_quant package directly (private repo fix) 10 days ago
storage.py

21.8 kB
Bundle ternary_quant package directly (private repo fix) 10 days ago
toolkit.py

11.9 kB
Bundle ternary_quant package directly (private repo fix) 10 days ago
vllm_backend.py

7.51 kB
Bundle ternary_quant package directly (private repo fix) 10 days ago