VPTQ-community

community

AI & ML interests

None defined yet.

OpenSourceRonin

in VPTQ-community/README 6 months ago

using VPTQ for my own models

#3 opened 6 months ago by

OpenSourceRonin

updated 19 models 11 months ago

VPTQ-community/Qwen2.5-72B-Instruct-v16-k65536-256-woft

6B • Updated Mar 20, 2025

VPTQ-community/Meta-Llama-3.1-8B-Instruct-v8-k65536-4096-woft

2B • Updated Mar 20, 2025 • 85

VPTQ-community/Meta-Llama-3-70B-v16-k65536-65536-woft

8B • Updated Mar 20, 2025

VPTQ-community/Meta-Llama-3-70B-v12-k4096-4096-woft

6B • Updated Mar 20, 2025 • 1

VPTQ-community/Meta-Llama-3-70B-v12-k4096-4096-ft

6B • Updated Mar 20, 2025 • 2

VPTQ-community/Meta-Llama-3-8B-v12-k4096-4096-woft

2B • Updated Mar 20, 2025 • 1

VPTQ-community/Qwen2.5-14B-Instruct-v8-k65536-256-woft

3B • Updated Mar 20, 2025 • 6

VPTQ-community/Qwen2.5-14B-Instruct-v8-k65536-65536-woft

4B • Updated Mar 20, 2025 • 1

VPTQ-community/Qwen2.5-7B-Instruct-v8-k65536-65536-woft

2B • Updated Mar 20, 2025 • 42

VPTQ-community/Meta-Llama-3.1-8B-Instruct-v8-k65536-65536-woft

2B • Updated Mar 20, 2025 • 22

VPTQ-community/Qwen2.5-14B-Instruct-v8-k65536-0-woft

3B • Updated Mar 20, 2025 • 2

VPTQ-community/Qwen2.5-14B-Instruct-v16-k65536-65536-woft

3B • Updated Mar 20, 2025 • 5

VPTQ-community/Meta-Llama-3-8B-v6-k4096-4096-woft

2B • Updated Mar 20, 2025 • 1

VPTQ-community/Meta-Llama-3.1-8B-Instruct-v8-k65536-256-woft

2B • Updated Mar 20, 2025 • 8 • 1

VPTQ-community/Qwen2.5-7B-Instruct-v8-k256-256-woft

2B • Updated Mar 20, 2025 • 194

VPTQ-community/Qwen2.5-14B-Instruct-v8-k256-256-woft

2B • Updated Mar 20, 2025 • 1

VPTQ-community/Qwen2.5-7B-Instruct-v8-k65536-0-woft

2B • Updated Mar 20, 2025 • 3

VPTQ-community/Meta-Llama-3-8B-v4-k4096-0-woft

2B • Updated Mar 20, 2025

VPTQ-community/Qwen2.5-7B-Instruct-v8-k65536-256-woft

2B • Updated Mar 20, 2025 • 5