Tfloow
/

OmniQuant

Weight-Quantization

Model card Files Files and versions

1.25 GB

Ctrl+K

Ctrl+K

1 contributor

History: 12 commits

Tfloow's picture

Upload folder using huggingface_hub

7d74872 verified 3 months ago

.gitattributes

1.52 kB
initial commit 3 months ago
Llama-2-7b-hf-w4a16g128.pth

203 MB
xet

Upload folder using huggingface_hub 3 months ago
Llama-3.1-8B-w4a16g128.pth

218 MB
xet

Upload folder using huggingface_hub 3 months ago
Llama-3.2-1B-w4a16g128.pth
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.HalfStorage"
What is a pickle import?
30.5 MB
xet

Upload Llama-3.2-1B-w4a16g128.pth 3 months ago
Llama-3.2-3B-w4a16g128.pth
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.HalfStorage"
What is a pickle import?
88.2 MB
xet

Upload folder using huggingface_hub 3 months ago
Qwen2.5-0.5B-w4a16g128.pth

11.3 MB
xet

Upload folder using huggingface_hub 3 months ago
Qwen2.5-14B-w4a16g128.pth

413 MB
xet

Upload folder using huggingface_hub 3 months ago
Qwen2.5-3B-w4a16g128.pth
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.HalfStorage"
What is a pickle import?
86.9 MB
xet

Upload folder using huggingface_hub 3 months ago
Qwen2.5-7B-w4a16g128.pth
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.HalfStorage"
What is a pickle import?
204 MB
xet

Upload folder using huggingface_hub 3 months ago
README.md

914 Bytes
Update README.md 3 months ago