karamjotsingh
/

Llama-3.2-3B-Instruct

Model card Files Files and versions

Llama-3.2-3B-Instruct

6.43 GB

1 contributor

History: 4 commits

karamjotsingh's picture

llama3.2 3B model awq log for A4 quantizer

a3698f7 verified 2 days ago

.gitattributes

1.52 kB

initial commit 2 months ago
awq.log

431 kB

llama3.2 3B model awq log for A4 quantizer 2 days ago
awq_scales.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage",
- "collections.OrderedDict"
What is a pickle import?
2.2 MB
xet

llama3.2 3B model awq scales for A4 quantizer 2 days ago
rqp_converted.pth
Detected Pickle imports (8)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "rqp.quantization.null_quantizer.NullQuantizer",
- "rqp.quantization.statistics.min_max_stats.MinMaxStats",
- "torch.BFloat16Storage",
- "rqp.quantization.same_quantizer.SameQuantizer",
- "torch.FloatStorage",
- "__builtin__.set"
How to fix it?
6.43 GB
xet

NQ Updated inputs in model 2 months ago