Update README.md
d8b6e3c verified - 1.63 kB Upload 3 files
- 1.04 kB Create LICENSE
- 5.95 kB Update README.md
- 249 Bytes Upload tokenizer
- 3.26 kB Upload Phi3ForCausalLM
- 174 Bytes Upload Phi3ForCausalLM
- 2.42 MB Upload tokenizer
phi4-mini-8dq4w-converted.bin Detected Pickle imports (17)
- "torchao.quantization.quant_api._int8_asymm_per_token_quant",
- "collections.OrderedDict",
- "torch._tensor._rebuild_from_type_v2",
- "torch.float32",
- "torchao.dtypes.affine_quantized_tensor.AffineQuantizedTensor",
- "torch.FloatStorage",
- "torchao.dtypes.uintx.q_dq_layout.QDQLayout",
- "torch._utils._rebuild_tensor_v2",
- "torchao.quantization.linear_activation_quantized_tensor.LinearActivationQuantizedTensor",
- "torch.device",
- "torch.CharStorage",
- "torch.BFloat16Storage",
- "torch.int8",
- "torch._utils._rebuild_wrapper_subclass",
- "torch.serialization._get_layout",
- "torchao.quantization.quant_primitives.ZeroPointDomain",
- "torchao.dtypes.uintx.q_dq_layout.QDQTensorImpl"
How to fix it?
4.81 GB Upload phi4-mini-8dq4w-converted.bin phi4-mini-8dq4w.bin Detected Pickle imports (17)
- "torch._tensor._rebuild_from_type_v2",
- "torch.int8",
- "collections.OrderedDict",
- "torch.CharStorage",
- "torchao.dtypes.uintx.q_dq_layout.QDQLayout",
- "torch.serialization._get_layout",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2",
- "torchao.quantization.quant_primitives.ZeroPointDomain",
- "torch.float32",
- "torch._utils._rebuild_wrapper_subclass",
- "torch.BFloat16Storage",
- "torchao.quantization.quant_api._int8_asymm_per_token_quant",
- "torchao.quantization.linear_activation_quantized_tensor.LinearActivationQuantizedTensor",
- "torchao.dtypes.affine_quantized_tensor.AffineQuantizedTensor",
- "torch.device",
- "torchao.dtypes.uintx.q_dq_layout.QDQTensorImpl"
How to fix it?
4.81 GB Upload 3 files - 3.02 GB Upload 3 files
- 587 Bytes Upload tokenizer
- 15.5 MB Upload tokenizer
- 2.96 kB Upload tokenizer
- 3.91 MB Upload tokenizer
