inference-optimization
/

Llama-3.1-8B-Instruct-HIGGS-quantized-paths

Model card Files Files and versions

Llama-3.1-8B-Instruct-HIGGS-quantized-paths / model.layers.0.mlp.gate_proj

352 MB

Ctrl+K

Ctrl+K

1 contributor

History: 1 commit

krishnateja95's picture

Upload folder using huggingface_hub

f2c97c3 verified 3 months ago

FP8_Block.pth
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage"
What is a pickle import?
117 MB
xet

Upload folder using huggingface_hub 3 months ago
FP8_Dynamic.pth
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage"
What is a pickle import?
117 MB
xet

Upload folder using huggingface_hub 3 months ago
NVFP4.pth
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage"
What is a pickle import?
117 MB
xet

Upload folder using huggingface_hub 3 months ago