smithblack-0
/

adaptive-transformer-experiments

Model card Files Files and versions

adaptive-transformer-experiments / Dataset_quality;_Fineweb_Adaptive_50m

201 MB

Ctrl+K

Ctrl+K

1 contributor

History: 1 commit

This model has 46 files scanned as unsafe.

smithblack-0's picture

Upload folder using huggingface_hub

f9f76b9 verified 9 months ago

metrics.json

3.32 MB
Upload folder using huggingface_hub 9 months ago
model.pt
Detected Pickle imports (15)
- "__main__.GPT",
- "__main__.TransformerBlock",
- "__main__.CausalSelfAttention",
- "torch._utils._rebuild_tensor_v2",
- "torch.nn.modules.sparse.Embedding",
- "__main__.RotaryPositionalEmbedding",
- "__builtin__.set",
- "__main__.SwiGLU",
- "torch._utils._rebuild_parameter",
- "collections.OrderedDict",
- "torch.FloatStorage",
- "torch.nn.modules.container.ModuleList",
- "torch.nn.modules.dropout.Dropout",
- "torch.nn.modules.linear.Linear",
- "torch.nn.modules.normalization.RMSNorm"
How to fix it?
198 MB
xet

Upload folder using huggingface_hub 9 months ago