smithblack-0
/

adaptive-transformer-experiments

Model card Files Files and versions

adaptive-transformer-experiments / Dataset_quality;_Fineweb_Control_50m

211 MB

Ctrl+K

Ctrl+K

1 contributor

History: 1 commit

smithblack-0's picture

Upload folder using huggingface_hub

d87abe6 verified 9 months ago

metrics.json

13.3 MB
xet

Upload folder using huggingface_hub 9 months ago
model.pt
Detected Pickle imports (15)
- "__main__.GPT",
- "torch.nn.modules.dropout.Dropout",
- "torch._utils._rebuild_parameter",
- "torch.nn.modules.normalization.RMSNorm",
- "torch.FloatStorage",
- "collections.OrderedDict",
- "__builtin__.set",
- "__main__.SwiGLU",
- "torch.nn.modules.sparse.Embedding",
- "__main__.CausalSelfAttention",
- "__main__.TransformerBlock",
- "torch.nn.modules.linear.Linear",
- "torch._utils._rebuild_tensor_v2",
- "torch.nn.modules.container.ModuleList",
- "__main__.RotaryPositionalEmbedding"
How to fix it?
198 MB
xet

Upload folder using huggingface_hub 9 months ago