Initial commit
c349172 verified pythia-2.8b-deduped_blocks.0.hook_mlp_out_s5120_100M_tokens.pt Detected Pickle imports (23)
- "pyarrow.lib.type_for_alias",
- "torch.float32",
- "pyarrow.lib._reconstruct_table",
- "pyarrow.lib.chunked_array",
- "numpy.ndarray",
- "datasets.table.InMemoryTable",
- "pyarrow.lib._restore_array",
- "torch._utils._rebuild_tensor_v2",
- "datasets.features.features.Features",
- "numpy.dtype",
- "numpy.core.multiarray._reconstruct",
- "collections.OrderedDict",
- "datasets.info.DatasetInfo",
- "pyarrow.lib.field",
- "pyarrow.lib.py_buffer",
- "pyarrow.lib._reconstruct_record_batch",
- "datasets.features.features.Value",
- "pyarrow.lib.schema",
- "_codecs.encode",
- "datasets.arrow_dataset.Dataset",
- "torch.FloatStorage",
- "__builtin__.bytearray",
- "sae.config.Config"
How to fix it?
124 MB Initial commit