232 GB

Ctrl+K

1 contributor

History: 349 commits

OpenTransformer

V88: BLOCK_FALLBACKS (64,32,32,32), INIT_STEPS=20000, MAX_STEPS=500000, better XLA cache search, --target_tokens added

8a65203 verified 4 months ago

.gitattributes

1.52 kB
initial commit 4 months ago
README.md

4.16 kB
Add model card documenting N300 training proof-of-concept 4 months ago
final.pt
Detected Pickle imports (4)
- "torch.BFloat16Storage",
- "collections.OrderedDict",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
1.66 GB
xet

Upload final.pt with huggingface_hub 4 months ago
n_tenstorrent_port.py

129 kB
V70 fix: remove double-spacing that broke syntax (10798->5420 lines) 4 months ago
pretrain_step00000002.pt
Detected Pickle imports (4)
- "collections.OrderedDict",
- "torch.BFloat16Storage",
- "torch._utils._rebuild_tensor_v2",
- "torch.FloatStorage"
What is a pickle import?
1.66 GB
xet

Upload pretrain_step00000002.pt with huggingface_hub 4 months ago
pretrain_step00000004.pt
Detected Pickle imports (4)
- "collections.OrderedDict",
- "torch.BFloat16Storage",
- "torch._utils._rebuild_tensor_v2",
- "torch.FloatStorage"
What is a pickle import?
1.66 GB
xet

Upload pretrain_step00000004.pt with huggingface_hub 4 months ago
pretrain_step00000006.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage",
- "collections.OrderedDict",
- "torch.FloatStorage"
What is a pickle import?
1.66 GB
xet

Upload pretrain_step00000006.pt with huggingface_hub 4 months ago
pretrain_step00000008.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "torch.FloatStorage",
- "collections.OrderedDict",
- "torch.BFloat16Storage"
What is a pickle import?
1.66 GB
xet

Upload pretrain_step00000008.pt with huggingface_hub 4 months ago
pretrain_step00000010.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "torch.FloatStorage",
- "collections.OrderedDict",
- "torch.BFloat16Storage"
What is a pickle import?
1.66 GB
xet

Upload pretrain_step00000010.pt with huggingface_hub 4 months ago
pretrain_step00000012.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage",
- "collections.OrderedDict"
What is a pickle import?
1.4 GB
xet

Upload pretrain_step00000012.pt with huggingface_hub 4 months ago
pretrain_step00000013.pt
Detected Pickle imports (3)
- "torch.BFloat16Storage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
1.4 GB
xet

Upload pretrain_step00000013.pt with huggingface_hub 4 months ago
pretrain_step00000014.pt
Detected Pickle imports (3)
- "torch.BFloat16Storage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
1.4 GB
xet

Upload pretrain_step00000014.pt with huggingface_hub 4 months ago
pretrain_step00000034.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage"
What is a pickle import?
1.4 GB
xet

Upload pretrain_step00000034.pt with huggingface_hub 4 months ago
pretrain_step00000040.pt
Detected Pickle imports (3)
- "torch.BFloat16Storage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
1.4 GB
xet

Upload pretrain_step00000040.pt with huggingface_hub 4 months ago
pretrain_step00000042.pt
Detected Pickle imports (3)
- "torch.BFloat16Storage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
1.4 GB
xet

Upload pretrain_step00000042.pt with huggingface_hub 4 months ago
pretrain_step00000044.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch.BFloat16Storage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
1.4 GB
xet

Upload pretrain_step00000044.pt with huggingface_hub 4 months ago
pretrain_step00000247.pt
Detected Pickle imports (3)
- "torch.FloatStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
7.32 GB
xet

Upload pretrain_step00000247.pt with huggingface_hub 4 months ago
pretrain_step00000248.pt
Detected Pickle imports (4)
- "collections.OrderedDict",
- "torch.FloatStorage",
- "torch.BFloat16Storage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
4.45 GB
xet

Upload pretrain_step00000248.pt with huggingface_hub 4 months ago
pretrain_step00000249.pt
Detected Pickle imports (4)
- "torch.BFloat16Storage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.FloatStorage"
What is a pickle import?
4.45 GB
xet

Upload pretrain_step00000249.pt with huggingface_hub 4 months ago
pretrain_step00000250.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage",
- "collections.OrderedDict",
- "torch.FloatStorage"
What is a pickle import?
4.45 GB
xet

Upload pretrain_step00000250.pt with huggingface_hub 4 months ago
pretrain_step00000251.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage",
- "collections.OrderedDict",
- "torch.FloatStorage"
What is a pickle import?
4.45 GB
xet

Upload pretrain_step00000251.pt with huggingface_hub 4 months ago
pretrain_step00000252.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage",
- "collections.OrderedDict",
- "torch.FloatStorage"
What is a pickle import?
4.45 GB
xet

Upload pretrain_step00000252.pt with huggingface_hub 4 months ago
pretrain_step00000253.pt
Detected Pickle imports (4)
- "torch.FloatStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage"
What is a pickle import?
4.45 GB
xet

Upload pretrain_step00000253.pt with huggingface_hub 4 months ago
pretrain_step00000254.pt
Detected Pickle imports (4)
- "torch.FloatStorage",
- "torch.BFloat16Storage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
4.45 GB
xet

Upload pretrain_step00000254.pt with huggingface_hub 4 months ago
pretrain_step00000255.pt
Detected Pickle imports (4)
- "collections.OrderedDict",
- "torch.BFloat16Storage",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
4.45 GB
xet

Upload pretrain_step00000255.pt with huggingface_hub 4 months ago
pretrain_step00000256.pt
Detected Pickle imports (4)
- "torch.BFloat16Storage",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
4.45 GB
xet

Upload pretrain_step00000256.pt with huggingface_hub 4 months ago
pretrain_step00000260.pt
Detected Pickle imports (4)
- "collections.OrderedDict",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage"
What is a pickle import?
4.45 GB
xet

Upload pretrain_step00000260.pt with huggingface_hub 4 months ago
pretrain_step00000264.pt
Detected Pickle imports (4)
- "collections.OrderedDict",
- "torch.BFloat16Storage",
- "torch._utils._rebuild_tensor_v2",
- "torch.FloatStorage"
What is a pickle import?
4.45 GB
xet

Upload pretrain_step00000264.pt with huggingface_hub 4 months ago
pretrain_step00000265.pt
Detected Pickle imports (4)
- "collections.OrderedDict",
- "torch.BFloat16Storage",
- "torch._utils._rebuild_tensor_v2",
- "torch.FloatStorage"
What is a pickle import?
4.45 GB
xet

Upload pretrain_step00000265.pt with huggingface_hub 4 months ago
pretrain_step00000269.pt
Detected Pickle imports (4)
- "torch.BFloat16Storage",
- "collections.OrderedDict",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
4.45 GB
xet

Upload pretrain_step00000269.pt with huggingface_hub 4 months ago
pretrain_step00000270.pt
Detected Pickle imports (4)
- "torch.FloatStorage",
- "torch.BFloat16Storage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
4.45 GB
xet

Upload pretrain_step00000270.pt with huggingface_hub 4 months ago
pretrain_step00000274.pt
Detected Pickle imports (4)
- "torch.FloatStorage",
- "torch.BFloat16Storage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
4.45 GB
xet

Upload pretrain_step00000274.pt with huggingface_hub 4 months ago
pretrain_step00000278.pt
Detected Pickle imports (4)
- "collections.OrderedDict",
- "torch.BFloat16Storage",
- "torch._utils._rebuild_tensor_v2",
- "torch.FloatStorage"
What is a pickle import?
4.45 GB
xet

Upload pretrain_step00000278.pt with huggingface_hub 4 months ago
pretrain_step00000279.pt
Detected Pickle imports (4)
- "collections.OrderedDict",
- "torch.BFloat16Storage",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
4.45 GB
xet

Upload pretrain_step00000279.pt with huggingface_hub 4 months ago
pretrain_step00000283.pt
Detected Pickle imports (4)
- "torch.FloatStorage",
- "torch.BFloat16Storage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
4.45 GB
xet

Upload pretrain_step00000283.pt with huggingface_hub 4 months ago
pretrain_step00000287.pt
Detected Pickle imports (4)
- "collections.OrderedDict",
- "torch.BFloat16Storage",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
4.45 GB
xet

Upload pretrain_step00000287.pt with huggingface_hub 4 months ago
pretrain_step00000288.pt
Detected Pickle imports (4)
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage",
- "collections.OrderedDict"
What is a pickle import?
4.45 GB
xet

Upload pretrain_step00000288.pt with huggingface_hub 4 months ago
pretrain_step00000292.pt
Detected Pickle imports (4)
- "torch.FloatStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage"
What is a pickle import?
4.45 GB
xet

Upload pretrain_step00000292.pt with huggingface_hub 4 months ago
pretrain_step00000293.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.BFloat16Storage",
- "torch.FloatStorage"
What is a pickle import?
4.45 GB
xet

Upload pretrain_step00000293.pt with huggingface_hub 4 months ago
pretrain_step00000294.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.BFloat16Storage",
- "torch.FloatStorage"
What is a pickle import?
4.45 GB
xet

Upload pretrain_step00000294.pt with huggingface_hub 4 months ago
pretrain_step00000295.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.BFloat16Storage",
- "torch.FloatStorage"
What is a pickle import?
4.45 GB
xet

Upload pretrain_step00000295.pt with huggingface_hub 4 months ago
pretrain_step00000296.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.BFloat16Storage",
- "torch.FloatStorage"
What is a pickle import?
4.45 GB
xet

Upload pretrain_step00000296.pt with huggingface_hub 4 months ago
pretrain_step00000297.pt
Detected Pickle imports (4)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage",
- "torch.FloatStorage"
What is a pickle import?
4.45 GB
xet

Upload pretrain_step00000297.pt with huggingface_hub 4 months ago
pretrain_step00000298.pt
Detected Pickle imports (4)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage",
- "torch.FloatStorage"
What is a pickle import?
4.45 GB
xet

Upload pretrain_step00000298.pt with huggingface_hub 4 months ago
pretrain_step00000299.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.FloatStorage",
- "torch.BFloat16Storage"
What is a pickle import?
4.45 GB
xet

Upload pretrain_step00000299.pt with huggingface_hub 4 months ago
pretrain_step00000300.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.FloatStorage",
- "torch.BFloat16Storage"
What is a pickle import?
4.45 GB
xet

Upload pretrain_step00000300.pt with huggingface_hub 4 months ago
pretrain_step00000301.pt
Detected Pickle imports (4)
- "collections.OrderedDict",
- "torch.BFloat16Storage",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
4.45 GB
xet

Upload pretrain_step00000301.pt with huggingface_hub 4 months ago
pretrain_step00000302.pt
Detected Pickle imports (4)
- "collections.OrderedDict",
- "torch.BFloat16Storage",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
4.45 GB
xet

Upload pretrain_step00000302.pt with huggingface_hub 4 months ago
pretrain_step00000303.pt
Detected Pickle imports (4)
- "collections.OrderedDict",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage"
What is a pickle import?
4.45 GB
xet

Upload pretrain_step00000303.pt with huggingface_hub 4 months ago
pretrain_step00000304.pt
Detected Pickle imports (4)
- "collections.OrderedDict",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage"
What is a pickle import?
4.45 GB
xet

Upload pretrain_step00000304.pt with huggingface_hub 4 months ago

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)