bertin-project
/

bertin-base-random-exp-512seqlen

Model card Files Files and versions

Metrics Training metrics Community

bertin-base-random-exp-512seqlen

5.3 GB

Ctrl+K

Ctrl+K

4 contributors

History: 6 commits

Pablogps's picture

Update README.md

3dff778 almost 5 years ago

configs
Step... (240001/250000 | Loss: 2.1932833194732666, Acc: 0.5893170833587646): 4%|▉ | 10063/250000 [3:28:31<88:33:32, 1.33s/it] almost 5 years ago
mc4
Step... (240001/250000 | Loss: 2.1932833194732666, Acc: 0.5893170833587646): 4%|▉ | 10063/250000 [3:28:31<88:33:32, 1.33s/it] almost 5 years ago
outputs
Step... (249001/250000 | Loss: 2.184157609939575, Acc: 0.5907210111618042): 8%|█▉ | 19999/250000 [6:53:56<72:26:45, 1.13s/it] almost 5 years ago
.gitattributes

823 Bytes
Step... (240001/250000 | Loss: 2.1932833194732666, Acc: 0.5893170833587646): 4%|▉ | 10063/250000 [3:28:31<88:33:32, 1.33s/it] almost 5 years ago
.gitignore

39 Bytes
Step... (240001/250000 | Loss: 2.1932833194732666, Acc: 0.5893170833587646): 4%|▉ | 10063/250000 [3:28:31<88:33:32, 1.33s/it] almost 5 years ago
README.md

1.18 kB
Update README.md almost 5 years ago
config.json

618 Bytes
Step... (240001/250000 | Loss: 2.1932833194732666, Acc: 0.5893170833587646): 4%|▉ | 10063/250000 [3:28:31<88:33:32, 1.33s/it] almost 5 years ago
convert.py

876 Bytes
Step... (240001/250000 | Loss: 2.1932833194732666, Acc: 0.5893170833587646): 4%|▉ | 10063/250000 [3:28:31<88:33:32, 1.33s/it] almost 5 years ago
flax_model.msgpack

250 MB
xet

Step... (249001/250000 | Loss: 2.184157609939575, Acc: 0.5907210111618042): 8%|█▉ | 19999/250000 [6:53:56<72:26:45, 1.13s/it] almost 5 years ago
merges.txt

514 kB
Step... (240001/250000 | Loss: 2.1932833194732666, Acc: 0.5893170833587646): 4%|▉ | 10063/250000 [3:28:31<88:33:32, 1.33s/it] almost 5 years ago
pytorch_model.bin
Detected Pickle imports (4)
- "torch.LongStorage",
- "torch.FloatStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
499 MB
xet

Step... (249001/250000 | Loss: 2.184157609939575, Acc: 0.5907210111618042): 8%|█▉ | 19999/250000 [6:53:56<72:26:45, 1.13s/it] almost 5 years ago
run_mlm_flax_stream.py

33 kB
Step... (240001/250000 | Loss: 2.1932833194732666, Acc: 0.5893170833587646): 4%|▉ | 10063/250000 [3:28:31<88:33:32, 1.33s/it] almost 5 years ago
run_stream.128.sh

930 Bytes
Step... (240001/250000 | Loss: 2.1932833194732666, Acc: 0.5893170833587646): 4%|▉ | 10063/250000 [3:28:31<88:33:32, 1.33s/it] almost 5 years ago
run_stream.512.sh

996 Bytes
Step... (240001/250000 | Loss: 2.1932833194732666, Acc: 0.5893170833587646): 4%|▉ | 10063/250000 [3:28:31<88:33:32, 1.33s/it] almost 5 years ago
run_stream.log

3.64 MB
xet

Step... (249001/250000 | Loss: 2.184157609939575, Acc: 0.5907210111618042): 8%|█▉ | 19999/250000 [6:53:56<72:26:45, 1.13s/it] almost 5 years ago
special_tokens_map.json

239 Bytes
Step... (240001/250000 | Loss: 2.1932833194732666, Acc: 0.5893170833587646): 4%|▉ | 10063/250000 [3:28:31<88:33:32, 1.33s/it] almost 5 years ago
tokenizer.json

1.47 MB
Step... (240001/250000 | Loss: 2.1932833194732666, Acc: 0.5893170833587646): 4%|▉ | 10063/250000 [3:28:31<88:33:32, 1.33s/it] almost 5 years ago
tokenizer_config.json

292 Bytes
Step... (240001/250000 | Loss: 2.1932833194732666, Acc: 0.5893170833587646): 4%|▉ | 10063/250000 [3:28:31<88:33:32, 1.33s/it] almost 5 years ago
vocab.json

855 kB
Step... (240001/250000 | Loss: 2.1932833194732666, Acc: 0.5893170833587646): 4%|▉ | 10063/250000 [3:28:31<88:33:32, 1.33s/it] almost 5 years ago