solves oom error with more reasonable configuration
d60ab6c
unverified
Tonic
commited on
Spaces:
Running
Running
Commit History
adds max perf script
58a74d2
unverified
Tonic
commited on
removes max sequences length argument from trainer
a2e0482
unverified
Tonic
commited on
removes dataset text field and packing arguments from the trainer
0a8dd72
unverified
Tonic
commited on
removes tokenizer from training arguments
bd882a0
unverified
Tonic
commited on
only enable distributed process group if available - it's not
5e4741a
unverified
Tonic
commited on
solves adam to adam_torch optimizer issue
e092247
unverified
Tonic
commited on
solves eval strategy typo
0c97eb6
unverified
Tonic
commited on
solves dataset dict issue
40f937e
unverified
Tonic
commited on
removes use cache
cb932c7
unverified
Tonic
commited on
removes flash attention 2
07eab17
unverified
Tonic
commited on
fix large training script
829d8f4
unverified
Tonic
commited on
removes flash attention from reqs
e8aadec
unverified
Tonic
commited on
improves requirements and dependencies
0de9de2
unverified
Tonic
commited on
adds trackio support for large experiment
bb64084
unverified
Tonic
commited on
adds A100 large experiments
5fe83da
unverified
Tonic
commited on
adds datasets splits
231fcd0
unverified
Tonic
commited on
adds support for hermes format
0e297cd
unverified
Tonic
commited on
first commit
d8dd7a1
unverified
Tonic
commited on