Commit History

fix: shift logits/labels for proper causal LM loss (was predicting current token instead of next token)
3edee97
verified

maidacundo commited on

fix: shift logits/labels for proper causal LM loss in production training script
8fed5c0
verified

maidacundo commited on

Add test suite
d4614fe
verified

maidacundo commited on

Add production training script
0548459
verified

maidacundo commited on

Add training script
2856afb
verified

maidacundo commited on

Add model variants
0d82fdc
verified

maidacundo commited on

Add modeling code
6bc6db6
verified

maidacundo commited on

Add configuration
63f06d0
verified

maidacundo commited on

Add package __init__
a8b0758
verified

maidacundo commited on

Add README
8efa1bb
verified

maidacundo commited on

initial commit
574ee90
verified

maidacundo commited on