distily
/

distily_dummy

Model card Files Files and versions

Metrics Training metrics Community

distily_dummy / logs

210 kB

1 contributor

History: 1 commit

lapp0's picture

Training in progress, step 2475

5803bc0 verified over 1 year ago

attn_projector=orthogonal, attn_weight=5, extra_grad_stats=True, learning_rate=0.0002, per_device_train_batch_size=4, warmup_ratio=0
Training in progress, step 2475 over 1 year ago
attn_projector=orthogonal, attn_weight=5, learning_rate=0.0002, per_device_train_batch_size=4, warmup_ratio=0
Training in progress, step 2475 over 1 year ago