Reproducible training script somewhere?
#4
by Jesse-marqo - opened
Hi, thanks very much for this! I was wondering if you have the code/scripts to reproduce the training exactly? Thanks
Yes here are the pretrain and finetuning configs:
https://github.com/nomic-ai/contrastors/blob/main/src/contrastors/configs/train/contrastive_pretrain_modernbert.yaml
https://github.com/nomic-ai/contrastors/blob/main/src/contrastors/configs/train/contrastive_finetune_modernnomic.yaml
code can be run there! it takes ~1 day for pretraining and about an hour for finetuning
Amazing, thank you!
zpn changed discussion status to closed