MosaicBERT A collection of BERT-based models of different sequence lengths trained on the C4 dataset. Details: https://mosaicbert.github.io/ mosaicml/mosaic-bert-base Fill-Mask • Updated Mar 5, 2024 • 90 • 47 mosaicml/mosaic-bert-base-seqlen-256 Fill-Mask • Updated Mar 5, 2024 • 13 • 2 mosaicml/mosaic-bert-base-seqlen-512 Fill-Mask • Updated Mar 5, 2024 • 7 • 4 mosaicml/mosaic-bert-base-seqlen-1024 Fill-Mask • Updated Mar 5, 2024 • 300 • 15
MosaicBERT A collection of BERT-based models of different sequence lengths trained on the C4 dataset. Details: https://mosaicbert.github.io/ mosaicml/mosaic-bert-base Fill-Mask • Updated Mar 5, 2024 • 90 • 47 mosaicml/mosaic-bert-base-seqlen-256 Fill-Mask • Updated Mar 5, 2024 • 13 • 2 mosaicml/mosaic-bert-base-seqlen-512 Fill-Mask • Updated Mar 5, 2024 • 7 • 4 mosaicml/mosaic-bert-base-seqlen-1024 Fill-Mask • Updated Mar 5, 2024 • 300 • 15