Instructions to use maktzgls/bert-jepa-medium-cosine with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use maktzgls/bert-jepa-medium-cosine with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="maktzgls/bert-jepa-medium-cosine")# Load model directly from transformers import AutoTokenizer, AutoModelForMaskedLM tokenizer = AutoTokenizer.from_pretrained("maktzgls/bert-jepa-medium-cosine") model = AutoModelForMaskedLM.from_pretrained("maktzgls/bert-jepa-medium-cosine", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Ctrl+K
Checkpoint: checkpoint_epoch_5.pt (epoch 5, step 3125) | Experiment: medium-cosine | Medium training run with cosine loss: 2 language pairs, 10k examples per pair, 5 epochs
8340ae3 verified