Fill-Mask
Transformers
PyTorch
Safetensors
English
modernbert
masked-lm
long-context
BioClinical-ModernBERT
clinical
biomedical
clinical encoder
clinical modern bert
Instructions to use thomas-sounack/BioClinical-ModernBERT-base with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use thomas-sounack/BioClinical-ModernBERT-base with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="thomas-sounack/BioClinical-ModernBERT-base")# Load model directly from transformers import AutoTokenizer, AutoModelForMaskedLM tokenizer = AutoTokenizer.from_pretrained("thomas-sounack/BioClinical-ModernBERT-base") model = AutoModelForMaskedLM.from_pretrained("thomas-sounack/BioClinical-ModernBERT-base") - Inference
- Notebooks
- Google Colab
- Kaggle
the Code-Repo Link is 404 (private repo)
#1
by Tonic - opened
the code link leads to https://github.com/lindvalllab/BioClinical-ModernBERT but it's a private code repo , i'm just a geek that wants to fine tune on our own data :-)
Hi @Tonic , sorry about that! Working on cleaning the repo, it will be available very soon. In addition to that we will also release a step-by-step guide on how to continue pre-training on your own data with ModernBERT and/or BioClinical ModernBERT a bit later!
thomas-sounack changed discussion status to closed
Closing as the github repo has been made public!