Instructions to use GottBERT/GottBERT_base_last with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use GottBERT/GottBERT_base_last with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="GottBERT/GottBERT_base_last")# Load model directly from transformers import AutoTokenizer, AutoModelForMaskedLM tokenizer = AutoTokenizer.from_pretrained("GottBERT/GottBERT_base_last") model = AutoModelForMaskedLM.from_pretrained("GottBERT/GottBERT_base_last") - Inference
- Notebooks
- Google Colab
- Kaggle
Add link to paper
#3
by nielsr HF Staff - opened
README.md
CHANGED
|
@@ -17,7 +17,7 @@ GottBERT is the first German-only RoBERTa model, pre-trained on the German porti
|
|
| 17 |
- **Large Model**: 24 layers, 355 million parameters
|
| 18 |
- **License**: MIT
|
| 19 |
|
| 20 |
-
|
| 21 |
|
| 22 |
## Pretraining Details
|
| 23 |
|
|
|
|
| 17 |
- **Large Model**: 24 layers, 355 million parameters
|
| 18 |
- **License**: MIT
|
| 19 |
|
| 20 |
+
This was presented in [GottBERT: a pure German Language Model](https://huggingface.co/papers/2012.02110).
|
| 21 |
|
| 22 |
## Pretraining Details
|
| 23 |
|