Instructions to use kd13/RoPERT-MLM-mini with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use kd13/RoPERT-MLM-mini with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="kd13/RoPERT-MLM-mini", trust_remote_code=True)# Load model directly from transformers import AutoModelForMaskedLM model = AutoModelForMaskedLM.from_pretrained("kd13/RoPERT-MLM-mini", trust_remote_code=True, dtype="auto") - Notebooks
- Google Colab
- Kaggle
Update configuration_mybert.py
Browse files- configuration_mybert.py +1 -1
configuration_mybert.py
CHANGED
|
@@ -37,4 +37,4 @@ class MyBertConfig(PretrainedConfig):
|
|
| 37 |
self.attention_probs_dropout_prob = attention_probs_dropout_prob
|
| 38 |
self.layer_norm_eps = layer_norm_eps
|
| 39 |
self.initializer_range = initializer_range
|
| 40 |
-
self.rope_theta = rope_theta
|
|
|
|
| 37 |
self.attention_probs_dropout_prob = attention_probs_dropout_prob
|
| 38 |
self.layer_norm_eps = layer_norm_eps
|
| 39 |
self.initializer_range = initializer_range
|
| 40 |
+
self.rope_theta = rope_theta
|