Instructions to use acul3/roberta-base-indo with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use acul3/roberta-base-indo with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="acul3/roberta-base-indo")# Load model directly from transformers import AutoTokenizer, AutoModelForMaskedLM tokenizer = AutoTokenizer.from_pretrained("acul3/roberta-base-indo") model = AutoModelForMaskedLM.from_pretrained("acul3/roberta-base-indo", device_map="auto") - Notebooks
- Google Colab
- Kaggle
add tmux
Browse files
run.sh
CHANGED
|
@@ -15,7 +15,7 @@ tmux new-session -d -s my_session python3 run_mlm_flax.py \
|
|
| 15 |
--adam_beta1="0.9" \
|
| 16 |
--adam_beta2="0.98" \
|
| 17 |
--adam_epsilon="1e-6" \
|
| 18 |
-
--learning_rate="
|
| 19 |
--num_train_epochs="20" \
|
| 20 |
--weight_decay="0.01" \
|
| 21 |
--save_strategy="steps" \
|
|
|
|
| 15 |
--adam_beta1="0.9" \
|
| 16 |
--adam_beta2="0.98" \
|
| 17 |
--adam_epsilon="1e-6" \
|
| 18 |
+
--learning_rate="6e-4" \
|
| 19 |
--num_train_epochs="20" \
|
| 20 |
--weight_decay="0.01" \
|
| 21 |
--save_strategy="steps" \
|