Instructions to use Doohae/lassl-koelectra-base with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Doohae/lassl-koelectra-base with Transformers:
# Load model directly from transformers import AutoTokenizer, AutoModelForPreTraining tokenizer = AutoTokenizer.from_pretrained("Doohae/lassl-koelectra-base") model = AutoModelForPreTraining.from_pretrained("Doohae/lassl-koelectra-base") - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -1,6 +1,6 @@
|
|
| 1 |
# ELECTRA discriminator base
|
| 2 |
- pretrained with large Korean corpus datasets (30GB)
|
| 3 |
-
- 113M model parameters (followed google/electra-
|
| 4 |
- 35,000 vocab size
|
| 5 |
- trained for 1,000,000 steps
|
| 6 |
- built on [lassl](https://github.com/lassl/lassl) framework
|
|
|
|
| 1 |
# ELECTRA discriminator base
|
| 2 |
- pretrained with large Korean corpus datasets (30GB)
|
| 3 |
+
- 113M model parameters (followed google/electra-base-discriminator config)
|
| 4 |
- 35,000 vocab size
|
| 5 |
- trained for 1,000,000 steps
|
| 6 |
- built on [lassl](https://github.com/lassl/lassl) framework
|