Commit
·
7d95fb6
1
Parent(s):
7088f81
updated with v2 model
Browse files- README.md +4 -0
- config.json +1 -1
- pytorch_model.bin +1 -1
README.md
CHANGED
|
@@ -7,6 +7,7 @@ license: cc-by-sa-4.0
|
|
| 7 |
|
| 8 |
# t5-sl-small
|
| 9 |
t5-sl-small model is a Slovene T5 model. It has 8 encoder and 8 decoder layers, in total about 60 million parameters.
|
|
|
|
| 10 |
|
| 11 |
## Corpora
|
| 12 |
The following corpora were used for training the model:
|
|
@@ -15,3 +16,6 @@ The following corpora were used for training the model:
|
|
| 15 |
* Janes 1.0 (only Janes-news, Janes-forum, Janes-blog, Janes-wiki subcorpora)
|
| 16 |
* Slovenian parliamentary corpus siParl 2.0
|
| 17 |
* slWaC
|
|
|
|
|
|
|
|
|
|
|
|
| 7 |
|
| 8 |
# t5-sl-small
|
| 9 |
t5-sl-small model is a Slovene T5 model. It has 8 encoder and 8 decoder layers, in total about 60 million parameters.
|
| 10 |
+
It was trained for 5 epochs on the following corpora:
|
| 11 |
|
| 12 |
## Corpora
|
| 13 |
The following corpora were used for training the model:
|
|
|
|
| 16 |
* Janes 1.0 (only Janes-news, Janes-forum, Janes-blog, Janes-wiki subcorpora)
|
| 17 |
* Slovenian parliamentary corpus siParl 2.0
|
| 18 |
* slWaC
|
| 19 |
+
|
| 20 |
+
## Changelog
|
| 21 |
+
2022-07-21: updated with v2 of the model, the old one is still accesible at [cjvt/legacy-t5-sl-small](https://huggingface.co/cjvt/legacy-t5-sl-small).
|
config.json
CHANGED
|
@@ -22,7 +22,7 @@
|
|
| 22 |
"relative_attention_num_buckets": 32,
|
| 23 |
"tie_word_embeddings": false,
|
| 24 |
"torch_dtype": "float32",
|
| 25 |
-
"transformers_version": "4.
|
| 26 |
"use_cache": true,
|
| 27 |
"vocab_size": 32000
|
| 28 |
}
|
|
|
|
| 22 |
"relative_attention_num_buckets": 32,
|
| 23 |
"tie_word_embeddings": false,
|
| 24 |
"torch_dtype": "float32",
|
| 25 |
+
"transformers_version": "4.9.1",
|
| 26 |
"use_cache": true,
|
| 27 |
"vocab_size": 32000
|
| 28 |
}
|
pytorch_model.bin
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 307402757
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:891fa1f9de9d243383fe075f4e8a044b3147a842d21d05f4e7a91db19eb820c0
|
| 3 |
size 307402757
|