Translation
Transformers.js
ONNX
Basque
marian
text2text-generation
basque
euskara
capitalization
punctuation
restoration
txukun
quantized
int8
Instructions to use itzune/txukun-cap-punct-eu with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers.js
How to use itzune/txukun-cap-punct-eu with Transformers.js:
// npm i @huggingface/transformers import { pipeline } from '@huggingface/transformers'; // Allocate pipeline const pipe = await pipeline('translation', 'itzune/txukun-cap-punct-eu');
Upload tokenizer_config.json with huggingface_hub
Browse files- tokenizer_config.json +3 -2
tokenizer_config.json
CHANGED
|
@@ -35,5 +35,6 @@
|
|
| 35 |
"sp_model_kwargs": {},
|
| 36 |
"target_lang": "modelEuskeraConvertir",
|
| 37 |
"tokenizer_class": "MarianTokenizer",
|
| 38 |
-
"unk_token": "<unk>"
|
| 39 |
-
|
|
|
|
|
|
| 35 |
"sp_model_kwargs": {},
|
| 36 |
"target_lang": "modelEuskeraConvertir",
|
| 37 |
"tokenizer_class": "MarianTokenizer",
|
| 38 |
+
"unk_token": "<unk>",
|
| 39 |
+
"source_spm": "source.spm"
|
| 40 |
+
}
|