Models
Datasets
Spaces
Docs
Enterprise
Pricing
Log In
Sign Up

Spaces:

mshukor
/

UnIVAL

Running

App Files Files Community

Fetching metadata from the HF Docker repository...

UnIVAL / fairseq /examples /m2m_100 /tokenizers

3.88 kB

3 contributors

History: 1 commit

mshukor

init

26fd00c over 2 years ago

thirdparty
init over 2 years ago
README.md
733 Bytes

init over 2 years ago
seg_ja.sh
399 Bytes

init over 2 years ago
seg_ko.sh
397 Bytes

init over 2 years ago
tokenize_indic.py
727 Bytes

init over 2 years ago
tokenize_thai.py
323 Bytes

init over 2 years ago
tokenize_zh.py
309 Bytes

init over 2 years ago
tokenizer_ar.sh
758 Bytes

init over 2 years ago