Instructions to use tutur90/SONAR-Mini-Text-to-Text with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use tutur90/SONAR-Mini-Text-to-Text with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="tutur90/SONAR-Mini-Text-to-Text")# Load model directly from transformers import AutoTokenizer, AutoModelForSeq2SeqLM tokenizer = AutoTokenizer.from_pretrained("tutur90/SONAR-Mini-Text-to-Text") model = AutoModelForSeq2SeqLM.from_pretrained("tutur90/SONAR-Mini-Text-to-Text", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use tutur90/SONAR-Mini-Text-to-Text with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "tutur90/SONAR-Mini-Text-to-Text" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "tutur90/SONAR-Mini-Text-to-Text", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/tutur90/SONAR-Mini-Text-to-Text
- SGLang
How to use tutur90/SONAR-Mini-Text-to-Text with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "tutur90/SONAR-Mini-Text-to-Text" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "tutur90/SONAR-Mini-Text-to-Text", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "tutur90/SONAR-Mini-Text-to-Text" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "tutur90/SONAR-Mini-Text-to-Text", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use tutur90/SONAR-Mini-Text-to-Text with Docker Model Runner:
docker model run hf.co/tutur90/SONAR-Mini-Text-to-Text
| { | |
| "predict_avg_bleu": 14.440597945488665, | |
| "predict_avg_bleu_AE": 14.153531539079665, | |
| "predict_avg_bleu_X-eng": 20.607019901695843, | |
| "predict_avg_bleu_eng-X": 8.984136456827802, | |
| "predict_bleu_ace_Arab-ace_Arab": 0.6124101229090743, | |
| "predict_bleu_ace_Arab-eng_Latn": 7.904886571761889, | |
| "predict_bleu_ace_Latn-ace_Latn": 2.412967155612422, | |
| "predict_bleu_ace_Latn-eng_Latn": 15.876522847334783, | |
| "predict_bleu_acm_Arab-acm_Arab": 2.1619288659452875, | |
| "predict_bleu_acm_Arab-eng_Latn": 22.717613934459727, | |
| "predict_bleu_acq_Arab-acq_Arab": 7.284759662302646, | |
| "predict_bleu_acq_Arab-eng_Latn": 24.354847687483804, | |
| "predict_bleu_aeb_Arab-aeb_Arab": 8.433679219494378, | |
| "predict_bleu_aeb_Arab-eng_Latn": 19.579605553975366, | |
| "predict_bleu_afr_Latn-afr_Latn": 31.59837635837358, | |
| "predict_bleu_afr_Latn-eng_Latn": 41.26405046826695, | |
| "predict_bleu_ajp_Arab-ajp_Arab": 8.891458195320727, | |
| "predict_bleu_ajp_Arab-eng_Latn": 26.372518802656995, | |
| "predict_bleu_aka_Latn-aka_Latn": 2.9613376935302567, | |
| "predict_bleu_aka_Latn-eng_Latn": 12.542452047009899, | |
| "predict_bleu_als_Latn-als_Latn": 32.13164988594328, | |
| "predict_bleu_als_Latn-eng_Latn": 29.789764805101463, | |
| "predict_bleu_amh_Ethi-amh_Ethi": 8.62206859739111, | |
| "predict_bleu_amh_Ethi-eng_Latn": 20.158101011567766, | |
| "predict_bleu_apc_Arab-apc_Arab": 9.97911996297066, | |
| "predict_bleu_apc_Arab-eng_Latn": 23.73490935327717, | |
| "predict_bleu_arb_Arab-arb_Arab": 22.0325197536476, | |
| "predict_bleu_arb_Arab-eng_Latn": 27.86960122761394, | |
| "predict_bleu_ars_Arab-ars_Arab": 14.988216988357907, | |
| "predict_bleu_ars_Arab-eng_Latn": 27.214570376282296, | |
| "predict_bleu_ary_Arab-ary_Arab": 0.9585620783810143, | |
| "predict_bleu_ary_Arab-eng_Latn": 15.517609634394745, | |
| "predict_bleu_arz_Arab-arz_Arab": 2.900962576897741, | |
| "predict_bleu_arz_Arab-eng_Latn": 19.92111109134028, | |
| "predict_bleu_asm_Beng-asm_Beng": 7.717797333038782, | |
| "predict_bleu_asm_Beng-eng_Latn": 16.222990945025618, | |
| "predict_bleu_ast_Latn-ast_Latn": 2.0242036236457093, | |
| "predict_bleu_ast_Latn-eng_Latn": 18.09785382386, | |
| "predict_bleu_awa_Deva-awa_Deva": 6.970403107513151, | |
| "predict_bleu_awa_Deva-eng_Latn": 21.780509889496713, | |
| "predict_bleu_ayr_Latn-ayr_Latn": 1.3344021708892744, | |
| "predict_bleu_ayr_Latn-eng_Latn": 7.003681669579347, | |
| "predict_bleu_azb_Arab-azb_Arab": 0.6745228790835222, | |
| "predict_bleu_azb_Arab-eng_Latn": 6.777634776703014, | |
| "predict_bleu_azj_Latn-azj_Latn": 15.015058870684076, | |
| "predict_bleu_azj_Latn-eng_Latn": 16.418403599515106, | |
| "predict_bleu_bak_Cyrl-bak_Cyrl": 12.33745669905586, | |
| "predict_bleu_bak_Cyrl-eng_Latn": 18.41150197281493, | |
| "predict_bleu_bam_Latn-bam_Latn": 1.6822702542525898, | |
| "predict_bleu_bam_Latn-eng_Latn": 10.431918024965, | |
| "predict_bleu_ban_Latn-ban_Latn": 7.862461795841116, | |
| "predict_bleu_ban_Latn-eng_Latn": 23.14291291742333, | |
| "predict_bleu_bel_Cyrl-bel_Cyrl": 25.439111620127022, | |
| "predict_bleu_bel_Cyrl-eng_Latn": 14.50466609106153, | |
| "predict_bleu_bem_Latn-bem_Latn": 3.2959417715500403, | |
| "predict_bleu_bem_Latn-eng_Latn": 17.11207916194583, | |
| "predict_bleu_ben_Beng-ben_Beng": 18.1016550591199, | |
| "predict_bleu_ben_Beng-eng_Latn": 22.157286949398387, | |
| "predict_bleu_bho_Deva-bho_Deva": 8.696168882394408, | |
| "predict_bleu_bho_Deva-eng_Latn": 17.928094830881665, | |
| "predict_bleu_bjn_Arab-bjn_Arab": 0.9628388538853163, | |
| "predict_bleu_bjn_Arab-eng_Latn": 9.14699210532977, | |
| "predict_bleu_bjn_Latn-bjn_Latn": 10.005583793319433, | |
| "predict_bleu_bjn_Latn-eng_Latn": 23.24285868104444, | |
| "predict_bleu_bod_Tibt-bod_Tibt": 1.3326532200526795, | |
| "predict_bleu_bod_Tibt-eng_Latn": 7.463077217515563, | |
| "predict_bleu_bos_Latn-bos_Latn": 27.176427781644136, | |
| "predict_bleu_bos_Latn-eng_Latn": 30.625663304827647, | |
| "predict_bleu_bug_Latn-bug_Latn": 2.1311840922995913, | |
| "predict_bleu_bug_Latn-eng_Latn": 14.452644691448334, | |
| "predict_bleu_bul_Cyrl-bul_Cyrl": 40.08308160209712, | |
| "predict_bleu_bul_Cyrl-eng_Latn": 29.655248007012776, | |
| "predict_bleu_cat_Latn-cat_Latn": 46.96411781532772, | |
| "predict_bleu_cat_Latn-eng_Latn": 35.405048450455375, | |
| "predict_bleu_ceb_Latn-ceb_Latn": 20.72899668001238, | |
| "predict_bleu_ceb_Latn-eng_Latn": 29.72550280070958, | |
| "predict_bleu_ces_Latn-ces_Latn": 36.47877822098665, | |
| "predict_bleu_ces_Latn-eng_Latn": 29.969646030875126, | |
| "predict_bleu_cjk_Latn-cjk_Latn": 0.7910040403245704, | |
| "predict_bleu_cjk_Latn-eng_Latn": 5.272833728365075, | |
| "predict_bleu_ckb_Arab-ckb_Arab": 6.69901624421011, | |
| "predict_bleu_ckb_Arab-eng_Latn": 19.833948189132276, | |
| "predict_bleu_crh_Latn-crh_Latn": 6.072690172007024, | |
| "predict_bleu_crh_Latn-eng_Latn": 19.668342636070808, | |
| "predict_bleu_cym_Latn-cym_Latn": 16.565367817658814, | |
| "predict_bleu_cym_Latn-eng_Latn": 33.86912245991061, | |
| "predict_bleu_dan_Latn-dan_Latn": 45.04674786899868, | |
| "predict_bleu_dan_Latn-eng_Latn": 37.169175344693095, | |
| "predict_bleu_deu_Latn-deu_Latn": 38.652214957595646, | |
| "predict_bleu_deu_Latn-eng_Latn": 33.53944881977507, | |
| "predict_bleu_dik_Latn-dik_Latn": 0.8945008860197898, | |
| "predict_bleu_dik_Latn-eng_Latn": 8.609238040965495, | |
| "predict_bleu_dyu_Latn-dyu_Latn": 0.6874820810678527, | |
| "predict_bleu_dyu_Latn-eng_Latn": 4.193522627915772, | |
| "predict_bleu_dzo_Tibt-dzo_Tibt": 3.2776106249798334, | |
| "predict_bleu_dzo_Tibt-eng_Latn": 9.342207530462467, | |
| "predict_bleu_ell_Grek-ell_Grek": 31.001293824810617, | |
| "predict_bleu_ell_Grek-eng_Latn": 26.584932306834695, | |
| "predict_bleu_eng_Latn-ace_Arab": 0.5343520202845207, | |
| "predict_bleu_eng_Latn-ace_Latn": 1.98838736934568, | |
| "predict_bleu_eng_Latn-acm_Arab": 1.1340315208863976, | |
| "predict_bleu_eng_Latn-acq_Arab": 5.0724915380151465, | |
| "predict_bleu_eng_Latn-aeb_Arab": 3.8554833238826194, | |
| "predict_bleu_eng_Latn-afr_Latn": 23.912821593308916, | |
| "predict_bleu_eng_Latn-ajp_Arab": 5.565922276094849, | |
| "predict_bleu_eng_Latn-aka_Latn": 2.7258642704943417, | |
| "predict_bleu_eng_Latn-als_Latn": 20.672921286395482, | |
| "predict_bleu_eng_Latn-amh_Ethi": 5.52593209817885, | |
| "predict_bleu_eng_Latn-apc_Arab": 5.125421193820204, | |
| "predict_bleu_eng_Latn-arb_Arab": 16.665422602371894, | |
| "predict_bleu_eng_Latn-ars_Arab": 9.219268608521771, | |
| "predict_bleu_eng_Latn-ary_Arab": 0.6882958229286419, | |
| "predict_bleu_eng_Latn-arz_Arab": 1.5129886248527982, | |
| "predict_bleu_eng_Latn-asm_Beng": 4.147095404969736, | |
| "predict_bleu_eng_Latn-ast_Latn": 4.842634413750466, | |
| "predict_bleu_eng_Latn-awa_Deva": 4.37139546048794, | |
| "predict_bleu_eng_Latn-ayr_Latn": 0.9385426620509533, | |
| "predict_bleu_eng_Latn-azb_Arab": 0.6959952795012369, | |
| "predict_bleu_eng_Latn-azj_Latn": 8.066702820670551, | |
| "predict_bleu_eng_Latn-bak_Cyrl": 4.4749986489063724, | |
| "predict_bleu_eng_Latn-bam_Latn": 1.1255803796015158, | |
| "predict_bleu_eng_Latn-ban_Latn": 4.109797187891038, | |
| "predict_bleu_eng_Latn-bel_Cyrl": 9.721990978007932, | |
| "predict_bleu_eng_Latn-bem_Latn": 2.315557645369649, | |
| "predict_bleu_eng_Latn-ben_Beng": 11.816079586521036, | |
| "predict_bleu_eng_Latn-bho_Deva": 5.636378449783701, | |
| "predict_bleu_eng_Latn-bjn_Arab": 0.6830329353889606, | |
| "predict_bleu_eng_Latn-bjn_Latn": 6.666561400052706, | |
| "predict_bleu_eng_Latn-bod_Tibt": 0.7917933301272984, | |
| "predict_bleu_eng_Latn-bos_Latn": 17.653082631246892, | |
| "predict_bleu_eng_Latn-bug_Latn": 1.1332154639149719, | |
| "predict_bleu_eng_Latn-bul_Cyrl": 27.529219623361502, | |
| "predict_bleu_eng_Latn-cat_Latn": 27.937224697456482, | |
| "predict_bleu_eng_Latn-ceb_Latn": 15.526723074405776, | |
| "predict_bleu_eng_Latn-ces_Latn": 22.58058669319737, | |
| "predict_bleu_eng_Latn-cjk_Latn": 0.5240488390155958, | |
| "predict_bleu_eng_Latn-ckb_Arab": 3.0039186112739094, | |
| "predict_bleu_eng_Latn-crh_Latn": 2.6676796108535648, | |
| "predict_bleu_eng_Latn-cym_Latn": 12.456873902476223, | |
| "predict_bleu_eng_Latn-dan_Latn": 30.325991723839103, | |
| "predict_bleu_eng_Latn-deu_Latn": 26.211940658092775, | |
| "predict_bleu_eng_Latn-dik_Latn": 0.5085540209211832, | |
| "predict_bleu_eng_Latn-dyu_Latn": 0.8832691647310775, | |
| "predict_bleu_eng_Latn-dzo_Tibt": 2.1685184567099256, | |
| "predict_bleu_eng_Latn-ell_Grek": 19.426511839134346, | |
| "predict_bleu_eng_Latn-eng_Latn": 57.15289812035715, | |
| "predict_bleu_eng_Latn-epo_Latn": 23.285979539537987, | |
| "predict_bleu_eng_Latn-est_Latn": 15.335050900091042, | |
| "predict_bleu_eng_Latn-eus_Latn": 3.0940240324402093, | |
| "predict_bleu_eng_Latn-ewe_Latn": 3.836834314657588, | |
| "predict_bleu_eng_Latn-fao_Latn": 4.341907304786498, | |
| "predict_bleu_eng_Latn-fij_Latn": 6.985775882285081, | |
| "predict_bleu_eng_Latn-fin_Latn": 14.980838651229442, | |
| "predict_bleu_eng_Latn-fon_Latn": 0.9044525535107895, | |
| "predict_bleu_eng_Latn-fra_Latn": 35.69772636740839, | |
| "predict_bleu_eng_Latn-fur_Latn": 11.910394662707976, | |
| "predict_bleu_eng_Latn-fuv_Latn": 0.2608216717863559, | |
| "predict_bleu_eng_Latn-gaz_Latn": 0.45788223332561495, | |
| "predict_bleu_eng_Latn-gla_Latn": 5.285863488921445, | |
| "predict_bleu_eng_Latn-gle_Latn": 7.469208382778265, | |
| "predict_bleu_eng_Latn-glg_Latn": 24.301110580776587, | |
| "predict_bleu_eng_Latn-grn_Latn": 4.6310764740761625, | |
| "predict_bleu_eng_Latn-guj_Gujr": 12.109364486756478, | |
| "predict_bleu_eng_Latn-hat_Latn": 10.186798580877964, | |
| "predict_bleu_eng_Latn-hau_Latn": 10.183456282186508, | |
| "predict_bleu_eng_Latn-heb_Hebr": 13.847574912904987, | |
| "predict_bleu_eng_Latn-hin_Deva": 15.314417493978594, | |
| "predict_bleu_eng_Latn-hne_Deva": 6.050374593351183, | |
| "predict_bleu_eng_Latn-hrv_Latn": 17.72594099642558, | |
| "predict_bleu_eng_Latn-hun_Latn": 16.724822419893314, | |
| "predict_bleu_eng_Latn-hye_Armn": 11.130154420380283, | |
| "predict_bleu_eng_Latn-ibo_Latn": 9.326933540710284, | |
| "predict_bleu_eng_Latn-ilo_Latn": 8.767690257308107, | |
| "predict_bleu_eng_Latn-ind_Latn": 27.538785811700098, | |
| "predict_bleu_eng_Latn-isl_Latn": 9.331870509643316, | |
| "predict_bleu_eng_Latn-ita_Latn": 22.241047134129523, | |
| "predict_bleu_eng_Latn-jav_Latn": 14.655378347136708, | |
| "predict_bleu_eng_Latn-jpn_Jpan": 9.048083159383948, | |
| "predict_bleu_eng_Latn-kab_Latn": 1.7141112808000598, | |
| "predict_bleu_eng_Latn-kac_Latn": 2.1283437818111604, | |
| "predict_bleu_eng_Latn-kam_Latn": 1.3846442536991257, | |
| "predict_bleu_eng_Latn-kan_Knda": 12.091168308134513, | |
| "predict_bleu_eng_Latn-kas_Arab": 2.6954066230963147, | |
| "predict_bleu_eng_Latn-kas_Deva": 0.1771956587381371, | |
| "predict_bleu_eng_Latn-kat_Geor": 7.553519456907556, | |
| "predict_bleu_eng_Latn-kaz_Cyrl": 7.223295567561123, | |
| "predict_bleu_eng_Latn-kbp_Latn": 1.128073789454096, | |
| "predict_bleu_eng_Latn-kea_Latn": 6.890295872745636, | |
| "predict_bleu_eng_Latn-khk_Cyrl": 2.315523854498585, | |
| "predict_bleu_eng_Latn-khm_Khmr": 3.525467663899649, | |
| "predict_bleu_eng_Latn-kik_Latn": 2.782940652550118, | |
| "predict_bleu_eng_Latn-kin_Latn": 3.4537557787193163, | |
| "predict_bleu_eng_Latn-kir_Cyrl": 5.105436343958488, | |
| "predict_bleu_eng_Latn-kmb_Latn": 1.268109171635326, | |
| "predict_bleu_eng_Latn-kmr_Latn": 2.469409436950585, | |
| "predict_bleu_eng_Latn-knc_Arab": 1.6830027159628949, | |
| "predict_bleu_eng_Latn-knc_Latn": 0.25256531738106813, | |
| "predict_bleu_eng_Latn-kon_Latn": 7.150397741025182, | |
| "predict_bleu_eng_Latn-kor_Hang": 7.733358903530949, | |
| "predict_bleu_eng_Latn-lao_Laoo": 8.839764246316898, | |
| "predict_bleu_eng_Latn-lij_Latn": 7.361394221119284, | |
| "predict_bleu_eng_Latn-lim_Latn": 6.8488403440378685, | |
| "predict_bleu_eng_Latn-lin_Latn": 5.340958049125359, | |
| "predict_bleu_eng_Latn-lit_Latn": 16.70631759424886, | |
| "predict_bleu_eng_Latn-lmo_Latn": 4.380452030935398, | |
| "predict_bleu_eng_Latn-ltg_Latn": 3.776656866660971, | |
| "predict_bleu_eng_Latn-ltz_Latn": 11.227713003713106, | |
| "predict_bleu_eng_Latn-lua_Latn": 2.1150478587293753, | |
| "predict_bleu_eng_Latn-lug_Latn": 1.4406745732313162, | |
| "predict_bleu_eng_Latn-luo_Latn": 2.863576959061525, | |
| "predict_bleu_eng_Latn-lus_Latn": 2.8932391708276346, | |
| "predict_bleu_eng_Latn-lvs_Latn": 1.425778594943445, | |
| "predict_bleu_eng_Latn-mag_Deva": 8.126861127426611, | |
| "predict_bleu_eng_Latn-mai_Deva": 5.842855281265615, | |
| "predict_bleu_eng_Latn-mal_Mlym": 9.699299998488545, | |
| "predict_bleu_eng_Latn-mar_Deva": 7.628106974804996, | |
| "predict_bleu_eng_Latn-min_Latn": 2.4556988000641486, | |
| "predict_bleu_eng_Latn-mkd_Cyrl": 20.9273656469387, | |
| "predict_bleu_eng_Latn-mlt_Latn": 12.360276827874955, | |
| "predict_bleu_eng_Latn-mni_Beng": 1.4611153519751958, | |
| "predict_bleu_eng_Latn-mos_Latn": 0.8263856483776842, | |
| "predict_bleu_eng_Latn-mri_Latn": 7.261059824166867, | |
| "predict_bleu_eng_Latn-mya_Mymr": 1.9106927503957347, | |
| "predict_bleu_eng_Latn-nld_Latn": 21.876370019555395, | |
| "predict_bleu_eng_Latn-nno_Latn": 16.45298710754079, | |
| "predict_bleu_eng_Latn-nob_Latn": 23.373722758983682, | |
| "predict_bleu_eng_Latn-npi_Deva": 8.944732496083018, | |
| "predict_bleu_eng_Latn-nso_Latn": 6.556705888579125, | |
| "predict_bleu_eng_Latn-nus_Latn": 2.4047317870316545, | |
| "predict_bleu_eng_Latn-nya_Latn": 7.3481613043175855, | |
| "predict_bleu_eng_Latn-oci_Latn": 14.526610080325849, | |
| "predict_bleu_eng_Latn-ory_Orya": 6.401097867960593, | |
| "predict_bleu_eng_Latn-pag_Latn": 5.6072218945529, | |
| "predict_bleu_eng_Latn-pan_Guru": 10.786823122610055, | |
| "predict_bleu_eng_Latn-pap_Latn": 11.85936699416347, | |
| "predict_bleu_eng_Latn-pbt_Arab": 4.919925629609929, | |
| "predict_bleu_eng_Latn-pes_Arab": 16.11112054627767, | |
| "predict_bleu_eng_Latn-plt_Latn": 9.020739622858642, | |
| "predict_bleu_eng_Latn-pol_Latn": 17.491696864311294, | |
| "predict_bleu_eng_Latn-por_Latn": 37.10743182899979, | |
| "predict_bleu_eng_Latn-prs_Arab": 14.134867558869056, | |
| "predict_bleu_eng_Latn-quy_Latn": 0.3941185316560313, | |
| "predict_bleu_eng_Latn-ron_Latn": 27.773254356243914, | |
| "predict_bleu_eng_Latn-run_Latn": 3.7885921497237227, | |
| "predict_bleu_eng_Latn-rus_Cyrl": 22.06229352710371, | |
| "predict_bleu_eng_Latn-sag_Latn": 3.4000131808162766, | |
| "predict_bleu_eng_Latn-san_Deva": 0.47356740093860517, | |
| "predict_bleu_eng_Latn-sat_Beng": 0.6930405104136586, | |
| "predict_bleu_eng_Latn-scn_Latn": 5.284575839021703, | |
| "predict_bleu_eng_Latn-shn_Mymr": 2.054440119268135, | |
| "predict_bleu_eng_Latn-sin_Sinh": 9.142277169715115, | |
| "predict_bleu_eng_Latn-slk_Latn": 21.859644590307738, | |
| "predict_bleu_eng_Latn-slv_Latn": 17.828248142062964, | |
| "predict_bleu_eng_Latn-smo_Latn": 10.465077692078744, | |
| "predict_bleu_eng_Latn-sna_Latn": 5.161535521421806, | |
| "predict_bleu_eng_Latn-snd_Arab": 7.7378871328691226, | |
| "predict_bleu_eng_Latn-som_Latn": 5.0656199629915895, | |
| "predict_bleu_eng_Latn-sot_Latn": 8.320549418829703, | |
| "predict_bleu_eng_Latn-spa_Latn": 23.914550469865347, | |
| "predict_bleu_eng_Latn-srd_Latn": 7.604057894098913, | |
| "predict_bleu_eng_Latn-srp_Cyrl": 20.6205565479829, | |
| "predict_bleu_eng_Latn-ssw_Latn": 2.8087412192900025, | |
| "predict_bleu_eng_Latn-sun_Latn": 9.73362330177827, | |
| "predict_bleu_eng_Latn-swe_Latn": 30.242007263697335, | |
| "predict_bleu_eng_Latn-swh_Latn": 14.970682422903892, | |
| "predict_bleu_eng_Latn-szl_Latn": 7.25233378434478, | |
| "predict_bleu_eng_Latn-tam_Taml": 9.58531567806883, | |
| "predict_bleu_eng_Latn-taq_Latn": 0.6788060025660175, | |
| "predict_bleu_eng_Latn-taq_Tfng": 0.8862802113447025, | |
| "predict_bleu_eng_Latn-tat_Cyrl": 4.956032545760572, | |
| "predict_bleu_eng_Latn-tel_Telu": 12.399962436602419, | |
| "predict_bleu_eng_Latn-tgk_Cyrl": 6.489048390253187, | |
| "predict_bleu_eng_Latn-tgl_Latn": 16.33472331100905, | |
| "predict_bleu_eng_Latn-tha_Thai": 8.034947333102476, | |
| "predict_bleu_eng_Latn-tir_Ethi": 1.514922434850326, | |
| "predict_bleu_eng_Latn-tpi_Latn": 6.920587813050594, | |
| "predict_bleu_eng_Latn-tsn_Latn": 7.95810310782608, | |
| "predict_bleu_eng_Latn-tso_Latn": 6.415673616487707, | |
| "predict_bleu_eng_Latn-tuk_Latn": 2.906980997379787, | |
| "predict_bleu_eng_Latn-tum_Latn": 3.6837816895835074, | |
| "predict_bleu_eng_Latn-tur_Latn": 15.266004487213072, | |
| "predict_bleu_eng_Latn-twi_Latn": 3.7009643961254763, | |
| "predict_bleu_eng_Latn-tzm_Tfng": 4.370140519369522, | |
| "predict_bleu_eng_Latn-uig_Arab": 2.2662516142006544, | |
| "predict_bleu_eng_Latn-ukr_Cyrl": 17.993161493409946, | |
| "predict_bleu_eng_Latn-umb_Latn": 0.8208021232454182, | |
| "predict_bleu_eng_Latn-urd_Arab": 9.530479259117168, | |
| "predict_bleu_eng_Latn-uzn_Latn": 8.565148135490388, | |
| "predict_bleu_eng_Latn-vec_Latn": 8.853580584523845, | |
| "predict_bleu_eng_Latn-vie_Latn": 24.745547721749954, | |
| "predict_bleu_eng_Latn-war_Latn": 10.451725329385223, | |
| "predict_bleu_eng_Latn-wol_Latn": 1.6954440288378334, | |
| "predict_bleu_eng_Latn-xho_Latn": 5.650468209857276, | |
| "predict_bleu_eng_Latn-ydd_Hebr": 3.9703237383748333, | |
| "predict_bleu_eng_Latn-yor_Latn": 1.697752564788556, | |
| "predict_bleu_eng_Latn-yue_Hant": 4.064248981396067, | |
| "predict_bleu_eng_Latn-zho_Hans": 11.293345298779013, | |
| "predict_bleu_eng_Latn-zho_Hant": 3.8068087372260164, | |
| "predict_bleu_eng_Latn-zsm_Latn": 22.481026238637966, | |
| "predict_bleu_eng_Latn-zul_Latn": 7.529781959220474, | |
| "predict_bleu_epo_Latn-eng_Latn": 32.76880012409368, | |
| "predict_bleu_epo_Latn-epo_Latn": 35.69782472688607, | |
| "predict_bleu_est_Latn-eng_Latn": 27.303204418750568, | |
| "predict_bleu_est_Latn-est_Latn": 22.909533978111664, | |
| "predict_bleu_eus_Latn-eng_Latn": 22.82715957953487, | |
| "predict_bleu_eus_Latn-eus_Latn": 5.5299395690761575, | |
| "predict_bleu_ewe_Latn-eng_Latn": 11.092549780069403, | |
| "predict_bleu_ewe_Latn-ewe_Latn": 6.100954973192679, | |
| "predict_bleu_fao_Latn-eng_Latn": 19.947937516060147, | |
| "predict_bleu_fao_Latn-fao_Latn": 8.017417867150446, | |
| "predict_bleu_fij_Latn-eng_Latn": 14.110441052251886, | |
| "predict_bleu_fij_Latn-fij_Latn": 12.350266366255362, | |
| "predict_bleu_fin_Latn-eng_Latn": 24.698391512080757, | |
| "predict_bleu_fin_Latn-fin_Latn": 24.178464758897626, | |
| "predict_bleu_fon_Latn-eng_Latn": 5.885634902282668, | |
| "predict_bleu_fon_Latn-fon_Latn": 1.2367462695821376, | |
| "predict_bleu_fra_Latn-eng_Latn": 35.67206757011737, | |
| "predict_bleu_fra_Latn-fra_Latn": 52.2817265395723, | |
| "predict_bleu_fur_Latn-eng_Latn": 29.12948542522294, | |
| "predict_bleu_fur_Latn-fur_Latn": 17.43532982996614, | |
| "predict_bleu_fuv_Latn-eng_Latn": 6.8459034584029395, | |
| "predict_bleu_fuv_Latn-fuv_Latn": 0.406028726438, | |
| "predict_bleu_gaz_Latn-eng_Latn": 11.715106735906295, | |
| "predict_bleu_gaz_Latn-gaz_Latn": 0.9544890112910019, | |
| "predict_bleu_gla_Latn-eng_Latn": 17.823136116978052, | |
| "predict_bleu_gla_Latn-gla_Latn": 7.667050032989697, | |
| "predict_bleu_gle_Latn-eng_Latn": 23.48381293809047, | |
| "predict_bleu_gle_Latn-gle_Latn": 10.616662884819103, | |
| "predict_bleu_glg_Latn-eng_Latn": 32.08247402143213, | |
| "predict_bleu_glg_Latn-glg_Latn": 45.33718695719623, | |
| "predict_bleu_grn_Latn-eng_Latn": 15.766094095668382, | |
| "predict_bleu_grn_Latn-grn_Latn": 8.038081447995854, | |
| "predict_bleu_guj_Gujr-eng_Latn": 24.04128776428626, | |
| "predict_bleu_guj_Gujr-guj_Gujr": 20.744833819397957, | |
| "predict_bleu_hat_Latn-eng_Latn": 26.94385375438927, | |
| "predict_bleu_hat_Latn-hat_Latn": 16.725913651821124, | |
| "predict_bleu_hau_Latn-eng_Latn": 21.53592523130126, | |
| "predict_bleu_hau_Latn-hau_Latn": 16.67017061078559, | |
| "predict_bleu_heb_Hebr-eng_Latn": 28.522354613175196, | |
| "predict_bleu_heb_Hebr-heb_Hebr": 18.983716163845248, | |
| "predict_bleu_hin_Deva-eng_Latn": 26.965368056851883, | |
| "predict_bleu_hin_Deva-hin_Deva": 24.03065635045922, | |
| "predict_bleu_hne_Deva-eng_Latn": 26.778192146645942, | |
| "predict_bleu_hne_Deva-hne_Deva": 12.060089161653313, | |
| "predict_bleu_hrv_Latn-eng_Latn": 28.278404714360803, | |
| "predict_bleu_hrv_Latn-hrv_Latn": 30.628078240938677, | |
| "predict_bleu_hun_Latn-eng_Latn": 26.088258003417536, | |
| "predict_bleu_hun_Latn-hun_Latn": 24.22250524980916, | |
| "predict_bleu_hye_Armn-eng_Latn": 24.881780769146122, | |
| "predict_bleu_hye_Armn-hye_Armn": 16.965449727891652, | |
| "predict_bleu_ibo_Latn-eng_Latn": 17.326646868566588, | |
| "predict_bleu_ibo_Latn-ibo_Latn": 13.20435573879994, | |
| "predict_bleu_ilo_Latn-eng_Latn": 24.847805210229314, | |
| "predict_bleu_ilo_Latn-ilo_Latn": 12.516930771780242, | |
| "predict_bleu_ind_Latn-eng_Latn": 31.591235188546086, | |
| "predict_bleu_ind_Latn-ind_Latn": 38.43635967485171, | |
| "predict_bleu_isl_Latn-eng_Latn": 22.016684462127163, | |
| "predict_bleu_isl_Latn-isl_Latn": 14.55282793251054, | |
| "predict_bleu_ita_Latn-eng_Latn": 28.41270521462659, | |
| "predict_bleu_ita_Latn-ita_Latn": 43.09965876110722, | |
| "predict_bleu_jav_Latn-eng_Latn": 26.949147530883433, | |
| "predict_bleu_jav_Latn-jav_Latn": 22.887855388233284, | |
| "predict_bleu_jpn_Jpan-eng_Latn": 18.109118669605547, | |
| "predict_bleu_jpn_Jpan-jpn_Jpan": 16.18683900943507, | |
| "predict_bleu_kab_Latn-eng_Latn": 10.259867855661403, | |
| "predict_bleu_kab_Latn-kab_Latn": 2.9287685366977074, | |
| "predict_bleu_kac_Latn-eng_Latn": 9.87162799400816, | |
| "predict_bleu_kac_Latn-kac_Latn": 3.371306767259679, | |
| "predict_bleu_kam_Latn-eng_Latn": 6.799314247218641, | |
| "predict_bleu_kam_Latn-kam_Latn": 1.3576187599194538, | |
| "predict_bleu_kan_Knda-eng_Latn": 20.151806133746753, | |
| "predict_bleu_kan_Knda-kan_Knda": 21.097624236504085, | |
| "predict_bleu_kas_Arab-eng_Latn": 18.204588843214843, | |
| "predict_bleu_kas_Arab-kas_Arab": 4.1235985022314825, | |
| "predict_bleu_kas_Deva-eng_Latn": 10.954839911564415, | |
| "predict_bleu_kas_Deva-kas_Deva": 0.2242032792294365, | |
| "predict_bleu_kat_Geor-eng_Latn": 16.948246603476125, | |
| "predict_bleu_kat_Geor-kat_Geor": 12.993417772213599, | |
| "predict_bleu_kaz_Cyrl-eng_Latn": 21.1446521318515, | |
| "predict_bleu_kaz_Cyrl-kaz_Cyrl": 12.747517830096577, | |
| "predict_bleu_kbp_Latn-eng_Latn": 8.227177550168213, | |
| "predict_bleu_kbp_Latn-kbp_Latn": 1.3138946018773552, | |
| "predict_bleu_kea_Latn-eng_Latn": 29.245451737321673, | |
| "predict_bleu_kea_Latn-kea_Latn": 10.134057959298264, | |
| "predict_bleu_khk_Cyrl-eng_Latn": 15.361112412286962, | |
| "predict_bleu_khk_Cyrl-khk_Cyrl": 4.732822216619869, | |
| "predict_bleu_khm_Khmr-eng_Latn": 15.782079348759973, | |
| "predict_bleu_khm_Khmr-khm_Khmr": 4.820818373652512, | |
| "predict_bleu_kik_Latn-eng_Latn": 14.624705543592606, | |
| "predict_bleu_kik_Latn-kik_Latn": 4.265659006536271, | |
| "predict_bleu_kin_Latn-eng_Latn": 18.631226267711288, | |
| "predict_bleu_kin_Latn-kin_Latn": 5.793505257525773, | |
| "predict_bleu_kir_Cyrl-eng_Latn": 15.679766892398685, | |
| "predict_bleu_kir_Cyrl-kir_Cyrl": 13.807509766541429, | |
| "predict_bleu_kmb_Latn-eng_Latn": 6.922172481882245, | |
| "predict_bleu_kmb_Latn-kmb_Latn": 1.0923791678712031, | |
| "predict_bleu_kmr_Latn-eng_Latn": 14.087746819600772, | |
| "predict_bleu_kmr_Latn-kmr_Latn": 4.763482699497636, | |
| "predict_bleu_knc_Arab-eng_Latn": 1.3442749062810109, | |
| "predict_bleu_knc_Arab-knc_Arab": 2.4946522894868686, | |
| "predict_bleu_knc_Latn-eng_Latn": 9.388671531485226, | |
| "predict_bleu_knc_Latn-knc_Latn": 0.48643881569725805, | |
| "predict_bleu_kon_Latn-eng_Latn": 14.21820963589838, | |
| "predict_bleu_kon_Latn-kon_Latn": 8.734933841944656, | |
| "predict_bleu_kor_Hang-eng_Latn": 18.72706419433876, | |
| "predict_bleu_kor_Hang-kor_Hang": 13.377253447099033, | |
| "predict_bleu_lao_Laoo-eng_Latn": 19.55871987031071, | |
| "predict_bleu_lao_Laoo-lao_Laoo": 9.997042020804857, | |
| "predict_bleu_lij_Latn-eng_Latn": 31.336849274492625, | |
| "predict_bleu_lij_Latn-lij_Latn": 11.13829595420522, | |
| "predict_bleu_lim_Latn-eng_Latn": 26.622815599748215, | |
| "predict_bleu_lim_Latn-lim_Latn": 10.325441818946231, | |
| "predict_bleu_lin_Latn-eng_Latn": 16.438272893051465, | |
| "predict_bleu_lin_Latn-lin_Latn": 10.769196277338787, | |
| "predict_bleu_lit_Latn-eng_Latn": 23.895414581372417, | |
| "predict_bleu_lit_Latn-lit_Latn": 26.735861562514238, | |
| "predict_bleu_lmo_Latn-eng_Latn": 25.431680104502433, | |
| "predict_bleu_lmo_Latn-lmo_Latn": 5.914758953932769, | |
| "predict_bleu_ltg_Latn-eng_Latn": 21.51294843260837, | |
| "predict_bleu_ltg_Latn-ltg_Latn": 5.487191827649239, | |
| "predict_bleu_ltz_Latn-eng_Latn": 29.949945675128372, | |
| "predict_bleu_ltz_Latn-ltz_Latn": 15.569657394858416, | |
| "predict_bleu_lua_Latn-eng_Latn": 11.612197772885736, | |
| "predict_bleu_lua_Latn-lua_Latn": 2.5815708655813387, | |
| "predict_bleu_lug_Latn-eng_Latn": 12.613447901113977, | |
| "predict_bleu_lug_Latn-lug_Latn": 2.22036790474632, | |
| "predict_bleu_luo_Latn-eng_Latn": 13.922766456683453, | |
| "predict_bleu_luo_Latn-luo_Latn": 4.262974973793072, | |
| "predict_bleu_lus_Latn-eng_Latn": 10.922372077286747, | |
| "predict_bleu_lus_Latn-lus_Latn": 5.037659399345031, | |
| "predict_bleu_lvs_Latn-eng_Latn": 7.420939632677014, | |
| "predict_bleu_lvs_Latn-lvs_Latn": 1.1651262690093318, | |
| "predict_bleu_mag_Deva-eng_Latn": 27.20315105728247, | |
| "predict_bleu_mag_Deva-mag_Deva": 13.591363269781091, | |
| "predict_bleu_mai_Deva-eng_Latn": 24.107556412735025, | |
| "predict_bleu_mai_Deva-mai_Deva": 9.449134130559695, | |
| "predict_bleu_mal_Mlym-eng_Latn": 20.463479092326146, | |
| "predict_bleu_mal_Mlym-mal_Mlym": 15.6420635366252, | |
| "predict_bleu_mar_Deva-eng_Latn": 20.81065601439587, | |
| "predict_bleu_mar_Deva-mar_Deva": 13.06942426683141, | |
| "predict_bleu_min_Latn-eng_Latn": 21.55313612633493, | |
| "predict_bleu_min_Latn-min_Latn": 5.217066386164249, | |
| "predict_bleu_mkd_Cyrl-eng_Latn": 29.951058885663354, | |
| "predict_bleu_mkd_Cyrl-mkd_Cyrl": 31.544411042886427, | |
| "predict_bleu_mlt_Latn-eng_Latn": 37.37095970689788, | |
| "predict_bleu_mlt_Latn-mlt_Latn": 16.54810950636906, | |
| "predict_bleu_mni_Beng-eng_Latn": 14.179423974318698, | |
| "predict_bleu_mni_Beng-mni_Beng": 2.491459748701038, | |
| "predict_bleu_mos_Latn-eng_Latn": 5.384549460355129, | |
| "predict_bleu_mos_Latn-mos_Latn": 0.9067791166138617, | |
| "predict_bleu_mri_Latn-eng_Latn": 16.28541527142995, | |
| "predict_bleu_mri_Latn-mri_Latn": 11.577289165214118, | |
| "predict_bleu_mya_Mymr-eng_Latn": 14.47927468117125, | |
| "predict_bleu_mya_Mymr-mya_Mymr": 2.3787222720252745, | |
| "predict_bleu_nld_Latn-eng_Latn": 26.185166186402228, | |
| "predict_bleu_nld_Latn-nld_Latn": 40.16518615004981, | |
| "predict_bleu_nno_Latn-eng_Latn": 33.51470837622846, | |
| "predict_bleu_nno_Latn-nno_Latn": 27.647287485084114, | |
| "predict_bleu_nob_Latn-eng_Latn": 33.185864110433236, | |
| "predict_bleu_nob_Latn-nob_Latn": 40.51190499124951, | |
| "predict_bleu_npi_Deva-eng_Latn": 22.67912845231258, | |
| "predict_bleu_npi_Deva-npi_Deva": 16.917678667318192, | |
| "predict_bleu_nso_Latn-eng_Latn": 23.76969825157868, | |
| "predict_bleu_nso_Latn-nso_Latn": 11.342021370759058, | |
| "predict_bleu_nus_Latn-eng_Latn": 8.950782035769592, | |
| "predict_bleu_nus_Latn-nus_Latn": 3.3050310864147963, | |
| "predict_bleu_nya_Latn-eng_Latn": 17.926343542900337, | |
| "predict_bleu_nya_Latn-nya_Latn": 14.019306303676213, | |
| "predict_bleu_oci_Latn-eng_Latn": 36.9259152218277, | |
| "predict_bleu_oci_Latn-oci_Latn": 21.07216880984343, | |
| "predict_bleu_ory_Orya-eng_Latn": 20.42248289343443, | |
| "predict_bleu_ory_Orya-ory_Orya": 10.298387600595202, | |
| "predict_bleu_pag_Latn-eng_Latn": 19.225308862830435, | |
| "predict_bleu_pag_Latn-pag_Latn": 10.332775620679913, | |
| "predict_bleu_pan_Guru-eng_Latn": 24.631899378876323, | |
| "predict_bleu_pan_Guru-pan_Guru": 18.045028179103856, | |
| "predict_bleu_pap_Latn-eng_Latn": 33.86063501020822, | |
| "predict_bleu_pap_Latn-pap_Latn": 17.717000107110415, | |
| "predict_bleu_pbt_Arab-eng_Latn": 18.43816696406228, | |
| "predict_bleu_pbt_Arab-pbt_Arab": 8.399915458188387, | |
| "predict_bleu_pes_Arab-eng_Latn": 25.25157936209901, | |
| "predict_bleu_pes_Arab-pes_Arab": 23.434495484326344, | |
| "predict_bleu_plt_Latn-eng_Latn": 18.955250232929316, | |
| "predict_bleu_plt_Latn-plt_Latn": 11.912525799397052, | |
| "predict_bleu_pol_Latn-eng_Latn": 23.60620660698165, | |
| "predict_bleu_pol_Latn-pol_Latn": 32.3380847850195, | |
| "predict_bleu_por_Latn-eng_Latn": 38.295182960524286, | |
| "predict_bleu_por_Latn-por_Latn": 53.22810723884738, | |
| "predict_bleu_prs_Arab-eng_Latn": 25.59673319929295, | |
| "predict_bleu_prs_Arab-prs_Arab": 20.559178946654093, | |
| "predict_bleu_quy_Latn-eng_Latn": 6.367187653075738, | |
| "predict_bleu_quy_Latn-quy_Latn": 0.49102755810337567, | |
| "predict_bleu_ron_Latn-eng_Latn": 33.71894223563158, | |
| "predict_bleu_ron_Latn-ron_Latn": 40.91734392833412, | |
| "predict_bleu_run_Latn-eng_Latn": 15.187414027067899, | |
| "predict_bleu_run_Latn-run_Latn": 5.092215123683881, | |
| "predict_bleu_rus_Cyrl-eng_Latn": 26.2243673713143, | |
| "predict_bleu_rus_Cyrl-rus_Cyrl": 37.36582242132353, | |
| "predict_bleu_sag_Latn-eng_Latn": 7.867113586092637, | |
| "predict_bleu_sag_Latn-sag_Latn": 3.5739343264559955, | |
| "predict_bleu_san_Deva-eng_Latn": 12.695750736277361, | |
| "predict_bleu_san_Deva-san_Deva": 1.3696451667352167, | |
| "predict_bleu_sat_Beng-eng_Latn": 3.6891737413993115, | |
| "predict_bleu_sat_Beng-sat_Beng": 1.1916242689956074, | |
| "predict_bleu_scn_Latn-eng_Latn": 26.345851327199732, | |
| "predict_bleu_scn_Latn-scn_Latn": 10.369469780400506, | |
| "predict_bleu_shn_Mymr-eng_Latn": 14.012092867010043, | |
| "predict_bleu_shn_Mymr-shn_Mymr": 3.269159591838726, | |
| "predict_bleu_sin_Sinh-eng_Latn": 19.832050342897013, | |
| "predict_bleu_sin_Sinh-sin_Sinh": 14.668978265142165, | |
| "predict_bleu_slk_Latn-eng_Latn": 29.67288264319452, | |
| "predict_bleu_slk_Latn-slk_Latn": 37.27430724138085, | |
| "predict_bleu_slv_Latn-eng_Latn": 26.346772573343866, | |
| "predict_bleu_slv_Latn-slv_Latn": 30.992548195524073, | |
| "predict_bleu_smo_Latn-eng_Latn": 21.058152394206658, | |
| "predict_bleu_smo_Latn-smo_Latn": 14.837722556952228, | |
| "predict_bleu_sna_Latn-eng_Latn": 18.182458721358234, | |
| "predict_bleu_sna_Latn-sna_Latn": 10.488094659986904, | |
| "predict_bleu_snd_Arab-eng_Latn": 22.32176636177888, | |
| "predict_bleu_snd_Arab-snd_Arab": 14.630092080230312, | |
| "predict_bleu_som_Latn-eng_Latn": 16.08784093198363, | |
| "predict_bleu_som_Latn-som_Latn": 9.282169162824516, | |
| "predict_bleu_sot_Latn-eng_Latn": 23.361136914647663, | |
| "predict_bleu_sot_Latn-sot_Latn": 12.025293908172973, | |
| "predict_bleu_spa_Latn-eng_Latn": 26.009794967447476, | |
| "predict_bleu_spa_Latn-spa_Latn": 49.62020223727758, | |
| "predict_bleu_srd_Latn-eng_Latn": 29.051943848207216, | |
| "predict_bleu_srd_Latn-srd_Latn": 11.742836284948241, | |
| "predict_bleu_srp_Cyrl-eng_Latn": 31.53044340828154, | |
| "predict_bleu_srp_Cyrl-srp_Cyrl": 31.660910858774102, | |
| "predict_bleu_ssw_Latn-eng_Latn": 19.01492861482041, | |
| "predict_bleu_ssw_Latn-ssw_Latn": 5.4606606368860655, | |
| "predict_bleu_sun_Latn-eng_Latn": 24.07305330612962, | |
| "predict_bleu_sun_Latn-sun_Latn": 18.503689514826917, | |
| "predict_bleu_swe_Latn-eng_Latn": 36.698935084298796, | |
| "predict_bleu_swe_Latn-swe_Latn": 44.06615389745329, | |
| "predict_bleu_swh_Latn-eng_Latn": 26.602148419113345, | |
| "predict_bleu_swh_Latn-swh_Latn": 22.34994050418557, | |
| "predict_bleu_szl_Latn-eng_Latn": 28.169066740775342, | |
| "predict_bleu_szl_Latn-szl_Latn": 11.524081196004113, | |
| "predict_bleu_tam_Taml-eng_Latn": 19.108350902636047, | |
| "predict_bleu_tam_Taml-tam_Taml": 15.977749439313314, | |
| "predict_bleu_taq_Latn-eng_Latn": 7.207339055967011, | |
| "predict_bleu_taq_Latn-taq_Latn": 1.1041520807745677, | |
| "predict_bleu_taq_Tfng-eng_Latn": 1.477301291832436, | |
| "predict_bleu_taq_Tfng-taq_Tfng": 0.9743225730691011, | |
| "predict_bleu_tat_Cyrl-eng_Latn": 18.801247813077847, | |
| "predict_bleu_tat_Cyrl-tat_Cyrl": 13.361979621576573, | |
| "predict_bleu_tel_Telu-eng_Latn": 22.836758972070776, | |
| "predict_bleu_tel_Telu-tel_Telu": 21.32832502974059, | |
| "predict_bleu_tgk_Cyrl-eng_Latn": 20.117641989732896, | |
| "predict_bleu_tgk_Cyrl-tgk_Cyrl": 12.348080541468468, | |
| "predict_bleu_tgl_Latn-eng_Latn": 31.073938003843267, | |
| "predict_bleu_tgl_Latn-tgl_Latn": 21.92083639510753, | |
| "predict_bleu_tha_Thai-eng_Latn": 18.474556731087315, | |
| "predict_bleu_tha_Thai-tha_Thai": 11.00737139928743, | |
| "predict_bleu_tir_Ethi-eng_Latn": 12.007649150260045, | |
| "predict_bleu_tir_Ethi-tir_Ethi": 3.088683689071283, | |
| "predict_bleu_tpi_Latn-eng_Latn": 15.912328708581304, | |
| "predict_bleu_tpi_Latn-tpi_Latn": 8.196161896701055, | |
| "predict_bleu_tsn_Latn-eng_Latn": 17.987321209169906, | |
| "predict_bleu_tsn_Latn-tsn_Latn": 12.536037853522942, | |
| "predict_bleu_tso_Latn-eng_Latn": 20.153231505544372, | |
| "predict_bleu_tso_Latn-tso_Latn": 11.789867072193404, | |
| "predict_bleu_tuk_Latn-eng_Latn": 19.329337730477466, | |
| "predict_bleu_tuk_Latn-tuk_Latn": 4.546470820109664, | |
| "predict_bleu_tum_Latn-eng_Latn": 12.6668137170151, | |
| "predict_bleu_tum_Latn-tum_Latn": 5.938125289397268, | |
| "predict_bleu_tur_Latn-eng_Latn": 27.102942304530362, | |
| "predict_bleu_tur_Latn-tur_Latn": 21.528377344780655, | |
| "predict_bleu_twi_Latn-eng_Latn": 14.260325680458013, | |
| "predict_bleu_twi_Latn-twi_Latn": 4.602426422180452, | |
| "predict_bleu_tzm_Tfng-eng_Latn": 8.510853791060574, | |
| "predict_bleu_tzm_Tfng-tzm_Tfng": 6.882879426936572, | |
| "predict_bleu_uig_Arab-eng_Latn": 13.534660719976738, | |
| "predict_bleu_uig_Arab-uig_Arab": 5.140075216374838, | |
| "predict_bleu_ukr_Cyrl-eng_Latn": 28.45833109556944, | |
| "predict_bleu_ukr_Cyrl-ukr_Cyrl": 32.95410072104557, | |
| "predict_bleu_umb_Latn-eng_Latn": 6.854779319698244, | |
| "predict_bleu_umb_Latn-umb_Latn": 1.5798092065456393, | |
| "predict_bleu_urd_Arab-eng_Latn": 21.094504541223557, | |
| "predict_bleu_urd_Arab-urd_Arab": 15.127195415261923, | |
| "predict_bleu_uzn_Latn-eng_Latn": 21.870422462355947, | |
| "predict_bleu_uzn_Latn-uzn_Latn": 13.204956265433147, | |
| "predict_bleu_vec_Latn-eng_Latn": 30.711756705570437, | |
| "predict_bleu_vec_Latn-vec_Latn": 14.300880493702074, | |
| "predict_bleu_vie_Latn-eng_Latn": 26.339776436264366, | |
| "predict_bleu_vie_Latn-vie_Latn": 36.89975294364276, | |
| "predict_bleu_war_Latn-eng_Latn": 30.586759863689164, | |
| "predict_bleu_war_Latn-war_Latn": 14.640552661318743, | |
| "predict_bleu_wol_Latn-eng_Latn": 9.95213626050727, | |
| "predict_bleu_wol_Latn-wol_Latn": 2.124764693023847, | |
| "predict_bleu_xho_Latn-eng_Latn": 22.847584919551252, | |
| "predict_bleu_xho_Latn-xho_Latn": 10.644270337808603, | |
| "predict_bleu_ydd_Hebr-eng_Latn": 23.086901775472086, | |
| "predict_bleu_ydd_Hebr-ydd_Hebr": 4.727455940815629, | |
| "predict_bleu_yor_Latn-eng_Latn": 12.309271042350622, | |
| "predict_bleu_yor_Latn-yor_Latn": 3.3322584588394055, | |
| "predict_bleu_yue_Hant-eng_Latn": 18.150864371431716, | |
| "predict_bleu_yue_Hant-yue_Hant": 6.5735299210922005, | |
| "predict_bleu_zho_Hans-eng_Latn": 19.02111421320213, | |
| "predict_bleu_zho_Hans-zho_Hans": 16.80562675863158, | |
| "predict_bleu_zho_Hant-eng_Latn": 15.312127435815235, | |
| "predict_bleu_zho_Hant-zho_Hant": 5.582611920615455, | |
| "predict_bleu_zsm_Latn-eng_Latn": 31.511297031839888, | |
| "predict_bleu_zsm_Latn-zsm_Latn": 32.668362383425844, | |
| "predict_bleu_zul_Latn-eng_Latn": 24.63282032321273, | |
| "predict_bleu_zul_Latn-zul_Latn": 12.778978343561064, | |
| "predict_loss": 1.0, | |
| "predict_model_preparation_time": 0.0054, | |
| "predict_runtime": 3647.923, | |
| "predict_samples": 611248, | |
| "predict_samples_per_second": 167.561, | |
| "predict_steps_per_second": 0.055 | |
| } |