Duplicate from facebook/mms-lid-1024

Co-authored-by: Patrick von Platen <patrickvonplaten@users.noreply.huggingface.co>

.gitattributes

@@ -0,0 +1,34 @@
+*.7z filter=lfs diff=lfs merge=lfs -text
+*.arrow filter=lfs diff=lfs merge=lfs -text
+*.bin filter=lfs diff=lfs merge=lfs -text
+*.bz2 filter=lfs diff=lfs merge=lfs -text
+*.ckpt filter=lfs diff=lfs merge=lfs -text
+*.ftz filter=lfs diff=lfs merge=lfs -text
+*.gz filter=lfs diff=lfs merge=lfs -text
+*.h5 filter=lfs diff=lfs merge=lfs -text
+*.joblib filter=lfs diff=lfs merge=lfs -text
+*.lfs.* filter=lfs diff=lfs merge=lfs -text
+*.mlmodel filter=lfs diff=lfs merge=lfs -text
+*.model filter=lfs diff=lfs merge=lfs -text
+*.msgpack filter=lfs diff=lfs merge=lfs -text
+*.npy filter=lfs diff=lfs merge=lfs -text
+*.npz filter=lfs diff=lfs merge=lfs -text
+*.onnx filter=lfs diff=lfs merge=lfs -text
+*.ot filter=lfs diff=lfs merge=lfs -text
+*.parquet filter=lfs diff=lfs merge=lfs -text
+*.pb filter=lfs diff=lfs merge=lfs -text
+*.pickle filter=lfs diff=lfs merge=lfs -text
+*.pkl filter=lfs diff=lfs merge=lfs -text
+*.pt filter=lfs diff=lfs merge=lfs -text
+*.pth filter=lfs diff=lfs merge=lfs -text
+*.rar filter=lfs diff=lfs merge=lfs -text
+*.safetensors filter=lfs diff=lfs merge=lfs -text
+saved_model/**/* filter=lfs diff=lfs merge=lfs -text
+*.tar.* filter=lfs diff=lfs merge=lfs -text
+*.tflite filter=lfs diff=lfs merge=lfs -text
+*.tgz filter=lfs diff=lfs merge=lfs -text
+*.wasm filter=lfs diff=lfs merge=lfs -text
+*.xz filter=lfs diff=lfs merge=lfs -text
+*.zip filter=lfs diff=lfs merge=lfs -text
+*.zst filter=lfs diff=lfs merge=lfs -text
+*tfevents* filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,1323 @@
+---
+tags:
+- mms
+language:
+- ab
+- af
+- ak
+- am
+- ar
+- as
+- av
+- ay
+- az
+- ba
+- bm
+- be
+- bn
+- bi
+- bo
+- sh
+- br
+- bg
+- ca
+- cs
+- ce
+- cv
+- ku
+- cy
+- da
+- de
+- dv
+- dz
+- el
+- en
+- eo
+- et
+- eu
+- ee
+- fo
+- fa
+- fj
+- fi
+- fr
+- fy
+- ff
+- ga
+- gl
+- gn
+- gu
+- zh
+- ht
+- ha
+- he
+- hi
+- sh
+- hu
+- hy
+- ig
+- ia
+- ms
+- is
+- it
+- jv
+- ja
+- kn
+- ka
+- kk
+- kr
+- km
+- ki
+- rw
+- ky
+- ko
+- kv
+- lo
+- la
+- lv
+- ln
+- lt
+- lb
+- lg
+- mh
+- ml
+- mr
+- ms
+- mk
+- mg
+- mt
+- mn
+- mi
+- my
+- zh
+- nl
+- 'no'
+- 'no'
+- ne
+- ny
+- oc
+- om
+- or
+- os
+- pa
+- pl
+- pt
+- ms
+- ps
+- qu
+- qu
+- qu
+- qu
+- qu
+- qu
+- qu
+- qu
+- qu
+- qu
+- qu
+- qu
+- qu
+- qu
+- qu
+- qu
+- qu
+- qu
+- qu
+- qu
+- qu
+- qu
+- ro
+- rn
+- ru
+- sg
+- sk
+- sl
+- sm
+- sn
+- sd
+- so
+- es
+- sq
+- su
+- sv
+- sw
+- ta
+- tt
+- te
+- tg
+- tl
+- th
+- ti
+- ts
+- tr
+- uk
+- ms
+- vi
+- wo
+- xh
+- ms
+- yo
+- ms
+- zu
+- za
+license: cc-by-nc-4.0
+datasets:
+- google/fleurs
+metrics:
+- acc
+---
+
+# Massively Multilingual Speech (MMS) - Finetuned LID
+
+This checkpoint is a model fine-tuned for speech language identification (LID) and part of Facebook's [Massive Multilingual Speech project](https://research.facebook.com/publications/scaling-speech-technology-to-1000-languages/).
+This checkpoint is based on the [Wav2Vec2 architecture](https://huggingface.co/docs/transformers/model_doc/wav2vec2) and classifies raw audio input to a probability distribution over 1024 output classes (each class representing a language).
+The checkpoint consists of **1 billion parameters** and has been fine-tuned from [facebook/mms-1b](https://huggingface.co/facebook/mms-1b) on 1024 languages.
+
+## Table Of Content
+
+- [Example](#example)
+- [Supported Languages](#supported-languages)
+- [Model details](#model-details)
+- [Additional links](#additional-links)
+
+## Example
+
+This MMS checkpoint can be used with [Transformers](https://github.com/huggingface/transformers) to identify
+the spoken language of an audio. It can recognize the [following 1024 languages](#supported-languages).
+
+Let's look at a simple example.
+
+First, we install transformers and some other libraries
+```
+pip install torch accelerate torchaudio datasets
+pip install --upgrade transformers
+````
+
+**Note**: In order to use MMS you need to have at least `transformers >= 4.30` installed. If the `4.30` version
+is not yet available [on PyPI](https://pypi.org/project/transformers/) make sure to install `transformers` from 
+source:
+```
+pip install git+https://github.com/huggingface/transformers.git
+```
+
+Next, we load a couple of audio samples via `datasets`. Make sure that the audio data is sampled to 16000 kHz.
+
+```py
+from datasets import load_dataset, Audio
+
+# English
+stream_data = load_dataset("mozilla-foundation/common_voice_13_0", "en", split="test", streaming=True)
+stream_data = stream_data.cast_column("audio", Audio(sampling_rate=16000))
+en_sample = next(iter(stream_data))["audio"]["array"]
+
+# Arabic
+stream_data = load_dataset("mozilla-foundation/common_voice_13_0", "ar", split="test", streaming=True)
+stream_data = stream_data.cast_column("audio", Audio(sampling_rate=16000))
+ar_sample = next(iter(stream_data))["audio"]["array"]
+```
+
+Next, we load the model and processor
+
+```py
+from transformers import Wav2Vec2ForSequenceClassification, AutoFeatureExtractor
+import torch
+
+model_id = "facebook/mms-lid-1024"
+
+processor = AutoFeatureExtractor.from_pretrained(model_id)
+model = Wav2Vec2ForSequenceClassification.from_pretrained(model_id)
+```
+
+Now we process the audio data, pass the processed audio data to the model to classify it into a language, just like we usually do for Wav2Vec2 audio classification models such as [ehcalabres/wav2vec2-lg-xlsr-en-speech-emotion-recognition](https://huggingface.co/harshit345/xlsr-wav2vec-speech-emotion-recognition)
+
+```py
+# English
+inputs = processor(en_sample, sampling_rate=16_000, return_tensors="pt")
+
+with torch.no_grad():
+    outputs = model(**inputs).logits
+
+lang_id = torch.argmax(outputs, dim=-1)[0].item()
+detected_lang = model.config.id2label[lang_id]
+# 'eng'
+
+# Arabic
+inputs = processor(ar_sample, sampling_rate=16_000, return_tensors="pt")
+
+with torch.no_grad():
+    outputs = model(**inputs).logits
+
+lang_id = torch.argmax(outputs, dim=-1)[0].item()
+detected_lang = model.config.id2label[lang_id]
+# 'ara'
+```
+
+To see all the supported languages of a checkpoint, you can print out the language ids as follows:
+```py
+processor.id2label.values()
+```
+
+For more details, about the architecture please have a look at [the official docs](https://huggingface.co/docs/transformers/main/en/model_doc/mms).
+
+## Supported Languages
+
+This model supports 1024 languages. Unclick the following to toogle all supported languages of this checkpoint in [ISO 639-3 code](https://en.wikipedia.org/wiki/ISO_639-3).
+You can find more details about the languages and their ISO 649-3 codes in the [MMS Language Coverage Overview](https://dl.fbaipublicfiles.com/mms/misc/language_coverage_mms.html).
+<details>
+  <summary>Click to toggle</summary>
+
+- ara
+- cmn
+- eng
+- spa
+- fra
+- mlg
+- swe
+- por
+- vie
+- ful
+- sun
+- asm
+- ben
+- zlm
+- kor
+- ind
+- hin
+- tuk
+- urd
+- aze
+- slv
+- mon
+- hau
+- tel
+- swh
+- bod
+- rus
+- tur
+- heb
+- mar
+- som
+- tgl
+- tat
+- tha
+- cat
+- ron
+- mal
+- bel
+- pol
+- yor
+- nld
+- bul
+- hat
+- afr
+- isl
+- amh
+- tam
+- hun
+- hrv
+- lit
+- cym
+- fas
+- mkd
+- ell
+- bos
+- deu
+- sqi
+- jav
+- kmr
+- nob
+- uzb
+- snd
+- lat
+- nya
+- grn
+- mya
+- orm
+- lin
+- hye
+- yue
+- pan
+- jpn
+- kaz
+- npi
+- kik
+- kat
+- guj
+- kan
+- tgk
+- ukr
+- ces
+- lav
+- bak
+- khm
+- cak
+- fao
+- glg
+- ltz
+- xog
+- lao
+- mlt
+- sin
+- aka
+- sna
+- che
+- mam
+- ita
+- quc
+- aiw
+- srp
+- mri
+- tuv
+- nno
+- pus
+- eus
+- kbp
+- gur
+- ory
+- lug
+- crh
+- bre
+- luo
+- nhx
+- slk
+- ewe
+- xsm
+- fin
+- rif
+- dan
+- saq
+- yid
+- yao
+- mos
+- quh
+- hne
+- xon
+- new
+- dtp
+- quy
+- est
+- ddn
+- dyu
+- ttq
+- bam
+- pse
+- uig
+- sck
+- ngl
+- tso
+- mup
+- dga
+- seh
+- lis
+- wal
+- ctg
+- mip
+- bfz
+- bxk
+- ceb
+- kru
+- war
+- khg
+- bbc
+- thl
+- nzi
+- vmw
+- mzi
+- ycl
+- zne
+- sid
+- asa
+- tpi
+- bmq
+- box
+- zpu
+- gof
+- nym
+- cla
+- bgq
+- bfy
+- hlb
+- qxl
+- teo
+- fon
+- sda
+- kfx
+- bfa
+- mag
+- tzh
+- pil
+- maj
+- maa
+- kdt
+- ksb
+- lns
+- btd
+- rej
+- pap
+- ayr
+- any
+- mnk
+- adx
+- gud
+- krc
+- onb
+- xal
+- ctd
+- nxq
+- ava
+- blt
+- lbw
+- hyw
+- udm
+- zar
+- tzo
+- kpv
+- san
+- xnj
+- kek
+- chv
+- kcg
+- kri
+- ati
+- bgw
+- mxt
+- ybb
+- btx
+- dgi
+- nhy
+- dnj
+- zpz
+- yba
+- lon
+- smo
+- men
+- ium
+- mgd
+- taq
+- nga
+- nsu
+- zaj
+- tly
+- prk
+- zpt
+- akb
+- mhr
+- mxb
+- nuj
+- obo
+- kir
+- bom
+- run
+- zpg
+- hwc
+- mnw
+- ubl
+- kin
+- xtm
+- hnj
+- mpm
+- rkt
+- miy
+- luc
+- mih
+- kne
+- mib
+- flr
+- myv
+- xmm
+- knk
+- iba
+- gux
+- pis
+- zmz
+- ses
+- dav
+- lif
+- qxr
+- dig
+- kdj
+- wsg
+- tir
+- gbm
+- mai
+- zpc
+- kus
+- nyy
+- mim
+- nan
+- nyn
+- gog
+- ngu
+- tbz
+- hoc
+- nyf
+- sus
+- guk
+- gwr
+- yaz
+- bcc
+- sbd
+- spp
+- hak
+- grt
+- kno
+- oss
+- suk
+- spy
+- nij
+- lsm
+- kaa
+- bem
+- rmy
+- kqn
+- nim
+- ztq
+- nus
+- bib
+- xtd
+- ach
+- mil
+- keo
+- mpg
+- gjn
+- zaq
+- kdh
+- dug
+- sah
+- awa
+- kff
+- dip
+- rim
+- nhe
+- pcm
+- kde
+- tem
+- quz
+- mfq
+- las
+- bba
+- kbr
+- taj
+- dyo
+- zao
+- lom
+- shk
+- dik
+- dgo
+- zpo
+- fij
+- bgc
+- xnr
+- bud
+- kac
+- laj
+- mev
+- maw
+- quw
+- kao
+- dag
+- ktb
+- lhu
+- zab
+- mgh
+- shn
+- otq
+- lob
+- pbb
+- oci
+- zyb
+- bsq
+- mhi
+- dzo
+- zas
+- guc
+- alz
+- ctu
+- wol
+- guw
+- mnb
+- nia
+- zaw
+- mxv
+- bci
+- sba
+- kab
+- dwr
+- nnb
+- ilo
+- mfe
+- srx
+- ruf
+- srn
+- zad
+- xpe
+- pce
+- ahk
+- bcl
+- myk
+- haw
+- mad
+- ljp
+- bky
+- gmv
+- nag
+- nav
+- nyo
+- kxm
+- nod
+- sag
+- zpl
+- sas
+- myx
+- sgw
+- old
+- irk
+- acf
+- mak
+- kfy
+- zai
+- mie
+- zpm
+- zpi
+- ote
+- jam
+- kpz
+- lgg
+- lia
+- nhi
+- mzm
+- bdq
+- xtn
+- mey
+- mjl
+- sgj
+- kdi
+- kxc
+- miz
+- adh
+- tap
+- hay
+- kss
+- pam
+- gor
+- heh
+- nhw
+- ziw
+- gej
+- yua
+- itv
+- shi
+- qvw
+- mrw
+- hil
+- mbt
+- pag
+- vmy
+- lwo
+- cce
+- kum
+- klu
+- ann
+- mbb
+- npl
+- zca
+- pww
+- toc
+- ace
+- mio
+- izz
+- kam
+- zaa
+- krj
+- bts
+- eza
+- zty
+- hns
+- kki
+- min
+- led
+- alw
+- tll
+- rng
+- pko
+- toi
+- iqw
+- ncj
+- toh
+- umb
+- mog
+- hno
+- wob
+- gxx
+- hig
+- nyu
+- kby
+- ban
+- syl
+- bxg
+- nse
+- xho
+- zae
+- mkw
+- nch
+- ibg
+- mas
+- qvz
+- bum
+- bgd
+- mww
+- epo
+- tzm
+- zul
+- bcq
+- lrc
+- xdy
+- tyv
+- ibo
+- loz
+- mza
+- abk
+- azz
+- guz
+- arn
+- ksw
+- lus
+- tos
+- gvr
+- top
+- ckb
+- mer
+- pov
+- lun
+- rhg
+- knc
+- sfw
+- bev
+- tum
+- lag
+- nso
+- bho
+- ndc
+- maf
+- gkp
+- bax
+- awn
+- ijc
+- qug
+- lub
+- srr
+- mni
+- zza
+- ige
+- dje
+- mkn
+- bft
+- tiv
+- otn
+- kck
+- kqs
+- gle
+- lua
+- pdt
+- swk
+- mgw
+- ebu
+- ada
+- lic
+- skr
+- gaa
+- mfa
+- vmk
+- mcn
+- bto
+- lol
+- bwr
+- unr
+- dzg
+- hdy
+- kea
+- bhi
+- glk
+- mua
+- ast
+- nup
+- sat
+- ktu
+- bhb
+- zpq
+- coh
+- bkm
+- gya
+- sgc
+- dks
+- ncl
+- tui
+- emk
+- urh
+- ego
+- ogo
+- tsc
+- idu
+- igb
+- ijn
+- njz
+- ngb
+- tod
+- jra
+- mrt
+- zav
+- tke
+- its
+- ady
+- bzw
+- kng
+- kmb
+- lue
+- jmx
+- tsn
+- bin
+- ble
+- gom
+- ven
+- sef
+- sco
+- her
+- iso
+- trp
+- glv
+- haq
+- toq
+- okr
+- kha
+- wof
+- rmn
+- sot
+- kaj
+- bbj
+- sou
+- mjt
+- trd
+- gno
+- mwn
+- igl
+- rag
+- eyo
+- div
+- efi
+- nde
+- mfv
+- mix
+- rki
+- kjg
+- fan
+- khw
+- wci
+- bjn
+- pmy
+- bqi
+- ina
+- hni
+- mjx
+- kuj
+- aoz
+- the
+- tog
+- tet
+- nuz
+- ajg
+- ccp
+- mau
+- ymm
+- fmu
+- tcz
+- xmc
+- nyk
+- ztg
+- knx
+- snk
+- zac
+- esg
+- srb
+- thq
+- pht
+- wes
+- rah
+- pnb
+- ssy
+- zpv
+- kpo
+- phr
+- atd
+- eto
+- xta
+- mxx
+- mui
+- uki
+- tkt
+- mgp
+- xsq
+- enq
+- nnh
+- qxp
+- zam
+- bug
+- bxr
+- maq
+- tdt
+- khb
+- mrr
+- kas
+- zgb
+- kmw
+- lir
+- vah
+- dar
+- ssw
+- hmd
+- jab
+- iii
+- peg
+- shr
+- brx
+- rwr
+- bmb
+- kmc
+- mji
+- dib
+- pcc
+- nbe
+- mrd
+- ish
+- kai
+- yom
+- zyn
+- hea
+- ewo
+- bas
+- hms
+- twh
+- kfq
+- thr
+- xtl
+- wbr
+- bfb
+- wtm
+- mjc
+- blk
+- lot
+- dhd
+- swv
+- wbm
+- zzj
+- kge
+- mgm
+- niq
+- zpj
+- bwx
+- bde
+- mtr
+- gju
+- kjp
+- mbz
+- haz
+- lpo
+- yig
+- qud
+- shy
+- gjk
+- ztp
+- nbl
+- aii
+- kun
+- say
+- mde
+- sjp
+- bns
+- brh
+- ywq
+- msi
+- anr
+- mrg
+- mjg
+- tan
+- tsg
+- tcy
+- kbl
+- mdr
+- mks
+- noe
+- tyz
+- zpa
+- ahr
+- aar
+- wuu
+- khr
+- kbd
+- kex
+- bca
+- nku
+- pwr
+- hsn
+- ort
+- ott
+- swi
+- kua
+- tdd
+- msm
+- bgp
+- nbm
+- mxy
+- abs
+- zlj
+- ebo
+- lea
+- dub
+- sce
+- xkb
+- vav
+- bra
+- ssb
+- sss
+- nhp
+- kad
+- kvx
+- lch
+- tts
+- zyj
+- kxp
+- lmn
+- qvi
+- lez
+- scl
+- cqd
+- ayb
+- xbr
+- nqg
+- dcc
+- cjk
+- bfr
+- zyg
+- mse
+- gru
+- mdv
+- bew
+- wti
+- arg
+- dso
+- zdj
+- pll
+- mig
+- qxs
+- bol
+- drs
+- anp
+- chw
+- bej
+- vmc
+- otx
+- xty
+- bjj
+- vmz
+- ibb
+- gby
+- twx
+- tig
+- thz
+- tku
+- hmz
+- pbm
+- mfn
+- nut
+- cyo
+- mjw
+- cjm
+- tlp
+- naq
+- rnd
+- stj
+- sym
+- jax
+- btg
+- tdg
+- sng
+- nlv
+- kvr
+- pch
+- fvr
+- mxs
+- wni
+- mlq
+- kfr
+- mdj
+- osi
+- nhn
+- ukw
+- tji
+- qvj
+- nih
+- bcy
+- hbb
+- zpx
+- hoj
+- cpx
+- ogc
+- cdo
+- bgn
+- bfs
+- vmx
+- tvn
+- ior
+- mxa
+- btm
+- anc
+- jit
+- mfb
+- mls
+- ets
+- goa
+- bet
+- ikw
+- pem
+- trf
+- daq
+- max
+- rad
+- njo
+- bnx
+- mxl
+- mbi
+- nba
+- zpn
+- zts
+- mut
+- hnd
+- mta
+- hav
+- hac
+- ryu
+- abr
+- yer
+- cld
+- zag
+- ndo
+- sop
+- vmm
+- gcf
+- chr
+- cbk
+- sbk
+- bhp
+- odk
+- mbd
+- nap
+- gbr
+- mii
+- czh
+- xti
+- vls
+- gdx
+- sxw
+- zaf
+- wem
+- mqh
+- ank
+- yaf
+- vmp
+- otm
+- sdh
+- anw
+- src
+- mne
+- wss
+- meh
+- kzc
+- tma
+- ttj
+- ots
+- ilp
+- zpr
+- saz
+- ogb
+- akl
+- nhg
+- pbv
+- rcf
+- cgg
+- mku
+- bez
+- mwe
+- mtb
+- gul
+- ifm
+- mdh
+- scn
+- lki
+- xmf
+- sgd
+- aba
+- cos
+- luz
+- zpy
+- stv
+- kjt
+- mbf
+- kmz
+- nds
+- mtq
+- tkq
+- aee
+- knn
+- mbs
+- mnp
+- ema
+- bar
+- unx
+- plk
+- psi
+- mzn
+- cja
+- sro
+- mdw
+- ndh
+- vmj
+- zpw
+- kfu
+- bgx
+- gsw
+- fry
+- zpe
+- zpd
+- bta
+- psh
+- zat
+
+</details>
+
+## Model details
+
+- **Developed by:** Vineel Pratap et al.
+- **Model type:** Multi-Lingual Automatic Speech Recognition model
+- **Language(s):** 1024 languages, see [supported languages](#supported-languages)
+- **License:** CC-BY-NC 4.0 license
+- **Num parameters**: 1 billion
+- **Audio sampling rate**: 16,000 kHz
+- **Cite as:**
+
+      @article{pratap2023mms,
+        title={Scaling Speech Technology to 1,000+ Languages},
+        author={Vineel Pratap and Andros Tjandra and Bowen Shi and Paden Tomasello and Arun Babu and Sayani Kundu and Ali Elkahky and Zhaoheng Ni and Apoorv Vyas and Maryam Fazel-Zarandi and Alexei Baevski and Yossi Adi and Xiaohui Zhang and Wei-Ning Hsu and Alexis Conneau and Michael Auli},
+      journal={arXiv},
+      year={2023}
+      }
+
+## Additional Links
+
+- [Blog post](https://ai.facebook.com/blog/multilingual-model-speech-recognition/)
+- [Transformers documentation](https://huggingface.co/docs/transformers/main/en/model_doc/mms).
+- [Paper](https://arxiv.org/abs/2305.13516)
+- [GitHub Repository](https://github.com/facebookresearch/fairseq/tree/main/examples/mms#asr)
+- [Other **MMS** checkpoints](https://huggingface.co/models?other=mms)
+- MMS base checkpoints:
+  - [facebook/mms-1b](https://huggingface.co/facebook/mms-1b)
+  - [facebook/mms-300m](https://huggingface.co/facebook/mms-300m)
+- [Official Space](https://huggingface.co/spaces/facebook/MMS)

config.json

@@ -0,0 +1,1135 @@
+{
+  "_name_or_path": "mms-lid-1024",
+  "activation_dropout": 0.05,
+  "adapter_attn_dim": 16,
+  "adapter_kernel_size": 3,
+  "adapter_stride": 2,
+  "add_adapter": false,
+  "apply_spec_augment": true,
+  "architectures": [
+    "Wav2Vec2ForSequenceClassification"
+  ],
+  "attention_dropout": 0.05,
+  "bos_token_id": 1,
+  "classifier_proj_size": 1024,
+  "codevector_dim": 1024,
+  "contrastive_logits_temperature": 0.1,
+  "conv_bias": true,
+  "conv_dim": [
+    512,
+    512,
+    512,
+    512,
+    512,
+    512,
+    512
+  ],
+  "conv_kernel": [
+    10,
+    3,
+    3,
+    3,
+    3,
+    2,
+    2
+  ],
+  "conv_stride": [
+    5,
+    2,
+    2,
+    2,
+    2,
+    2,
+    2
+  ],
+  "ctc_loss_reduction": "mean",
+  "ctc_zero_infinity": false,
+  "diversity_loss_weight": 0.1,
+  "do_stable_layer_norm": true,
+  "eos_token_id": 2,
+  "feat_extract_activation": "gelu",
+  "feat_extract_dropout": 0.0,
+  "feat_extract_norm": "layer",
+  "feat_proj_dropout": 0.05,
+  "feat_quantizer_dropout": 0.0,
+  "final_dropout": 0.05,
+  "hidden_act": "gelu",
+  "hidden_dropout": 0.05,
+  "hidden_size": 1280,
+  "id2label": {
+    "0": "ara",
+    "1": "cmn",
+    "2": "eng",
+    "3": "spa",
+    "4": "fra",
+    "5": "mlg",
+    "6": "swe",
+    "7": "por",
+    "8": "vie",
+    "9": "ful",
+    "10": "sun",
+    "11": "asm",
+    "12": "ben",
+    "13": "zlm",
+    "14": "kor",
+    "15": "ind",
+    "16": "hin",
+    "17": "tuk",
+    "18": "urd",
+    "19": "aze",
+    "20": "slv",
+    "21": "mon",
+    "22": "hau",
+    "23": "tel",
+    "24": "swh",
+    "25": "bod",
+    "26": "rus",
+    "27": "tur",
+    "28": "heb",
+    "29": "mar",
+    "30": "som",
+    "31": "tgl",
+    "32": "tat",
+    "33": "tha",
+    "34": "cat",
+    "35": "ron",
+    "36": "mal",
+    "37": "bel",
+    "38": "pol",
+    "39": "yor",
+    "40": "nld",
+    "41": "bul",
+    "42": "hat",
+    "43": "afr",
+    "44": "isl",
+    "45": "amh",
+    "46": "tam",
+    "47": "hun",
+    "48": "hrv",
+    "49": "lit",
+    "50": "cym",
+    "51": "fas",
+    "52": "mkd",
+    "53": "ell",
+    "54": "bos",
+    "55": "deu",
+    "56": "sqi",
+    "57": "jav",
+    "58": "kmr",
+    "59": "nob",
+    "60": "uzb",
+    "61": "snd",
+    "62": "lat",
+    "63": "nya",
+    "64": "grn",
+    "65": "mya",
+    "66": "orm",
+    "67": "lin",
+    "68": "hye",
+    "69": "yue",
+    "70": "pan",
+    "71": "jpn",
+    "72": "kaz",
+    "73": "npi",
+    "74": "kik",
+    "75": "kat",
+    "76": "guj",
+    "77": "kan",
+    "78": "tgk",
+    "79": "ukr",
+    "80": "ces",
+    "81": "lav",
+    "82": "bak",
+    "83": "khm",
+    "84": "cak",
+    "85": "fao",
+    "86": "glg",
+    "87": "ltz",
+    "88": "xog",
+    "89": "lao",
+    "90": "mlt",
+    "91": "sin",
+    "92": "aka",
+    "93": "sna",
+    "94": "che",
+    "95": "mam",
+    "96": "ita",
+    "97": "quc",
+    "98": "aiw",
+    "99": "srp",
+    "100": "mri",
+    "101": "tuv",
+    "102": "nno",
+    "103": "pus",
+    "104": "eus",
+    "105": "kbp",
+    "106": "gur",
+    "107": "ory",
+    "108": "lug",
+    "109": "crh",
+    "110": "bre",
+    "111": "luo",
+    "112": "nhx",
+    "113": "slk",
+    "114": "ewe",
+    "115": "xsm",
+    "116": "fin",
+    "117": "rif",
+    "118": "dan",
+    "119": "saq",
+    "120": "yid",
+    "121": "yao",
+    "122": "mos",
+    "123": "quh",
+    "124": "hne",
+    "125": "xon",
+    "126": "new",
+    "127": "dtp",
+    "128": "quy",
+    "129": "est",
+    "130": "ddn",
+    "131": "dyu",
+    "132": "ttq",
+    "133": "bam",
+    "134": "pse",
+    "135": "uig",
+    "136": "sck",
+    "137": "ngl",
+    "138": "tso",
+    "139": "mup",
+    "140": "dga",
+    "141": "seh",
+    "142": "lis",
+    "143": "wal",
+    "144": "ctg",
+    "145": "mip",
+    "146": "bfz",
+    "147": "bxk",
+    "148": "ceb",
+    "149": "kru",
+    "150": "war",
+    "151": "khg",
+    "152": "bbc",
+    "153": "thl",
+    "154": "nzi",
+    "155": "vmw",
+    "156": "mzi",
+    "157": "ycl",
+    "158": "zne",
+    "159": "sid",
+    "160": "asa",
+    "161": "tpi",
+    "162": "bmq",
+    "163": "box",
+    "164": "zpu",
+    "165": "gof",
+    "166": "nym",
+    "167": "cla",
+    "168": "bgq",
+    "169": "bfy",
+    "170": "hlb",
+    "171": "qxl",
+    "172": "teo",
+    "173": "fon",
+    "174": "sda",
+    "175": "kfx",
+    "176": "bfa",
+    "177": "mag",
+    "178": "tzh",
+    "179": "pil",
+    "180": "maj",
+    "181": "maa",
+    "182": "kdt",
+    "183": "ksb",
+    "184": "lns",
+    "185": "btd",
+    "186": "rej",
+    "187": "pap",
+    "188": "ayr",
+    "189": "any",
+    "190": "mnk",
+    "191": "adx",
+    "192": "gud",
+    "193": "krc",
+    "194": "onb",
+    "195": "xal",
+    "196": "ctd",
+    "197": "nxq",
+    "198": "ava",
+    "199": "blt",
+    "200": "lbw",
+    "201": "hyw",
+    "202": "udm",
+    "203": "zar",
+    "204": "tzo",
+    "205": "kpv",
+    "206": "san",
+    "207": "xnj",
+    "208": "kek",
+    "209": "chv",
+    "210": "kcg",
+    "211": "kri",
+    "212": "ati",
+    "213": "bgw",
+    "214": "mxt",
+    "215": "ybb",
+    "216": "btx",
+    "217": "dgi",
+    "218": "nhy",
+    "219": "dnj",
+    "220": "zpz",
+    "221": "yba",
+    "222": "lon",
+    "223": "smo",
+    "224": "men",
+    "225": "ium",
+    "226": "mgd",
+    "227": "taq",
+    "228": "nga",
+    "229": "nsu",
+    "230": "zaj",
+    "231": "tly",
+    "232": "prk",
+    "233": "zpt",
+    "234": "akb",
+    "235": "mhr",
+    "236": "mxb",
+    "237": "nuj",
+    "238": "obo",
+    "239": "kir",
+    "240": "bom",
+    "241": "run",
+    "242": "zpg",
+    "243": "hwc",
+    "244": "mnw",
+    "245": "ubl",
+    "246": "kin",
+    "247": "xtm",
+    "248": "hnj",
+    "249": "mpm",
+    "250": "rkt",
+    "251": "miy",
+    "252": "luc",
+    "253": "mih",
+    "254": "kne",
+    "255": "mib",
+    "256": "flr",
+    "257": "myv",
+    "258": "xmm",
+    "259": "knk",
+    "260": "iba",
+    "261": "gux",
+    "262": "pis",
+    "263": "zmz",
+    "264": "ses",
+    "265": "dav",
+    "266": "lif",
+    "267": "qxr",
+    "268": "dig",
+    "269": "kdj",
+    "270": "wsg",
+    "271": "tir",
+    "272": "gbm",
+    "273": "mai",
+    "274": "zpc",
+    "275": "kus",
+    "276": "nyy",
+    "277": "mim",
+    "278": "nan",
+    "279": "nyn",
+    "280": "gog",
+    "281": "ngu",
+    "282": "tbz",
+    "283": "hoc",
+    "284": "nyf",
+    "285": "sus",
+    "286": "guk",
+    "287": "gwr",
+    "288": "yaz",
+    "289": "bcc",
+    "290": "sbd",
+    "291": "spp",
+    "292": "hak",
+    "293": "grt",
+    "294": "kno",
+    "295": "oss",
+    "296": "suk",
+    "297": "spy",
+    "298": "nij",
+    "299": "lsm",
+    "300": "kaa",
+    "301": "bem",
+    "302": "rmy",
+    "303": "kqn",
+    "304": "nim",
+    "305": "ztq",
+    "306": "nus",
+    "307": "bib",
+    "308": "xtd",
+    "309": "ach",
+    "310": "mil",
+    "311": "keo",
+    "312": "mpg",
+    "313": "gjn",
+    "314": "zaq",
+    "315": "kdh",
+    "316": "dug",
+    "317": "sah",
+    "318": "awa",
+    "319": "kff",
+    "320": "dip",
+    "321": "rim",
+    "322": "nhe",
+    "323": "pcm",
+    "324": "kde",
+    "325": "tem",
+    "326": "quz",
+    "327": "mfq",
+    "328": "las",
+    "329": "bba",
+    "330": "kbr",
+    "331": "taj",
+    "332": "dyo",
+    "333": "zao",
+    "334": "lom",
+    "335": "shk",
+    "336": "dik",
+    "337": "dgo",
+    "338": "zpo",
+    "339": "fij",
+    "340": "bgc",
+    "341": "xnr",
+    "342": "bud",
+    "343": "kac",
+    "344": "laj",
+    "345": "mev",
+    "346": "maw",
+    "347": "quw",
+    "348": "kao",
+    "349": "dag",
+    "350": "ktb",
+    "351": "lhu",
+    "352": "zab",
+    "353": "mgh",
+    "354": "shn",
+    "355": "otq",
+    "356": "lob",
+    "357": "pbb",
+    "358": "oci",
+    "359": "zyb",
+    "360": "bsq",
+    "361": "mhi",
+    "362": "dzo",
+    "363": "zas",
+    "364": "guc",
+    "365": "alz",
+    "366": "ctu",
+    "367": "wol",
+    "368": "guw",
+    "369": "mnb",
+    "370": "nia",
+    "371": "zaw",
+    "372": "mxv",
+    "373": "bci",
+    "374": "sba",
+    "375": "kab",
+    "376": "dwr",
+    "377": "nnb",
+    "378": "ilo",
+    "379": "mfe",
+    "380": "srx",
+    "381": "ruf",
+    "382": "srn",
+    "383": "zad",
+    "384": "xpe",
+    "385": "pce",
+    "386": "ahk",
+    "387": "bcl",
+    "388": "myk",
+    "389": "haw",
+    "390": "mad",
+    "391": "ljp",
+    "392": "bky",
+    "393": "gmv",
+    "394": "nag",
+    "395": "nav",
+    "396": "nyo",
+    "397": "kxm",
+    "398": "nod",
+    "399": "sag",
+    "400": "zpl",
+    "401": "sas",
+    "402": "myx",
+    "403": "sgw",
+    "404": "old",
+    "405": "irk",
+    "406": "acf",
+    "407": "mak",
+    "408": "kfy",
+    "409": "zai",
+    "410": "mie",
+    "411": "zpm",
+    "412": "zpi",
+    "413": "ote",
+    "414": "jam",
+    "415": "kpz",
+    "416": "lgg",
+    "417": "lia",
+    "418": "nhi",
+    "419": "mzm",
+    "420": "bdq",
+    "421": "xtn",
+    "422": "mey",
+    "423": "mjl",
+    "424": "sgj",
+    "425": "kdi",
+    "426": "kxc",
+    "427": "miz",
+    "428": "adh",
+    "429": "tap",
+    "430": "hay",
+    "431": "kss",
+    "432": "pam",
+    "433": "gor",
+    "434": "heh",
+    "435": "nhw",
+    "436": "ziw",
+    "437": "gej",
+    "438": "yua",
+    "439": "itv",
+    "440": "shi",
+    "441": "qvw",
+    "442": "mrw",
+    "443": "hil",
+    "444": "mbt",
+    "445": "pag",
+    "446": "vmy",
+    "447": "lwo",
+    "448": "cce",
+    "449": "kum",
+    "450": "klu",
+    "451": "ann",
+    "452": "mbb",
+    "453": "npl",
+    "454": "zca",
+    "455": "pww",
+    "456": "toc",
+    "457": "ace",
+    "458": "mio",
+    "459": "izz",
+    "460": "kam",
+    "461": "zaa",
+    "462": "krj",
+    "463": "bts",
+    "464": "eza",
+    "465": "zty",
+    "466": "hns",
+    "467": "kki",
+    "468": "min",
+    "469": "led",
+    "470": "alw",
+    "471": "tll",
+    "472": "rng",
+    "473": "pko",
+    "474": "toi",
+    "475": "iqw",
+    "476": "ncj",
+    "477": "toh",
+    "478": "umb",
+    "479": "mog",
+    "480": "hno",
+    "481": "wob",
+    "482": "gxx",
+    "483": "hig",
+    "484": "nyu",
+    "485": "kby",
+    "486": "ban",
+    "487": "syl",
+    "488": "bxg",
+    "489": "nse",
+    "490": "xho",
+    "491": "zae",
+    "492": "mkw",
+    "493": "nch",
+    "494": "ibg",
+    "495": "mas",
+    "496": "qvz",
+    "497": "bum",
+    "498": "bgd",
+    "499": "mww",
+    "500": "epo",
+    "501": "tzm",
+    "502": "zul",
+    "503": "bcq",
+    "504": "lrc",
+    "505": "xdy",
+    "506": "tyv",
+    "507": "ibo",
+    "508": "loz",
+    "509": "mza",
+    "510": "abk",
+    "511": "azz",
+    "512": "guz",
+    "513": "arn",
+    "514": "ksw",
+    "515": "lus",
+    "516": "tos",
+    "517": "gvr",
+    "518": "top",
+    "519": "ckb",
+    "520": "mer",
+    "521": "pov",
+    "522": "lun",
+    "523": "rhg",
+    "524": "knc",
+    "525": "sfw",
+    "526": "bev",
+    "527": "tum",
+    "528": "lag",
+    "529": "nso",
+    "530": "bho",
+    "531": "ndc",
+    "532": "maf",
+    "533": "gkp",
+    "534": "bax",
+    "535": "awn",
+    "536": "ijc",
+    "537": "qug",
+    "538": "lub",
+    "539": "srr",
+    "540": "mni",
+    "541": "zza",
+    "542": "ige",
+    "543": "dje",
+    "544": "mkn",
+    "545": "bft",
+    "546": "tiv",
+    "547": "otn",
+    "548": "kck",
+    "549": "kqs",
+    "550": "gle",
+    "551": "lua",
+    "552": "pdt",
+    "553": "swk",
+    "554": "mgw",
+    "555": "ebu",
+    "556": "ada",
+    "557": "lic",
+    "558": "skr",
+    "559": "gaa",
+    "560": "mfa",
+    "561": "vmk",
+    "562": "mcn",
+    "563": "bto",
+    "564": "lol",
+    "565": "bwr",
+    "566": "unr",
+    "567": "dzg",
+    "568": "hdy",
+    "569": "kea",
+    "570": "bhi",
+    "571": "glk",
+    "572": "mua",
+    "573": "ast",
+    "574": "nup",
+    "575": "sat",
+    "576": "ktu",
+    "577": "bhb",
+    "578": "zpq",
+    "579": "coh",
+    "580": "bkm",
+    "581": "gya",
+    "582": "sgc",
+    "583": "dks",
+    "584": "ncl",
+    "585": "tui",
+    "586": "emk",
+    "587": "urh",
+    "588": "ego",
+    "589": "ogo",
+    "590": "tsc",
+    "591": "idu",
+    "592": "igb",
+    "593": "ijn",
+    "594": "njz",
+    "595": "ngb",
+    "596": "tod",
+    "597": "jra",
+    "598": "mrt",
+    "599": "zav",
+    "600": "tke",
+    "601": "its",
+    "602": "ady",
+    "603": "bzw",
+    "604": "kng",
+    "605": "kmb",
+    "606": "lue",
+    "607": "jmx",
+    "608": "tsn",
+    "609": "bin",
+    "610": "ble",
+    "611": "gom",
+    "612": "ven",
+    "613": "sef",
+    "614": "sco",
+    "615": "her",
+    "616": "iso",
+    "617": "trp",
+    "618": "glv",
+    "619": "haq",
+    "620": "toq",
+    "621": "okr",
+    "622": "kha",
+    "623": "wof",
+    "624": "rmn",
+    "625": "sot",
+    "626": "kaj",
+    "627": "bbj",
+    "628": "sou",
+    "629": "mjt",
+    "630": "trd",
+    "631": "gno",
+    "632": "mwn",
+    "633": "igl",
+    "634": "rag",
+    "635": "eyo",
+    "636": "div",
+    "637": "efi",
+    "638": "nde",
+    "639": "mfv",
+    "640": "mix",
+    "641": "rki",
+    "642": "kjg",
+    "643": "fan",
+    "644": "khw",
+    "645": "wci",
+    "646": "bjn",
+    "647": "pmy",
+    "648": "bqi",
+    "649": "ina",
+    "650": "hni",
+    "651": "mjx",
+    "652": "kuj",
+    "653": "aoz",
+    "654": "the",
+    "655": "tog",
+    "656": "tet",
+    "657": "nuz",
+    "658": "ajg",
+    "659": "ccp",
+    "660": "mau",
+    "661": "ymm",
+    "662": "fmu",
+    "663": "tcz",
+    "664": "xmc",
+    "665": "nyk",
+    "666": "ztg",
+    "667": "knx",
+    "668": "snk",
+    "669": "zac",
+    "670": "esg",
+    "671": "srb",
+    "672": "thq",
+    "673": "pht",
+    "674": "wes",
+    "675": "rah",
+    "676": "pnb",
+    "677": "ssy",
+    "678": "zpv",
+    "679": "kpo",
+    "680": "phr",
+    "681": "atd",
+    "682": "eto",
+    "683": "xta",
+    "684": "mxx",
+    "685": "mui",
+    "686": "uki",
+    "687": "tkt",
+    "688": "mgp",
+    "689": "xsq",
+    "690": "enq",
+    "691": "nnh",
+    "692": "qxp",
+    "693": "zam",
+    "694": "bug",
+    "695": "bxr",
+    "696": "maq",
+    "697": "tdt",
+    "698": "khb",
+    "699": "mrr",
+    "700": "kas",
+    "701": "zgb",
+    "702": "kmw",
+    "703": "lir",
+    "704": "vah",
+    "705": "dar",
+    "706": "ssw",
+    "707": "hmd",
+    "708": "jab",
+    "709": "iii",
+    "710": "peg",
+    "711": "shr",
+    "712": "brx",
+    "713": "rwr",
+    "714": "bmb",
+    "715": "kmc",
+    "716": "mji",
+    "717": "dib",
+    "718": "pcc",
+    "719": "nbe",
+    "720": "mrd",
+    "721": "ish",
+    "722": "kai",
+    "723": "yom",
+    "724": "zyn",
+    "725": "hea",
+    "726": "ewo",
+    "727": "bas",
+    "728": "hms",
+    "729": "twh",
+    "730": "kfq",
+    "731": "thr",
+    "732": "xtl",
+    "733": "wbr",
+    "734": "bfb",
+    "735": "wtm",
+    "736": "mjc",
+    "737": "blk",
+    "738": "lot",
+    "739": "dhd",
+    "740": "swv",
+    "741": "wbm",
+    "742": "zzj",
+    "743": "kge",
+    "744": "mgm",
+    "745": "niq",
+    "746": "zpj",
+    "747": "bwx",
+    "748": "bde",
+    "749": "mtr",
+    "750": "gju",
+    "751": "kjp",
+    "752": "mbz",
+    "753": "haz",
+    "754": "lpo",
+    "755": "yig",
+    "756": "qud",
+    "757": "shy",
+    "758": "gjk",
+    "759": "ztp",
+    "760": "nbl",
+    "761": "aii",
+    "762": "kun",
+    "763": "say",
+    "764": "mde",
+    "765": "sjp",
+    "766": "bns",
+    "767": "brh",
+    "768": "ywq",
+    "769": "msi",
+    "770": "anr",
+    "771": "mrg",
+    "772": "mjg",
+    "773": "tan",
+    "774": "tsg",
+    "775": "tcy",
+    "776": "kbl",
+    "777": "mdr",
+    "778": "mks",
+    "779": "noe",
+    "780": "tyz",
+    "781": "zpa",
+    "782": "ahr",
+    "783": "aar",
+    "784": "wuu",
+    "785": "khr",
+    "786": "kbd",
+    "787": "kex",
+    "788": "bca",
+    "789": "nku",
+    "790": "pwr",
+    "791": "hsn",
+    "792": "ort",
+    "793": "ott",
+    "794": "swi",
+    "795": "kua",
+    "796": "tdd",
+    "797": "msm",
+    "798": "bgp",
+    "799": "nbm",
+    "800": "mxy",
+    "801": "abs",
+    "802": "zlj",
+    "803": "ebo",
+    "804": "lea",
+    "805": "dub",
+    "806": "sce",
+    "807": "xkb",
+    "808": "vav",
+    "809": "bra",
+    "810": "ssb",
+    "811": "sss",
+    "812": "nhp",
+    "813": "kad",
+    "814": "kvx",
+    "815": "lch",
+    "816": "tts",
+    "817": "zyj",
+    "818": "kxp",
+    "819": "lmn",
+    "820": "qvi",
+    "821": "lez",
+    "822": "scl",
+    "823": "cqd",
+    "824": "ayb",
+    "825": "xbr",
+    "826": "nqg",
+    "827": "dcc",
+    "828": "cjk",
+    "829": "bfr",
+    "830": "zyg",
+    "831": "mse",
+    "832": "gru",
+    "833": "mdv",
+    "834": "bew",
+    "835": "wti",
+    "836": "arg",
+    "837": "dso",
+    "838": "zdj",
+    "839": "pll",
+    "840": "mig",
+    "841": "qxs",
+    "842": "bol",
+    "843": "drs",
+    "844": "anp",
+    "845": "chw",
+    "846": "bej",
+    "847": "vmc",
+    "848": "otx",
+    "849": "xty",
+    "850": "bjj",
+    "851": "vmz",
+    "852": "ibb",
+    "853": "gby",
+    "854": "twx",
+    "855": "tig",
+    "856": "thz",
+    "857": "tku",
+    "858": "hmz",
+    "859": "pbm",
+    "860": "mfn",
+    "861": "nut",
+    "862": "cyo",
+    "863": "mjw",
+    "864": "cjm",
+    "865": "tlp",
+    "866": "naq",
+    "867": "rnd",
+    "868": "stj",
+    "869": "sym",
+    "870": "jax",
+    "871": "btg",
+    "872": "tdg",
+    "873": "sng",
+    "874": "nlv",
+    "875": "kvr",
+    "876": "pch",
+    "877": "fvr",
+    "878": "mxs",
+    "879": "wni",
+    "880": "mlq",
+    "881": "kfr",
+    "882": "mdj",
+    "883": "osi",
+    "884": "nhn",
+    "885": "ukw",
+    "886": "tji",
+    "887": "qvj",
+    "888": "nih",
+    "889": "bcy",
+    "890": "hbb",
+    "891": "zpx",
+    "892": "hoj",
+    "893": "cpx",
+    "894": "ogc",
+    "895": "cdo",
+    "896": "bgn",
+    "897": "bfs",
+    "898": "vmx",
+    "899": "tvn",
+    "900": "ior",
+    "901": "mxa",
+    "902": "btm",
+    "903": "anc",
+    "904": "jit",
+    "905": "mfb",
+    "906": "mls",
+    "907": "ets",
+    "908": "goa",
+    "909": "bet",
+    "910": "ikw",
+    "911": "pem",
+    "912": "trf",
+    "913": "daq",
+    "914": "max",
+    "915": "rad",
+    "916": "njo",
+    "917": "bnx",
+    "918": "mxl",
+    "919": "mbi",
+    "920": "nba",
+    "921": "zpn",
+    "922": "zts",
+    "923": "mut",
+    "924": "hnd",
+    "925": "mta",
+    "926": "hav",
+    "927": "hac",
+    "928": "ryu",
+    "929": "abr",
+    "930": "yer",
+    "931": "cld",
+    "932": "zag",
+    "933": "ndo",
+    "934": "sop",
+    "935": "vmm",
+    "936": "gcf",
+    "937": "chr",
+    "938": "cbk",
+    "939": "sbk",
+    "940": "bhp",
+    "941": "odk",
+    "942": "mbd",
+    "943": "nap",
+    "944": "gbr",
+    "945": "mii",
+    "946": "czh",
+    "947": "xti",
+    "948": "vls",
+    "949": "gdx",
+    "950": "sxw",
+    "951": "zaf",
+    "952": "wem",
+    "953": "mqh",
+    "954": "ank",
+    "955": "yaf",
+    "956": "vmp",
+    "957": "otm",
+    "958": "sdh",
+    "959": "anw",
+    "960": "src",
+    "961": "mne",
+    "962": "wss",
+    "963": "meh",
+    "964": "kzc",
+    "965": "tma",
+    "966": "ttj",
+    "967": "ots",
+    "968": "ilp",
+    "969": "zpr",
+    "970": "saz",
+    "971": "ogb",
+    "972": "akl",
+    "973": "nhg",
+    "974": "pbv",
+    "975": "rcf",
+    "976": "cgg",
+    "977": "mku",
+    "978": "bez",
+    "979": "mwe",
+    "980": "mtb",
+    "981": "gul",
+    "982": "ifm",
+    "983": "mdh",
+    "984": "scn",
+    "985": "lki",
+    "986": "xmf",
+    "987": "sgd",
+    "988": "aba",
+    "989": "cos",
+    "990": "luz",
+    "991": "zpy",
+    "992": "stv",
+    "993": "kjt",
+    "994": "mbf",
+    "995": "kmz",
+    "996": "nds",
+    "997": "mtq",
+    "998": "tkq",
+    "999": "aee",
+    "1000": "knn",
+    "1001": "mbs",
+    "1002": "mnp",
+    "1003": "ema",
+    "1004": "bar",
+    "1005": "unx",
+    "1006": "plk",
+    "1007": "psi",
+    "1008": "mzn",
+    "1009": "cja",
+    "1010": "sro",
+    "1011": "mdw",
+    "1012": "ndh",
+    "1013": "vmj",
+    "1014": "zpw",
+    "1015": "kfu",
+    "1016": "bgx",
+    "1017": "gsw",
+    "1018": "fry",
+    "1019": "zpe",
+    "1020": "zpd",
+    "1021": "bta",
+    "1022": "psh",
+    "1023": "zat"
+  },
+  "initializer_range": 0.02,
+  "intermediate_size": 5120,
+  "label2id": null,
+  "layer_norm_eps": 1e-05,
+  "layerdrop": 0.05,
+  "mask_feature_length": 10,
+  "mask_feature_min_masks": 0,
+  "mask_feature_prob": 0.0,
+  "mask_time_length": 10,
+  "mask_time_min_masks": 2,
+  "mask_time_prob": 0.05,
+  "model_type": "wav2vec2",
+  "num_adapter_layers": 3,
+  "num_attention_heads": 16,
+  "num_codevector_groups": 2,
+  "num_codevectors_per_group": 320,
+  "num_conv_pos_embedding_groups": 16,
+  "num_conv_pos_embeddings": 128,
+  "num_feat_extract_layers": 7,
+  "num_hidden_layers": 48,
+  "num_negatives": 100,
+  "output_hidden_size": 1280,
+  "pad_token_id": 0,
+  "proj_codevector_dim": 1024,
+  "tdnn_dilation": [
+    1,
+    2,
+    3,
+    1,
+    1
+  ],
+  "tdnn_dim": [
+    512,
+    512,
+    512,
+    512,
+    1500
+  ],
+  "tdnn_kernel": [
+    5,
+    3,
+    3,
+    1,
+    1
+  ],
+  "torch_dtype": "float32",
+  "transformers_version": "4.31.0.dev0",
+  "use_weighted_layer_sum": false,
+  "vocab_size": 154,
+  "xvector_output_dim": 512
+}

langs.txt

@@ -0,0 +1,1024 @@
+- ara
+- cmn
+- eng
+- spa
+- fra
+- mlg
+- swe
+- por
+- vie
+- ful
+- sun
+- asm
+- ben
+- zlm
+- kor
+- ind
+- hin
+- tuk
+- urd
+- aze
+- slv
+- mon
+- hau
+- tel
+- swh
+- bod
+- rus
+- tur
+- heb
+- mar
+- som
+- tgl
+- tat
+- tha
+- cat
+- ron
+- mal
+- bel
+- pol
+- yor
+- nld
+- bul
+- hat
+- afr
+- isl
+- amh
+- tam
+- hun
+- hrv
+- lit
+- cym
+- fas
+- mkd
+- ell
+- bos
+- deu
+- sqi
+- jav
+- kmr
+- nob
+- uzb
+- snd
+- lat
+- nya
+- grn
+- mya
+- orm
+- lin
+- hye
+- yue
+- pan
+- jpn
+- kaz
+- npi
+- kik
+- kat
+- guj
+- kan
+- tgk
+- ukr
+- ces
+- lav
+- bak
+- khm
+- cak
+- fao
+- glg
+- ltz
+- xog
+- lao
+- mlt
+- sin
+- aka
+- sna
+- che
+- mam
+- ita
+- quc
+- aiw
+- srp
+- mri
+- tuv
+- nno
+- pus
+- eus
+- kbp
+- gur
+- ory
+- lug
+- crh
+- bre
+- luo
+- nhx
+- slk
+- ewe
+- xsm
+- fin
+- rif
+- dan
+- saq
+- yid
+- yao
+- mos
+- quh
+- hne
+- xon
+- new
+- dtp
+- quy
+- est
+- ddn
+- dyu
+- ttq
+- bam
+- pse
+- uig
+- sck
+- ngl
+- tso
+- mup
+- dga
+- seh
+- lis
+- wal
+- ctg
+- mip
+- bfz
+- bxk
+- ceb
+- kru
+- war
+- khg
+- bbc
+- thl
+- nzi
+- vmw
+- mzi
+- ycl
+- zne
+- sid
+- asa
+- tpi
+- bmq
+- box
+- zpu
+- gof
+- nym
+- cla
+- bgq
+- bfy
+- hlb
+- qxl
+- teo
+- fon
+- sda
+- kfx
+- bfa
+- mag
+- tzh
+- pil
+- maj
+- maa
+- kdt
+- ksb
+- lns
+- btd
+- rej
+- pap
+- ayr
+- any
+- mnk
+- adx
+- gud
+- krc
+- onb
+- xal
+- ctd
+- nxq
+- ava
+- blt
+- lbw
+- hyw
+- udm
+- zar
+- tzo
+- kpv
+- san
+- xnj
+- kek
+- chv
+- kcg
+- kri
+- ati
+- bgw
+- mxt
+- ybb
+- btx
+- dgi
+- nhy
+- dnj
+- zpz
+- yba
+- lon
+- smo
+- men
+- ium
+- mgd
+- taq
+- nga
+- nsu
+- zaj
+- tly
+- prk
+- zpt
+- akb
+- mhr
+- mxb
+- nuj
+- obo
+- kir
+- bom
+- run
+- zpg
+- hwc
+- mnw
+- ubl
+- kin
+- xtm
+- hnj
+- mpm
+- rkt
+- miy
+- luc
+- mih
+- kne
+- mib
+- flr
+- myv
+- xmm
+- knk
+- iba
+- gux
+- pis
+- zmz
+- ses
+- dav
+- lif
+- qxr
+- dig
+- kdj
+- wsg
+- tir
+- gbm
+- mai
+- zpc
+- kus
+- nyy
+- mim
+- nan
+- nyn
+- gog
+- ngu
+- tbz
+- hoc
+- nyf
+- sus
+- guk
+- gwr
+- yaz
+- bcc
+- sbd
+- spp
+- hak
+- grt
+- kno
+- oss
+- suk
+- spy
+- nij
+- lsm
+- kaa
+- bem
+- rmy
+- kqn
+- nim
+- ztq
+- nus
+- bib
+- xtd
+- ach
+- mil
+- keo
+- mpg
+- gjn
+- zaq
+- kdh
+- dug
+- sah
+- awa
+- kff
+- dip
+- rim
+- nhe
+- pcm
+- kde
+- tem
+- quz
+- mfq
+- las
+- bba
+- kbr
+- taj
+- dyo
+- zao
+- lom
+- shk
+- dik
+- dgo
+- zpo
+- fij
+- bgc
+- xnr
+- bud
+- kac
+- laj
+- mev
+- maw
+- quw
+- kao
+- dag
+- ktb
+- lhu
+- zab
+- mgh
+- shn
+- otq
+- lob
+- pbb
+- oci
+- zyb
+- bsq
+- mhi
+- dzo
+- zas
+- guc
+- alz
+- ctu
+- wol
+- guw
+- mnb
+- nia
+- zaw
+- mxv
+- bci
+- sba
+- kab
+- dwr
+- nnb
+- ilo
+- mfe
+- srx
+- ruf
+- srn
+- zad
+- xpe
+- pce
+- ahk
+- bcl
+- myk
+- haw
+- mad
+- ljp
+- bky
+- gmv
+- nag
+- nav
+- nyo
+- kxm
+- nod
+- sag
+- zpl
+- sas
+- myx
+- sgw
+- old
+- irk
+- acf
+- mak
+- kfy
+- zai
+- mie
+- zpm
+- zpi
+- ote
+- jam
+- kpz
+- lgg
+- lia
+- nhi
+- mzm
+- bdq
+- xtn
+- mey
+- mjl
+- sgj
+- kdi
+- kxc
+- miz
+- adh
+- tap
+- hay
+- kss
+- pam
+- gor
+- heh
+- nhw
+- ziw
+- gej
+- yua
+- itv
+- shi
+- qvw
+- mrw
+- hil
+- mbt
+- pag
+- vmy
+- lwo
+- cce
+- kum
+- klu
+- ann
+- mbb
+- npl
+- zca
+- pww
+- toc
+- ace
+- mio
+- izz
+- kam
+- zaa
+- krj
+- bts
+- eza
+- zty
+- hns
+- kki
+- min
+- led
+- alw
+- tll
+- rng
+- pko
+- toi
+- iqw
+- ncj
+- toh
+- umb
+- mog
+- hno
+- wob
+- gxx
+- hig
+- nyu
+- kby
+- ban
+- syl
+- bxg
+- nse
+- xho
+- zae
+- mkw
+- nch
+- ibg
+- mas
+- qvz
+- bum
+- bgd
+- mww
+- epo
+- tzm
+- zul
+- bcq
+- lrc
+- xdy
+- tyv
+- ibo
+- loz
+- mza
+- abk
+- azz
+- guz
+- arn
+- ksw
+- lus
+- tos
+- gvr
+- top
+- ckb
+- mer
+- pov
+- lun
+- rhg
+- knc
+- sfw
+- bev
+- tum
+- lag
+- nso
+- bho
+- ndc
+- maf
+- gkp
+- bax
+- awn
+- ijc
+- qug
+- lub
+- srr
+- mni
+- zza
+- ige
+- dje
+- mkn
+- bft
+- tiv
+- otn
+- kck
+- kqs
+- gle
+- lua
+- pdt
+- swk
+- mgw
+- ebu
+- ada
+- lic
+- skr
+- gaa
+- mfa
+- vmk
+- mcn
+- bto
+- lol
+- bwr
+- unr
+- dzg
+- hdy
+- kea
+- bhi
+- glk
+- mua
+- ast
+- nup
+- sat
+- ktu
+- bhb
+- zpq
+- coh
+- bkm
+- gya
+- sgc
+- dks
+- ncl
+- tui
+- emk
+- urh
+- ego
+- ogo
+- tsc
+- idu
+- igb
+- ijn
+- njz
+- ngb
+- tod
+- jra
+- mrt
+- zav
+- tke
+- its
+- ady
+- bzw
+- kng
+- kmb
+- lue
+- jmx
+- tsn
+- bin
+- ble
+- gom
+- ven
+- sef
+- sco
+- her
+- iso
+- trp
+- glv
+- haq
+- toq
+- okr
+- kha
+- wof
+- rmn
+- sot
+- kaj
+- bbj
+- sou
+- mjt
+- trd
+- gno
+- mwn
+- igl
+- rag
+- eyo
+- div
+- efi
+- nde
+- mfv
+- mix
+- rki
+- kjg
+- fan
+- khw
+- wci
+- bjn
+- pmy
+- bqi
+- ina
+- hni
+- mjx
+- kuj
+- aoz
+- the
+- tog
+- tet
+- nuz
+- ajg
+- ccp
+- mau
+- ymm
+- fmu
+- tcz
+- xmc
+- nyk
+- ztg
+- knx
+- snk
+- zac
+- esg
+- srb
+- thq
+- pht
+- wes
+- rah
+- pnb
+- ssy
+- zpv
+- kpo
+- phr
+- atd
+- eto
+- xta
+- mxx
+- mui
+- uki
+- tkt
+- mgp
+- xsq
+- enq
+- nnh
+- qxp
+- zam
+- bug
+- bxr
+- maq
+- tdt
+- khb
+- mrr
+- kas
+- zgb
+- kmw
+- lir
+- vah
+- dar
+- ssw
+- hmd
+- jab
+- iii
+- peg
+- shr
+- brx
+- rwr
+- bmb
+- kmc
+- mji
+- dib
+- pcc
+- nbe
+- mrd
+- ish
+- kai
+- yom
+- zyn
+- hea
+- ewo
+- bas
+- hms
+- twh
+- kfq
+- thr
+- xtl
+- wbr
+- bfb
+- wtm
+- mjc
+- blk
+- lot
+- dhd
+- swv
+- wbm
+- zzj
+- kge
+- mgm
+- niq
+- zpj
+- bwx
+- bde
+- mtr
+- gju
+- kjp
+- mbz
+- haz
+- lpo
+- yig
+- qud
+- shy
+- gjk
+- ztp
+- nbl
+- aii
+- kun
+- say
+- mde
+- sjp
+- bns
+- brh
+- ywq
+- msi
+- anr
+- mrg
+- mjg
+- tan
+- tsg
+- tcy
+- kbl
+- mdr
+- mks
+- noe
+- tyz
+- zpa
+- ahr
+- aar
+- wuu
+- khr
+- kbd
+- kex
+- bca
+- nku
+- pwr
+- hsn
+- ort
+- ott
+- swi
+- kua
+- tdd
+- msm
+- bgp
+- nbm
+- mxy
+- abs
+- zlj
+- ebo
+- lea
+- dub
+- sce
+- xkb
+- vav
+- bra
+- ssb
+- sss
+- nhp
+- kad
+- kvx
+- lch
+- tts
+- zyj
+- kxp
+- lmn
+- qvi
+- lez
+- scl
+- cqd
+- ayb
+- xbr
+- nqg
+- dcc
+- cjk
+- bfr
+- zyg
+- mse
+- gru
+- mdv
+- bew
+- wti
+- arg
+- dso
+- zdj
+- pll
+- mig
+- qxs
+- bol
+- drs
+- anp
+- chw
+- bej
+- vmc
+- otx
+- xty
+- bjj
+- vmz
+- ibb
+- gby
+- twx
+- tig
+- thz
+- tku
+- hmz
+- pbm
+- mfn
+- nut
+- cyo
+- mjw
+- cjm
+- tlp
+- naq
+- rnd
+- stj
+- sym
+- jax
+- btg
+- tdg
+- sng
+- nlv
+- kvr
+- pch
+- fvr
+- mxs
+- wni
+- mlq
+- kfr
+- mdj
+- osi
+- nhn
+- ukw
+- tji
+- qvj
+- nih
+- bcy
+- hbb
+- zpx
+- hoj
+- cpx
+- ogc
+- cdo
+- bgn
+- bfs
+- vmx
+- tvn
+- ior
+- mxa
+- btm
+- anc
+- jit
+- mfb
+- mls
+- ets
+- goa
+- bet
+- ikw
+- pem
+- trf
+- daq
+- max
+- rad
+- njo
+- bnx
+- mxl
+- mbi
+- nba
+- zpn
+- zts
+- mut
+- hnd
+- mta
+- hav
+- hac
+- ryu
+- abr
+- yer
+- cld
+- zag
+- ndo
+- sop
+- vmm
+- gcf
+- chr
+- cbk
+- sbk
+- bhp
+- odk
+- mbd
+- nap
+- gbr
+- mii
+- czh
+- xti
+- vls
+- gdx
+- sxw
+- zaf
+- wem
+- mqh
+- ank
+- yaf
+- vmp
+- otm
+- sdh
+- anw
+- src
+- mne
+- wss
+- meh
+- kzc
+- tma
+- ttj
+- ots
+- ilp
+- zpr
+- saz
+- ogb
+- akl
+- nhg
+- pbv
+- rcf
+- cgg
+- mku
+- bez
+- mwe
+- mtb
+- gul
+- ifm
+- mdh
+- scn
+- lki
+- xmf
+- sgd
+- aba
+- cos
+- luz
+- zpy
+- stv
+- kjt
+- mbf
+- kmz
+- nds
+- mtq
+- tkq
+- aee
+- knn
+- mbs
+- mnp
+- ema
+- bar
+- unx
+- plk
+- psi
+- mzn
+- cja
+- sro
+- mdw
+- ndh
+- vmj
+- zpw
+- kfu
+- bgx
+- gsw
+- fry
+- zpe
+- zpd
+- bta
+- psh
+- zat

model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f3d33eab69ee57dfd5e68434048a4e07d13f3655fb52e71c9a7a5d9b37139182
+size 3868177624

preprocessor_config.json

@@ -0,0 +1,9 @@
+{
+  "do_normalize": true,
+  "feature_extractor_type": "Wav2Vec2FeatureExtractor",
+  "feature_size": 1,
+  "padding_side": "right",
+  "padding_value": 0,
+  "return_attention_mask": true,
+  "sampling_rate": 16000
+}

pytorch_model.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1aea1f212158f6524cecbb2c3d62776b71c9f6298d1e32ccd35b5dcecb477dd3
+size 3868406423