can you please do the same for decoder
#2
by damerajee - opened
Title
I am planning to do this as soon as SONAR encoder-only and decoder-only are officially supported by transformer - which is going to happen after (if) this pull request is merged https://github.com/huggingface/transformers/pull/29646.