Unimax sampler
#1
by StephennFernandes - opened
hey @stefan-it i really appreciate all the hard work for merging umT5 to HF.
The umT5 model comes with a new sampling strategy called unimax that supposed to integrate with seqio on sampling dataset mixture.
was hoping if you have a way to implement the same or have link/resources for the same, as i believe the t5x and seqio repo haven't released the official code.