Hugging Face's logo

jbochi
/
madlad400-3b-mt

Translation
Transformers
Safetensors
GGUF
JAX
t5
text2text-generation
text-generation-inference
Model card Files
xet
 Community
21

Skip a subset of tokens during translation

#9
by anothersherlock - opened
Discussion
anothersherlock

Is it possible to skip some systematically delineated tokens?
[CITY] is beautiful! -> [CITY] est belle!

anothersherlock changed discussion title from Skip a subset of tokens during translations to Skip a subset of tokens during translation
jbochi
 Owner

This is not supported. The easiest approach is probably to replace [CITY] by a city name and then replace it back after translation.

You can also fine tune the model. Peft should work well. It supports t5 models.

jbochi changed discussion status to closed

Sign up or log in to comment