fix: encode_text latency
#9
by dmidmidmi - opened
Switching the condition if not self.tokenizerwhich takes 20~30ms to an explicit if self.tokenizer is None: ( < 1ms)
we were rebuilding the tokenizer each time?
gmastrapas changed pull request status to merged