Appreciation, and a question

#1
by QyrouNnet-AI - opened

I just want to say that this is some amazing work!

I want to know if you did teacher-student distillation for the 4M model? it sounds exactly like the 10M model, which is amazing!

This comment has been hidden

Thanks so much! Yes, the 4M model was distilled.

Ahh, good move!

either ways, thanks man!

QyrouNnet-AI changed discussion status to closed

Sign up or log in to comment