how to finetune the ouro model

#5
by ryota39 - opened

thanks for making public the impressive models!! I love this kind of compact but powerfull model.

btw, when I would like to finetune this model, should I write code from scratch? or Is this model already compatible to train the model using libraries like transformers or trl?

Thanks in advance!

⚠️ IMPORTANT: Please use transformers<4.56.0 to avoid compatibility issues. We recommend transformers==4.54.1 or earlier versions.

I missed the above caution in README.md. I got it the models are already compatible to transformers.
I also found that ouro is compatible with vllm ouro-vllm
It's enough for me to finetune ouro with these supports from libraries.

Thanks!

ryota39 changed discussion status to closed

Sign up or log in to comment