Finetuning using RayTrain

#83
by jitesh129 - opened

I am trying to run finetuning on Ray Cluster using torchTrainer. I am encountering error which says MistralForCausalLM.forward() got an unexpected keyword argument 'text'. While the same trainer config works well on the standalone setup.

hey @jitesh129 you might find Impulse AI (https://www.impulselabs.ai/) useful. we make it super easy to fine-tune and deploy open source models. hopefully you find it helpful! i know not relevant to your problem above but might be easier to use us to fine tune and deploy

docs: https://docs.impulselabs.ai/introduction
python sdk: https://pypi.org/project/impulse-api-sdk-python/

Sign up or log in to comment