Finetuning using RayTrain
#83
by
jitesh129 - opened
I am trying to run finetuning on Ray Cluster using torchTrainer. I am encountering error which says MistralForCausalLM.forward() got an unexpected keyword argument 'text'. While the same trainer config works well on the standalone setup.
hey @jitesh129 you might find Impulse AI (https://www.impulselabs.ai/) useful. we make it super easy to fine-tune and deploy open source models. hopefully you find it helpful! i know not relevant to your problem above but might be easier to use us to fine tune and deploy
docs: https://docs.impulselabs.ai/introduction
python sdk: https://pypi.org/project/impulse-api-sdk-python/