Training Code
#3
by linker81 - opened
I would like to train the LWM from scratch and I would like to know if you can share the complete training code.
You can find the pre-training script here. While this script is fully functional, you are welcome to modify the methods used during pre-training to enhance the performance and capabilities of the LWM model. We would love to hear about your improvements and results!
To replicate the exact pre-training process we followed, please refer to the instructions provided here. If you would like to use our pre-training dataset, you can find more details in this discussion.
Feel free to reach out if you have any questions or need further assistance!