Custom Training Albert-xxlarge-v1
#1
by sahmed31 - opened
I wish to train the Albert-xxlarge-v1 model on different datasets. Can we do that?
Hey @sahmed31 ,
Yes, you can do that. I recommend taking a look at the examples in the transformers repository to see possible training pipelines.
Once you have trained your model on a dataset, you can re-use the resulting checkpoint and train it on another similar dataset or another task altogether (dropping task-specific weights in the process).