How can I Fine Tune it to increase its context Length while maintaining its accuracy and knowledge?
#4
by kalashshah19 - opened
I have tried to increase its context length to 8K tokens but its accuracy dropped like anything
kalashshah19 changed discussion title from How can I Fine Tune it to increase its context Length while maintaining its accuracy and knowldge? to How can I Fine Tune it to increase its context Length while maintaining its accuracy and knowledge?