EleutherAI/pile
Updated โข 3.41k โข 495
These are RWKV-4-Pile models finetuned on novels.
Currently I am doing it for Chn novels. More languages to come.
Use https://github.com/BlinkDL/ChatRWKV to run them.
See https://github.com/BlinkDL/RWKV-LM for details on the RWKV Language Model (100% RNN).