payelb
/

rnn-next-token-classifier

Add trained RNN next-token classifier (Pythia-160M features)

153e1c5 verified 5 months ago

145 Bytes

	{
	"input_dim": 1537,
	"hidden_dim": 256,
	"num_layers": 2,
	"llm_model": "EleutherAI/pythia-160m",
	"max_seq_len": 128,
	"step_size": 32
	}