Commit History

config: add initial version of generative config
a80d0a8

stefan-it commited on

tokenizer: add new post processor: </s> is prepended to input sequence
3021b3d

stefan-it commited on

model: eos and bos ids are same now
db00698

stefan-it commited on

tokenizer: add special tokens map
49e1483

stefan-it commited on

model: fix eos and bos ids
2c59d71

stefan-it commited on

tokenizer: add vocab
3f5c1cc

stefan-it commited on

model: add initial version of config
1b3e98f

stefan-it commited on

initial commit
83aad58

stefan-it commited on