xmemtransfer-llama2-source-30m / memory_config.json
leehenry's picture
Publish individual model repo for OLAResearchX/xmemtransfer-llama2-source-30m
9465aa6 verified
Raw
History Blame Contribute Delete
179 Bytes
{
"max_ngram": 3,
"heads_per_order": 4,
"table_size": 65536,
"d_head": 64,
"hash_seed": 42,
"d_mem": 512,
"total_params": 33554432,
"canon_mode": "word_boundary"
}