featherless-ai/kvmpaper_kvm256_120M
0.2B • Updated • 19
KVM Paper
Models featured in the Key-Value Means paper
Note These are the models from the Key-Value Means paper. Please note that they are not self-contained, and must be run using the code from the paper to be functional.
-
featherless-ai/kvmpaper_kvm256_350M
0.4B • Updated • 42 -
featherless-ai/kvmpaper_kvmsqrt16_120M
0.2B • Updated • 25 -
featherless-ai/kvmpaper_kvmsqrt16_350M
0.4B • Updated • 24 -
featherless-ai/kvmpaper_bswa_120M
0.2B • Updated • 22 -
featherless-ai/kvmpaper_bswa_350M
0.4B • Updated • 22 -
featherless-ai/kvmpaper_gptalpha_120M
0.2B • Updated • 19 -
featherless-ai/kvmpaper_gptalpha_350M
0.4B • Updated • 21 -
featherless-ai/kvmpaper_rwkv7_ffn4_120M
0.2B • Updated • 21 -
featherless-ai/kvmpaper_rwkv7_ffn4_350M
0.4B • Updated • 21 -
featherless-ai/kvmpaper_gptalpha_swa256_120M
0.2B • Updated • 20 -
featherless-ai/kvmpaper_gptalpha_swa256_350M
0.4B • Updated • 19 -
featherless-ai/kvmpaper_gptalphaprope_swa256_120M
0.2B • Updated • 20 -
featherless-ai/kvmpaper_gptalphaprope_swa256_350M
0.4B • Updated • 19 -
featherless-ai/kvmpaper_kvmsat_swa256_120M
0.2B • Updated • 20 -
featherless-ai/kvmpaper_kvmsat_swa256_350M
0.4B • Updated • 22 -
featherless-ai/kvmpaper_ovqsat_swa256_120M
0.2B • Updated • 22 -
featherless-ai/kvmpaper_ovqsat_swa256_350M
0.4B • Updated • 23 -
featherless-ai/kvmpaper_ablation_kvm_no_sink_120M
0.2B • Updated • 22 -
featherless-ai/kvmpaper_ablation_kvm_no_vlens_120M
0.2B • Updated • 22 -
featherless-ai/kvmpaper_ablation_kvm_no_head_temps_120M
0.2B • Updated • 21 -
featherless-ai/kvmpaper_ablation_kvm_no_merge_gate_120M
0.2B • Updated • 18 -
featherless-ai/kvmpaper_ablation_gptalpha_swa256_3Gtok_350M
0.4B • Updated • 22