Pre-computed Q-Filters for efficient KV cache compression.
Nathan Godey
nthngdy
AI & ML interests
None yet
Recent Activity
submitted
a paper
about 16 hours ago
Lost in Backpropagation: The LM Head is a Gradient Bottleneck updated
a model 4 days ago
nthngdy/matryoshka-baselines published
a model 4 days ago
nthngdy/matryoshka-baselines Organizations
models 60
nthngdy/matryoshka-baselines
Updated
• 20
nthngdy/matryoshka-1B
Text Generation • 1B • Updated
• 376
nthngdy/matritest_1B
Text Generation • 0.6B • Updated
• 134
nthngdy/matritest_600M
Text Generation • 0.4B • Updated
• 135
nthngdy/matritest_300M
Text Generation • 0.2B • Updated
• 154
nthngdy/matritest_van_1B
Text Generation • 1B • Updated
• 68
nthngdy/matritest_van_600M
Text Generation • 0.6B • Updated
• 68
nthngdy/matritest_van_300M
Text Generation • 0.3B • Updated
• 66
nthngdy/matritest_van_100M
Text Generation • 0.1B • Updated
• 70
nthngdy/matritest_100M
Text Generation • 0.1B • Updated
• 161
datasets 30
nthngdy/mmlu_olmo3_contamination
Viewer
• Updated
• 15.9k • 465
nthngdy/hellaswag_wikihow_olmo_contamination
Viewer
• Updated
• 1.28k • 17
nthngdy/hellaswag_activitynet
Viewer
• Updated
• 21.5k • 6
nthngdy/hellaswag_wikihow
Viewer
• Updated
• 38.4k • 8
nthngdy/mmlu_olmo_contaminated
Viewer
• Updated
• 3.33k • 824
nthngdy/mmlu_olmo_decontaminated
Viewer
• Updated
• 10.7k • 632
nthngdy/pile_small_deduped_tokenized
Viewer
• Updated
• 100k • 8
nthngdy/mmlu_olmo_contamination
Viewer
• Updated
• 15.9k • 337
nthngdy/mmlu_shuffled
Viewer
• Updated
• 31.7k • 227
nthngdy/mmlu
Viewer
• Updated
• 116k • 30