Instructions to use GenomaLabs-com/kv-cache-eviction-mla with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use GenomaLabs-com/kv-cache-eviction-mla with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("GenomaLabs-com/kv-cache-eviction-mla", dtype="auto") - Notebooks
- Google Colab
- Kaggle
GENOMA LABS / research
Day 1 of 7-day Kimi K2.6 + RULER 128K sprint: transformers 5.x port + real-weights install validation
95298f5 | step,max_cache_size,avg_cache_size,expected_cap,over_cap,eviction_events_total | |
| 0,1,1.0,44,0,0 | |
| 1,2,2.0,44,0,0 | |
| 2,3,3.0,44,0,0 | |
| 3,4,4.0,44,0,0 | |
| 4,5,5.0,44,0,0 | |
| 5,6,6.0,44,0,0 | |
| 6,7,7.0,44,0,0 | |
| 7,8,8.0,44,0,0 | |
| 8,9,9.0,44,0,0 | |
| 9,10,10.0,44,0,0 | |
| 10,11,11.0,44,0,0 | |
| 11,12,12.0,44,0,0 | |
| 12,13,13.0,44,0,0 | |
| 13,14,14.0,44,0,0 | |
| 14,15,15.0,44,0,0 | |
| 15,16,16.0,44,0,0 | |
| 16,17,17.0,44,0,0 | |
| 17,18,18.0,44,0,0 | |
| 18,19,19.0,44,0,0 | |
| 19,20,20.0,44,0,0 | |
| 20,21,21.0,44,0,0 | |
| 21,22,22.0,44,0,0 | |
| 22,23,23.0,44,0,0 | |
| 23,24,24.0,44,0,0 | |
| 24,25,25.0,44,0,0 | |
| 25,26,26.0,44,0,0 | |
| 26,27,27.0,44,0,0 | |
| 27,28,28.0,44,0,0 | |
| 28,29,29.0,44,0,0 | |
| 29,30,30.0,44,0,0 | |
| 30,31,31.0,44,0,0 | |
| 31,32,32.0,44,0,0 | |
| 32,33,33.0,44,0,0 | |
| 33,34,34.0,44,0,0 | |
| 34,35,35.0,44,0,0 | |
| 35,36,36.0,44,0,0 | |
| 36,37,37.0,44,0,0 | |
| 37,38,38.0,44,0,0 | |
| 38,39,39.0,44,0,0 | |
| 39,40,40.0,44,0,0 | |
| 40,41,41.0,44,0,0 | |
| 41,42,42.0,44,0,0 | |
| 42,43,43.0,44,0,0 | |
| 43,44,44.0,44,0,0 | |
| 44,44,44.0,44,0,4 | |
| 45,44,44.0,44,0,8 | |
| 46,44,44.0,44,0,12 | |
| 47,44,44.0,44,0,16 | |
| 48,44,44.0,44,0,20 | |
| 49,44,44.0,44,0,24 | |
| 50,44,44.0,44,0,28 | |
| 51,44,44.0,44,0,32 | |
| 52,44,44.0,44,0,36 | |
| 53,44,44.0,44,0,40 | |
| 54,44,44.0,44,0,44 | |
| 55,44,44.0,44,0,48 | |
| 56,44,44.0,44,0,52 | |
| 57,44,44.0,44,0,56 | |
| 58,44,44.0,44,0,60 | |
| 59,44,44.0,44,0,64 | |
| 60,44,44.0,44,0,68 | |
| 61,44,44.0,44,0,72 | |
| 62,44,44.0,44,0,76 | |
| 63,44,44.0,44,0,80 | |
| 64,44,44.0,44,0,84 | |
| 65,44,44.0,44,0,88 | |
| 66,44,44.0,44,0,92 | |
| 67,44,44.0,44,0,96 | |
| 68,44,44.0,44,0,100 | |
| 69,44,44.0,44,0,104 | |
| 70,44,44.0,44,0,108 | |
| 71,44,44.0,44,0,112 | |
| 72,44,44.0,44,0,116 | |
| 73,44,44.0,44,0,120 | |
| 74,44,44.0,44,0,124 | |
| 75,44,44.0,44,0,128 | |
| 76,44,44.0,44,0,132 | |
| 77,44,44.0,44,0,136 | |
| 78,44,44.0,44,0,140 | |
| 79,44,44.0,44,0,144 | |
| 80,44,44.0,44,0,148 | |
| 81,44,44.0,44,0,152 | |
| 82,44,44.0,44,0,156 | |
| 83,44,44.0,44,0,160 | |
| 84,44,44.0,44,0,164 | |
| 85,44,44.0,44,0,168 | |
| 86,44,44.0,44,0,172 | |
| 87,44,44.0,44,0,176 | |
| 88,44,44.0,44,0,180 | |
| 89,44,44.0,44,0,184 | |
| 90,44,44.0,44,0,188 | |
| 91,44,44.0,44,0,192 | |
| 92,44,44.0,44,0,196 | |
| 93,44,44.0,44,0,200 | |
| 94,44,44.0,44,0,204 | |
| 95,44,44.0,44,0,208 | |
| 96,44,44.0,44,0,212 | |
| 97,44,44.0,44,0,216 | |
| 98,44,44.0,44,0,220 | |
| 99,44,44.0,44,0,224 | |
| 100,44,44.0,44,0,228 | |
| 101,44,44.0,44,0,232 | |
| 102,44,44.0,44,0,236 | |
| 103,44,44.0,44,0,240 | |
| 104,44,44.0,44,0,244 | |
| 105,44,44.0,44,0,248 | |
| 106,44,44.0,44,0,252 | |
| 107,44,44.0,44,0,256 | |
| 108,44,44.0,44,0,260 | |
| 109,44,44.0,44,0,264 | |
| 110,44,44.0,44,0,268 | |
| 111,44,44.0,44,0,272 | |
| 112,44,44.0,44,0,276 | |
| 113,44,44.0,44,0,280 | |
| 114,44,44.0,44,0,284 | |
| 115,44,44.0,44,0,288 | |
| 116,44,44.0,44,0,292 | |
| 117,44,44.0,44,0,296 | |
| 118,44,44.0,44,0,300 | |
| 119,44,44.0,44,0,304 | |
| 120,44,44.0,44,0,308 | |
| 121,44,44.0,44,0,312 | |
| 122,44,44.0,44,0,316 | |
| 123,44,44.0,44,0,320 | |
| 124,44,44.0,44,0,324 | |
| 125,44,44.0,44,0,328 | |
| 126,44,44.0,44,0,332 | |
| 127,44,44.0,44,0,336 | |
| 128,44,44.0,44,0,340 | |
| 129,44,44.0,44,0,344 | |
| 130,44,44.0,44,0,348 | |
| 131,44,44.0,44,0,352 | |
| 132,44,44.0,44,0,356 | |
| 133,44,44.0,44,0,360 | |
| 134,44,44.0,44,0,364 | |
| 135,44,44.0,44,0,368 | |
| 136,44,44.0,44,0,372 | |
| 137,44,44.0,44,0,376 | |
| 138,44,44.0,44,0,380 | |
| 139,44,44.0,44,0,384 | |
| 140,44,44.0,44,0,388 | |
| 141,44,44.0,44,0,392 | |
| 142,44,44.0,44,0,396 | |
| 143,44,44.0,44,0,400 | |
| 144,44,44.0,44,0,404 | |
| 145,44,44.0,44,0,408 | |
| 146,44,44.0,44,0,412 | |
| 147,44,44.0,44,0,416 | |
| 148,44,44.0,44,0,420 | |
| 149,44,44.0,44,0,424 | |
| 150,44,44.0,44,0,428 | |
| 151,44,44.0,44,0,432 | |
| 152,44,44.0,44,0,436 | |
| 153,44,44.0,44,0,440 | |
| 154,44,44.0,44,0,444 | |
| 155,44,44.0,44,0,448 | |
| 156,44,44.0,44,0,452 | |
| 157,44,44.0,44,0,456 | |
| 158,44,44.0,44,0,460 | |
| 159,44,44.0,44,0,464 | |
| 160,44,44.0,44,0,468 | |
| 161,44,44.0,44,0,472 | |
| 162,44,44.0,44,0,476 | |
| 163,44,44.0,44,0,480 | |
| 164,44,44.0,44,0,484 | |
| 165,44,44.0,44,0,488 | |
| 166,44,44.0,44,0,492 | |
| 167,44,44.0,44,0,496 | |
| 168,44,44.0,44,0,500 | |
| 169,44,44.0,44,0,504 | |
| 170,44,44.0,44,0,508 | |
| 171,44,44.0,44,0,512 | |
| 172,44,44.0,44,0,516 | |
| 173,44,44.0,44,0,520 | |
| 174,44,44.0,44,0,524 | |
| 175,44,44.0,44,0,528 | |
| 176,44,44.0,44,0,532 | |
| 177,44,44.0,44,0,536 | |
| 178,44,44.0,44,0,540 | |
| 179,44,44.0,44,0,544 | |
| 180,44,44.0,44,0,548 | |
| 181,44,44.0,44,0,552 | |
| 182,44,44.0,44,0,556 | |
| 183,44,44.0,44,0,560 | |
| 184,44,44.0,44,0,564 | |
| 185,44,44.0,44,0,568 | |
| 186,44,44.0,44,0,572 | |
| 187,44,44.0,44,0,576 | |
| 188,44,44.0,44,0,580 | |
| 189,44,44.0,44,0,584 | |
| 190,44,44.0,44,0,588 | |
| 191,44,44.0,44,0,592 | |
| 192,44,44.0,44,0,596 | |
| 193,44,44.0,44,0,600 | |
| 194,44,44.0,44,0,604 | |
| 195,44,44.0,44,0,608 | |
| 196,44,44.0,44,0,612 | |
| 197,44,44.0,44,0,616 | |
| 198,44,44.0,44,0,620 | |
| 199,44,44.0,44,0,624 | |
| 200,44,44.0,44,0,628 | |
| 201,44,44.0,44,0,632 | |
| 202,44,44.0,44,0,636 | |
| 203,44,44.0,44,0,640 | |
| 204,44,44.0,44,0,644 | |
| 205,44,44.0,44,0,648 | |
| 206,44,44.0,44,0,652 | |
| 207,44,44.0,44,0,656 | |
| 208,44,44.0,44,0,660 | |
| 209,44,44.0,44,0,664 | |
| 210,44,44.0,44,0,668 | |
| 211,44,44.0,44,0,672 | |
| 212,44,44.0,44,0,676 | |
| 213,44,44.0,44,0,680 | |
| 214,44,44.0,44,0,684 | |
| 215,44,44.0,44,0,688 | |
| 216,44,44.0,44,0,692 | |
| 217,44,44.0,44,0,696 | |
| 218,44,44.0,44,0,700 | |
| 219,44,44.0,44,0,704 | |
| 220,44,44.0,44,0,708 | |
| 221,44,44.0,44,0,712 | |
| 222,44,44.0,44,0,716 | |
| 223,44,44.0,44,0,720 | |
| 224,44,44.0,44,0,724 | |
| 225,44,44.0,44,0,728 | |
| 226,44,44.0,44,0,732 | |
| 227,44,44.0,44,0,736 | |
| 228,44,44.0,44,0,740 | |
| 229,44,44.0,44,0,744 | |
| 230,44,44.0,44,0,748 | |
| 231,44,44.0,44,0,752 | |
| 232,44,44.0,44,0,756 | |
| 233,44,44.0,44,0,760 | |
| 234,44,44.0,44,0,764 | |
| 235,44,44.0,44,0,768 | |
| 236,44,44.0,44,0,772 | |
| 237,44,44.0,44,0,776 | |
| 238,44,44.0,44,0,780 | |
| 239,44,44.0,44,0,784 | |
| 240,44,44.0,44,0,788 | |
| 241,44,44.0,44,0,792 | |
| 242,44,44.0,44,0,796 | |
| 243,44,44.0,44,0,800 | |
| 244,44,44.0,44,0,804 | |
| 245,44,44.0,44,0,808 | |
| 246,44,44.0,44,0,812 | |
| 247,44,44.0,44,0,816 | |
| 248,44,44.0,44,0,820 | |
| 249,44,44.0,44,0,824 | |
| 250,44,44.0,44,0,828 | |
| 251,44,44.0,44,0,832 | |
| 252,44,44.0,44,0,836 | |
| 253,44,44.0,44,0,840 | |
| 254,44,44.0,44,0,844 | |
| 255,44,44.0,44,0,848 | |
| 256,44,44.0,44,0,852 | |
| 257,44,44.0,44,0,856 | |
| 258,44,44.0,44,0,860 | |
| 259,44,44.0,44,0,864 | |
| 260,44,44.0,44,0,868 | |
| 261,44,44.0,44,0,872 | |
| 262,44,44.0,44,0,876 | |
| 263,44,44.0,44,0,880 | |
| 264,44,44.0,44,0,884 | |
| 265,44,44.0,44,0,888 | |
| 266,44,44.0,44,0,892 | |
| 267,44,44.0,44,0,896 | |
| 268,44,44.0,44,0,900 | |
| 269,44,44.0,44,0,904 | |
| 270,44,44.0,44,0,908 | |
| 271,44,44.0,44,0,912 | |
| 272,44,44.0,44,0,916 | |
| 273,44,44.0,44,0,920 | |
| 274,44,44.0,44,0,924 | |
| 275,44,44.0,44,0,928 | |
| 276,44,44.0,44,0,932 | |
| 277,44,44.0,44,0,936 | |
| 278,44,44.0,44,0,940 | |
| 279,44,44.0,44,0,944 | |
| 280,44,44.0,44,0,948 | |
| 281,44,44.0,44,0,952 | |
| 282,44,44.0,44,0,956 | |
| 283,44,44.0,44,0,960 | |
| 284,44,44.0,44,0,964 | |
| 285,44,44.0,44,0,968 | |
| 286,44,44.0,44,0,972 | |
| 287,44,44.0,44,0,976 | |
| 288,44,44.0,44,0,980 | |
| 289,44,44.0,44,0,984 | |
| 290,44,44.0,44,0,988 | |
| 291,44,44.0,44,0,992 | |
| 292,44,44.0,44,0,996 | |
| 293,44,44.0,44,0,1000 | |
| 294,44,44.0,44,0,1004 | |
| 295,44,44.0,44,0,1008 | |
| 296,44,44.0,44,0,1012 | |
| 297,44,44.0,44,0,1016 | |
| 298,44,44.0,44,0,1020 | |
| 299,44,44.0,44,0,1024 | |
| 300,44,44.0,44,0,1028 | |
| 301,44,44.0,44,0,1032 | |
| 302,44,44.0,44,0,1036 | |
| 303,44,44.0,44,0,1040 | |
| 304,44,44.0,44,0,1044 | |
| 305,44,44.0,44,0,1048 | |
| 306,44,44.0,44,0,1052 | |
| 307,44,44.0,44,0,1056 | |
| 308,44,44.0,44,0,1060 | |
| 309,44,44.0,44,0,1064 | |
| 310,44,44.0,44,0,1068 | |
| 311,44,44.0,44,0,1072 | |
| 312,44,44.0,44,0,1076 | |
| 313,44,44.0,44,0,1080 | |
| 314,44,44.0,44,0,1084 | |
| 315,44,44.0,44,0,1088 | |
| 316,44,44.0,44,0,1092 | |
| 317,44,44.0,44,0,1096 | |
| 318,44,44.0,44,0,1100 | |
| 319,44,44.0,44,0,1104 | |
| 320,44,44.0,44,0,1108 | |
| 321,44,44.0,44,0,1112 | |
| 322,44,44.0,44,0,1116 | |
| 323,44,44.0,44,0,1120 | |
| 324,44,44.0,44,0,1124 | |
| 325,44,44.0,44,0,1128 | |
| 326,44,44.0,44,0,1132 | |
| 327,44,44.0,44,0,1136 | |
| 328,44,44.0,44,0,1140 | |
| 329,44,44.0,44,0,1144 | |
| 330,44,44.0,44,0,1148 | |
| 331,44,44.0,44,0,1152 | |
| 332,44,44.0,44,0,1156 | |
| 333,44,44.0,44,0,1160 | |
| 334,44,44.0,44,0,1164 | |
| 335,44,44.0,44,0,1168 | |
| 336,44,44.0,44,0,1172 | |
| 337,44,44.0,44,0,1176 | |
| 338,44,44.0,44,0,1180 | |
| 339,44,44.0,44,0,1184 | |
| 340,44,44.0,44,0,1188 | |
| 341,44,44.0,44,0,1192 | |
| 342,44,44.0,44,0,1196 | |
| 343,44,44.0,44,0,1200 | |
| 344,44,44.0,44,0,1204 | |
| 345,44,44.0,44,0,1208 | |
| 346,44,44.0,44,0,1212 | |
| 347,44,44.0,44,0,1216 | |
| 348,44,44.0,44,0,1220 | |
| 349,44,44.0,44,0,1224 | |
| 350,44,44.0,44,0,1228 | |
| 351,44,44.0,44,0,1232 | |
| 352,44,44.0,44,0,1236 | |
| 353,44,44.0,44,0,1240 | |
| 354,44,44.0,44,0,1244 | |
| 355,44,44.0,44,0,1248 | |
| 356,44,44.0,44,0,1252 | |
| 357,44,44.0,44,0,1256 | |
| 358,44,44.0,44,0,1260 | |
| 359,44,44.0,44,0,1264 | |
| 360,44,44.0,44,0,1268 | |
| 361,44,44.0,44,0,1272 | |
| 362,44,44.0,44,0,1276 | |
| 363,44,44.0,44,0,1280 | |
| 364,44,44.0,44,0,1284 | |
| 365,44,44.0,44,0,1288 | |
| 366,44,44.0,44,0,1292 | |
| 367,44,44.0,44,0,1296 | |
| 368,44,44.0,44,0,1300 | |
| 369,44,44.0,44,0,1304 | |
| 370,44,44.0,44,0,1308 | |
| 371,44,44.0,44,0,1312 | |
| 372,44,44.0,44,0,1316 | |
| 373,44,44.0,44,0,1320 | |
| 374,44,44.0,44,0,1324 | |
| 375,44,44.0,44,0,1328 | |
| 376,44,44.0,44,0,1332 | |
| 377,44,44.0,44,0,1336 | |
| 378,44,44.0,44,0,1340 | |
| 379,44,44.0,44,0,1344 | |
| 380,44,44.0,44,0,1348 | |
| 381,44,44.0,44,0,1352 | |
| 382,44,44.0,44,0,1356 | |
| 383,44,44.0,44,0,1360 | |
| 384,44,44.0,44,0,1364 | |
| 385,44,44.0,44,0,1368 | |
| 386,44,44.0,44,0,1372 | |
| 387,44,44.0,44,0,1376 | |
| 388,44,44.0,44,0,1380 | |
| 389,44,44.0,44,0,1384 | |
| 390,44,44.0,44,0,1388 | |
| 391,44,44.0,44,0,1392 | |
| 392,44,44.0,44,0,1396 | |
| 393,44,44.0,44,0,1400 | |
| 394,44,44.0,44,0,1404 | |
| 395,44,44.0,44,0,1408 | |
| 396,44,44.0,44,0,1412 | |
| 397,44,44.0,44,0,1416 | |
| 398,44,44.0,44,0,1420 | |
| 399,44,44.0,44,0,1424 | |
| 400,44,44.0,44,0,1428 | |
| 401,44,44.0,44,0,1432 | |
| 402,44,44.0,44,0,1436 | |
| 403,44,44.0,44,0,1440 | |
| 404,44,44.0,44,0,1444 | |
| 405,44,44.0,44,0,1448 | |
| 406,44,44.0,44,0,1452 | |
| 407,44,44.0,44,0,1456 | |
| 408,44,44.0,44,0,1460 | |
| 409,44,44.0,44,0,1464 | |
| 410,44,44.0,44,0,1468 | |
| 411,44,44.0,44,0,1472 | |
| 412,44,44.0,44,0,1476 | |
| 413,44,44.0,44,0,1480 | |
| 414,44,44.0,44,0,1484 | |
| 415,44,44.0,44,0,1488 | |
| 416,44,44.0,44,0,1492 | |
| 417,44,44.0,44,0,1496 | |
| 418,44,44.0,44,0,1500 | |
| 419,44,44.0,44,0,1504 | |
| 420,44,44.0,44,0,1508 | |
| 421,44,44.0,44,0,1512 | |
| 422,44,44.0,44,0,1516 | |
| 423,44,44.0,44,0,1520 | |
| 424,44,44.0,44,0,1524 | |
| 425,44,44.0,44,0,1528 | |
| 426,44,44.0,44,0,1532 | |
| 427,44,44.0,44,0,1536 | |
| 428,44,44.0,44,0,1540 | |
| 429,44,44.0,44,0,1544 | |
| 430,44,44.0,44,0,1548 | |
| 431,44,44.0,44,0,1552 | |
| 432,44,44.0,44,0,1556 | |
| 433,44,44.0,44,0,1560 | |
| 434,44,44.0,44,0,1564 | |
| 435,44,44.0,44,0,1568 | |
| 436,44,44.0,44,0,1572 | |
| 437,44,44.0,44,0,1576 | |
| 438,44,44.0,44,0,1580 | |
| 439,44,44.0,44,0,1584 | |
| 440,44,44.0,44,0,1588 | |
| 441,44,44.0,44,0,1592 | |
| 442,44,44.0,44,0,1596 | |
| 443,44,44.0,44,0,1600 | |
| 444,44,44.0,44,0,1604 | |
| 445,44,44.0,44,0,1608 | |
| 446,44,44.0,44,0,1612 | |
| 447,44,44.0,44,0,1616 | |
| 448,44,44.0,44,0,1620 | |
| 449,44,44.0,44,0,1624 | |
| 450,44,44.0,44,0,1628 | |
| 451,44,44.0,44,0,1632 | |
| 452,44,44.0,44,0,1636 | |
| 453,44,44.0,44,0,1640 | |
| 454,44,44.0,44,0,1644 | |
| 455,44,44.0,44,0,1648 | |
| 456,44,44.0,44,0,1652 | |
| 457,44,44.0,44,0,1656 | |
| 458,44,44.0,44,0,1660 | |
| 459,44,44.0,44,0,1664 | |
| 460,44,44.0,44,0,1668 | |
| 461,44,44.0,44,0,1672 | |
| 462,44,44.0,44,0,1676 | |
| 463,44,44.0,44,0,1680 | |
| 464,44,44.0,44,0,1684 | |
| 465,44,44.0,44,0,1688 | |
| 466,44,44.0,44,0,1692 | |
| 467,44,44.0,44,0,1696 | |
| 468,44,44.0,44,0,1700 | |
| 469,44,44.0,44,0,1704 | |
| 470,44,44.0,44,0,1708 | |
| 471,44,44.0,44,0,1712 | |
| 472,44,44.0,44,0,1716 | |
| 473,44,44.0,44,0,1720 | |
| 474,44,44.0,44,0,1724 | |
| 475,44,44.0,44,0,1728 | |
| 476,44,44.0,44,0,1732 | |
| 477,44,44.0,44,0,1736 | |
| 478,44,44.0,44,0,1740 | |
| 479,44,44.0,44,0,1744 | |
| 480,44,44.0,44,0,1748 | |
| 481,44,44.0,44,0,1752 | |
| 482,44,44.0,44,0,1756 | |
| 483,44,44.0,44,0,1760 | |
| 484,44,44.0,44,0,1764 | |
| 485,44,44.0,44,0,1768 | |
| 486,44,44.0,44,0,1772 | |
| 487,44,44.0,44,0,1776 | |
| 488,44,44.0,44,0,1780 | |
| 489,44,44.0,44,0,1784 | |
| 490,44,44.0,44,0,1788 | |
| 491,44,44.0,44,0,1792 | |
| 492,44,44.0,44,0,1796 | |
| 493,44,44.0,44,0,1800 | |
| 494,44,44.0,44,0,1804 | |
| 495,44,44.0,44,0,1808 | |
| 496,44,44.0,44,0,1812 | |
| 497,44,44.0,44,0,1816 | |
| 498,44,44.0,44,0,1820 | |
| 499,44,44.0,44,0,1824 | |