Oct 29 Today

1. 10:45

   Run the sliding-window layers with flash attention

   daveycodez
   Verified signature

   3c75909
2. 06:56

   Block-32 GPTQ with a 48k vocabulary (900 MB of weights)

   daveycodez
   Verified signature

   2395323
3. 05:29

   Trim the vocabulary to 80k tokens (856 MB of weights)

   daveycodez
   Verified signature

   c7cce6b
4. 05:09

   Remove the Reshape that duplicated the embedding at load

   daveycodez
   Verified signature

   a405c7f
5. 04:10

   LFM3-1.7B ONNX, GPTQ 4-bit (block 128), 16k rotary caches

   daveycodez
   Verified signature

   5bc567e
6. 04:10

   initial commit

   daveycodez
   Verified signature

   f7e20d4