fraQtl AI Research

AI & ML interests

KV cache compression, inference optimization, model compression

Recent Activity

samuel-salfati  updated a collection 6 days ago

KV-Cache Receipts — nine ≈128K users on one A100 (vLLM)

samuel-salfati  updated a collection 6 days ago

KV-Cache Receipts — nine ≈128K users on one A100 (vLLM)

samuel-salfati  published a model 6 days ago

fraQtl/mistral-nemo-instruct-2407-kv-sidecars

View all activity

Team members 1