thats easily solved with some representational math especially on frequently similar calculations through the weights, the issue is not the model or weights but runtime you use for it
Wendell Adams PRO
Wl6adams
AI & ML interests
None yet
Recent Activity
repliedto alphabell-research's post 23 days ago
One number missing from LFM3's on-device story: memory at 256K context. Liquid AI reports 1.90 GB peak on iPhone 17 Pro at 32K. From the pinned config, f16 K/V cache alone would be 0.41 GB at 32K, 1.61 GB at 128K and 3.22 GB at 256K, before weights and runtime buffers. The chart shows the calculation, not a phone measurement. If you have run longer contexts on-device, share peak memory and time to first token here: https://huggingface.co/LiquidAI/LFM3-1.7B/discussions/5
Model: https://huggingface.co/LiquidAI/LFM3-1.7B updated a collection 4 months ago
Nitrous updated a model 4 months ago
namenotfoundai/Nitrous