File size: 965 Bytes
fa6f3aa bf9ef09 fa6f3aa 93c6402 fa6f3aa bf9ef09 64b1f37 bf9ef09 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 | ---
title: What We Do
emoji: 🔥
colorFrom: gray
colorTo: green
sdk: static
pinned: false
---
**Run giant AI models fast on small machines.**
Kera is a local AI engine being built to run dense and mixture-of-experts models on a Mac, an AMD Ryzen AI Max PC or an NVIDIA machine, including models too big for the machine's memory. It measures your machine when it starts and tunes itself to it.
- Streams parts of the model from the SSD when it doesn't fit in memory
- Guesses several words ahead and checks them all at once, so replies come out faster
- Saves chat memory, so long chats and coding agents don't re-read everything
- Fine-tuning built in
- 22-54% Faster Than llama.cpp (tested)
- 1.71x - 2.5x Faster Than Ollama (tested)
**Status:** in development. Speed numbers will be posted here once they've been measured. |