| --- |
| title: What We Do |
| emoji: 🔥 |
| colorFrom: gray |
| colorTo: green |
| sdk: static |
| pinned: false |
| --- |
| |
|  |
|
|
| **Run giant AI models fast on small machines.** |
|
|
| Kera is a local AI engine being built to run dense and mixture-of-experts models on a Mac, an AMD Ryzen AI Max PC or an NVIDIA machine, including models too big for the machine's memory. It measures your machine when it starts and tunes itself to it. |
|
|
| - Streams parts of the model from the SSD when it doesn't fit in memory |
| - Guesses several words ahead and checks them all at once, so replies come out faster |
| - Saves chat memory, so long chats and coding agents don't re-read everything |
| - Fine-tuning built in |
| - 22-54% Faster Than llama.cpp (tested) |
| - 1.71x - 2.5x Faster Than Ollama (tested) |
|
|
| **Status:** in development. Speed numbers will be posted here once they've been measured. |
