llama-benches/data
2.59 MB
llama-benches
non-profit
AI & ML interests
None defined yet.
Recent Activity
angt
updated a
bucket 2 days ago
angt
updated a
Space 22 days ago
angt
published a
Space 22 days ago
Post
2966
installama.sh at the TigerBeetle 1000x World Tour !
Last week I had the chance to give a short talk during the TigerBeetle 1000x World Tour (organized by @jedisct1 👏 ) a fantastic event celebrating high-performance engineering and the people who love pushing systems to their limits!
In the talk, I focused on the CPU and Linux side of things, with a simple goal in mind: making the installation of llama.cpp instant, automatic, and optimal, no matter your OS or hardware setup.
For the curious, here are the links worth checking out:
Event page: https://tigerbeetle.com/event/1000x
GitHub repo: https://github.com/angt/installama.sh
Talk: https://youtu.be/pg5NOeJZf0o?si=9Dkcfi2TqjnT_30e
More improvements are coming soon. Stay tuned!
Last week I had the chance to give a short talk during the TigerBeetle 1000x World Tour (organized by @jedisct1 👏 ) a fantastic event celebrating high-performance engineering and the people who love pushing systems to their limits!
In the talk, I focused on the CPU and Linux side of things, with a simple goal in mind: making the installation of llama.cpp instant, automatic, and optimal, no matter your OS or hardware setup.
For the curious, here are the links worth checking out:
Event page: https://tigerbeetle.com/event/1000x
GitHub repo: https://github.com/angt/installama.sh
Talk: https://youtu.be/pg5NOeJZf0o?si=9Dkcfi2TqjnT_30e
More improvements are coming soon. Stay tuned!
- 1 reply
Post
1868
I'm excited to share that https://installama.sh is up and running! 🚀
On Linux / macOS / FreeBSD it is easier than ever:
And Windows just joined the party 🥳
Stay tuned for new backends on Windows!
On Linux / macOS / FreeBSD it is easier than ever:
curl https://installama.sh | shAnd Windows just joined the party 🥳
irm https://installama.sh | iexStay tuned for new backends on Windows!
Post
519
🚀
The fastest way to install and run
We are expanding hardware and OS support to make local AI even more accessible. This includes:
🌋 Vulkan support for Linux on
😈 FreeBSD support (CPU backend) on
✨ Lots of small optimizations and improvements under the hood.
Give it a try right now:
installama.sh update: Vulkan & FreeBSD support added!The fastest way to install and run
llama.cpp has just been updated!We are expanding hardware and OS support to make local AI even more accessible. This includes:
🌋 Vulkan support for Linux on
x86_64 and aarch64.😈 FreeBSD support (CPU backend) on
x86_64 and aarch64 too.✨ Lots of small optimizations and improvements under the hood.
Give it a try right now:
curl angt.github.io/installama.sh | MODEL=unsloth/Qwen3-4B-GGUF:Q4_0 shPost
2051
One command line is all you need...
...to launch a local llama.cpp server on any Linux box or any Metal-powered Mac 🚀
Learn more: https://github.com/angt/installama.sh
...to launch a local llama.cpp server on any Linux box or any Metal-powered Mac 🚀
curl angt.github.io/installama.sh | MODEL=unsloth/gpt-oss-20b-GGUF shLearn more: https://github.com/angt/installama.sh
Post
290
The new
I couldn't resist writing a blog post about it:
https://huggingface.co/blog/angt/your-own-gpu-powered-image-generator-with-hf-jobs
hf jobs CLI is absolutely awesome!I couldn't resist writing a blog post about it:
https://huggingface.co/blog/angt/your-own-gpu-powered-image-generator-with-hf-jobs
Post
327
Just published: Nano-vLLM meets Inference Endpoints
I show how to bind Nano-vLLM (supporting Qwen3-0.6B) to a web service — and deploy it easily on Hugging Face Inference Endpoints.
Minimalist engine, maximum fun!
https://huggingface.co/blog/angt/nano-vllm-meets-inference-endpoints
I show how to bind Nano-vLLM (supporting Qwen3-0.6B) to a web service — and deploy it easily on Hugging Face Inference Endpoints.
Minimalist engine, maximum fun!
https://huggingface.co/blog/angt/nano-vllm-meets-inference-endpoints