Process long prompts 3x faster with close to full prefill quality
AI & ML interests
LLM speculative inference, built for specific consumer hardware & heterogeneous computing
Recent Activity
View all activity
LLM speculative inference, built for specific consumer hardware & heterogeneous computing