---
license: mit
language: en
tags:
- efficient-inference
- quantization
- speculative-decoding
- kv-cache
- llm-optimization
- tiny-models
---

# Tiny-Inference-Optimizer-Suite 

> Cost-aware inference optimizer that auto-selects best quantization + speculative decoding + KV-cache compression strategy.

Author:Samudhan (@samudhan2003)

This is my  artifact combining 3 research threads into