File size: 393 Bytes
e91332e 2e17075 e91332e 2e17075 8b75550 2e17075 8b75550 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 | ---
license: mit
language: en
tags:
- efficient-inference
- quantization
- speculative-decoding
- kv-cache
- llm-optimization
- tiny-models
---
# Tiny-Inference-Optimizer-Suite
> Cost-aware inference optimizer that auto-selects best quantization + speculative decoding + KV-cache compression strategy.
Author:Samudhan (@samudhan2003)
This is my artifact combining 3 research threads into |