Spaces:

Ypeng12
/

InferRoute

Sleeping

App Files Files Community

InferRoute / inferroute

2.75 MB

Ctrl+K

1 contributor

History: 25 commits

Ypeng12

fix: overhaul technical terminology, unified cost engine, reproducible artifacts, and engineering report tone

e55a60a 5 days ago

adapters
feat: add HF real workload datasets (10k), streaming benchmark results, and BYOK budget tests 5 days ago
plugins
feat: add HF real workload datasets (10k), streaming benchmark results, and BYOK budget tests 5 days ago
static
feat: platform ecosystem showcase and UI upgrade 12 days ago
templates
fix: overhaul technical terminology, unified cost engine, reproducible artifacts, and engineering report tone 5 days ago
__init__.py

25 Bytes
first commit about 2 months ago
agentic_router.py

4.06 kB
feat: integrate 9 academic routing policies as explicit selectable gateway strategies and add benchmarking harness 18 days ago
auth.py

5.31 kB
feat: add HF real workload datasets (10k), streaming benchmark results, and BYOK budget tests 5 days ago
cache.py

16.8 kB
Fix SQLite, OpenAI mock, circuit breaker fallback for pinned models, cache isolation, prefix cache answers, docs relative paths, and integration tests 28 days ago
circuit_breaker.py

8.94 kB
feat: Kubernetes-ready multi-provider LLM gateway v0.2.0 about 2 months ago
config.py

4.81 kB
feat: optimize Hugging Face Space Docker build and zero-config deployment 11 days ago
cost_engine.py

3.03 kB
fix: overhaul technical terminology, unified cost engine, reproducible artifacts, and engineering report tone 5 days ago
database.py

1.21 kB
Fix SQLite, OpenAI mock, circuit breaker fallback for pinned models, cache isolation, prefix cache answers, docs relative paths, and integration tests 28 days ago
learned_router.py

16.1 kB
feat: implement server-side FrugalGPT cascade router, prompt adaptation, and offline Pareto sweeps 25 days ago
main.py

82 kB
fix: overhaul technical terminology, unified cost engine, reproducible artifacts, and engineering report tone 5 days ago
models.py

5.8 kB
feat: implement streaming request dedup, cache-affinity trie routing, speculative cascade, vegas concurrency limiter, web UI playground, and multi-tenant wallet billing 29 days ago
observability.py

5.13 kB
feat: Kubernetes-ready multi-provider LLM gateway v0.2.0 about 2 months ago
preference_router.py

4.79 kB
feat: integrate 9 academic routing policies as explicit selectable gateway strategies and add benchmarking harness 18 days ago
prompt_adapter.py

5.2 kB
feat: platform ecosystem showcase and UI upgrade 12 days ago
rate_limiter.py

4.14 kB
feat: implement streaming request dedup, cache-affinity trie routing, speculative cascade, vegas concurrency limiter, web UI playground, and multi-tenant wallet billing 29 days ago
router.py

28.2 kB
feat: integrate 9 academic routing policies as explicit selectable gateway strategies and add benchmarking harness 18 days ago
router_trie.py

3.43 kB
feat: implement streaming request dedup, cache-affinity trie routing, speculative cascade, vegas concurrency limiter, web UI playground, and multi-tenant wallet billing 29 days ago
validator.py

15 kB
feat: implement server-side FrugalGPT cascade router, prompt adaptation, and offline Pareto sweeps 25 days ago