Spaces:

Ypeng12
/

InferRoute

Sleeping

App Files Files Community

InferRoute / tests

122 kB

Ctrl+K

1 contributor

History: 8 commits

Ypeng12

feat: add HF real workload datasets (10k), streaming benchmark results, and BYOK budget tests

7191aa9 5 days ago

__pycache__
fix: resolve circuit breaker mocking and update router test assertions about 2 months ago
__init__.py

31 Bytes
first commit about 2 months ago
chaos_test.py
11.5 kB
feat: Kubernetes-ready multi-provider LLM gateway v0.2.0 about 2 months ago
locustfile.py
8.75 kB
feat: Kubernetes-ready multi-provider LLM gateway v0.2.0 about 2 months ago
test_adapters.py
6.27 kB
feat: Kubernetes-ready multi-provider LLM gateway v0.2.0 about 2 months ago
test_advanced_features.py
12.4 kB
feat: implement streaming request dedup, cache-affinity trie routing, speculative cascade, vegas concurrency limiter, web UI playground, and multi-tenant wallet billing 29 days ago
test_byok_budget_responses.py
2.29 kB
feat: add HF real workload datasets (10k), streaming benchmark results, and BYOK budget tests 5 days ago
test_cache.py
6.37 kB
Fix SQLite, OpenAI mock, circuit breaker fallback for pinned models, cache isolation, prefix cache answers, docs relative paths, and integration tests 27 days ago
test_cascade_router.py
6.2 kB
feat: implement server-side FrugalGPT cascade router, prompt adaptation, and offline Pareto sweeps 24 days ago
test_circuit_breaker.py
4.67 kB
feat: Kubernetes-ready multi-provider LLM gateway v0.2.0 about 2 months ago
test_gateway.py
6.35 kB
fix: resolve circuit breaker mocking and update router test assertions about 2 months ago
test_integration.py
3.53 kB
Fix SQLite, OpenAI mock, circuit breaker fallback for pinned models, cache isolation, prefix cache answers, docs relative paths, and integration tests 27 days ago
test_plugins.py
1.59 kB
feat: platform ecosystem showcase and UI upgrade 12 days ago
test_quant_plugin.py
2.1 kB
feat: platform ecosystem showcase and UI upgrade 12 days ago
test_router_slo.py
7.96 kB
feat: Kubernetes-ready multi-provider LLM gateway v0.2.0 about 2 months ago