Kalpana-API-GPU / app.py

Commit History

docs: remove studio link and add paradigm info to API tab
bdef46f

MaduRox commited on

docs: add paradigm explanations under tabs
1307aaa

MaduRox commited on

docs: add cURL equivalent and rename Swagger tab
25c3ffa

MaduRox commited on

Fix Phase Attention Benchmark to simulate GQA 2 KV heads
81b6e37

MaduRox commited on

Add torch.inference_mode to stop backward graph creeping
b48d71c

MaduRox commited on

Fix Phase Attention Benchmark to simulate 24 layers
4c632bd

MaduRox commited on

feat: Add True O(1) Phase Attention benchmark endpoint
67c5c69

MaduRox commited on

feat: add real empirical benchmark harness with /run_benchmark endpoint
ae7c56f

MaduRox commited on

docs: update Swagger tab with complete PowerShell, Python, JS, and cURL 2-step REST examples
095ce37

MaduRox commited on

fix: configure clean chat template and hybrid RIF sliding window on T4 GPU
74aa433

MaduRox commited on

fix: add system prompt, top_p, and repetition_penalty to prevent small model loop
ef5ecdb

MaduRox commited on

fix: restore native Gradio 5 launcher for ZeroGPU prestart hooks
38dbeb1

MaduRox commited on

feat: add FastAPI server with Live Swagger UI, OpenAI endpoints, and CORS
c8f0400

MaduRox commited on

feat: upgrade holographic resolution to 2048 bands on NVIDIA A100
1e0f5c6

MaduRox commited on

feat: integrate KalpanaDynamicCache into all 24 layers of Qwen2.5 on ZeroGPU
6018bf3

MaduRox commited on

feat: integrate KalpanaDynamicCache into all 24 layers of Qwen2.5 on ZeroGPU
01c6ddb

MaduRox commited on

feat: integrate KalpanaDynamicCache into all 24 layers of Qwen2.5 on ZeroGPU
c23e3c7

MaduRox commited on

feat: integrate KalpanaDynamicCache into all 24 layers of Qwen2.5 on ZeroGPU
37d0686

MaduRox commited on

feat: integrate KalpanaDynamicCache into all 24 layers of Qwen2.5 on ZeroGPU
b1909b4

MaduRox commited on

feat: integrate KalpanaDynamicCache into all 24 layers of Qwen2.5 on ZeroGPU
efb9f26

MaduRox commited on

feat: integrate KalpanaDynamicCache into all 24 layers of Qwen2.5 on ZeroGPU
1a668ac

MaduRox commited on

feat: integrate KalpanaDynamicCache into all 24 layers of Qwen2.5 on ZeroGPU
ab09287

MaduRox commited on

feat: integrate KalpanaDynamicCache into all 24 layers of Qwen2.5 on ZeroGPU
21e9521

MaduRox commited on

feat: integrate KalpanaDynamicCache into all 24 layers of Qwen2.5 on ZeroGPU
c828501

MaduRox commited on

feat: integrate KalpanaDynamicCache into all 24 layers of Qwen2.5 on ZeroGPU
2a33d72

MaduRox commited on

feat: integrate KalpanaDynamicCache into all 24 layers of Qwen2.5 on ZeroGPU
7fc1739

MaduRox commited on

feat: integrate KalpanaDynamicCache into all 24 layers of Qwen2.5 on ZeroGPU
2e4d3c6

MaduRox commited on

feat: integrate KalpanaDynamicCache into all 24 layers of Qwen2.5 on ZeroGPU
c07d3e6

MaduRox commited on

feat: integrate KalpanaDynamicCache into all 24 layers of Qwen2.5 on ZeroGPU
110959e

MaduRox commited on

feat: integrate KalpanaDynamicCache into all 24 layers of Qwen2.5 on ZeroGPU
2f6a704

MaduRox commited on

feat: integrate KalpanaDynamicCache into all 24 layers of Qwen2.5 on ZeroGPU
b6b8b5d

MaduRox commited on

fix: resolve AttributeError on llm.DEFAULT_MODELS in Gradio UI startup
b879636

Madusha Perera commited on

fix: restore list_models optional request parameter
1469bd5

Madusha Perera commited on

fix: update list_models request signature
13bbf0d

Madusha Perera commited on

fix: define _RATE_WINDOWS dict to prevent server 500 error
607fdc9

Madusha Perera commited on

fix: make _get_client_ip safe against None request
1b5b6b9

Madusha Perera commited on

feat: GET /v1/models returns ONLY user-registered provider models
e197e6c

Madusha Perera commited on

feat: enforce registered provider keys and remove HF serverless fallbacks
562cddf

Madusha Perera commited on

fix: add 429 rate limit formatting and boilerplate chunk filtering for story retrieval
a0f0d11

Madusha Perera commited on

fix: correct cost comparison formula based on full uncompressed document size vs compressed RIF tokens
6a02f22

Madusha Perera commited on

feat: expand RIF retrieval to 1600 tokens and enable natural synthesis system prompt
1246a60

Madusha Perera commited on

fix: auto-map gemini model to gemini-2.5-flash
3093778

Madusha Perera commited on

fix: import time inside generate method
ae33d9b

Madusha Perera commited on

fix: define t0 at top of generate method
3d0f535

Madusha Perera commited on

fix: report registered provider key errors explicitly in chat response
66181bf

Madusha Perera commited on

fix: route gemini and registered model IDs to custom provider API caller
aff6204

Madusha Perera commited on

debug: expose last_err in RIF context fallback
9f7c7e5

Madusha Perera commited on

fix: add browser User-Agent header to HF router requests for live LLM inference
048f6f9

Madusha Perera commited on

fix: clear custom provider fallback on error and add /v1/providers/reset endpoint
a0b26e4

Madusha Perera commited on

feat: add Google Gemini support and global latest_provider fallback
e311056

Madusha Perera commited on