customer-support-api / inference.py

Commit History

fix: normalize [END] score to (0,1) range — divide by 4.8 max score, clamp to (0.001, 0.999)
9f3a7c5

3v324v23 commited on

fix: wrap LLM call in try/except with fallback responses to prevent inference.py crash
49f7113

3v324v23 commited on

fix: rewrite inference.py to use LiteLLM proxy via API_BASE_URL/API_KEY env vars
000a6e7

3v324v23 commited on

fix: add [START]/[STEP]/[END] structured output blocks to inference.py for Phase 2 validator
0261b11

3v324v23 commited on

FastAPI OpenEnv server
a77725d

3v324v23 commited on