SPEED FIX: remove int8 quant (slower for bs=1 CPU), fix input_ids= AttributeError, truncate context to last 2 msgs, default max_new_tokens=128

Upload app.py

Upload app.py

Upload app.py

Upload app.py

app.py: FastAPI backend with int8 quant + SSE streaming