Track metrics during streaming, remove redundant generation re-runs

Fix early exit inference loop to eliminate redundant computation