feat: stabilize celery loops, add redis caching, and scale stage 2 neural limit to 250

feat: add pipeline page, session delete with Qdrant cleanup, explain worker, and final frontend polish