feat: stabilize celery loops, add redis caching, and scale stage 2 neural limit to 250

feat: add embedding singleton and batch ingest Celery worker